I located a Web site called Civil War Manuscripts with information about Connecticut men who served.
This valuable piece of information tells us where he was wounded prior to Petersburg and and that he died of the second wound which was the one at Petersburg. I couldn't reconcile the dates until I found the information specific for Connecticut.
|Ancestry.com Clip of Register of Deaths|
Rest in Peace, Horatio N. Fish, Jr.