My only explanation is that your perk damage bonuses do not apply to the 2nd shot, so it does half as much damage.
I've already started to neglect my two shot weapons due to accuracy loss. My personal favourite prefix is 'rapid' although it is big on ammo consumption, so 'violent' would be 2nd.
My two shot .44 is my favourite pistol though