I have three amulets of Dibella and two rings of minor magicka, it appears that I'm wearing them all at the same time, do the effects stack or do I only get one effect?

you are only wearing 1 of each stack, the effect for the single ring and amulet stack, the spare ring and amulets are just taking up space