Those have been the symbols of the Divines since Daggerfall.
Kynareth's hawk (no idea why the Skyrim shrine looks like that), Dibella's flower, Julianos' pyramid, Stendarr's goblet/drinking horn and Aka's hourglass (now with Aka curled around it).
Obviously flower=beauty=Dibella, hawk=sky=Kynareth and hourglass=time=Akatosh but I have no idea what the others are supposed to symbolize.
Julianos' pyramid could represent his relation to mathematics and logic.
Following this line of thinking, I feel that:
Dibella=flower=beauty/female naughty bits
Akatosh=hourglass=time
Julianos=pyramid= mathematics/magic (i.e.: numerology)
Kynereth=hawk=sky
Stendarr=horn=cornucopia=gifts
Zenithar=anvil=work/crafting
Mara=knot=ties (as in familiar and friendship bonds)
Arkay=loop=life to death to rebirth (i.e.: dreamsleeve)
Talos=sword=war
or
Talos=red diamond=empire/dragonborn