This. The town reminds me of Hackdirt in Oblivion, where a seemingly normal town that have its people worshiping "The Deep Ones".
Rorikstead has sketchy history as well. Rorik says the town is named after him, yet there are mentions of the name Rorikstead in some old documents that ages back to the time of the Dragons, as well as the song "Ragnar the Red". Some facts might even out the theory Rorikstead was abandoned for unknown reason at one point.
But then there's Rorik himself. He said he once commanded men during the Great War, was stabbed through the chest and somehow was healed by Jouane Manette, and they became best friends ever since. I don't buy this, and I think some thing went down during the Great War that happened to Rorik's entire unit... But more likely, I think that "Rorik" is actually a fake name that "Rorik" took up to change his identity after feel guilty for the deaths of his men during the war.
On another note, when Rorik talks to Jouane, he makes a passing comments on "some other force at work" that gave Rorikstead the best farm land in the Whiterun hold. And there's that little girl Sissel. I overheard Jouane talking to her not to let the village know their "secrets" as he teaches her magic. Sissel also has dreams about Paarthunax when Alduin returns. The village is at close-proximity to a Shrine of Akatosh.
My theory about Rorikstead is that it used to be a Dragon-worshipping place during the Dragon War, which power saved "Rorik" during the Great War by sacrificing his men as well as giving the village good farmland. Also, I suspect that Sissel might be Dragonborn. But that doesn't explain Rorik and Jouane's clueless conversation, unless they both had their memories erased to fit into a new life by a malevolent force under Rorikstead that is slowly recovering its strength.