I'd like to be okay with getting the Bound Sword tome and Bound Bow tome early. Reaching that point for Bound sword is easy. Your character heard of the man that wishes to retake his home outside of Riften during their travels. It's the reason you crossed the border in the first place. This allows you to start Infiltration without feeling bad.

Is there any type of logical reasoning for going after the Bound Bow tome inside the prison of Fort Amol? If not, it just feels wrong.

Would you rather criminals had it? Unspeakable acts could be accomplished by the person who wields that spell.

You lack any real reason to be there in the first place -- Fort Amol. There is no quest tied to the location other than the civil war. That begs the questions. Why am I there? How do I know about the place? Going to Fort Amol and entering the prison for the sole purpose of grabbing the spell tome: Bound Bow seems weak. I want a valid reason; something that lets me feel good about it. Either that or I just purchase it from a court wizard or the appropriate wizard at Winterhold like a wuss.

I don't roleplay -- per se. But, it's important to me to have a reason for going somewhere. It helps me avoid breaking quests and other potential problems down the road.

One question I can answer on my own.

How do I know about the place? Well, I happen to come across a map when visiting the Jarl at Falkreath or any Jarl for that matter. What I lack is motivation and a situation that sends me to the location (Ie: A bounty on the leader, freeing a prisoner, etc.).

You asked for some logical reasoning, I posted a logical reason. Past that, I really couldn't care less.

Would I rather criminals have it? No. Now, how did I find out the spell tome was there in the first place? See, that is why it doesn't work. First, you need a reason to be in the prison portion of the Fort. That allows for a sense of discovery. It legitimizes the action.