Well, I imagine that scrolls actually combust upon use, burning up into the fireball or ice storm that the user is casting.
The spell books, on the other hand...the same thing happens to them that happens to the flasks and bottles of the potions you drink, I suppose. You either chuck them away like the ignorant adventurer you are, or stick them into the invisible bag of holding outside of your inventory.