Did you edit the Spell Tomes.esp? And make a separate .esp with your Spell in it?
If so, then this won't work, because the Mods are isolated-- one .esp file cannot read another .esp file.
You will need to copy the script from the Spell Tome into the Mod with your Spell in it, and then make a new book with this Script attached.