I've just started making a guild and my first quest dialogue is a bit glitched. When I load the game it says that certain journal entries are trying to become topic dialogue.

The quest is a typical find item and give it to someone quest, but for some reason, when she asks if I have the item, either answer just makes her ask again and it gets stuck in a loop. I have three different answers (saying yes with and without the item, saying no), but they don't work.

Really can't help you with the first problem as I've never had that happened, but the second problem is because you have the question above the answers. Move it down to below your three answers and it should work correctly.

Alright, that's working now. Thank you very much. And all the journal entries seem to work fine, but I still have a message saying that my journal entries are trying to turn into dialogue topics.

Those are harmless errors.
Simply open your mod in the CS, Save, exit. They will be gone.

The error appears because of the EMPTY slots that get created when you make new dialog/journals. But saving the esp again removes them.

:facepalm: I had just found these as I got the topic reply notification. Thank you, now I know that they were the problem. On to the next quest!