I've recently upgraded my GPU, formatted my computer and reinstalled Skyrim. I quickly got some high-res texture mods i could not use before and ENB. I went to test them in-game and noticed my FPS was playable but not ideal on most exterior areas. It would range between 20-40 most of the time with higher FPSs when not looking at much detail.

My first reaction was to test without ENB and the graphical mods and to my surprise i found out i barely got any FPS by removing them. Turning ENB on and off will make a 5 FPS difference at most and even running the game completely vanilla will not give me much more than that. What could be causing it?

I noticed that usually i get the worst FPS when looking at areas with lots on NPCs and objects in general, like in front of the Bannered Mare looking towards the entrance to Whiterun but still even setting all the draw distance settings in the in-game options to 0 did not help at all.

are your drivers up to date?

The driver for the VGA is for sure. I checked it just yesterday.

and its the PC you listed in your sig yout trying to run it on?

Exactly. I just bought that GTX 970, formatted the computer and installed Windows 10.

Maybe try running with skyrim performance monitor and see what is happening? Or what's happening with memory, vram, CPU / gpu usage etc.