and i was woundering should i wait until i'm a higher level ( i just started the game ) or can i go there right off the bat?

If your current character can kill mudcrabs, kwama foragers, and cliff racers without a problem and is able to levitate or swim long distances, I'd say go for it. Maybe you should test your character on a couple of smugglers, too, but I didn't run into anything tougher than those by accident when I first visited. You have to look for the difficult challenges or get involved in quests to find them. In the meantime, lots of places to explore over on the mainland.