@Mr_NutterButter a lot of people are like "I'm going to build an awesome world like Tolkien" and they get really into the weeds of all the specifics without ever writing a story to belong there.
There is definitely a balance to be had. I think the best way to go about it is coming up with your world as you write your first draft and then letting that influence how you continue refining things. The story and the world should serve each other and the best way for that to happen is for them to be created in parallel.