"I know how to build a house with ease" That kind of skill and confidence can't be held down for long.
Real tangible work is hard to come by these days, a lot of people have more money than skill and pay well to those who can build or take care of problems. I would take the downtime and build your business base. Not everything we do for the business necessarily makes us money, there are things that just need to be done. Marketing, creating a logo, building a website, creating a strong plan...I know you are probably doing this, but its a grind man. Nothing comes easy to those who decided to ditch the safety net and fly on our own.
One thing I learned early on, and I pass on to others quite regularly on here is to start small. Take on smaller jobs, less crew, less material, less overhead. Ask for a deposit to keep yourself going and use personal credit cards if needed. Chip away at it bit by bit and build yourself up. Not everything comes instantly, its a hard push out here sometimes. Keep your head up and press on man, you will be just fine.
I hope you look back on these days and think "I wish I had as much free time to do what I want/need to". Or look back and remind yourself how hard work and determination pays off and pass that on to others.