Is it worth it? It can be. It can also be a nightmare. Won't know until you try.
I bought a very small restaurant way back in May so I could open a BBQ joint. Here it is December and the doors still aren't officially open and I've sunk close to $75k into it so far and haven't had a paycheck since February.
Incredibly hard work, lots of stress, yet also a lot of joy and many rewards to go along with it. But above all else, turning your hobby into a business is not something to take lightly. If you plan accordingly and have the finances in place to make it happen, you could turn your life upside down for the better. But go into it without a solid plan or lack the capital required, and it could end up being the worst decision you've ever made.