Prioritizing free time is a thing.
In fact, it is the one thing all well-informed individuals strive to do. Problem is when we achieve more free time it feels like we are doing something wrong, as if we should be working. Worse still it feels like business is drying up. In reality, of course, the numbers (most of the time) will show that business is healthy.
More than this, as the business owner you will be healthy too, or healthier in any event. Find other things to occupy your time, it’s OK, really.