A restaurant that's too small for its following creates pent-up demand and can thrive as it lays plans to expand.
A restaurant that's too big merely fails.
There are occasional counterexamples of ventures that fail because they were too small when they gained customer traction. But not many.
It pays to have big dreams but low overhead.