You say the limits of LLMs don't matter, because we don't have definitions strong enough to describe them.

I say the limits of LLMs do matter and the fact that we can't yet define them rigorously means we aren't able to fix them (assuming we want to).