Or one company to get hacked and the hackers leak it

Realistically the only people able to run models of this size are large enterprises.

Those enterprises won’t take the risk of being sued for using a model without proper permission.

I don't know – if there's still dumb money being thrown towards AI in non-tech and non-privacy-heavy industries, especially ones traditionally targeted by ransomware, there'll always be a chance of datasets getting leaked. I'm thinking retail and consumer product-oriented companies. (There's always non-Western governments without strong security orgs, too.)

Nations.

or large government sponsored entities like Mossad. Air gapping won't protect against spying. Good luck trying to sue them