My hot take is that we're merely catching up on until recently unutilized hardware improvements. There's nothing 'self-improving', it's largely "just" scaled up methods or new, clever applications of scaled up methods.

The pace at which methods scale up is currently a lot faster than hardware improvements, so unless these scaled up methods become incredibly lucrative (not impossible), I think it's quite likely we'll soon-ish (a couple years from now) see a slowdown.