I'm hoping Apple is working on something that run locally or potentially in some privacy-focused cloud approach but honestly I can't see any way to feed data into an LLM that doesn't result in leaking a ton of data about you if someone peaked at the input/output.
The good news is I've been impressed with running various AI-type things (Stable Diffusion and llamda.cpp) locally on my M1 Max Macbook so if anyone can pull this off locally I think it's Apple.
I do agree Apple's hardware is still top-notch. Their home-made chips have been amazing to use and I have no worry they'll continue to push the envelope there. And even iOS I feel is a solid piece of evolving software (other than Siri). It's MacOS and their lack of focus on devs that worries me.
> It's MacOS and their lack of focus on devs that worries me
You and me both, System Settings alone is a disgrace that I'm embarrassed for them that they shipped and it's only one of many recent failures related to macOS.
The good news is I've been impressed with running various AI-type things (Stable Diffusion and llamda.cpp) locally on my M1 Max Macbook so if anyone can pull this off locally I think it's Apple.