The question that I haven't seen answered yet is whether or not we will reach a sort of "peak vibe coding" phase. What I mean by that is, right now, LLM's are somewhat decent at writing workable code. That code, however, needs babysitting to keep from going off the rails. And that code is sourced from training, which has been gleaned from the billions of lines of code written by hackers everywhere and pushed to source control.
We currently have engineers competent enough to use an LLM, review the code written, and fix the places where the LLM writes poor code. We also still have engineers pushing novel code themselves. That means we are on the up-slope. Right now, nascent hackers are learning perhaps the old ways, but also are for sure paying attention to and using vibe coding. That creates a negative feedback loop. As greybeards age out of programming, so to does the knowledge foundation that allowed LLM training to take place in the first place, and more importantly, that trained the next generation of hackers. AI is going to increasingly begin consuming AI code, and I haven't seen solid evidence yet that it is capable (at least currently) of putting truly novel ideas into code.
There will be an inflection point where AI's are consuming their own output more than that from competent hackers, and that's when things will go downhill unless there is a significant breakthrough in actual reasoning in AI.
This has been my suspicion since LLMs began eating the Internet. Whether it's code or writing, now that LLMs are consuming their own output, the Habsburg Jaw[1] is going to quickly become evident. It is very difficult--sometimes impossible--to know whether a given chunk of input is wholly or partially generated by an LLM. Nevertheless, filtering input may become a critical task. That expense will be passed to the consumer, and LLM prices will necessarily rise as their quality diminishes. It could become a death spiral.
If so, I, for one, will be relieved. I'm tired of LLMs trying to take over the enjoyable parts of writing and coding, and leaving the menial tasks to us humans.
Nothing I've seen from the AI labs appears to indicate that they are worried about model collapse in the slightest.
That makes sense to me, because if their models start getting worse because there's slop in the training data they can detect that and take steps to fix it.
Their entire research pipeline is about finding what makes models that score better! Why would they keep going with a technique that scored worse?
> Nothing I've seen from the AI labs appears to indicate that they are worried about model collapse in the slightest.
AI labs are insufferable hype machines, they are unlikely to sow doubt about their own business models.
> they can detect that and take steps to fix it.
Each model will need an endless diet of new content to remain relevant, and over time, avoiding ingestion of LLM output (and the accompanying inbreeding depression) will likely be a tricky proposition. Not impossible, but expensive and error-prone.
I happened to take a look at your HN profile and realized you don't post much, which leads me to believe this is REALLY bothering you.
I can relate. My grandfather, who had been a math teacher and actually got me into computing way back in the beige toaster Macintosh days, religiously checked his email and practiced his Spanish on Rosetta Stone for decades. I had to update from Win 7 to 10 for the desktop I built for him, and that was a big struggle for him. That would probably be many times harder now considering the sad shape of Windows. It was heartbreaking watching him struggle with one of the few simple joys he had left towards the end of his life.
I'm very sorry you're having to deal with that and your anger is warranted.
Hmm, how do you figure? Just about every source I can find shows slow burning carbs, fiber, and protein rich foods blow fatty foods out of water in terms of satiety. (if you are using a metric other than satiety to represent "fills you up", feel free to correct me)
We're only massacring the fruiting bodies. The mycelium is just fine and lives on to create even more fruiting bodies. It's like picking apples from an apple tree. The tree itself isn't harmed in the slightest. The only difference is that many fruits are designed to be eaten so that the seeds can pass an germinate, whereas mushrooms achieve this through spore release.
For some of these fungal meat-substitute products, I think you do eat the mycelia (for bystanders, the fruiting body we eat is mushrooms). But I don't think the fungus is bothered about it the same way the chicken is.
I feel like this might have been shown in the 2019 documentary 'Fantastic Fungi' (https://www.imdb.com/title/tt8258074/) - really interesting and fun movie.
I'm not sure this is the best showcase. It doesn't show me any kind of a before and after to demonstrate the 2D-3D process. Also, the interior-view floor plans don't quite make sense e.g. doors leading into impossible spaces, two bathrooms directly beside each other, furniture in odd spots
reply