Wow, it’s amazing that just 3.3% of the training set coming from the same model can already start to mess it up.
Wow, it’s amazing that just 3.3% of the training set coming from the same model can already start to mess it up.
I’ve read some snippets of AI written books and it really does feel like my brain is short circuiting
At least in this case, we can be pretty confident that there’s no higher function going on. It’s true that AI models are a bit of a black box that can’t really be examined to understand why exactly they produce the results they do, but they are still just a finite amount of data. The black box doesn’t “think” any more than a river decides its course, though the eventual state of both is hard to predict or control. In the case of model collapse, we know exactly what’s going on: the AI is repeating and amplifying the little mistakes it’s made with each new generation. There’s no mystery about that part, it’s just that we lack the ability to directly tune those mistakes out of the model.
Weird, I hear the anthems of nearly every other developed country in the world.
Maybe because the choices are pay for insurance or live in agony/die? Maybe both, if you’re lucky.
The problem is greatly unequal access to healthcare. I’m glad your insurance is doing well for you, but there are many out there who are struggling to pay for expensive family insurance with high deductibles that still leave them in medical debt.
I’m also currently in a situation where I’d like to find a new job, but I have some expensive medication ($750 a month for one of them) and I am worried about losing my insurance/not being able to afford the premium while I wait for benefits to kick in at a new job. I also have absolutely no way of knowing if another employer’s plan will cover my medication or if my current group of providers will be in network. All this added stress, and yet I’m lucky to work in a field where almost every employer offers health insurance.
Ideally, there would be universal safety nets to provide the services you’re benefiting from to all Americans. It’s not even like we’re saving money by relying on private insurance, as the US spends way more per capita on Healthcare for average results, at best.
So I’m glad that your insurance is taking care of you, truly I am. But spare a thought for the thousands of Americans out there who are struggling to survive under the same system.
I guess the question is, what happens to the kernel when all the people who learned on C are gone? The majority of even the brightest new devs aren’t going to cut their teeth on C, and will feel the same resistance to learning a new language when they think that there are diminishing returns to be had compared to what’s new and modern and, most importantly, familiar.
I honestly get the hostility, the fast pace of technology has left a lot of older devs being seen as undesirable because the don’t know the new stuff, even if their fundamental understanding of low level languages could be a huge asset. Their knowledge of C is vast and valuable, and they’re working on a project that thrives because of it. To have new people come to the project and say “Yeah, we could do this without having to worry about all that stuff” feels like throwing away a lot of the skill they’ve built. I’m not sure what the solution is, I really don’t think there are enough new C developers in the world to keep the project going strong into the future though. Maybe a fork is just the way to go; time will tell which is more sustainable.
Permissive licenses mean faster and more widespread adoption, it’s up to project maintainers if the tradeoff is worth it. Ideally a company would realize that an open source part of their project probably isn’t radically going to affect their revenue stream, but you don’t just have to convince devs, you have to convince the suits and lawyers, and they will tell you to just build your own rather than give up any precious IP.
I’m so glad younger people are largely abandoning the “wife bad” garbage. Maybe it’s not so bad to, you know, openly enjoy being with someone you love without having to make a joke about it.
The most heinous thing is lack of required sick time. And who is it that’s least likely to get paid sick time? Customer service, of course, the ones coughing and sneezing all over your clothes and food.
Just make sure you actually do get a payout, had a friend screwed over by that recently.
Also plenty of people with disabilities still find ways to write in spite of or even inspired by their unique limitations. I’ve seen very similar arguments around visual arts and loads of people with disabilities have spoken out against it.
Honestly, props on figuring out how bondage would work on a snake.
I mean, we’ve seen already that AI companies are forced to be reactive when people exploit loopholes in their models or some unexpected behavior occurs. Not that they aren’t smart people, but these things are very hard to predict, and hard to fix once they go wrong.
Also, what do you mean by synthetic data? If it’s made by AI, that’s how collapse happens.
The problem with curated data is that you have to, well, curate it, and that’s hard to do at scale. No longer do we have a few decades’ worth of unpoisoned data to work with; the only way to guarantee training data isn’t from its own model is to make it yourself