FaceDeer

A basic Google search for "synthetic data llm training" will give you lots of hits describing how the process goes these days.

Take this as "defeatist" if you wish, as I said it doesn't really matter. In the early days of LLMs when ChatGPT first came out the strategy for training these things was to just dump as much raw data onto them as possible and hope quantity allowed the LLM to figure something out from it, but since then it's been learned that quality is better than quantity and so training data is far more carefully curated these days. Not because there's "poison" in it, just because it results in better LLMs. Filtering out poison will happen as a side effect.

It's like trying to contaminate a city's water supply by peeing in the river upstream of the water treatment plant drawing from it. The water treatment plant is already dealing with all sorts of contaminants anyway.

I think it's worthwhile to show people that views outside of their like-minded bubble exist. One of the nice things about the Fediverse over Reddit is that the upvote and downvote tallies are both shown, so we can see that opinions are not a monolith.

Also, engaging in Internet debate is never to convince the person you're actually talking to. That almost never happens. The point of debate is to present convincing arguments for the less-committed casual readers who are lurking rather than participating directly.

Doesn't work, but I guess if it makes people feel better I suppose they can waste their resources doing this.

Modern LLMs aren't trained on just whatever raw data can be scraped off the web any more. They're trained with synthetic data that's prepared by other LLMs and carefully crafted and curated. Folks are still thinking ChatGPT 3 is state of the art here.

even bad trek is more trek.

What this attitude tells executives is "guess we don't need to bother trying to make Trek good, they'll eat up whatever we shovel their way."

I'm a big fan of Star Trek. That's why I haven't watched anything other than Lower Decks since Discovery started airing.

Meanwhile Americans are moaning about how they can't protest because they need their jobs to provide their health insurance.

Yeah, the list goes on and on.

It's "I've taken Venezuela, now give me Greenland. And Cuba. And Panama. And Canada. And.,.."

Seems likely to have been the result of inside information, sure.

But that's the point of prediction markets, isn't it? Their purpose is to get people who have knowledge about a topic to put that knowledge out there to the public, with money put up against that to back their certainty. It's a way of surfacing that knowledge to the general public. People who don't have knowledge and are just making gambling bets based on their "feelings" are going to get screwed now and then. They probably shouldn't be doing that.

Eh, I could see it as a reasonable deal from her perspective. If giving Trump a pointless shiny metal disk got him to actually back democratic reform in Venezuela, sure, give him the shiny metal disk. Whatever, it's just a thing.

Unfortunately it wouldn't work, though; Trump never sticks to his deals after he's got what he wanted out of them or when he sees an opportunity to squeeze even more out of you. So might as well keep the shiny metal disk.

Carney didn't "clap for the attack on Venezuela." He called for international law to be followed, which should be an obvious rebuke to anyone who isn't at a Trump level of understanding of how diplomacy is done.