this post was submitted on 11 Apr 2025
43 points (95.7% liked)

Solarpunk

6450 readers
6 users here now

The space to discuss Solarpunk itself and Solarpunk related stuff that doesn't fit elsewhere.

What is Solarpunk?

Join our chat: Movim or XMPP client.

founded 3 years ago
MODERATORS
 

I'm finding it harder and harder to tell whether an image has been generated or not (the main giveaways are disappearing). This is probably going to become a big problem in like half a year's time. Does anyone know of any proof of legitimacy projects that are gaining traction? I can imagine news orgs being the first to be hit by this problem. Are they working on anything?

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 20 points 2 days ago (3 children)

Does anyone know of any proof of legitimacy projects that are gaining traction? I can imagine news orgs being the first to be hit by this problem. Are they working on anything?

In short, no. There's no solution to this crisis of legitimacy and no way to validate that a work came from human hands that can't be counterfeited. Short of a Butlerian Jihad, it won't be going away either. I'm looking forward to the inevitable bubble pop that will kill the overinvestment in generative tech but the models will still be around even without big companies wasting billions to train new ones.

In short, it's long past time to start treating every day like April Fools Day.

[–] [email protected] 9 points 2 days ago

Butlerian Jihad it is then!

[–] [email protected] 1 points 2 days ago (1 children)

Time lapses of drawing the image would be near impossible to replicate currently.

[–] [email protected] 1 points 2 days ago (1 children)

Only a matter of time and they're already good enough to fool the gullible.

[–] [email protected] 3 points 2 days ago (1 children)

My understanding is that the generator would have to make each frame from scratch and also keep track of the progress of the drawing.

They may have trained on a few Timelapse drawings, but that dataset is much smaller then the photographs and artworks in the models.

I’m sure it could happen, but I’m not sure there will be enough demand to bother.

Universal Basic Income is really the only answer. So we can make art for fun instead of as a means to survive.

[–] [email protected] 3 points 2 days ago* (last edited 1 day ago)

The problem is Goodhart's Law; "Every measure which becomes a target becomes a bad measure". Implementing a verification system that depends on video evidence creates both an incentive to forge such videos and a set of labeled training data that grows more readily available as the system sees more use. The adversarial generative network is literally designed to evolve better scams in response to a similarly-evolving scam detector, there's no computational way around the need to have people involved to make sure things are what they're claimed to be.

Universal Basic Income would be a good start, but the fundamental problem is money as the primary organizing force of society.