News
Welcome to the News community!
Rules:
1. Be civil
Attack the argument, not the person. No racism/sexism/bigotry. Good faith argumentation only. This includes accusing another user of being a bot or paid actor. Trolling is uncivil and is grounds for removal and/or a community ban. Do not respond to rule-breaking content; report it and move on.
2. All posts should contain a source (url) that is as reliable and unbiased as possible and must only contain one link.
Obvious biased sources will be removed at the mods’ discretion. Supporting links can be added in comments or posted separately but not to the post body. Sources may be checked for reliability using Wikipedia, MBFC, AdFontes, GroundNews, etc.
3. No bots, spam or self-promotion.
Only approved bots, which follow the guidelines for bots set by the instance, are allowed.
4. Post titles should be the same as the article used as source. Clickbait titles may be removed.
Posts which titles don’t match the source may be removed. If the site changed their headline, we may ask you to update the post title. Clickbait titles use hyperbolic language and do not accurately describe the article content. When necessary, post titles may be edited, clearly marked with [brackets], but may never be used to editorialize or comment on the content.
5. Only recent news is allowed.
Posts must be news from the most recent 30 days.
6. All posts must be news articles.
No opinion pieces, Listicles, editorials, videos, blogs, press releases, or celebrity gossip will be allowed. All posts will be judged on a case-by-case basis. Mods may use discretion to pre-approve videos or press releases from highly credible sources that provide unique, newsworthy content not available or possible in another format.
7. No duplicate posts.
If an article has already been posted, it will be removed. Different articles reporting on the same subject are permitted. If the post that matches your post is very old, we refer you to rule 5.
8. Misinformation is prohibited.
Misinformation / propaganda is strictly prohibited. Any comment or post containing or linking to misinformation will be removed. If you feel that your post has been removed in error, credible sources must be provided.
9. No link shorteners or news aggregators.
All posts must link to original article sources. You may include archival links in the post description. News aggregators such as Yahoo, Google, Hacker News, etc. should be avoided in favor of the original source link. Newswire services such as AP, Reuters, or AFP, are frequently republished and may be shared from other credible sources.
10. Don't copy entire article in your post body
For copyright reasons, you are not allowed to copy an entire article into your post body. This is an instance wide rule, that is strictly enforced in this community.
view the rest of the comments
This might make the path to generating slightly harder, but it won't do anything to stop an intelligent person. I haven't seen a ton of info from people talking about this stuff, but exploring on my own, especially with Stable Diffusion 3, diffusion models are very different than LLM's. The filtering for safety type alignment is happening external to the model using CLIP, and in the case of SD3, 2× CLIP models and a T5xxl LLM model. The alignment filters are done with these and some trickery. Screwing with these can enable all kinds of capabilities. It is just hard to understand the effect of some tricks, like SD3 swaps an entire layer in the T5 manually. When these mechanisms are defeated, models can generate freely, which essentially means everything is a deepfake. This is open source. So it can never be extinguished. There was a concerted effort to remove the rogue 4chanGPT. It does not have the ChatGPT derived alignment like all other models. The 4chanGPT is still readily available if you know where to look.
This bill just raises the barrier of entry and makes such content less familiar and more powerful in the end. In reality, we would be socially stigmatizing while accepting the new reality IMO. This is like an weapons arms race. You may not like that the enemy created cannons, but banning the casting of cannons within your realm will do nothing to help you in the end. Everyone in the realm may understandably hate cannons, but you really need everyone familiar with casting, making the and everyone in your realm to learn how to deal with them and what to expect. The last thing you need is a lot of ignorant people on a battlefield bunching up together because they do not understand their opponents.
These tools are also weapons. Everyone needs to understand what is truly possible, regardless of how unpleasant that may seem. They can not have a healthy skepticism without familiarity. If they do not have familiarity, they will bunch up on a battlefield facing cannons loaded with grapeshot.
So I haven't dug deeply into the actual legislation, so someone correct me if I'm misinformed... but my understanding is that this isn't necessarily trying to raise the bar for using the technology as much as much as trying to make clearer legal guidelines for victims to have legal recourse. If we were to relate it to other weapons, it's like creating the law "it's illegal to shoot someone with a gun".
I have not dug deeply either, but have noticed that Civitai has shifted their wording and hosting in ways that indicated a change was coming. In practice, the changes will come from the model hosting sites for open source tools limiting their liability and not hosting content related to real humans.
My main concern is the stupid public reacting to some right wing fake and lacking appropriate skepticism. Like expecting detection tools to be magical and understanding the full spectrum of possibilities.