!nostupidquestions is a community dedicated to being helpful and answering each others' questions on various topics.
The rules for posting and commenting, besides the rules defined here for lemmy.world, are as follows:
Rule 1- All posts must be legitimate questions. All post titles must include a question.
All posts must be legitimate questions, and all post titles must include a question. Questions that are joke or trolling questions, memes, song lyrics as title, etc. are not allowed here. See Rule 6 for all exceptions.
Rule 2- Your question subject cannot be illegal or NSFW material.
Your question subject cannot be illegal or NSFW material. You will be warned first, banned second.
Rule 3- Do not seek mental, medical and professional help here.
Do not seek mental, medical and professional help here. Breaking this rule will not get you or your post removed, but it will put you at risk, and possibly in danger.
Rule 4- No self promotion or upvote-farming of any kind.
That's it.
Rule 5- No baiting or sealioning or promoting an agenda.
Questions which, instead of being of an innocuous nature, are specifically intended (based on reports and in the opinion of our crack moderation team) to bait users into ideological wars on charged political topics will be removed and the authors warned - or banned - depending on severity.
Rule 6- Regarding META posts and joke questions.
Provided it is about the community itself, you may post non-question posts using the [META] tag on your post title.
On fridays, you are allowed to post meme and troll questions, on the condition that it's in text format only, and conforms with our other rules. These posts MUST include the [NSQ Friday] tag in their title.
If you post a serious question on friday and are looking only for legitimate answers, then please include the [Serious] tag on your post. Irrelevant replies will then be removed by moderators.
Rule 7- You can't intentionally annoy, mock, or harass other members.
If you intentionally annoy, mock, harass, or discriminate against any individual member, you will be removed.
Likewise, if you are a member, sympathiser or a resemblant of a movement that is known to largely hate, mock, discriminate against, and/or want to take lives of a group of people, and you were provably vocal about your hate, then you will be banned on sight.
Rule 8- All comments should try to stay relevant to their parent content.
Rule 9- Reposts from other platforms are not allowed.
Let everyone have their own content.
Rule 10- Majority of bots aren't allowed to participate here. This includes using AI responses and summaries.
Our breathtaking icon was bestowed upon us by @Cevilia!
The greatest banner of all time: by @TheOneWithTheHair!
Nvidia Nemotron has a published dataset, so if they had copyright data in it it would be very easy to determine.
https://huggingface.co/collections/nvidia/nemotron-pre-training-datasets
๐ https://huggingface.co/datasets/nvidia/Nemotron-CC-Code-v1 They're using Common Crawl and there's no mention of filtering for public domain licenses in this text. Pretty safe to say it's probably a bad dataset. (In my opinion. I'm not a lawyer. This isn't legal advice.)
If that dataset has copyrighted material, nvidia committed a clear copyright violation by publishing it publically. I'm happy to trust that nvidias lawyers have vetted it properly.
I'm happy to trust that nvidias lawyers have vetted it properly.
Yes, but while you would vet it by "what complies with laws", large companies use the "what can we getaway with" metric. And if the only penalty is a fine, they will just consider that cost of doing business, and do it anyway.
True, but as per the anthropic settlement linked in another comment, the penalties are pretty significant. 1.5B is a pretty reasonable fine against a 59B profit. Copyright still has some pretty significant teeth.
Its not like its antitrust law /j
. 1.5B is a pretty reasonable fine against a 59B profit.
How is a single digit percentage of profit a penalty?
It would need to be >100% to dissuade imho
It could always be higher, but what percentage would you actually be happy with? Most civil fines are well under a percent, they are definitely a penalty.
The way I look at it, nvidias nemotron division isnt bring in anything close to $1.5B by itself. If they get hit with $1.5B fine for copyright infringement, the nemotron division takes a huge loss, which the rest of the company has to pick up the tab for. That isn't going to make investors happy, and they would be out for blood. It would impact earns and may cause actual damage to their valuation. (Whether its enough is unknown, the market makes no fucking sense at the best of times). If I lost 1% of my companies profit I'd lose my job. Its enough of a deterrent that the people involved should be paying attention.
On the other hand, Anthropic is playing with magical funny money, so $1.5B really doesnt matter at all to them. And they don't answer to investors, because they think they're build god.....
For a business, something costing them a single digit percentage of profit is just the cost of doing business.
They should lose double digit or more profits as a company plus individuals, starting at the top, should be penalized financially and/or with jail time depending on the offense. Yes, I mean mean some penalties should eat into future profits as well.
Don't confuse having deep enough pockets to dissuade lawsuits with actually adhering to the law.
Anthropic has deep pockets, still got fined. Deep pockets also makes you are target.
Do they though? They have investments, but a product that has never made money.
Nvidia has capital.
Deep pockets in that their investors seem happy to pour money into a pit....
Fair enough. But still less liquid than real capital, which is my only point.
Litigation is mostly too expensive for anyone but the super rich, even for more basic things.
You think the wealthiest business on Earth is afraid of a little thing like copyright law?
They're also some of the better open weight models
Ive never tried them tbh, have you? Do they work for code?
Not personally, the larger ones rate well, but may be out of reach for most home users due to hardware requirements. Generally open weights models have been about about 3 to 6 months behind the big closed frontier models
Apertus. Or at least so it claims, I haven't checked if their data sources (listed in this paper) corroborate their claims about them.
๐ Doubt it: https://github.com/swiss-ai/apertus-tech-report/issues/10 (I'm not a lawyer, this isn't legal advice.)
Apertus is a Swiss-made (public institutions) model, commited to be reproducible, i.e. training data and training pipeline is public as well. Idk if all training data is puclic domain, but I guess at least it is "freely licensed".
Edit: ah, overread the other comment mentioning it. Seems unclear.
Not what you asked for but just a note. I heard from level1techs that IBM has model called 'Granite' if i remember correctly. Supposedly one that has properly got all the permissions+public domain and will go to court for you if needed.
Wasn't there one that was trained on pre ww 1 books or something
Probably, the more relevant question is what can such models do.
Once there is one, people can test. It would be interesting for sure. (I say that as mostly an LLM hater. But I'd like to see adoption of a solution that is less problematic for everyone. I think most people would agree that would be an improvement.)
Translation would be nice.
Also finding bugs. Just training it on all historic CVEs of Foss like WordPress and the Linux kernel would be a huge plus to CI pipelines.
