this post was submitted on 04 Nov 2026
-2 points (44.4% liked)

Programming

29278 readers
300 users here now

Welcome to the main community in programming.dev! Feel free to post anything relating to programming here!

Cross posting is strongly encouraged in the instance. If you feel your post or another person's post makes sense in another community cross post into it.

Hope you enjoy the instance!

Rules

Rules

  • Follow the programming.dev instance rules
  • Keep content related to programming in some way
  • If you're posting long videos try to add in some form of tldr for those who don't want to watch videos

Wormhole

Follow the wormhole through a path of communities !webdev@programming.dev



founded 3 years ago
MODERATORS
 

How can I find a local coding LLM that wasn't trained on copyleft code?

It's an ethical concern, not a legal one, so if the data collection doesn't entirely rule out copyleft, that might be OK

top 14 comments
sorted by: hot top controversial new old
[–] robertdegallan@lemmy.org 0 points 5 days ago

The LLM provider/creator would have to disclose this. Easier said than done but you would need open-source models and not just open-weight models.

[–] Lemvi@piefed.zip 6 points 1 week ago (1 children)

What's wrong with copyleft code?

[–] staircase@programming.dev 0 points 1 week ago* (last edited 1 week ago) (2 children)

Nothing in itself. I just felt it was antithetical to the intention behind copyleft to train on it then share the result.

It's a good question, I'll think on it more.

[–] Lemvi@piefed.zip 4 points 1 week ago

I don't see why it would be. Isn't 'copyleft' basically: "You may modify and redistribute this code for free, but whatever you produce with it has to be copyleft as well"?

Extending that to coding agents trained on copyleft code, I would say that any code that agent writes is also copyleft. How is that anti-ethical?

[–] nykula@piefed.social 3 points 1 week ago

You're probably looking for explicitly public domain code, not just avoiding copyleft. That will be rare to find. Permissive licenses such as MIT share with GPL and other copyleft licenses the aspect that they require attribution, while LLMs act as an attribution stripper.

[–] panda_abyss@lemmy.ca 4 points 1 week ago (1 children)

Olmo might be the closest you can get

https://allenai.org/olmo (website straight up crashes my phone)

https://huggingface.co/allenai/OLMo-7B

Olmo is trained on the Dolma dataset, “a diverse mixture of web content, scientific papers, code, public-domain books, social media, and encyclopedic materials”, so this might be a more ethical source, but I’m not sure if it’s copyleft free.

https://huggingface.co/papers/2402.00159

You could rent a cluster of GPUs and remove copyleft material and retrain

[–] staircase@programming.dev 4 points 1 week ago* (last edited 1 week ago) (1 children)

Dolma uses starcoder https://huggingface.co/blog/starcoder, which

are Large Language Models for Code (Code LLMs) trained on permissively licensed data from GitHub

so this might do. Thanks.

[–] hendrik@palaver.p3x.de 1 points 1 week ago

Only correct answer so far. Here's the licenses included in the dataset.

[–] scallisto@retrofed.com 1 points 1 week ago (1 children)

Just because code isn't copyleft doesn't mean it does not require attribution or consent to being scraped by LLMs!

Also, I don't think there's any model out there that has asked for permission for scraping, and if any claim they do, they're almost certainly liars.

In my opinion, you should ideally avoid LLMs if you can do the task yourself. It definitely has some genuine applications, especially translation, but functionally, ethically, and legally, it is not a suitable option for most people.

[–] staircase@programming.dev 1 points 1 week ago* (last edited 1 week ago)

Just because code isn’t copyleft doesn’t mean it does not require attribution or consent to being scraped by LLMs!

I am painfully aware. For my own work, I don't use LLMs, but I'm not convinced I'm going to be able to do that at work. I'm trying to work out the details of what that means and if it's irretrievably immoral. It's not looking good.