After I made this unrelated post, I was informed by @MysticMushroom1776@lemmy.dbzer0.com that lemmy.dbzer0.com was a pro-genAI instance.
It was honestly shocking for me to hear that these two things can coexist and I would like to share the discussion which was correctly moved for being off topic from the above linked post.
I think we owe it to ourselves to discuss topics like this with an open mind.
Here is my statements in reply to MysticMushroom1776, I wasn't able to record their reply before it was removed for being off topic bit I hope they can come here and we can continue the discussion.
Others, please also feel free to discuss with us.
'Wow, I didn't know [that lemmy.dbzer0.com was a pro genAI instance] As an anarchist myself I have to say that is really disappointing.
Anarchist communities [especially in real life] need humans otherwise there is no community. GenAl is a stolen facsimile of a human who can never understand morals or praxis. It can never understand freedom or control. It will however poison our communities (look at what SpaceX/Anthropic is doing in Memphis, TN) make us more predictable (and thus easier to control) and isolate us from other humans within the community which is so important to us.
Even with the most moral genAl you can possibly have, one that is totally FOSS and self hosted on a single gaming GPU, a lot of this is still true.
~~Obviously, this is the wrong place but I have to ask,~~ [prior to moving the discussion to this thread] what makes you think the extreme negatives of genAl (specifically to the anarchist community) can be excused?
... [I do not have a copy of mushroom's reply]
I pirate and seed. I'm also a fan of the megathread And for the most part, I think data is data. However there is a big difference between my pirating a book like the Lord of the Rings (which is credited and I can see the title of) and how Meta scraped Anna's archive and funneled all that data into an approximation of all combined work.
If I pirate the book, the Lord of the Rings to read it. I might enjoy it, I might talk about it to others, quote it, share it with my daughter, I might use the ring of power an an allegory for authoritarian control with a powerful technology, I might even decide to buy my own copies of the book.
What Meta did and then released as open source, won't allow a person the freedom to do any of that. The works were consumed and are used in silence to camouflage as human thought. No credit will ever be contributed. And so no one can even hope to appreciate the original works that was used in training.
The other concerns I have with (local) genAI that I think are deeply important to anarchists specifically.
- Isolation of humanity
- severing of our ties to community
- increasing predictability
- method of control
Photo is genAI made and sourced from the following article:
My background is that I am a PhD student in STEM. I'm not gonna doxx myself, but my research area is in mathematical systems theory. LLM systems are not my primary research area, but I have taken advanced coursework on classical machine learning, and LLMs will certainly affect my research area from a technical perspective. So I am obligated to understand LLMs, reinforcement learning systems, deep learning algorithms, classical machine learning systems, and basically the rest of "artificial intelligence" from a theoretical, mathematical point of view. In addition, I use LLMs extensively as a LaTeX assistant, to generate counterexamples, and to "fill in" proofs when I read math books.
I am also a lifelong anarchist.
Absolutely. Anarchist users of LLMs do not intend to replace the human element. Literally the opposite.
I don't oppose proletarians "stealing" "copyrighted" work. Copyright is classically anti-anarchist rentier behavior. What I do oppose, and I believe you're pointing to, are a few related but distinct problems with AI systems as they exist today:
All of these problems are serious critiques of AI systems as tools. What you'll notice about all four of these, however, is that they are primarily socially driven phenomena. These problems are contingent on the existence of hierarchical social relations. In fact, these problems have pre-AI counterparts:
"AI" systems can't understand anything. They are mathematical algorithms implemented on silicon-based computers.
This is not an inherent feature of the technology. We could have absolutely trained these models, albeit at a vastly slower sustainable pace, through the use of distributed and decentralized computing strategies. The issue is that the perverse incentivization structure of capitalism pushed AI companies to grow unsustainably, at great expense to the ecosystem and the people of the world. I.e.: capitalist interests of quick money and infinite expansion triumphed over proletarian interests of survival, dignity, freedom, and sustainability, as usual.
And it is my view, as an anarcho-communist, that by seizing the means of production from the capitalists, in particular their AI hardware, and distributing these systems more equitably around the world, we can remake these AI systems to some extent into sustainable systems at an ecologically appropriate scale. At least we would be able to try โ capitalists, as monstrous as they are, never even try to do things correctly.
I cannot stress enough that I do not want to see AI replace humans in human-centered tasks. In particular, I am completely uninterested in AI-generated "drawings" or "music". Art is an activity by sentient beings. Unedited AI "art" can be technically competent (or not), but it is ultimately just a product of a machine and therefore not tremendously compelling to me.
And I also agree that we are seeing a crisis of isolation, but my view is that:
The extreme negatives of AI must not be excused.
They must be confronted and ruthlessly reversed. And in order to do this, we must conduct a holistic analysis of why AI technologies enable these heinous things. This is impossible to conduct, i.e. useless, without relating these technologies to the social relations that motivate these technologies to destroy for their masters. Anarchists who use AI systems do not, in general, excuse these systems or their users. To the best of our abilities, we use them with the care required not to replicate capitalist harms. And we must be held accountable for our failures on that front.
Not really, no. I would have zero problems if you personally did that in a way that didn't destroy the ecology, and then released your weights, model architecture, data, and training proces. In fact, in my view, you would be doing the world a great service. It is my personal hope that we live long enough (we as proletarians living in a world doomed by capitalists) so that I can someday train an AI on all of Anna's Archive. I'm sorry if that's offensive to you, but that would be so unbelievably fucking cool and useful.
* weight available, not open source. Huge difference: you cannot reasonably recreate Meta's model weights on your own. In my view, besides being unethical, it's bad data science because it's not reproducible!
Yeah I can live that. E.g., I don't cite my calculus textbook every time I use calculus in a paper. I cite the things that must be cited. And when I wrote my metal album ten years ago, I didn't credit any artists, even though my work obviously draws from the work of dozens of metal bands. And I don't expect to receive any credit if my work influences someone else's music, or even if it gets sampled, and that thought doesn't bother me at all. It would be neat if someone did shout out my work, I'd appreciate it, but really I'm just happy if someone listens to it. (Not gonna post my album here because that would insta-doxx me lol. You're not missing out on much ๐.)
These are my views on AI systems:
Lastly, this comment was written by a real autistic human on a cell phone with zero AI assistance, as are all my comments. Yes I actually write like this ๐
Wow, just wow. I love your comment and fully agree with what you say based on what I know as a software dev with a deep background in math and cumputer vision (my master's thesis was on facial recognition). The thing is that you explain incredibly well. And I had to say that this point you make is specially interesting and is making me think a lot:
"We cannot mathematically prove yet *why* this is the case, but this was practically seen to be the case. I personally suspect that natural language has some deep underlying structure that we cannot see yet, but informs both the AI's ability to learn\*, *and* our ability as humans to learn."
Thanks for sharing your thoughts and knowledge.
You're very welcome, and thank you for reading!
Please I beg you do not change this typo ๐
If we're all being honest, this spelling is more accurate. xD
Thank you for this! It really put a lot of my thoughts into words along with some deeper insight. I think if we are going to push for a better society then we need to pay attention to people like you who are experts in the field and can really tease apart the pros and cons of things like this.
I see a bit of a panic in current anti-AI sentiment at the moment, and honestly rightfully so, as it is being weaponized against us. But to outright dismiss it or to try to put the genie back in the bottle could be shooting ourselves in the foot. If we can take control of it ourselves and push out the capitalists we could have something that is genuinely useful, and most importantly, ours.
Thank you for the lovely post, as I am also working to grapple with the impacts of AI from an Anarchist perspective
A bit off-topic: I'm looking to de-rust my calculus and linear algebra skills. I have taken courses on Machine Learning and Deep Learning but they were mostly applied rather than theory. I could explain most operations and phenomena like exploding/diminishing gradient but I'm not sure if I could explain it in a formulaic way. I tried taking RL course, and while I understand the concepts, when it comes to understanding the formulas I found myself quite lost. I feel like I have forgotten some of the foundations.
Any book / course you'd recommend for this? I even thought about paying for something like Brilliant but I'm very hesitant about that.
First, thank you for writing this well thought out reply. I do have some things I'd like to clarify or ask.
If the issue of resources required nfor training is purely corporate, then why did deepseek use the resources it did for training? It is true they were able to train the model much cheaper than the corporate models, but the scale of the training and amount of resources used was still much larger than one might have expected if the issue was purely a corporate one. Although there is something to be said about geopolitics and Chinese state influence (which is extremely capitalist)
Totally agree, the issue is not caused by genAI, but this issue is something that in my opinion prevents us from forming the societies we want to live in. It is something I have been giving a lot of thought too before the wide-spread adoption of gen-ai and it is something I keep seeing in the people that use it as a tool to get something important to them done. So many would rather hope an AI translation app works then to ask a friend to help them translate. Or to ask a neighbor to help them with planning a garden. I think using genAI as a convenience limits us from building solidarity with eachother.
I'm not offended by this, but I do think the current iteration of genAI not being able to credit creators means that information is siloed and harder to extract. Maybe that changes in the future?
Yeah, I can cop to that. Im not an expert and I don't claim to be.
I've actually ran models locally that I converted to gguf from huggingface before, I've also fine tuned and but a rag system before, but I'll check out the book. Thanks for the recommendation.
Thank you.
So first of all, there is a difference between using X total resources over three years versus using X total resources over three decades. A more extreme example is the difference between burning a full tank of gas over a few days of driving versus burning all that gas at once by lighting it on fire.
China's contributions to the AI race are, in my view, tarnished by many of the same problems as Western AI systems, since China is (state) capitalist. (That being said, Chinese companies do usually make their models weight-available, which is commendable, but not enough.)
While I suspect that we have not thrown enough theoretical math at the problem of LLM training (we have thrown lots of empirical math at them; useful for guiding the development of theory, but not theory itself), I also suspect (frankly based on my limited experience training and using these things) that the useful structural properties of LLMs only manifest themselves when you train with large datasets.
So the problem of large datasets is, in fact, an inherent part of the technology. My view is that we have to tackle these things head on.
Distributed computing. Internally, LLM companies are computing at such a scale that they already must use distributed computing technologies to spread the load out amongst many machines. My vision would be something like BOINC, where people and collectives who benefit from AI systems can give limited access to the computing power of their systems. Note that AI Horde does something like this for inference. Hence why it is so important to seize the means of production from the capitalist class. Not ask, take! They have the tools and power to do this sustainably, but they chose to do it wrong so they could make a quick bag.
Leverage existing resources sustainably. The logic here is that individuals and collectives spreading out the effort won't necessarily save resources or energy integrated over the whole planet. In fact, as a planet, we might spend more energy on a geographically distributed system if it is done at the scale AI companies are doing it. However, the issue is not just "we're spending too much energy "; it's "we're spending too much energy, too fast, and we are overloading and obliterating local ecosystems, and we are doing it in a way that exacerbates existing climate". I.e., it's not just quantity, but also space and computing time whose distribution is mismatched.
Like what the capitalists have pushed on us in basically three years...it really should have taken at least a decade.
Depends on what I need help translating. Basic Spanish? I'll ask my mom. Farsi? I don't know anyone personally who speaks Farsi, to the best of my knowledge. Advanced Spanish? Ain't no way my mom's gonna beat a machine, even a pre-2023 AI translator. I could go hire a translator, but I suspect that they have more important things to translate. I.e., translation is usually a routine task, and human translators can show up for the fun stuff (translations that require human supervision).
I wouldn't ask AI personally. I would probably look on LibGen for botany books, or drop a post on Lemmy since I'm sure there are a few botanists lurking around.
It can, but it doesn't have to. And I think that a lot of those examples are people misusing the tech. In particular, people are using the tech to "solve" problems with simple, well-understood solutions. LLM systems are suited for problems without algorithmic solutions, where either a partial and/or approximate solution is better than none at all.
I would argue that at least for math, you can actually get really far by telling the AI to cite its sources in the system prompt and giving the harness access to your PDF library (I do this in a virtual machine with a subset of my actual library that I have backed up in case I lose it). (And of course you triple check the citation it gives you.)
Also, the thing about math in particular is that we do not particularly disagree with the capitalists about mathematics. We all agree that 2+2=4 and the indefinite integral of cos(t) is sin(t) + C. And we also widely agree on how to typeset mathematics, namely "rewrite unreadable spaghetti code in LaTeX until the rendered PDF looks gorgeous." So a LLM with a capitalist bias... isn't really a problem for math typesetting questions. Conversely, I would never ask a capitalist LLM to, say, summarize the contents of Mutual Aid by Kropotkin, even if I give the system the PDF. (Most capitalist LLMs probably do recall the broad contents of Mutual Aid and the most important texts in anarchist theory, simply because they sucked up all our literature too.) I think there are other walks of life where anarchists and other class-conscious proletarians do not disagree with the capitalists, although personally my disagreements with capitalists are extremely broad, almost universal, so I understand if people have trouble finding common ground with them!
That wasn't just aimed at you ... that holds for everyone, myself included. Again, the capitalists are overselling the convergence to AGI specifically...but things are moving incredibly fast. So if you're not using the systems regularly, it's honestly going to be very difficult to keep up with the development of the tech. (I'm not saying that you should necessarily start using AI systems regularly just to keep up; it will suffice to just remember that your knowledge might be out of date by the time you finish your argument.)
Have you ever considered writing theory?
Yes lol, but I currently don't think I'm up to the task (yet) of writing anarchist theory. Mathematical theory yes, oh God yes ๐
No, I did not exclusively refer to LLMs as "AI", I referred to them as LLMs. (My view is that LLM (large language model) is a reasonable and accurate name for that class of algorithms.)
I referred to systems using various "artificial intelligence" algorithms, often including LLMs, as "AI systems". Admittedly, I sometimes forgot to use the scare quotes around "AI" and "artificial intelligence" because I thought it would be clear from the content how I feel about these terms...and I was writing this from my bed with my cellphone, so Ctrl+F and Ctrl+R weren't available. My preferred terminology would be "systems driven by statistical learning algorithms", but I decided to write that comment using the popular terminology because otherwise, I would have to begin my comment with a list of definitions. In academic work, this is actually what I would do, but in a casual online forum, beginning with a list of definitions would likely be seen as "word games".
I think that you can understand that even though I don't agree with the popular terminology, I found it more accessible to communicate my point using the popular terminology...part of which includes my disagreement with the terminology and why.