db0

As I said elsewhere, I'd rather this be a learning moment, than a purging moment.

We're probably long overdue with an official meta post in our instance about this whole shitshow that we can link on the next time this disinfo is pushed.

I don’t accept that the LLM summary didn’t influence the decision because the mod in question confirmed that he knew the LLM agreed with him (that’s bias, and also not something LLMs are capable of actually doing) and because if it didn’t, then the summary is worthless

In this case, according to the admin in question, the LLM summary came after the decision, as a sort of a test. I.e. the admin made a decision, and wanted to see if an LLM would subsequently agree with that decision. In this specific case, it did, which is why they misguidedly decided to keep its summary in the modlog (opening us up to this whole shitstorm), but ultimately, that admin anyway decided LLMs in the mix is not good at all, which is why you never again saw an LLM summary in the modlog.

I can only put so much fault for a person for just testing shit out, yanno? I am not happy that they decided to use the output of the test because they are not familiar with how quickly disinfo breeds, but ultimately they came to the right decision anyway. If they had not and they had raised the issue on using LLMs officially, they would have been shut down.

I think that would just be performative at this point, but I'll discuss with the team.

why are you going to bat for someone using unofficial tooling that proved to be extremely unpopular because it was used in a manner that looked like abuse to most observers and qualifies as abuse for instances like ours?

I am not defending them. Trust me I am plenty annoyed that I have to deal with the fallout and the constant disinfo it opened us up on. But at the end of the day, we're humans and people are new at moderating and new to social media, and don't always understand how visuals come across and how easy it is for people to pick up the pitchforks, and I'd rather make this a learning moment than a purging moment.

I will absolutely accept the shit that comes our way because people didn't think how their actions would look (again, this doesn't mean that LLM for moderation is good but being seen using is bad. The former is bad too.) But I don't like being blamed for bringing the frigging LLM apocalypse to the fediverse, you know what I mean?

it feels kind of rich to come here angry when other people are asking you to stop. maybe you can just take our word for it that we don’t want an LLM anywhere in the moderation process, even as a post summarizer? you don’t have to understand why if you don’t want to.

For the record: I'm not angry at people telling us to stop. I am angry because we never even started and I keep saying this and it feels like people are just not listening and keep repeating the same disinfo and I have to keep saying "People, this is not true, this is not at all what happened" again and again.

You realize there might not be a repo, right?

assume I know and understand that the LLM did not literally do the banning

I am telling, again, that the human did not use the LLM to think for them either. The admin took the decision to ban the user irrespective of the LLM, and the rest of our admin team and me specifically, would never let an admin become a "human in the loop". The LLM was used just to summarize, as part of the test, with a misguided inside joke on using OpenAI tech.

I will readily admit that there was mistakes made by the admin. Not on their actions, but on their visuals. Because those visuals were spun to keep feeding this made-up controversy. We didn't use the LLM to decide or even guide our decision, but it appeared like we did, and we already owned that.

this human in loop shit is how corporations absolve themselves of responsibility for decisions taken purely on the word of an LLM. it lets them fire a worker instead of an executive. you’re sure this is the route you want to go?

I completely agree with you. We have never and will never go that route.

Here's the answer to the only question you posted which should be obvious from everything else I've said and done.

This is an internal tool that a mod developed and an admin was trying out. You realize that at this point I could just post any fucking code I want to prove whatever I want, right? So you understand this doesn't prove anything? So why not just believe me when I tell you that all the script was doing was downloading a user's public post history via the API?

I anyway asked the developer to share the code with me, as again, it wasn't an official instance tooling.

yeah, it’s ok because the LLM wasn’t hooked up directly to the ban API, you just used it systemically to not do the only fucking thing you’re supposed to be doing as a moderator

Can you fucking read? What "systematically" are you talking about? How did we use it " only fucking thing you’re supposed to be doing as a moderator"? Is summarizing "the thing you're supposed to be doing as a moderator"? Is doing a summary once "systematically"? Why are you continuing to spread disinfo?

Once again. The admin in question DID NOT USE THE LLM TO DECIDE ON THE ADMIN ACTION. Can you understand this? Can you read this? Am I talking to a wall?! You are swallowing disinfo and then spitting your outrage mindlessly on people.

The code of what? The script that uses the lemmy API to download the public post history of a user?

did you read my post and see the bit where I don't make any moderation claims

You linked to disinfo and them claimed we"feed posts wholesale to prompts". You know the implication you were trying to make, and as it's clear from the comments from others here that it's working.