hendrik

joined 9 months ago
[–] [email protected] 3 points 10 hours ago* (last edited 9 hours ago)

I get what you say. I'm still not convinced. With something like like SQL, my query is an exact order. Fetch me these rows, do these operations on those fields and return that. And it does exactly that. While with LLMs, I put in human language, it translates that into some unknown representation and does autocomplete. Which I think is a different mechanism. And also in consequence, it's a different thing that gets returned. I'm thinking of something like asking a database an exact question. Like count the number of users and answer me which servers have the most users. You get the answer to that question. While if I query an AI, that also gives me an answer. And it may be deterministic once I set the temperature to zero. But I found LLMs tend to "augment" their answer with arbitrary "facts". Once it knows that Reddit for example is a big platform, it won't really look at the news article I gave and the numbers in it. If it's a counter-intuitive finding, it'll rather base its answer on its background knowledge and disregard the other numbers, leading to an incorrect answer. And that tends to happen to me with more complex things. So I think it isn't the correct tool for things like summarizations, or half the things databases are concerned with.

With simpler things, I'm completely on your side. It'll almost every time get simple questions right. And it has an astounding pile of knowledge available. It seems to be able to connect information, apply it to other things. I'm always amazed by what it can do. And its shortcomings. I think a lot of those aren't very obvious. I'm a bit curious whether we're one day able to improve LLMs to a state where we can steer AI into being truthful (or creative), control what it bases its responses on...

I mean we kind of want that. I frequently see some Github bot or help bot return incorrect answers. At the same time we want things like Retrieval Augmented Generation, AI assistants helping workers to be more efficient. Or doctors to avoid mistreatment, look through the patient's medical records... But I think these people often confuse AI with a database that gives a summary. And I don't think it is. It will do for the normal case. But you really have to pay attention to what current AI really is, if you use it for critical applications, because it's knowledgeable, but at the same time not super smart. And it tends to be weird with all edge-cases.

And I think that's kind of the difference. "Traditional" computing will handle edge-cases just as well as the regular stuff. It'll look up information and it will match the query or won't return anything. And it can't answer a lot of questions unles you tell the computer exactly what steps to do.

[–] [email protected] 5 points 11 hours ago* (last edited 11 hours ago) (2 children)

I don't think I'd support that parallel. With SQL, I always get the correct result back (as long as the DB keeps running). And I've tried a bit of programming and asking questions lately, and I must say AI isn't really 100% accurate. And it really depends on the complexity of the query and whether there are any traps on the way. Because in contrast to databases, AI will make up an answer to most questions. Even if it's wrong. And it'll also go ahead and sprinkle in some inaccuracies here and there. I personally struggle a bit with that kind of behaviour. It's super useful to be able to ask expert questions. But I think I like traditional databases, knowledge-bases and documentation better. Becuase with that it's super clear to me whether I get 100% accurate information. Or if I'm reading random answers from Stack Overflow... And AI is often not alike a knowledge database, but one that also rolls dice and decides to fool me every now and then.

[–] [email protected] 7 points 18 hours ago

I've also printed a few thingies for the car and my experience is, PLA deforms on the first hot day and you can throw it out. PETG lasted 2-3 years for me until it became brittle and broke.

[–] [email protected] 2 points 19 hours ago

I think on Lemmy, you can't follow people. You can just follow topics (communities, maybe hashtags).

[–] [email protected] 5 points 19 hours ago* (last edited 19 hours ago)

I think that's just another showcase on why we should regulate X-AI, OpenAI, Google and Anthropic and force them to implement watermarking, so we can easily tell which texts and papers were fabricated by their services.

[–] [email protected] 1 points 1 day ago* (last edited 20 hours ago)

Ja, die Rechtssysteme sind schon unterschiedlich. Also sowohl in der Auslegung als auch in der Durchführung nachher.

Wann ist denn sowas mal passiert?

Naja, die Geschichte hin zur Machtergreifung und Hindenburg ist schon kompliziert. Ich möchte hier auch nicht zu viel spekulieren was wäre wenn... Aber zumindest der Umgang mit dem ausbrechenden Zweiten Weltkrieg, den Polenfeldzug etc wurde ja nachher anders bewertet und die "Toleranz" z.B. von Churchill als Fehler(?) gesehen. Wenn man Parallelen zu den heutigen rechten Parteien sehen will, sollte man sich meiner Meinung nach vielleicht eher fragen, was die Zivilbevölkerung so zwischen '30 und '45 getan hat. Ich denke da mussten sich auch ein paar Leute fragen wie sie so mit der allgemeinen Situation umgehen möchten. Soweit ich weiß haben Menschen dort auch unterschiedliche Positionen gegenüber den Nazis gehabt und sind unterschiedliche Wege gegangen.

Ich meine wir haben ja viele Optionen. Man kann alles über sich ergehen lassen, man kann so wie die Franzosen ein paar Teslas anzünden. Man kann Leute aus seiner Nachbarschaft herausekeln oder sie willkommen heißen. Man kann sich überlegen ob man die AfD verbietet oder nicht... Ich denke das hat alles Auswirkungen. Wir sehen ja auch aktuell wie sich gesellschaftliche Stimmungen recht schnell verändern. Von Leuten geformt werden... Das sind ja alles Auswirkungen von etwas und ich denke das ist überhaupt nicht in Stein gemeißelt.

Das klingt für mich nach Sozialstaat oder Ordoliberalismus und nicht nach irgendwelchen Lehren aus dem Toleranz-Paradoxon.

Naja, ich finde schon, dass wir uns als Bürger fragen sollten wen wir hier was gestalten lassen wollen. In diesem Kommentarfaden geht es ja eigentlich nicht um staatliche Zensur, sondern um Social Media und Privatkonzerne, die diese "Zensur" oder Moderationsfunktion übernehmen. Und sie haben ja die absolute Kontrolle über den Raum in dem der Großteil unserer Mitmenschen ihr digitales Leben verbringen, kommunizieren, diskutieren, ihre Informationen über die Welt beziehen... Den Rahmen geben die Tech-Konzerne aus Silicon-Valley an. Ihre "Algorithmen" diktieren unsere Weltsicht. Ich denke das hat ganz viel mit dem Toleranz-Paradoxon zu tun. Also entweder finden wir Filterblasen und ungesunde Einflußnahme auf die Gesellschaft gut, oder es gibt ungefähr zwei Möglichkeiten dagegen vorzugehen. Entweder stimmen die Leute mit den Füßen ab, oder der Staat oder die EU reguliert. Und "Regulation" ist ja so ziemlich per definition die Schranke, die gesetzt wird im Kontrast zu Toleranz Großkonzerne machen zu lassen, wasauchimmer sie möchten. Das Andere ist meine individuelle Toleranz gegebüber solchen Geschäftspraktiken. Mittelbar geht es dann auch um Privatsphäre, ob wir unsere Gewerkschaften behalten möchten oder das so machen wie Amazon es möchte... Meines Erachtens ist das alles eine Frage der Toleranz unserer Gesellschaft. Und ziemlich direkte Fragestellung von dem Thema über das wir gerade reden.

Zu Islamfeindlichkeit habe ich nicht viel beizutragen. Ich komme aus dem Ruhrpott. Hier ist das ziemlich normal, dass man eine handvoll Mitschüler, Kommilitonen oder Kollegen hat, die einem von den Problemen mit den (streng) gläubigen Eltern erzählen, oder was sie so zu Ramadan machen oder nicht. Also meine Perspektive wäre da sicherlich anders als die eines AfD-Wählers vom Dorf in den Bundesländern mit mehr Bio-Deutschen-Anteil. Ich kann mich da schlecht hineinversetzen. Ich persönlich habe dem Islam gegenüber dieselbe Toleranz wie gegenüber dem Christentum. Ich finde, die haben sich alle an unsere Rechtsordnung zu halten, und sollen andere Leute bitte nicht mit ihren vor-mittelalterlichen Weltvorstellungen belästigen. Feiern und anbeten darf jede*r wen und was er oder sie will. Aber das ist ja auch der Unterschied zwischen ich mag die Leute wegen Kultur/Religion nicht, oder wegen ihres Aussehens.

[–] [email protected] 2 points 1 day ago* (last edited 1 day ago) (2 children)

Naja, soweit ich weiß gibt es hier Verleumdung, diverse Delikte mit persönlicher Ehre, dank Böhmermann hat man mal an die speziellen alten Paragraphen für Staatsoberhäupter und den Papst gedacht... Man darf den Holocaust nicht leugnen. Und bei der Verleumdung liegt die Beweislast oft bei demjenigen, der/die die Behauptungen aufstellt. Die müssen dann beweisen, dass das Fakt ist. Was so ziemlich entgegengesetzt zum Konzept "Free Speech" ist.

Was ist denn das Problem mit dem Toleranzparadoxon? Ich denke die Geschichte hat doch recht eindrücklich gezeigt, dass Toleranz z.B. gegenüber Faschisten letztendlich zu Problemen führt, weil sie dann doch so schlimm sind wie befürchtet, wenn nicht noch schlimmer. Ich finde es immer sehr okay denen keinen Raum zu geben. Also sowohl im echten Leben als auch hier im Internet dulde ich sowas kaum, spreche die Probleme deutlich an, und ich verlasse auch Plattformen wie X ratz fatz, wenn die von Faschisten übernommen werden. Und wenn ich mir mein direktes Umfeld anschaue, scheint das auch ganz gut zu funktionieren?

Und ein anderes Thema was ich wichtig finde ist die Toleranz gegenüber Großkonzernen. In Amerika ist ja uneingeschränkter Kapitalismus angesagt. Und hier gibt es ja doch Bestrebungen das zu regulieren. Z.B. darf mein Internetprovider nicht jedes meiner privaten Worte weiterverkaufen. Der Arbeitgeber darf mich nicht mit ein paar Dollar fünfzig pro Stunde über den Tisch ziehen und Arbeitssicherheit abschaffen. Ich finde das schon ganz gut, dass wir dem Turbo-Kapitalismus gegenüber nicht ganz so tolerant sind, wie die Amerikaner... Also auch wenn wir nicht perfekt sind, "nutzlos" finde ich das nicht.

[–] [email protected] 22 points 1 day ago (4 children)

Ich glaube viel von der Kontroverse ist auch importiert aus den USA. Dort wird immer als erstes Zensur geschrien. Aber eigentlich ist das nicht so ganz unser Kulturkreis. Wir haben keine absolute Redefreiheit. Und eigentlich ist hier auch das Toleranzparadoxon bekannt. Von daher ist nach unseren Maßstäben auch nicht immer jeder entfernte Beitrag Zensur.

[–] [email protected] 3 points 1 day ago* (last edited 1 day ago)

If that's true, is there any cheap compute provider leveraging the low cost and providing service to customers abroad?

[–] [email protected] 3 points 1 day ago* (last edited 1 day ago)

Uh wow. Last time I traveled outside of Europe, it was still pretty safe. Seems one good option would be to make a cloud backup, wipe the phone before the flight and restore everything using the first hotel wifi. I wonder if creating a second (empty) user account on the phone and unlocking that one at the border is enough to comply with the law.

[–] [email protected] 1 points 2 days ago* (last edited 2 days ago) (1 children)
[–] [email protected] 8 points 3 days ago (3 children)

There are no tags as of now. Everyone is running the main branch from Git. I suppose that's going to change at some point when PieFed deems itself ready.

 

I'm developing a small Python webapp as some sort of finger exercise. Mostly a chatbot. I'm using the Quart framework, which is pretty much alike Flask, just async. Now I want to connect that to a LLM inference endpoint. And while I could do the HTTP requests myself, I'd prefer something that does that for me. It should support the usual OpenAI style API, in the end I'd like it to connect to things like Ollama and KoboldCPP. No harm if it supports image generation, agents, tools, vector databases, but that's optional.

I've tried Langchain, but I don't think I like it very much. Are there other Python frameworks out there? What do you like? I'd prefer something relatively lightweigt that gets out of the way. Ideally provider agnostic, but I'm mainly looking for local solutions like the ones I mentioned.

Edit: Maybe something that also connects to a Runpod endpoint, to do inference on demand (later on)? Or at least something which I can adapt to that?

 

I've been using Etar for years now. But the Samsung calendar app on my wife's phone looks way better, while I'm missing things like the titles in the appointments once it gets crowded. And the all day events and birthdays aren't that prominent either. Plus I don't have some features on Etar like adding notes/emojis to days.

Is there a better calendar app out there? It has to be open source and somehow connect to my Nextcloud. That'd be my requirements. But I believe all calendar apps can connect to webdav.

13
submitted 3 months ago* (last edited 3 months ago) by [email protected] to c/[email protected]
 

Seems Meta have been doing some research lately, to replace the current tokenizers with new/different representations:

 

I got a new phone. Skipped a few generations and now I'm running the current GrapheneOS, based on Android 15. I've moved most of the apps, but now I'd like to install my 3 banking apps and 5 discount program spyware apps. I guess I best separate them from the rest of the arbitrary stuff. Banking apps so they can't be messed with, and shady discount programs so those apps can't mess with me and my data...

The internet has a lot of information about Shelter, work profiles, the new(?) private spaces... But I don't know what is current advice and what's outdated advice... What's the current best practice?

 

During the summer the European Commission made the decision to stop funding Free Software projects within the Next Generation Internet initiative (NGI). This decision results in a loss of €27 million for software freedom. Since 2018, the European Commission has supported the Free Software ecosystem through NGI, that provided funding and technical assistance to Free Software projects. This decision unfortunately exposes a larger issue: that software freedom in the EU needs more stable, long-term financial support. The ease with which this funding was excluded underlines this need.

CC BY-SA 4.0 - SFSCON 2024

Cross-posted from the FSFE Peertube Channel

 

Seems they recently changed something on Spotify and all the tools I've tried fail now. And DownOnSpot which seems promising has received a cease and desist letter and got taken down. What do you people use? I want something that actually fetches the audio from Spotify, not just rip it from YouTube. And it has to work as of now. Does the latest commit from DownOnSpot work? Back when I tested it a few weeks ago it failed due to some API changes. Are there other tools floating around?

 

I just found https://www.arliai.com/ who offer LLM inference for quite cheap. Without rate-limits and unlimited token generation. No-logging policy and they have an OpenAI compatible API.

I've been using runpod.io previously but that's a whole different service as they sell compute and the customers have to build their own Docker images and run them in their cloud, by the hour/second.

Should I switch to ArliAI? Does anyone have some experience with them? Or can recommend another nice inference service? I still refuse to pay $1.000 for a GPU and then also pay for electricity when I can use some $5/month cloud service and it'd last me 16 years before I reach the price of buying a decent GPU...

Edit: Saw their $5 tier only includes models up to 12B parameters, so I'm not sure anymore. For larger models I'd need to pay close to what other inference services cost.

Edit2: I discarded the idea. 7B parameter models and one 12B one is a bit small to pay for. I can do that at home thanks to llama.cpp

 

tl;dr: Be excellent to each other, do something constructive here?

I'm not sure anymore where the Threadiverse is headed. (The Threadiverse being this threaded part of the Fediverse, i.e. Lemmy, MBin, PieFed, ...)
In my time here, I've met a lot of nice people and had meaningful conversations and learned lots of things. At the same time, it's always been a mixed bag. We've always had quite some argumentative people here, trolls, ... I've seen people hate on and yell at each other, and do all kinds of destructive things. My issue with that is: Negative behavior is disproportionately affecting the atmosphere. And I'd argue we have nowhere enough nice behavior to even that out.

I don't see Lemmy grow for quite some time now. Seems it's now leveling off at a bit less that 50k monthly active users. And I don't see how that'd change. I'm missing some clear vision/idea of where we want to be headed. And I miss an atmosphere that makes people want to join or stay here, of all of the places on the internet. The saying is: "If you don't go forwards you go backwards". I'm not sure if this applies... At least we're not shrinking anymore.

And I'm always unsure if the tone and atmosphere here changes subtly and gradually. I've always disagreed with a few dynamics here. But lately it feels like we're on the decline, at least to me. I occasionally keep an eye on the votes on my comments. And seems I'm getting fewer of them. Sometimes I reply to a post and not a single person interacts. Even OP seems to have abandoned their post moments after writing it. And also for nuanced and longer replies, I regularly don't get more than one or two upvotes. I think that used to be a bit better at some point. And I see the same thing happening with other peoples' comments. So it's not just me writing low-quality comments. What does work is stating simple truths. I regularly get some incoming votes with those. But my vision of this place isn't spreading simple truths, but have proper and meaningful discussions, learn things and new perspectives or just mingle with people or talk. But judging by the votes I observe, that isn't appreciated by the community here.

Another pet peeve of mine is the link aggregator aspect of Lemmy. I'd say at least 80% of Lemmy is about dumping some political (or tech) news articles. Lots of them don't generate any engagement. Lots of them are really low-effort. OP just dumps something somewhere, no body text added, no info about what's interesting about it. And people don't even read those articles. They just read the title and react (emotionally) to that. In the end probably neither OP nor the audience read the article and it's just littering the place. Burying and diminishing other, meaningful content. (With that said: There are also nice (news) discussions going on at the same time. And Lemmy is meant to be a link aggregator. It's just that my perception is: it's skewed towards low quality, low engagement and random noise.)

A few people here also don't really like political debate. And there's no escape from it here on Lemmy since so much revolves around that. And nowadays politics is about strong opinions, emotions and emotional reactions. And often limited to that. The dynamics of Lemmy reinforce the negative aspect of that, because the time when you're most incentivized to reply or react is, when it triggers some strong emotion in you, for example you strongly disagree with a comment and that makes you want to counter it and write your own opinion underneath. If you agree, you don't feel a strong emotion and you don't reply. And the majority of users seems to also forget to upvote in that case, as I lined out earlier. And we also don't write nuanced answers, dissect complex things and examine it from all angles. That's just effort and it's not as rewarding for the brain to do that as it is pointing out that someone is wrong. So it just fosters an atmosphere of being argumentative.

Prospect

I think we have several ways of steering the community:

  1. Technology: Features in the software, design choices that foster good behavior.
  2. Moderation: Give toxic people the boot, or delete content that drags down the place. Following: What remains is nice people and not adverse content.
  3. The community

I'd say 1 and 2 go without saying. (Not that everything is perfect with those...) But it really boils down to 3: The community. This is a fairly participatory place. We are the ones shaping the tone and atmosphere. And it's our place. It's kind of our obligation to care for it if we want to see it go somewhere. Isn't it?

So what's your vision of this place? Do you have some idea on where you'd like it to go? Practical ideas on how to achieve it?
Do you even agree with my perception of the dynamics here, and the implications and conclusions I came up with?

view more: next ›