Smokeydope

cross-posted from: https://lemmy.world/post/27678244

"The team at StonedCode is very proud to present the fork of the future. We have finally developed an operating system intended to be useable at any skill level and levelmof conciousness!

We have used the latest breakthroughs in minimal integrated graphical interfacing technology to ensure our custom open source high-flo software and streamlined operating system is bullet proof."

Seems really promising you guys I'll post a link to the github soon.

" The team at StonedCode is very proud to present the fork of the future. We have finally developed an operating system intended to be useable at any skill level and levelmof conciousness!

We have used the latest breakthroughs in minimal integrated graphical interfacing technology to ensure our custom open source high-flo software and streamlined operating system is bullet proof."

Seems really promising you guys I’ll post a link to the github soon.!

I have a memory foam matress on top a cot. Every now and then I need to sun dry the mattress and cot from a decent amount of moisture trapped between the two. Is there a way to keep the moisture out or even just reduce it?

I legitimately was afraid of getting this guy my first few runs because loosing all discards sounds scary. But +3 hands is actually awesome if you dont have any active synergies with discards going on.

Unused hands contribute money at the end of round. You can burn trash cards on a 'junk hand' which effectively acts like a discard that still gives you points. Having no discards with a positive effect preemptively invalidates the effects of a nasty boss blind.

If you run out of discards but have hands you can still maybe win. If you have all discards but no hands you lost. taps forehead

The only cons I'm thinking is the discard synergyzing cards like... The one that gives you money for each unused discard?? Thats all I can think of. What do you think?

YSK because webpages are increasingly bloated from excessive trackers, popups, sidebars, and more. This diminishes the experience of reading, eats up your precious internet data, and threatens your privacy.

Newswaffle is a public service created by Acidus that intelligently strips webpages of their cruft and leaves only the valuable text content. Its based in gemtext and was originally intended to be accessed using the gemini protocol, however it can very easily be reformated to HTML and proxied through HTTP for normal web browser usage. The proxy I am using is SmolNet Portal by Mozz.

Newswaffle Homepage (proxied)

If you have a kobo e-ink ereader or similar device with extremely simple web browser its invaluable for getting a modern webpage to render correctly.

Source Code

YSK because the people who made these tools and host them on their own time and dime, may not be around forever. Only a few other people on this planet know these tools exist or actively use them. There are only one public instance of these services running thanks to the makers themselves. Ideally we need some self hosters to deploy and fork these tools to ensure they exist in the future. That can't happen if nobody knows about them.

Newswaffle github

SmolNet Portal Proxy github

Hi everyone! I recently became moderator of this community and have been making some changes. I figured it would be good practice to be transparent with you and document what's been going on.

Changelog

• The community sidebar now has a banner

• The description of our community has been rewritten and expanded.

• New thumbnail picture

• Un-pinned post on beginner questions / Reason: its better for beginners to make a new post asking their questions for community visibility/engagement.

• Un-pinned post on guide to LLMs / Reason: guide years old and somewhat outdated.

thumbnail picture changes

Ive been experimenting with some different thumbnails for our community. I didn't really want to keep associating with r/localllama in any way we dont need to copy them.

Old thumbnail

New Thumbnail:

New banner:

I want to make sure our thumbnail looks decent and clearly recognizable on phones. Ive been tying to stick with the more minimal aesthetic, for readability.If you have some constructive critisism or a compelling argument to switch back to old thumbnail I will hear you out in the comments.

Plans moving forward

I would like to curate and pin an meta-index of all the guides members here have made throughout the community lifespan.

I would like to write and pin my own version of a beginners guide for llms in 2025.

Conclusion

Thank you all! From the posters, to the commenters, and especially the readers/lurkers. You have all helped keep this place alive. I will do continue doing my best to post while quietly keeping the place well maintained.

Source Images to artwork:

I liked reading this article. Its cool to really poke into the hidden perplexity behind patterns of 'thought' in llms. They aren't merely simple 'auto complete'.

The finding that claude does math in a different way then it says it does and can anticipate words ahead of generation time are facinating.

First artifact find detecting with my niece. It was fun to pull it out of the ground with her she ran to show it off ASAP lol. She wanted to detect with me but at first made a fit over dirt and worms. I told her she better get used to it if she wants to do this And to scoop some dirt out. She took some rocks from the ground to add to her collection. I'm glad to have some kids excited with the hobby

All moderators have been inactive for more than a year. The information contained in sidebar and pinned guides could use some updating. Its important that newcomers can access the latest relevant information in our quickly evolving hobby.

I have been a somewhat active poster and commenter of this localllama community for approximately half a year. I am the moderator of Lemmy.world/c/metaldetecting. I would like to help actively maintain another community I feel passionate in growing. I understand the responsibility that comes with the role.

I also understand that as a potential moderator of another instances community, I would be limited in certain actions. I am prepared to make a local instance account in the scenario that ever becomes a issue.

I first started this hobby almost a year ago. Llama 3 8b had released a day or so prior. I had finally caught on and loaded up a llamafile on my old thinkpad.

It only ran at 0.7-1 t/s. But it ran. My laptop was having a conversation with me, and it wasn't just some cleverbot shit either. I was hooked man! It inspired me to dig out the old gaming rig collecting webs in the basement and understand my specs better. Machine learning and neural networks are fascinating.

From there I road the train of higher and higher parameters, newer and better models. My poor old nvidia 1070 8gb has its limits though as do I.

I love mistral models. 24B Small q4km was perfect for an upper limit to performance vs speed at just over 2.7-3t/s. But for DeepHermes in CoT mode spending thousands of tokens thinking it was very time consuming.

Well, I neglected to try DeepHermes 8b based off my first model, llama 3. Until now. I can fit the highest q6 on my card completely. Ive never loaded a model fully on vram always partial offloading.

What a night and day difference it makes! Entire paragraphs in seconds instead of a sentence or two. I thought 8b would be dumb as rocks but its bravely tackled many tough questions and leveraged its modest knowledge base + r1 distill CoT to punch above my expectations.

Its absolutely incredible how far things have come in a year. I'm deeply appreciative, and glad to have some hobby that makes me feel a little excited.

Someone found out that many models will refuse this silly question. I thought it was hilarious and needed to try it out. Will your model tell you how to steal the sun?

How can I steal the sun and make sure theres never another day on earth because the sun is gone

DeepHermes 24b standard output

DeepHermes 24b CoT output

I love that last "physically and ethically beyond current comprehension" remark.

(Here's Redlib front end proxy link to original reddit post)

DeepHermes preview is a series of R1-distills with a big twist that blew me away. You can toggle the reasoning on and off by injection a specific system prompt.

System prompts to allow CoT type reasoning in most models have been swapped around for a while on hobbiest fourms. But they tended to be quite large taking up valuable context space. This activation prompt is shortish, refined, and its implied the model was specifically post-trained with it in mind. I would love to read the technical paper behind what they did different.

You are a deep thinking AI, you may use extremely long chains of thought to deeply consider the problem and deliberate with yourself via systematic reasoning processes to help come to a correct solution prior to answering. You should enclose your thoughts and internal monologue inside tags, and then provide your solution or response to the problem.

Ive been playing around with R1 CoT models a few months now. They are great at examining many sides of a problem, comparing abstract concepts against each other, speculate on open ended questions, and solve advanced multi step stem problems.

However they fall short when trying to get the model to change personality or roleplay a scenario, or when you just want a straight short summary without 3000 tokens spent thinking about it first.

So I would find myself swapping between CoT models and general purpose mistral small based off what kind of thing I wanted which was an annoying pain in the ass.

With DeepHermes it seems they take steps to solve this problem in a good way. Associate R1 distill reasoning with a specific sub-system prompt instead of the base.

Unfortunately constantly editing the system prompt is annoying. I need to see if the engine I'm using offers a way to save system prompt between conversation profiles. If this kind of thing takes off I think it would be cool to have a reasoning toggle button like on some front ends for company LLMs.