mike_wooskey

joined 2 years ago

Yeah, my thinking was definitely biased to my environment. I selfhost llama.cpp so even if Hivekeep doesn't require significant resources, whatever LLMs it runs will use my hardware.

agents are activated serially per message, not all firing at once, and the persistent memory is exactly what keeps each context small

It sounds like I need to try it!

I laughed out loud (well giggled out loud) at this one, twice.

 

cross-posted from: https://lemmy.thewooskeys.com/post/1269207

A friend of mine made a cool calculator and unit converter. It parses natural English phrases like "how many inches are in 3 feet?" and "300 miles / 65 mph in hours and minutes" and "download 10GB 1Gbps". You can access it from web (including PWA), CLI or as a library. It has a strong FOSS philosophy behind it.

[–] mike_wooskey@lemmy.thewooskeys.com 2 points 1 week ago* (last edited 1 week ago) (4 children)

This looks interesting, especially the persistent memory. I want to try it out but it seems likely to me that multiple simultaneous agents would require significant hardware. Even if they were serially activated, reloading contexts with each switch would take time. I have a pretty beefy GPU and experience significant (almost ridiculous) slowdown when opencode runs 2 subagents simultaneously.

But perhaps the memory storage/lookup keeps contexts very small?

Anyway, I can't find any mention in the repo or docs what the suggested minimum hardware is.

I'm so sorry. I'm glad you and he had each other.

[–] mike_wooskey@lemmy.thewooskeys.com 6 points 1 week ago (1 children)

Tangent: I've stopped using "google" as a verb as part of my philosophy of removing Big Data from my life (and hopefully having a tiny, tiny influence on others to do the same). It's still possible and likely that Adobe Photoshop was used for this pic, but it's quickly becoming even more likely that AI was the tool. Maybe "this pic was manipulated"?

I'm glad this conversation is happening.

LuisCore is a X, X X for X X at scale: an X for X, X, and X X across X. The X X is luiscore.com, with X at X and X.

I often feel like that's what I'm reading, but I assume that enough people understand it that the trend goes on. Like maybe I should just not read articles about tech any more.

I really like the quote "If you can’t explain it to a six-year-old, you don’t really understand it yourself" (possibly by Feynman). I'd like this to be how the works works, but it would mean that most people don't understand what they're talking about or they're intentionally being pretentious and exclusive. But technical things do get made, so it seems more likely that I just don't understand.

Yes. You can use opencode, the agenetic coding tool, with just about any llm runner or model. But Opencode Go is their cloud-llm suscription plan, with limited/slightly-dated llm models.

Good thinking to mention open-webui - I was only thinking agenetic coding, but I use open-webui for llm chatting. I think it's fantastic.

[–] mike_wooskey@lemmy.thewooskeys.com 3 points 2 weeks ago (3 children)

FYI, I think opencode go is kind of a subscription model, not a direct credits-to-tokens model. In terms of value it's nowhere near as good as Claude's subscriptions, but it seems way more valuable that paying for tokens directly. However they only offer a few models - decent ones, but not many and a little behind the times.

[–] mike_wooskey@lemmy.thewooskeys.com 12 points 2 weeks ago (1 children)

AMD Ryzen 9 9950X CPU and AMD radeon pro w7900 (48GB vram). I get 55tps output pretty consistently, but ingesting context starts around 1500tps and if context size reaches, say, 50K, tps drops to around 200tps. I often have to wait a bit, but it's a price I'm happy to pay for local-only AI

[–] mike_wooskey@lemmy.thewooskeys.com 22 points 2 weeks ago (3 children)

I use opencode with locally-hosted llama.cpp - usually with qwen3.6-35b-a3b.

I tried opencode go for a couple month, and its definitely nice to have an lln runner with more gram and more GPUs, but I prefer to have all my stuff local whenever it's possible. Also, I'd use up my token allotments fairly quickly on opencode go.

I also tried opentouter and it, too, was great - many more models. But I exhausted by credits even quicker than opencode go, and its also not local.

[–] mike_wooskey@lemmy.thewooskeys.com 7 points 1 month ago* (last edited 1 month ago) (3 children)

I share your frustration. Both of my parents have multiple sheets of paper next to their computers with "all" of their passwords written on them, but when they need tech support (i.e., me), the password they need is never on there.

Have you considered the possibility that this could be a subconscious act by your mom to communicate with you, a way to ensure she gets to talk to you more frequently than otherwise?

 
 

The Purina for Professionals website's "cookie management" (to opt out of cookies) is heavily dark-patterned. Not only does the popup at the bottom of the page not have cookie management (it has a link that takes you to a page that has a link to take you to cookie management), but the wording is intentionally counter-intuitive to opt out: Manage Cookies UI The option is called "Do Not Sell or Share My Personal Information", which suggests that by selecting the option, you want them to not sell or share your information. But in parentheses it adds "slide left to opt out of sale/share", which suggests that disabling the option means for them to not sell or share your information.

 

Which of the 3 buttons does which of the 4 commands listed next to them?

 

I recently integrated self-hosted Ollama with Home Assistant and it's pretty cool.

I'd like to also be able to ask the Home Assistant Assist things like "What movies are playing in MyCity?" and have the model in Ollama search the web and summarize the results. I use Open-WebUI as a frontend for Ollama and it can do that, but I can't see how configure HA's Assist to do it.

Has anyone done this?

Another example would be to ask "what's the weather today?", and I realize that HA has a weather integration built in and thus I wouldn't need Ollama to search the web for results. Is there a web search integration for HA, so that any question (like "what movies are playing") could be passed to it?

My ultimate goal is to be able to ask questions about the world (i.e., search the web and summarize the results) and control Home Assistant devices. It doesn't have to be HA's Assist, but if I were to use Open-WebUI* for example, I'd have to come up with a way to link my audio-listening devices to it. It also doesn't have to be one "entity", but it should "feel like" one entity to the user (i.e., I don't want to have to speak to a different device or have a different wakeword to ask about the world than I do to control Home Assistant).

*Open-WebUI has integrations to control Home Assistant.

 

Of the 3 buttons in the red-outlined-box on this Brother printer control panel, which does what function? Grrr!

 

Can someone please paste the configuration yaml for an M5Stack Atom Echo that is currently working as a voice assistant satellite for Home Assistant using open wake word? (remember to redact your private data)

I installed a bunch of these Echos following these instructions back when they were first introduced. They have tiny little speakers which are essentially useless, but I routed the output sound to a media player in the same room. At that time the only option was to use open-wake-word - Nabu Casa even provided instructions and virtual-gpu resources to train your own wakeword, which I did.

The Echos worked great with my own custom wakeword for a long time!

Then sometime within the past year they stopped working. Their "wake word" entity is unavailable. I know Home Assistant came out with micro-wake-word, but I wasn't aware they ended (or broke) the open-wake-word functionality. I'd love to get my Echos working again - I'd prefer to use open-wake-word, but if the only way they're going to work now is with a pre-set wakeword, that's better than no voice assist at all!

Thanks for any help you can provide.

 

I want to install smart blinds on 4 windows, from small (2'x3') to kind of large (4'x5').

I need them blinds to be local-only and integrate into Home Assistant.

I'm looking at SmartWings, but blinds with a z-wave motor for one of my large windows would cost Just under $400. That seems a bit expensive to me (especially considerin that I got my current non-motorized, non-smart blinds for those windows for like $50 each - and they're good blinds!). Is that just what smart blinds are going to cost? Or did I land on an expense option?

Do you have a preferred make or model of local-only smart blinds?

 

Is anyone familiar with gum?

I have a simple:

while true; do
    CHOICE=$(gum choose "one" "two" "three")
    case "$CHOICE" in
        "one")
            <do something>
        "two")
            <do something>
        "three")
            <do something>
    esac
done

If the user hits ESC, gum displays "nothing selected" and exits.

Is there a way to disable the "nothing selected"? I tried redirecting 2>/dev/null but it suppresses the entire menu. I also tried adding $'\x1b' to the case, but it did nothing.

I also tried adding:

    if [ -z "$CHOICE" ]; then
        exit 0
    fi

directly after CHOICE=$(gum choose...).

No dice.

 

Within the past couple months, I saw someone's pet-project where they were cobbling together a self-hostable FOSS app/service to allow people to collaborate on travel planning. It included note taking, images, possibly some functionality around dates, and a map to drop pins and see a route (I'm not sure which backend but I would guess OSM).

Now I can't find it. :(

Does anyone use an app like this? Does anyone have any recommendations? My needs are loose - my only requirements are a FOSS license and to be self-hostable.

Thanks for ideas/suggestions.

 

Cross-posted from "finance management software suggestions" by @mike_wooskey@lemmy.thewooskeys.com in !foss@beehaw.org


I used to use Quicken long ago but have been using Moneydance for many years to manage my personal finances. But Moneydance is propietary software and I prefer FOSS now. What's your preferred finance management software?

Thing I need it to do:

  • manage different accounts (common types are banks, credit cards, loans, assets)
  • have basic reporting (e.g., categorized expenses per time period)
  • preferably uses tags
  • export or copy reports or data - could be excel or csv or something that can be pasted or imported into spreadsheets
  • self-hostable with a web app

I'm not a fan of software that's budget-focused. I don't mind it having some budgeting functionality, but I don't want opinionated software to force me to manage my money a certain way. I just want felxible software to help me manage my software how I want to manage it.

I'm wary of source-available/freemium/dual-licensed/open-core licenses. It can't hurt to suggest such apps if you like them and I'll take a look, but I think it's not likely that I'll buy into that philosophy.

So what software do you use and like?

 

I used to use Quicken long ago but have been using Moneydance for many years to manage my personal finances. But Moneydance is propietary software and I prefer FOSS now. What's your preferred finance management software?

Thing I need it to do:

  • manage different accounts (common types are banks, credit cards, loans, assets)
  • have basic reporting (e.g., categorized expenses per time period)
  • preferably uses tags
  • export or copy reports or data - could be excel or csv or something that can be pasted or imported into spreadsheets
  • self-hostable with a web app

I'm not a fan of software that's budget-focused. I don't mind it having some budgeting functionality, but I don't want opinionated software to force me to manage my money a certain way. I just want felxible software to help me manage my software how I want to manage it.

I'm wary of source-available/freemium/dual-licensed/open-core licenses. It can't hurt to suggest such apps if you like them and I'll take a look, but I think it's not likely that I'll buy into that philosophy.

So what software do you use and like?

view more: next ›