Thanks, will also ask in the other group you mentioned. I am still having a gaming rig here with rx6900xt as well but way too big to get it wife approved into the living room and have no man cave to run it 24/7. ;) But maybe good for testing what I actually need in model size, I think it is just 1 generation before all the ai hype took off but going to try now right away.
bazinga
joined 2 weeks ago
Thank you for the detailed writeup. Are you aware of anything small footprint? I am thinking like dgx spark size maybe a bit bigger?
NUC i7, 32gb ram. Full Docker stack includes home assistant and all relevant containers for it zigbee2mqtt, esphome, vscodium, sqliteweb, rtl_433, mqtt, kokoro_tts, weaviate, zwavejs, openwebui, ollama, paperless with ai capabilities, a1111, whisper, sync thing, searxng, redis, qdrant, postgres. Runs fine, however ollama starts to max it out as I want to go for bigger models, so looking for something with serious gpu oomphbut still small footprint and low power consumption
Wireguard runs in a different subnet at home, so the ping sensor for my phone fails on the regular WLAN address and this my ha always knows when home and when not.
Opnsense any option for you instead of openwrt. I run an old hp with Intel Ethernet card and connected a unify AP to it. Works well since years
I agree. I also think that there is nothing good in for-profit AI corporations. I can recommend the book "the empire of AI" However, I personally think self hosting and having full control of the use is a bit different.