LocalLLaMA
Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.
Get support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.
As ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.
Rules:
Rule 1 - No harassment or personal character attacks of community members. I.E no namecalling, no generalizing entire groups of people that make up our community, no baseless personal insults.
Rule 2 - No comparing artificial intelligence/machine learning models to cryptocurrency. I.E no comparing the usefulness of models to that of NFTs, no comparing the resource usage required to train a model is anything close to maintaining a blockchain/ mining for crypto, no implying its just a fad/bubble that will leave people with nothing of value when it burst.
Rule 3 - No comparing artificial intelligence/machine learning to simple text prediction algorithms. I.E statements such as "llms are basically just simple text predictions like what your phone keyboard autocorrect uses, and they're still using the same algorithms since <over 10 years ago>.
Rule 4 - No implying that models are devoid of purpose or potential for enriching peoples lives.
view the rest of the comments
Thanks. Maybe Agent Zero is a bit too close to the "usual" security model for my liking. Seems they also tell me to run it isolated and not connect it to private data and production systems... But that's kind of what I want. I'd like it to screen my email inbox or move the remaining spam mails to the spam folder. But I thought there maybe was some sane approach where a human programmed the email adapter of it. And I can just configure the agent to stick to read permissions only, so it'd be fine.
Thanks for the other link. From reading the list, I think crewAI and smolagents are closest to what I want. I mean I don't have an exact use case. I just figured since everyone and their grandma supposedly has AI agents these days. And AI is supposed to my life better, I'd try it. Idk. Let it sift trough my email inbox. Some online RSS feeds and the changelogs of some open-source projects I follow and alert me if there's something interesting. Or if there's something going on in a pull request I was part of... Maybe it can help with some other things. Or be a FAQ bot for all the knowledge I stored on my computer... Or generate a cat picture and send it to me via chat at lunchtime to brighten up my day. Connect to my Home Assistant and ping me before I leave the house if the train is delayed, it's icy conditions on the road. That's roughly what could be my needs.
But I want something more grounded than OpenClaw. It's probably easy to build in some permission system and come up with separate agents for tasks, so the email agent can't blackmail me with information from my knowledgebase, or delete the inbox. And sure I could use LangChain. That'd do it. But I've tried, and that's just a lot of work. I'll end up coding all the workflows myself. Figure out the prompts or steal them from another project. Reinvent how planning and subdividing tasks works... Copy lots of boilerplate code to start a vector database and then do RAG. Memory, skills. I'll have to write all the email, chat, RSS, webcrawler integrations myself. A scheduler, background tasks. Then code an entire UI because what they have is more for testing and very straightforward chatbots. And it just escalates to a 100h+ Python project. For what I think must have been written several times already?!
Totally reletable, I actually want the same functions. I will stick to something more conservative at the moment to test and also because it is relevant for my work.
AgentZero has builtin connectors to Email, Telegram and WhatsApp. You can install plugins for Matrix or Discord. Not sure about the security model as I do not use these currently.
However, it also has a secrets store that replaces secrets in tool calls locally. I use it for SSH access to another machine.
The a0 connector can be used to link it to your PC locally for projects that require file acces, etc.