overview for Disonantezko

How to run LLaMA (and other LLMs) on Android. in c/[email protected]

[–] [email protected] 1 points 4 weeks ago

PocketPal is good, has built in huggingface search and download, only text chat (no multimodal yet), support last models from llama-cpp, as:

gemma3 (just released)
falcon3
phi-4-mini
granite3.2

Recommend models for GTX 1660 Super (6GB) in c/[email protected]

[–] [email protected] 2 points 1 month ago (1 children)

My gear is an old:

I7-4790 16GB RAM

How many tokens by second?

Recommend models for GTX 1660 Super (6GB) in c/[email protected]

[–] [email protected] 1 points 1 month ago

It's not out of my scope, I'm just learning what can I do locally with my current machine.

Today I read about RAG, maybe I'm gonna try an easy local setup to chat with a PDF.

7

Recommend models for GTX 1660 Super (6GB) (lemmy.sdf.org)

submitted 1 month ago by [email protected] to c/[email protected]

6 comments fedilink

I have an GTX 1660 Super (6 GB)

Right now I have ollama with:

deepseek-r1:8b
qwen2.5-coder:7b

Do you recommend any other local models to play with my GPU?

Arch Linux – Best Tips for Beginners? in c/[email protected]

[–] [email protected] 2 points 2 months ago

Wayland and Cosmic are not there yet for beginners, more like beta, watch videos from Brodie Robertson, I'll wait half year at least to try that for newbies.

Which distro would you install on a celeron 2gb ram laptop for a lay person to use? in c/[email protected]

[–] [email protected] 2 points 2 months ago (2 children)

But web browsers and video players are going to be painful with any distro.

Which distro would you install on a celeron 2gb ram laptop for a lay person to use? in c/[email protected]

[–] [email protected] 7 points 2 months ago

This!

Even 4GB RAM is low for web browsers and they're gonna struggle, A LOT, even with just one tab open, is going to be painfully slow to not want to use it anymore.

Old laptops like this, don't have hardware video decoders for YouTube or any video in AVC or HEVC códecs that is used everywhere today.

You can use Gnumeric for spreadsheets and Abiword for docs if Libreoffice is too slow.

What are some fun or unconventional uses for an old Atom notebook with 2GB RAM? in c/[email protected]

[–] [email protected] 3 points 2 months ago

SliTaz is fun to play and very small.
Puppy Linux is very capable and there are Debian variants.

What are some fun or unconventional uses for an old Atom notebook with 2GB RAM? in c/[email protected]

[–] [email protected] 2 points 2 months ago

Bad idea, they struggle with YouTube or any video because they don't have hardware decoders for AVC/HEVC.

Maybe can decode by software, something easy on CPU (MPEG1 maybe), and the conversion is done by other machine.

Maybe audio?

Reference: I have one of those Atom netbooks.

Introducing BootSelector, GUI utility to set grub default boot entry in c/[email protected]

[–] [email protected] 1 points 3 months ago (1 children)

EFI didn't work for me, maybe I need LILO

What's the most obscure distro you can think of in c/[email protected]

[–] [email protected] 1 points 4 months ago

Not so obscure, just 50mb and very functional, in between tiny core and puppy.

What's the most obscure distro you can think of in c/[email protected]

[–] [email protected] 1 points 4 months ago

Not really obscure

should I completely jumpship to linux when windows 10 ends support/am ready or dualboot ltsc and linux in c/[email protected]

[–] [email protected] 2 points 5 months ago* (last edited 5 months ago) (1 children)

LTSC + WSL (Better than VM)
Dual Boot
Linux only