68
this post was submitted on 22 Jan 2025
68 points (98.6% liked)
AI
4786 readers
4 users here now
Artificial intelligence (AI) is intelligence demonstrated by machines, unlike the natural intelligence displayed by humans and animals, which involves consciousness and emotionality. The distinction between the former and the latter categories is often revealed by the acronym chosen.
founded 4 years ago
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
You still need an expensive hardware to run it. Unless myceliumwebserver project will start
How much vram does your TI pack? Is that the standard 8gb ddr6?
I will because I'm surprised and impressed that a 14b model runs smoothly.
Thanks for the insights!
i dont even have a GPU and the 14b model runs at an acceptable speed. but yes, faster and bigger would be nice.. or knowing how to distill the biggest one, cuz I only use it for something very specific.