Futurology

4309 readers

5 users here now

founded 3 years ago

MODERATORS

voidx@futurology.today

Lugh@futurology.today

Espiritdescali@futurology.today

AwesomeLowlander@futurology.today

This new Chinese AI Is outperforming ChatGPT — and its open-source & runs locally (www.tomsguide.com)

submitted 3 weeks ago by Lugh@futurology.today to c/futurology@futurology.today

14 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] fluffykittycat@slrpnk.net 3 points 3 weeks ago

Given how memory is the bottleneck especially at the very low end it makes me wonder if one bit quantization of an extremely large model would be a gigabyte per gigabyte of ram better

permalink
fedilink
source
parent