Just fyi codestral has 22b parameters:
https://huggingface.co/mistralai/Codestral-22B-v0.1
So it's quite small as far as general-purpose LLMs go, but coding-specific models are often of a similar size.
Welcome to the programming.dev Godot community!
This is a place where you can discuss about anything relating to the Godot game engine. Feel free to ask questions, post tutorials, show off your godot game, etc.
Make sure to follow the Godot CoC while chatting
We have a matrix room that can be used for chatting with other members of the community here
We have a four strike system in this community where you get warned the first time you break a rule, then given a week ban, then given a year ban, then a permanent ban. Certain actions may bypass this and go straight to permanent ban if severe enough and done with malicious intent
Just fyi codestral has 22b parameters:
https://huggingface.co/mistralai/Codestral-22B-v0.1
So it's quite small as far as general-purpose LLMs go, but coding-specific models are often of a similar size.
nope, that is not the model I am referring to.
the old codestral model truly does have 22B parameters, but the new 25.01 version i have linked to is unfortunately still closed-access and we don't know the exact size.
They do claim it is "sub 100B" so it might be a bit bigger.
i hope they release it soon, because it is a pretty darn good model, even in Godot.
Ah my bad. Mistral has been pretty consistent with their naming schemes though - I would assume it's of a similar size. (First Mistral Small was 22b, the newest one is 24b for example, so maybe the currently closed codestral is 24b as well)
I wouldn't hold my breath on the release though, they seem to be keeping more and more models locked.
At first I thought they'd release it after some time, like miatral large v3.
Buuut it's been some weeks now and no update for codestral ;(
i hope there's gonna be some new one which is open and maybe even a free api, like codestral is currently.
wow this looks super cool!
thanksies!! ~ ~ ~ <3