Glasgow

joined 2 years ago
MODERATOR OF
[–] [email protected] 5 points 2 months ago

There was some interesting research on herv-k (part of rccx) being overexpressed in CFS.

https://me-pedia.org/wiki/RCCX_Genetic_Module_Theory

[–] [email protected] 18 points 2 months ago (8 children)

This is old news. They said no.

[–] [email protected] 10 points 2 months ago (1 children)

I assumed we were upvoting them to laugh at them.

[–] [email protected] 10 points 2 months ago (1 children)

From someone in the field

It lowered training costs by quite a bit. To learn from preference data (whats termed as alignment with human values), we used a very large reward model as a proxy for human feedback. 

They completely got rid of this, hence also the need to have very large clusters

This has serious implications for spending though. Big companies who would have to train foundation models coz they couldnt directly use meta's llama, can now just use deepseek.

and directly move to the human/customer alignment phase, which was already  significantly cheaper than pretraining (first phase of foundation model training). With their new algorithm, even the later stage does not need huge compute

so they def got rid of a big chunk of compute by not relying on what is called a “reward” model

GRPO: group relative policy optimization

huggingface is trying to replicate their results

https://github.com/huggingface/open-r1

[–] [email protected] 10 points 2 months ago* (last edited 2 months ago)

Not gonna watch a 30min video but the title is legit. They’ve wrote books and stuff on it, not really a secret.

https://www.vcinfodocs.com/what-is-the-network-state

edit: actually from the description/timestamps it looks like a good watch.

[–] [email protected] 0 points 2 months ago* (last edited 2 months ago)

The right wing factions pretty much say they’ve been guaranteed as much.

[–] [email protected] 6 points 2 months ago (1 children)

And why can’t they wage war on the world? What are we gonna do about?

And seems Trump is laser focused on erasing Palestine and giving his donors everything they promised.

[–] [email protected] 2 points 2 months ago

Adelson donated much more to Trump than aipac has in decades

[–] [email protected] 2 points 2 months ago

Israel is going to annex Egypt.

[–] [email protected] 3 points 2 months ago

Oh there’ll be a single state if Trump gets his way. But it’ll be Israel.

[–] [email protected] 2 points 2 months ago (6 children)

Because it’s an effective vote for Genocide++

view more: ‹ prev next ›