Technology

DeepSeek V3 is a big deal for a number of reasons.

At only $5.5 million to train, it's a fraction of the cost of models from OpenAI, Google, or Anthropic which are often in the hundreds of millions.

It breaks the whole AI as a service business model that OpenAI and Google have been pursuing making state-of-the-art language models accessible to smaller companies, research institutions, and even individuals.

The code is publicly available, allowing anyone to use, study, modify, and build upon it. Companies can integrate it into their products without paying for usage, making it financially attractive. The open-source nature fosters collaboration and rapid innovation.

The model goes head-to-head with and often outperforms models like GPT-4o and Claude-3.5-Sonnet in various benchmarks. It excels in areas that are traditionally challenging for AI, like advanced mathematics and code generation. Its 128K token context window means it can process and understand very long documents. Meanwhile it processes text at 60 tokens per second, twice as fast as GPT-4o.

The Mixture-of-Experts (MoE) approach used by the model is key to its performance. While the model has a massive 671 billion parameters, it only uses 37 billion at a time, making it incredibly efficient. Compared to Meta's Llama3.1 (405 billion parameters used all at once), DeepSeek V3 is over 10 times more efficient yet performs better.

DeepSeek V3 can be seen as a significant technological achievement by China in the face of US attempts to limit its AI progress. China once again demonstrates that resourcefulness can overcome limitations.

🖕 Fuck PayPal

And fuck Linus Tech Tips for intentionally keeping quiet about this after they found out.

https://archive.ph/kI6je

cross-posted from: https://lemm.ee/post/50462283

Analog tech 😏

Brian Merchant and Paris Marx are back with the very first guest of System Crash: Molly White! With Molly’s help, we walk through the biggest stories in the crypto world. We explore the resurgence of crypto, how its backers influenced the election and won Trump’s favor, what the crypto industry wants from the incoming administration—and how it plans to wield power.

An Australian computer scientist who falsely claimed to be the creator of bitcoin has been given a one-year suspended prison sentence after the high court in London ruled he was in contempt because he would not stop suing people.

Mr Justice Mellor had already found that Craig Wright, 54, repeatedly lied about his claim to be Satoshi Nakamoto, the pseudonym used by the person or people who launched bitcoin – the cryptocurrency that was first mined in 2009 and recently soared in value to £79,000.

Wright had claimed intellectual property rights associated with bitcoin, but that was demolished when the high court found he lied about his role, deploying often clumsy forgeries “on a grand scale” and “technobabble”. The real Nakamoto is likely to be a billionaire because they are thought to own 1 million bitcoins.

Wright was then ordered to stop taking legal actions against bitcoin developers, but defied that court order in October when he brought suits against cryptocurrency developers amounting to more than £900bn in respect of his claimed intellectual property rights related to bitcoin.

More than 140 Facebook content moderators have been diagnosed with severe post-traumatic stress disorder caused by exposure to graphic social media content including murders, suicides, child sexual abuse and terrorism.

The moderators worked eight- to 10-hour days at a facility in Kenya for a company contracted by the social media firm and were found to have PTSD, generalised anxiety disorder (GAD) and major depressive disorder (MDD), by Dr Ian Kanyanya, the head of mental health services at Kenyatta National hospital in Nairobi.

The mass diagnoses have been made as part of lawsuit being brought against Facebook’s parent company, Meta, and Samasource Kenya, an outsourcing company that carried out content moderation for Meta using workers from across Africa.

The images and videos including necrophilia, bestiality and self-harm caused some moderators to faint, vomit, scream and run away from their desks, the filings allege.

GUIs are certainly awesome, and they look like they’ll be the future of IT; but what if you desperately wanted one, yet all you had was a regular IBM PC? Lucky you, as Visi On was just what you needed; let’s explore it in our newest Episode of GUI Wonderland!