New Odium Symposium premium episode. We talk about Julia Galef guest hosting the Ezra Klein show to shill superforecasting
https://www.patreon.com/OdiumSymposium/posts/ezra-klein-is-2-172872571
Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.
This is not debate club. Unless it’s amusing debate.
For actually-good tech, you want our NotAwfulTech community
New Odium Symposium premium episode. We talk about Julia Galef guest hosting the Ezra Klein show to shill superforecasting
https://www.patreon.com/OdiumSymposium/posts/ezra-klein-is-2-172872571
Quick Q, from where does the weird term "abliteration" come from? I've seen it used for "jailbroken" GenAI models.
With a bit of google searching by date it seems like this guy (https://huggingface.co/failspy/Meta-Llama-3-70B-Instruct-abliterated-v3.5) claims ownership of the coining, which I find plausible, based on the list of released weights and their timing.
As far as "abliteration": it's just a fun play-on-words using the original "ablation" term used in the original paper to refer to removing features, which I made up particularly to differentiate the model from "uncensored" fine-tunes. Ablate + obliterated = Abliterated.
The paper being referred to being: Refusal in Language Models Is Mediated by a Single Direction which seems to have somehow started out on the "AI alignement forum" of LessWrong https://www.alignmentforum.org/posts/jGuXSZgv6qfdhMCuJ/refusal-in-llms-is-mediated-by-a-single-direction first posted 27th of April 2024. In general it's a method of weight alteration so only really applicable to some opensource (or i guess leaked) models.
First model with abliterated in the name by "failspy" on 8th of May 2024.
Thanks!
wiktionary claims it is a blend of "ablate" and "obliterate", it does not list an origin (at this point in time)
edit: looking a little more into this, knowing the etymology requires reading about AI discussions which I am not prepared for at this point in time but it is out there in the internet
On a more personal note and trying to keep exact circumstances vague and not name any names, but the IT corp I work at just had another wave of layoffs and our team got reduced from 5 to 4 people (and same for a neighbouring team that we are pretty close socially with, and more). Idk how they expect us to get anything done (I mean, I know, they want us to use more AI), especially with how much the mood has tanked. By any metric productivity this week is going to be close to 0% because everyone from affected teams has just mentally checked out.
So uhhhh anyone has any recommendations for what fields I could try to retrain to from IT? Preferably without going through uni again. I'm thinking locksmithing.
If you're interested in locksmithing I've got bad news. It got harder after WFH, waaaay more people home in rich neighbourhoods
OT: popping in for a second since I’m not drowning in homework for once (midterms start friday) to say carpal tunnel stripping is really good.
(so far I’m averaging in the high 80s last I checked).
Good luck with your exams.
going thru it myself, can report that non-graded "suggested exercises," with exams being the only graded material, is not any better