disorderly

joined 1 week ago
[–] disorderly@lemmy.world 9 points 3 hours ago

This might seem like a very indirect response, and that's because it is largely a notion I have after a couple years of observing the fediverse. My background is in infrastructure for micro services, which is a powerful source of bias, so take this with a grain of salt.

The fediverse is suffering from major problems caused by homogeneity, data duplication, and lack of meaningful coordination. It is completely unsurprising that it struggles to provide the level of service that most users expect. I'm not saying this to be mean, but because I've experienced these same growing pains in commercial settings.

The solution has always been to restructure product services in a way that separates concerns. Most of the big guys will, at a very high level, use an API gateway which handles security + authn, then forward requests to high level product services which in turn reach down to the data layer services (which are often ORMs with huge caches sitting on top of databases). Works great, usually.

The fediverse, from what I've seen, does not do this. Everyone sets up largely identical monolithic applications which share messages through the Pubsub protocol. Information is duplicated everywhere, and inter-instance communications are a liability not only in content but even in compute and persistence (you can absolutely get DDOS'd by a noisy neighbor). Individual instances are responsible for their own edge security, compute, and data. It's just a lot to ask of a single person that wants to host a federated instance.

I think that a healthy federated internet will eventually require highly specialized instances at several layers, and for certain maintainers to thanklessly support the public facing services. One of the most obvious classes of these specialized instances, to me, would be the data layer and catching instances, which exist to ensure that content posted on one instance is backed up and served for other instances. It reduces the strain on public facing instances because they no longer have to host all the content they've ever seen, and it also ensures that if a public instance goes down, the content does not disappear with it.

This same principle could be used on "gateway" or "bastion" instances which enforce strict security on behalf of public instances. Public instances would block direct connections while treating requests from the gateway nodes as highly privileged. Each public instance would either find a gateway instance to protect it or handle its own security and inter-instance communications.

This obviously isn't a complete solution, and it's a hell of a long way from a technical specification, but my hope is that others who are looking at the weird and wonderful landscape of our new internet are having similar concerns and reaching similar conclusions.

[–] disorderly@lemmy.world 8 points 1 day ago (1 children)

Can't speak for others, but my work performance is evaluated against a KPI specifically on LLM usage.

[–] disorderly@lemmy.world 3 points 3 days ago

My read was that waist size is the issue because the manufacturers have made it the issue. The idea you can derive the other dimensions as a function of waist size is clearly an assumption that has a limited range of validity, and there hasn't been a broader effort to come up with something better.

[–] disorderly@lemmy.world 2 points 1 week ago

It honestly sucks that some interesting structures are basically flags against the writer now. I personally love the rule of three, the Oxford comma, the semicolon to hang a dependent clause, and yes, even the now fucking pervasive em-dash. It's just one more thing that LLMs have ruined for us.