Selfhosted
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
-
Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
-
No spam posting.
-
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
-
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
-
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
-
No trolling.
-
No low-effort posts. This is subjective and will largely be determined by the community member reports.
Resources:
- selfh.st Newsletter and index of selfhosted software and apps
- awesome-selfhosted software
- awesome-sysadmin resources
- Self-Hosted Podcast from Jupiter Broadcasting
Any issues on the community? Report it using the report flag.
Questions? DM the mods!
view the rest of the comments
How much of that 50 terabytes is media downloaded from the Internet? Because the cheapest way would be to trust that it's already backed up on the Internet and then use one of the usual services like B2 by Backblaze or Storagebox by Hetzner to back the rest of it up.
This is a good compromise. When I was tight on backup space, I just had a “backup” script that ran nightly and wrote all the media file names to a text file and pushed that to my backup.
It would mean tons of redownloading if my storage array failed, but it was preferable to spending hundreds of dollars I didn't have on new hardware.
If you back up the modern day Arrs databases then it's essentially the same thing and already built into the software that will redownload them for you. That's my solution. I backup my backups of those, of my home assistant, my Immich library, my Nextcloud, etc... Pirated media is, for the most part, out there backed up on several places already.
This is what I do - well, I back up there entire container. But functionally the same.
There's only a few pieces of media that I have backed up manually due to their rarity, but even those I don't really care about.
But... can we trust that we will have stuff available on the internet in the future?
All my TV shows and movies, I don't bother. But my 150gb mp3 library I keep backed up because it's much smaller and I know some of that stuff is not readily available online.
Exactly. Regimes want to kill this as fast as they can to milk us of every penny witghr their shitty services. I dont trust any sites will stay up.
You can replicate across more than one provider and do automated regular monitoring that backups are still accessible.
If one goes down you hopefully have time to figure out a replacment before the other(s) do.
Probably not worth it for a bunch of xvid dvdrips or historical archives of full system-level backups but for critical data it's sensible.
It's kinda complicated because a good chunk of that is data that is technically redownloadable, but has been tweaked (most of my movies are a multiplexed high-res eng version merged with audio from lower-res dub.) Either way, thank you for the suggestions
I suggest making a script that uses existing software (ie mkvtoolnix) to extract the dubbed audio and then backing that up and l leaving the high quality video to the Web to backup.
I know it's less than ideal but you can automate both extracting it and muxing it back in. It may take some effort to setup, but it's well worth the huge recurring costs incurred from backing up that amount of data.
Just an idea to consider.
Yeah, if 90% of that is movies/shows, then you really don't need a backup of that as you can always re-download it. Then you have a 5TB backup problem which is much cheaper to solve.
That's a shit load of downloading. LOL wow!
I have 45TB of data and the majority of that is definitely downloaded media. They call us data hoarders for a reason.
Oh sure I understand data hoarding. I was just thinking, to restore 50 tb from the internet is going to take more than a fortnight.
It's literally downloading the same amount of data you would be backing up, and you won't be charged hourly for downloading it from the internet as opposed to a large storage service.
Imagine having to back up 50Tb to S3 :p
Not everyone has a symmetric connection.