Selfhosted

61734 readers

445 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Detailed Rules Post

Be civil.
No spam.
Posts are to be related to self-hosting.
Don't duplicate the full text of your blog or readme if you're providing a link.
Submission headline should match the article title.
No trolling.
Promotion posts require active participation, with an account that is at least 30 days old. F/LOSS without a paywall has exceptions, with requirements. See the rules link for details. Tags [CBH] or [AIP] are required, see the links in Rule 8 for details.
AI-related discussions and AI-involved promotional posts have additional requirements for tagging, as noted in Rule 7 and the AI & Promotional Post Expanded Rules post, and find example disclosures here.

Resources:

selfh.st Newsletter and index of selfhosted software and apps
awesome-selfhosted software
awesome-sysadmin resources
Self-Hosted Podcast from Jupiter Broadcasting

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 3 years ago

MODERATORS

curbstickle@anarchist.nexus

curbstickle_lw@lemmy.world

259

Docker Hub limiting unauthenticated users to 10 pulls per hour (docs.docker.com)

submitted 2 years ago by lepinkainen@lemmy.world to c/selfhosted@lemmy.world

48 comments fedilink hide all child comments

AFAIK every NAS just uses unauthenticated connections to pull containers, I'm not sure how many actually allow you to log in even (raising the limit to a whopping 40 per hour).

So hopefully systems like /r/unRAID handle the throttling gracefully when clicking "update all".

Anyone have ideas on how to set up a local docker hub proxy to keep the most common containers on-site instead of hitting docker hub every time?

you are viewing a single comment's thread
view the rest of the comments

[–] PassingThrough@lemm.ee 29 points 2 years ago (2 children)

Huh. I was just considering establishing a caching registry for other reasons. Ferb, I know what we’re going to do today!

[–] Daughter3546@lemmy.world 4 points 2 years ago (2 children)

Do you have a good resource for how one can go about this?

[–] PassingThrough@lemm.ee 8 points 2 years ago (2 children)

I’ve only done my “is it even possible” research so far, but these look promising:

https://medium.com/@amandubey_6607/docker-registry-caching-a2dfefecfff5

https://github.com/obeone/multi-registry-cache

[–] carzian@lemmy.ml 3 points 2 years ago

https://www.squid-cache.org/ Should work too I think

[–] Daughter3546@lemmy.world 2 points 2 years ago

Much appreciated <3

[–] jaxxed@lemmy.ml 6 points 2 years ago (1 children)

You can host your own with harbor, and set up replication per repo (pull upstream tags) If you need a commercial product/support you can use MSR v4.

Harbor can install on any K8s cluster using helm, with just a couple of dependencies (cert-manager, postgres op, redis-op) Replication stuff you can easily add.

I have some no-warranty terraform I could share if there is some interest.

[–] femtech@midwest.social 1 points 2 years ago

That's what we do internally for our openshift deployment. It will reach out if not in harbor and then cache it there for everyone else to use.

[–] Uli@sopuli.xyz 1 points 2 years ago

Same here. I've been building a bootstrap script, and each time I test it, it tears down the whole cluster and starts from scratch, pulling all of the images again. Every time I hit the Docker pull limit after 10 - 12 hours of work, I treat that as my "that's enough work for today" signal. I'm going to need to set up a caching system ASAP or the hours I work on this project are about to suddenly get a lot shorter.