this post was submitted on 30 Dec 2025
69 points (97.3% liked)

Selfhosted

54041 readers
525 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

  7. No low-effort posts. This is subjective and will largely be determined by the community member reports.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 2 years ago
MODERATORS
 

Hey everyone,

I recently built my first NAS. It was bough used with SAS hardware. I've finally got past all the roadblocks and problems that were in my way (I basically bricked a whole SAS drive, a hero of a lemmy user helped me fix it).

Now after filling the 15 TB of RAIDZ2 with around 100gb of data. One of the drives started waiving its white flag and wants to die on me.

I am a complete beginner with no experience with these things.

Is my drive dying and should be replaced? or can it be fixed?

This is the output of the 507 errors that TrueNAS received form it and labelled the vDev as degraded and the drive as faulted:

Output of zpool status and sudo smartctl -a /dev/sdd

As a beginner it looks like this drive is cooked, please let me know if it needs replacing so I can order a new one and replace it right away.

Thank you sooo much!

Edit: SAS not SATA drives

top 21 comments
sorted by: hot top controversial new old
[–] SapphironZA@sh.itjust.works 3 points 12 hours ago* (last edited 12 hours ago)

My rule for older hardware, before trusting the ZFS fault reporting, I would follow the following steps.

(Note these are homelabber steps and not what I would do in the enterprise, where risk and time is a lot more expensive than replacing hardware)

  1. Check the Smart data of the drive. If it reports the drive as faulty, replace it.

  2. Zpool clear the error and see if it comes back. Sometimes drive errors are not cause by the drive itself

  3. Reseat the drive and the cables between the motherboard and the drive. Clear errors after this step. Especially with older hardware and it having travelled from its previous owner to you, something might not be seated properly.

  4. Move the drive to another drive bay, or swap it with another drive. If the errors move with the drive, the drive is faulty. If the errors move to the bay, you probably have a good drive, but a faulty drive bay/cable.

[–] SapphironZA@sh.itjust.works 2 points 12 hours ago

In addition to other advice, with only hardware, have 1 cold spare drive for every 2 years of remaining life of the hardware. It gets difficult to find similar spec drives the older they get. So if you want to use the drives in the NAS for another 4 years, get 2 spares. After that you start getting into the territory of replacing the drives anyway.

[–] sakphul@discuss.tchncs.de 2 points 14 hours ago

I had similar problems with a single Drive in a new TrueNAS setup. The Drive would come up healthy after most reboots but after some reboots it was unhealthy. For me S.M.A.R.T data die not indicate and errors. I reboot the Maschine often because it is a backup system that only runs during backups.

Swapping drives (with a known gold drive) did not resolve it. The error was always at the same Drivebay.

For me thepProblem was the y-split SATA power cable I used. After replacing it the system is working without a problem since.

[–] BarbecueCowboy@lemmy.dbzer0.com 28 points 1 day ago (1 children)

An extra perspective, hard drive prices are mostly expected to get even worse next year.

It may hold on for months to years but all drives will likely die eventually and this one is giving you a warning, I'd replace it now and save some money if you can afford it.

[–] scrubbles@poptalk.scrubbles.tech 11 points 1 day ago* (last edited 1 day ago)

For everyone here, this is true, and I'd recommend buying a couple drives for quick replacements. If you don't you're gambling that 1) a replacement drive will be available and 2) that it will be affordable.

Keep a few spares lying around while we get through the ebbs and flows of the market. As K said, a person is smart, people are dumb and panicky. If ssd and storage prices rise, people panic and our hdds will rise too.

Prep now and thank yourself later.

[–] Lemmchen@feddit.org 6 points 1 day ago

Does this drive not have SMART values? Could be a loose cable for all we know (UDMA CRC errors).

[–] non_burglar@lemmy.world 20 points 1 day ago

zpool has very reasonable thresholds for disk failure being enough to kick it from the pool. I've seen pool members have a batch of bad blocks and ZFS still chugged along for a few years just avoiding those blocks before the disk finally failed.

Heed truenas here, replace the disk if you can.

[–] frongt@lemmy.zip 16 points 1 day ago (2 children)

Not necessarily. I would shut the system down completely and check the drive connectors. If it's on a backplane, try swapping slots, or if it's breakout connector, swap it with another drive (and clear the zpool errors). If the errors start happening on the other drive, it's a cable problem. If they continue on the same drive, it's a drive problem. If they stop happening, it was a bad connection and it ought to be fine now.

That's kind of a short output from smartctl -a, though. Shouldn't it include the attribute data? I'd run a smart test (after doing the swap above) and see what it says.

On a raidz2, I wouldn't be too concerned about losing a drive, but you should always be prepared to order a replacement if you value your data.

[–] ragebutt@lemmy.dbzer0.com 4 points 1 day ago

I would bet money that drive is done. Cable would be udma crc errors, not media failure. Drive made it 11 years (even if power on time is only about half of that)

[–] s38b35M5@lemmy.world 4 points 1 day ago (2 children)

I second this. SATA cables are cheaply made and can present issues that seem to indicate drive failure.

[–] BigDaddySlim@lemmy.world 3 points 1 day ago

Had this issue once, 2 drives kept not initializing during boot, rebooting a few times got them to register but showed drive errors. I thought either the drives or my SAS card was dying. Fully reseating the connectors fixed it and haven't had an issue since.

[–] frongt@lemmy.zip 2 points 1 day ago (1 children)

OP is using SAS, but it's not too far from SATA.

[–] s38b35M5@lemmy.world 1 points 8 hours ago* (last edited 8 hours ago)

Good catch. I don't usually see SAS as /dev/sd* so I assumed. Almost the same cables, though *usually better made.

[–] CubitOom@infosec.pub 3 points 1 day ago* (last edited 1 day ago) (2 children)

42441.67 powered on hours is really young for drive death, I normally don't start seeing issues till 50k.

Is it making any audible sounds while running?

I haven't read the smart data for Seagate in a while but the errors numbers look off and would like to see more details. Haveing errors in itself doesn't mean much. Normally I look for Reallocated Sector Count, Seek Error Rate, and Uncorrectable Sector Count. But here it's not telling the details like the types of errors.

Maybe try sudo smartctl -all /dev/sdd not sure if the -a you used is being interpreteded correctly?

[–] suzune@ani.social 1 points 1 day ago

I'm also missing the smart tabular output here, because it's easier to read and allows to inspect the source of the errors. Maybe it's because it's SAS?

[–] ryannathans@aussie.zone 1 points 1 day ago* (last edited 1 day ago) (2 children)

sudo? -all?

I'm going to assume truenas is entirely Linux based now because last time I worked on it, it was FreeBSD and it was smartctl -x /dev/ada3 as root

[–] eli@lemmy.world 3 points 20 hours ago* (last edited 20 hours ago)

Kind of, TrueNAS has "CORE" which is FreeBSD and "SCALE" which is Linux.

If you're on CORE 13.X you can actually side-grade over to SCALE.

CORE is in maintenance only and SCALE is the path forward. So you can still get some updates on CORE I think, but everyone should be switching over to SCALE or using SCALE from here on out.

[–] suzune@ani.social 0 points 1 day ago (1 children)

On FreeBSD it's also -a or -A for shorter output.

[–] ryannathans@aussie.zone 1 points 1 day ago

-a is limited for legacy compatibility, -x is the new all

Buy two replacements

Just RMA it now. If it has SMART failures, you can provide the codes and they'll replace it no problem.