Page 1 of 1
[SOLVED] ZFS says drives failing. How bad is it.
Posted: 01 Oct 2014 11:39
by navi
ZFS says drives failing. How bad is it. Please advice!!!
Hi All,
I help build my frind a NAS using all brand new hardware. Including the 3x brand new Segate Barracuda 2TB 7200RPM SATA3 Drives. Motherboard is Gigabyte GA-B85M-D3H with 3.2ghz intel i3 and 4GB GSKill RAM. The NAS is only 3 months old. From the first week onward ZFS Scrub finding and fixing few error. First one driver and slowly others. Now It is at a point where it can't even fix the data anymore.
we have backup of the data. Safety of the data is not in question at this point.
* How likely that all 3 brand new drives be failing so soon?
* Could the error be originating from somewhere else?
* Before we could successfully RMA the drives we have to prove to the shop that the drives are actually faulty and not other hardware/software or configuration is faking the Drive error. any suggestion how do we go around proving the drive failure?
* I am a ZFS noob. How bad are these numbes 2.33K, 2.37K, 2.24K etc?
* "scan: scrub repaired 444M" does this mean ZFS fixed 444Mbytes of data?
* In an imaginary scale of 1 to 100 (1=seriously bad, 100=ok), how bad is this situation? (in terms of hardware failure and future data lose) (data at this point is safe and well backed up)
Code: Select all
Pool information and status
pool: pool1
state: ONLINE
status: One or more devices has experienced an error resulting in data
corruption. Applications may be affected.
action: Restore the file in question if possible. Otherwise restore the
entire pool from backup.
see: http://illumos.org/msg/ZFS-8000-8A
scan: scrub repaired 444M in 1h8m with 1 errors on Tue Sep 30 16:53:42 2014
config:
NAME STATE READ WRITE CKSUM
pool1 ONLINE 0 0 1
raidz1-0 ONLINE 0 0 10
ada0.nop ONLINE 0 0 2.33K
ada1.nop ONLINE 0 0 2.37K
ada2.nop ONLINE 0 0 2.24K
errors: Permanent errors have been detected in the following files:
/mnt/pool1/dataset1/Movies/All Movies/of the Moon (2011) - 3D.mp4
Copyright © 2012-2014 The NAS4Free Project
Thanks & Regards,
navi
Re: ZFS says drives failing. How bad is it. Please advice!!!
Posted: 01 Oct 2014 12:06
by crowi
HI Navi,
first of all the Motherboard does not support ECC memory, which is mandatory if you want to use ZFS!!!
Please read here:
http://forums.freenas.org/index.php?thr ... zfs.15449/
* How likely that all 3 brand new drives be failing so soon?
Please post the SMART values of the disks
* Could the error be originating from somewhere else?
Yes, from the memory, please run memtest
and from a bad cable, vibrations, etc, please post (again) the SMART values and the dmesg output
* "scan: scrub repaired 444M" does this mean ZFS fixed 444Mbytes of data?
it found a fault and corrected it, yes
* In an imaginary scale of 1 to 100 (1=seriously bad, 100=ok), how bad is this situation?
1, (seriously bad) if you stick to non-ECC RAM.... please post the values (SMART & dmesg) for better jugdement of the situation.
Cheers,
Crowi
Re: ZFS says drives failing. How bad is it. Please advice!!!
Posted: 01 Oct 2014 13:00
by navi
Thank you for your reply "Crowi"
here are the S.M.A.R.T. Results. Please note there are 2x other drives ( 250GB & 1TB HDD /dev/ada3 & /dev/ada4) connected to the system. they are not part of ZFS Pool and are not in question.
Code: Select all
Device /dev/ada0 - Seagate Barracuda 7200.14 (AF)
=== START OF INFORMATION SECTION ===
Model Family: Seagate Barracuda 7200.14 (AF)
Device Model: ST2000DM001-1CH164
Serial Number: Z1E75XR8
LU WWN Device Id: 5 000c50 066187638
Firmware Version: CC27
User Capacity: 2,000,397,852,160 bytes [2.00 TB]
Sector Sizes: 512 bytes logical, 4096 bytes physical
Rotation Rate: 7200 rpm
Device is: In smartctl database [for details use: -P show]
ATA Version is: ACS-2, ACS-3 T13/2161-D revision 3b
SATA Version is: SATA 3.1, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is: Wed Oct 1 18:44:11 2014 UTC
==> WARNING: A firmware update for this drive may be available,
see the following Seagate web pages:
http://knowledge.seagate.com/articles/en_US/FAQ/207931en
http://knowledge.seagate.com/articles/en_US/FAQ/223651en
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
General SMART Values:
Offline data collection status: (0x00) Offline data collection activity
was never started.
Auto Offline Data Collection: Disabled.
Self-test execution status: ( 0) The previous self-test routine completed
without error or no self-test has ever
been run.
Total time to complete Offline
data collection: ( 584) seconds.
Offline data collection
capabilities: (0x73) SMART execute Offline immediate.
Auto Offline data collection on/off support.
Suspend Offline collection upon new
command.
No Offline surface scan supported.
Self-test supported.
Conveyance Self-test supported.
Selective Self-test supported.
SMART capabilities: (0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability: (0x01) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time: ( 1) minutes.
Extended self-test routine
recommended polling time: ( 223) minutes.
Conveyance self-test routine
recommended polling time: ( 2) minutes.
SCT capabilities: (0x3085) SCT Status supported.
SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE
1 Raw_Read_Error_Rate 0x000f 117 099 006 Pre-fail Always - 118572024
3 Spin_Up_Time 0x0003 096 096 000 Pre-fail Always - 0
4 Start_Stop_Count 0x0032 100 100 020 Old_age Always - 27
5 Reallocated_Sector_Ct 0x0033 100 100 010 Pre-fail Always - 0
7 Seek_Error_Rate 0x000f 070 060 030 Pre-fail Always - 11172943
9 Power_On_Hours 0x0032 096 096 000 Old_age Always - 4362
10 Spin_Retry_Count 0x0013 100 100 097 Pre-fail Always - 0
12 Power_Cycle_Count 0x0032 100 100 020 Old_age Always - 67
183 Runtime_Bad_Block 0x0032 100 100 000 Old_age Always - 0
184 End-to-End_Error 0x0032 100 100 099 Old_age Always - 0
187 Reported_Uncorrect 0x0032 100 100 000 Old_age Always - 0
188 Command_Timeout 0x0032 100 100 000 Old_age Always - 0 0 0
189 High_Fly_Writes 0x003a 100 100 000 Old_age Always - 0
190 Airflow_Temperature_Cel 0x0022 065 061 045 Old_age Always - 35 (Min/Max 29/39)
191 G-Sense_Error_Rate 0x0032 100 100 000 Old_age Always - 0
192 Power-Off_Retract_Count 0x0032 100 100 000 Old_age Always - 42
193 Load_Cycle_Count 0x0032 100 100 000 Old_age Always - 601
194 Temperature_Celsius 0x0022 035 040 000 Old_age Always - 35 (0 21 0 0 0)
197 Current_Pending_Sector 0x0012 100 100 000 Old_age Always - 0
198 Offline_Uncorrectable 0x0010 100 100 000 Old_age Offline - 0
199 UDMA_CRC_Error_Count 0x003e 200 200 000 Old_age Always - 0
240 Head_Flying_Hours 0x0000 100 253 000 Old_age Offline - 3309h+02m+56.988s
241 Total_LBAs_Written 0x0000 100 253 000 Old_age Offline - 2035255514
242 Total_LBAs_Read 0x0000 100 253 000 Old_age Offline - 7163421593
SMART Error Log Version: 1
No Errors Logged
SMART Self-test log structure revision number 1
No self-tests have been logged. [To run self-tests, use: smartctl -t]
SMART Selective self-test log data structure revision number 1
SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS
1 0 0 Not_testing
2 0 0 Not_testing
3 0 0 Not_testing
4 0 0 Not_testing
5 0 0 Not_testing
Selective self-test flags (0x0):
After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.
Device /dev/ada1 - Seagate Barracuda 7200.14 (AF)
=== START OF INFORMATION SECTION ===
Model Family: Seagate Barracuda 7200.14 (AF)
Device Model: ST2000DM001-1CH164
Serial Number: Z1E76C9S
LU WWN Device Id: 5 000c50 066187060
Firmware Version: CC27
User Capacity: 2,000,398,934,016 bytes [2.00 TB]
Sector Sizes: 512 bytes logical, 4096 bytes physical
Rotation Rate: 7200 rpm
Device is: In smartctl database [for details use: -P show]
ATA Version is: ACS-2, ACS-3 T13/2161-D revision 3b
SATA Version is: SATA 3.1, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is: Wed Oct 1 18:44:11 2014 UTC
==> WARNING: A firmware update for this drive may be available,
see the following Seagate web pages:
http://knowledge.seagate.com/articles/en_US/FAQ/207931en
http://knowledge.seagate.com/articles/en_US/FAQ/223651en
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
General SMART Values:
Offline data collection status: (0x00) Offline data collection activity
was never started.
Auto Offline Data Collection: Disabled.
Self-test execution status: ( 0) The previous self-test routine completed
without error or no self-test has ever
been run.
Total time to complete Offline
data collection: ( 575) seconds.
Offline data collection
capabilities: (0x73) SMART execute Offline immediate.
Auto Offline data collection on/off support.
Suspend Offline collection upon new
command.
No Offline surface scan supported.
Self-test supported.
Conveyance Self-test supported.
Selective Self-test supported.
SMART capabilities: (0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability: (0x01) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time: ( 1) minutes.
Extended self-test routine
recommended polling time: ( 220) minutes.
Conveyance self-test routine
recommended polling time: ( 2) minutes.
SCT capabilities: (0x3085) SCT Status supported.
SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE
1 Raw_Read_Error_Rate 0x000f 118 099 006 Pre-fail Always - 175136840
3 Spin_Up_Time 0x0003 096 096 000 Pre-fail Always - 0
4 Start_Stop_Count 0x0032 100 100 020 Old_age Always - 27
5 Reallocated_Sector_Ct 0x0033 100 100 010 Pre-fail Always - 0
7 Seek_Error_Rate 0x000f 070 060 030 Pre-fail Always - 11739102
9 Power_On_Hours 0x0032 095 095 000 Old_age Always - 4387
10 Spin_Retry_Count 0x0013 100 100 097 Pre-fail Always - 0
12 Power_Cycle_Count 0x0032 100 100 020 Old_age Always - 67
183 Runtime_Bad_Block 0x0032 100 100 000 Old_age Always - 0
184 End-to-End_Error 0x0032 100 100 099 Old_age Always - 0
187 Reported_Uncorrect 0x0032 100 100 000 Old_age Always - 0
188 Command_Timeout 0x0032 100 100 000 Old_age Always - 0 0 2
189 High_Fly_Writes 0x003a 100 100 000 Old_age Always - 0
190 Airflow_Temperature_Cel 0x0022 064 060 045 Old_age Always - 36 (Min/Max 29/39)
191 G-Sense_Error_Rate 0x0032 100 100 000 Old_age Always - 0
192 Power-Off_Retract_Count 0x0032 100 100 000 Old_age Always - 42
193 Load_Cycle_Count 0x0032 100 100 000 Old_age Always - 632
194 Temperature_Celsius 0x0022 036 040 000 Old_age Always - 36 (0 21 0 0 0)
197 Current_Pending_Sector 0x0012 100 100 000 Old_age Always - 0
198 Offline_Uncorrectable 0x0010 100 100 000 Old_age Offline - 0
199 UDMA_CRC_Error_Count 0x003e 200 200 000 Old_age Always - 5
240 Head_Flying_Hours 0x0000 100 253 000 Old_age Offline - 3315h+59m+45.729s
241 Total_LBAs_Written 0x0000 100 253 000 Old_age Offline - 2034739145
242 Total_LBAs_Read 0x0000 100 253 000 Old_age Offline - 7158951948
SMART Error Log Version: 1
No Errors Logged
SMART Self-test log structure revision number 1
No self-tests have been logged. [To run self-tests, use: smartctl -t]
SMART Selective self-test log data structure revision number 1
SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS
1 0 0 Not_testing
2 0 0 Not_testing
3 0 0 Not_testing
4 0 0 Not_testing
5 0 0 Not_testing
Selective self-test flags (0x0):
After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.
Device /dev/ada2 - Seagate Barracuda 7200.14 (AF)
=== START OF INFORMATION SECTION ===
Model Family: Seagate Barracuda 7200.14 (AF)
Device Model: ST2000DM001-1CH164
Serial Number: Z340KNX4
LU WWN Device Id: 5 000c50 0652d239f
Firmware Version: CC27
User Capacity: 2,000,398,934,016 bytes [2.00 TB]
Sector Sizes: 512 bytes logical, 4096 bytes physical
Rotation Rate: 7200 rpm
Device is: In smartctl database [for details use: -P show]
ATA Version is: ACS-2, ACS-3 T13/2161-D revision 3b
SATA Version is: SATA 3.1, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is: Wed Oct 1 18:44:11 2014 UTC
==> WARNING: A firmware update for this drive may be available,
see the following Seagate web pages:
http://knowledge.seagate.com/articles/en_US/FAQ/207931en
http://knowledge.seagate.com/articles/en_US/FAQ/223651en
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
General SMART Values:
Offline data collection status: (0x00) Offline data collection activity
was never started.
Auto Offline Data Collection: Disabled.
Self-test execution status: ( 0) The previous self-test routine completed
without error or no self-test has ever
been run.
Total time to complete Offline
data collection: ( 592) seconds.
Offline data collection
capabilities: (0x73) SMART execute Offline immediate.
Auto Offline data collection on/off support.
Suspend Offline collection upon new
command.
No Offline surface scan supported.
Self-test supported.
Conveyance Self-test supported.
Selective Self-test supported.
SMART capabilities: (0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability: (0x01) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time: ( 1) minutes.
Extended self-test routine
recommended polling time: ( 227) minutes.
Conveyance self-test routine
recommended polling time: ( 2) minutes.
SCT capabilities: (0x3085) SCT Status supported.
SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE
1 Raw_Read_Error_Rate 0x000f 117 099 006 Pre-fail Always - 135125512
3 Spin_Up_Time 0x0003 094 094 000 Pre-fail Always - 0
4 Start_Stop_Count 0x0032 100 100 020 Old_age Always - 29
5 Reallocated_Sector_Ct 0x0033 100 100 010 Pre-fail Always - 0
7 Seek_Error_Rate 0x000f 070 060 030 Pre-fail Always - 11332376
9 Power_On_Hours 0x0032 096 096 000 Old_age Always - 4363
10 Spin_Retry_Count 0x0013 100 100 097 Pre-fail Always - 0
12 Power_Cycle_Count 0x0032 100 100 020 Old_age Always - 69
183 Runtime_Bad_Block 0x0032 100 100 000 Old_age Always - 0
184 End-to-End_Error 0x0032 100 100 099 Old_age Always - 0
187 Reported_Uncorrect 0x0032 100 100 000 Old_age Always - 0
188 Command_Timeout 0x0032 100 100 000 Old_age Always - 0 0 0
189 High_Fly_Writes 0x003a 100 100 000 Old_age Always - 0
190 Airflow_Temperature_Cel 0x0022 062 058 045 Old_age Always - 38 (Min/Max 31/42)
191 G-Sense_Error_Rate 0x0032 100 100 000 Old_age Always - 0
192 Power-Off_Retract_Count 0x0032 100 100 000 Old_age Always - 44
193 Load_Cycle_Count 0x0032 100 100 000 Old_age Always - 621
194 Temperature_Celsius 0x0022 038 042 000 Old_age Always - 38 (0 21 0 0 0)
197 Current_Pending_Sector 0x0012 100 100 000 Old_age Always - 0
198 Offline_Uncorrectable 0x0010 100 100 000 Old_age Offline - 0
199 UDMA_CRC_Error_Count 0x003e 200 200 000 Old_age Always - 0
240 Head_Flying_Hours 0x0000 100 253 000 Old_age Offline - 3308h+56m+15.292s
241 Total_LBAs_Written 0x0000 100 253 000 Old_age Offline - 2036108257
242 Total_LBAs_Read 0x0000 100 253 000 Old_age Offline - 7159544807
SMART Error Log Version: 1
No Errors Logged
SMART Self-test log structure revision number 1
No self-tests have been logged. [To run self-tests, use: smartctl -t]
SMART Selective self-test log data structure revision number 1
SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS
1 0 0 Not_testing
2 0 0 Not_testing
3 0 0 Not_testing
4 0 0 Not_testing
5 0 0 Not_testing
Selective self-test flags (0x0):
After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.
Device /dev/ada3 - Hitachi Deskstar 7K1000.C
=== START OF INFORMATION SECTION ===
Model Family: Hitachi Deskstar 7K1000.C
Device Model: Hitachi HDS721010CLA332
Serial Number: JP2940HQ3R6E3H
LU WWN Device Id: 5 000cca 35df45ec9
Firmware Version: JP4OA3EA
User Capacity: 1,000,203,804,160 bytes [1.00 TB]
Sector Size: 512 bytes logical/physical
Rotation Rate: 7200 rpm
Device is: In smartctl database [for details use: -P show]
ATA Version is: ATA8-ACS T13/1699-D revision 4
SATA Version is: SATA 2.6, 3.0 Gb/s
Local Time is: Wed Oct 1 18:44:11 2014 UTC
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
General SMART Values:
Offline data collection status: (0x80) Offline data collection activity
was never started.
Auto Offline Data Collection: Enabled.
Self-test execution status: ( 0) The previous self-test routine completed
without error or no self-test has ever
been run.
Total time to complete Offline
data collection: ( 9811) seconds.
Offline data collection
capabilities: (0x5b) SMART execute Offline immediate.
Auto Offline data collection on/off support.
Suspend Offline collection upon new
command.
Offline surface scan supported.
Self-test supported.
No Conveyance Self-test supported.
Selective Self-test supported.
SMART capabilities: (0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability: (0x01) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time: ( 1) minutes.
Extended self-test routine
recommended polling time: ( 164) minutes.
SCT capabilities: (0x003d) SCT Status supported.
SCT Error Recovery Control supported.
SCT Feature Control supported.
SCT Data Table supported.
SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE
1 Raw_Read_Error_Rate 0x000b 095 095 016 Pre-fail Always - 589829
2 Throughput_Performance 0x0005 135 135 054 Pre-fail Offline - 97
3 Spin_Up_Time 0x0007 121 121 024 Pre-fail Always - 314 (Average 311)
4 Start_Stop_Count 0x0012 100 100 000 Old_age Always - 703
5 Reallocated_Sector_Ct 0x0033 100 100 005 Pre-fail Always - 0
7 Seek_Error_Rate 0x000b 100 100 067 Pre-fail Always - 0
8 Seek_Time_Performance 0x0005 138 138 020 Pre-fail Offline - 31
9 Power_On_Hours 0x0012 100 100 000 Old_age Always - 5299
10 Spin_Retry_Count 0x0013 100 100 060 Pre-fail Always - 0
12 Power_Cycle_Count 0x0032 100 100 000 Old_age Always - 696
192 Power-Off_Retract_Count 0x0032 100 100 000 Old_age Always - 867
193 Load_Cycle_Count 0x0012 100 100 000 Old_age Always - 867
194 Temperature_Celsius 0x0002 176 176 000 Old_age Always - 34 (Min/Max 15/41)
196 Reallocated_Event_Count 0x0032 100 100 000 Old_age Always - 0
197 Current_Pending_Sector 0x0022 100 100 000 Old_age Always - 0
198 Offline_Uncorrectable 0x0008 100 100 000 Old_age Offline - 0
199 UDMA_CRC_Error_Count 0x000a 200 200 000 Old_age Always - 1
SMART Error Log Version: 0
No Errors Logged
SMART Self-test log structure revision number 1
No self-tests have been logged. [To run self-tests, use: smartctl -t]
SMART Selective self-test log data structure revision number 1
SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS
1 0 0 Not_testing
2 0 0 Not_testing
3 0 0 Not_testing
4 0 0 Not_testing
5 0 0 Not_testing
Selective self-test flags (0x0):
After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.
Device /dev/ada4 - Hitachi Deskstar T7K250
=== START OF INFORMATION SECTION ===
Model Family: Hitachi Deskstar T7K250
Device Model: HDT722525DLA380
Serial Number: VDS41DT4FHDXAJ
LU WWN Device Id: 5 000cca 20bf1488e
Firmware Version: V44OA9BA
User Capacity: 250,059,350,016 bytes [250 GB]
Sector Size: 512 bytes logical/physical
Device is: In smartctl database [for details use: -P show]
ATA Version is: ATA/ATAPI-7 T13/1532D revision 1
Local Time is: Wed Oct 1 18:44:12 2014 UTC
SMART support is: Available - device has SMART capability.
SMART support is: Disabled
SMART Disabled. Use option -s with argument 'on' to enable it.
(override with '-T permissive' option)
Copyright ? 2012-2014 The NAS4Free Project
Re: ZFS says drives failing. How bad is it. Please advice!!!
Posted: 01 Oct 2014 13:07
by raulfg3
Re: ZFS says drives failing. How bad is it. Please advice!!!
Posted: 01 Oct 2014 13:09
by b0ssman
smart looks fine.
however
ada1
199 UDMA_CRC_Error_Count 0x003e 200 200 000 Old_age Always - 5
mean that the sata cable needs to be changed.
ada3 same sata cable error.
199 UDMA_CRC_Error_Count 0x000a 200 200 000 Old_age Always - 1
Re: ZFS says drives failing. How bad is it. Please advice!!!
Posted: 01 Oct 2014 13:11
by b0ssman
thats a seagate drive.
the seagate number is a special number that is not a decimal number
see
http://www.users.on.net/~fzabkar/HDD/Se ... R_HEC.html
Re: ZFS says drives failing. How bad is it. Please advice!!!
Posted: 01 Oct 2014 13:30
by navi
Hi All,
Thanks very much for all your suggestions. Running Memtest with Memtest86+ V5.01 from (
http://www.memtest.org). will post the result of changing SATA Cable and Memtest as soon as they are available.
Regards,
Navi
Re: ZFS says drives failing. How bad is it. Please advice!!!
Posted: 01 Oct 2014 13:39
by b0ssman
get sata cables with Locking Latch
Re: ZFS says drives failing. How bad is it. Please advice!!!
Posted: 01 Oct 2014 14:06
by navi
memtest not looking good!
memtest.jpg
Re: ZFS says drives failing. How bad is it. Please advice!!!
Posted: 01 Oct 2014 14:40
by b0ssman
so you ran a scrub with bad memory....
you might have destroyed some of your data, no way to know for sure.
Re: ZFS says drives failing. How bad is it. Please advice!!!
Posted: 01 Oct 2014 14:59
by crowi
If you buy new RAM, take ECC RAM and a mainboard which supports it.
Or get a HPN54L, which is already equipped with 4GB ECC
Re: ZFS says drives failing. How bad is it. Please advice!!!
Posted: 01 Oct 2014 15:45
by navi
b0ssman wrote:so you ran a scrub with bad memory.... you might have destroyed some of your data, no way to know for sure.
Yes. Not "a" scrub. Many, many scrubs to be honest! almost one every week or so. Fortunately though, data is still available from the systems they originated from before coming into this pool. So we can restore the pool with quite confidence after sorted out the memory issue.
After solving the memory issue, should I ran few more scrub on this damage data, just to see if hdd produce any farther read errors or not? after scrub starts to return 0 errors, we can destroy the pool and recreate it from original sources.
crowi wrote:If you buy new RAM, take ECC RAM and a mainboard which supports it.
Or get a HPN54L, which is already equipped with 4GB ECC
Yes. after this lesson, ECC does look essential then ever for ZFS. But to be honest, I was dumb not to run a memtest before I started with the NAS/nas4free/zfs/pool. usual assumption was if memory was bad, OS will crash and burn and will be apparent from the get go. Didn't realize that OS can happily churn away with hidden bad memory and storage get destroyed from it. Biggest hurdle with ECC Memory though, not a lot desktop boards supports ECC and most of my builds are desktop centric. But lesson learned.
Once again, Thank you very much and I really appreciate the quick and effective response from all you guys.
regards,
navi