[SOLVED] ZFS says drives failing. How bad is it.

navi · Post by **navi** » 01 Oct 2014 11:39

ZFS says drives failing. How bad is it. Please advice!!!

Hi All,

I help build my frind a NAS using all brand new hardware. Including the 3x brand new Segate Barracuda 2TB 7200RPM SATA3 Drives. Motherboard is Gigabyte GA-B85M-D3H with 3.2ghz intel i3 and 4GB GSKill RAM. The NAS is only 3 months old. From the first week onward ZFS Scrub finding and fixing few error. First one driver and slowly others. Now It is at a point where it can't even fix the data anymore. we have backup of the data. Safety of the data is not in question at this point.

* How likely that all 3 brand new drives be failing so soon?

* Could the error be originating from somewhere else?

* Before we could successfully RMA the drives we have to prove to the shop that the drives are actually faulty and not other hardware/software or configuration is faking the Drive error. any suggestion how do we go around proving the drive failure?

* I am a ZFS noob. How bad are these numbes 2.33K, 2.37K, 2.24K etc?

* "scan: scrub repaired 444M" does this mean ZFS fixed 444Mbytes of data?

* In an imaginary scale of 1 to 100 (1=seriously bad, 100=ok), how bad is this situation? (in terms of hardware failure and future data lose) (data at this point is safe and well backed up)

Code: Select all

Pool information and status

  pool: pool1
 state: ONLINE
status: One or more devices has experienced an error resulting in data
	corruption.  Applications may be affected.
action: Restore the file in question if possible.  Otherwise restore the
	entire pool from backup.
   see: http://illumos.org/msg/ZFS-8000-8A
  scan: scrub repaired 444M in 1h8m with 1 errors on Tue Sep 30 16:53:42 2014
config:

	NAME          STATE     READ WRITE CKSUM
	pool1         ONLINE       0     0     1
	  raidz1-0    ONLINE       0     0    10
	    ada0.nop  ONLINE       0     0 2.33K
	    ada1.nop  ONLINE       0     0 2.37K
	    ada2.nop  ONLINE       0     0 2.24K

errors: Permanent errors have been detected in the following files:

        /mnt/pool1/dataset1/Movies/All Movies/of the Moon (2011) - 3D.mp4

Copyright © 2012-2014 The NAS4Free Project

Thanks & Regards,
navi

Post by **crowi** » 01 Oct 2014 12:06

HI Navi,

first of all the Motherboard does not support ECC memory, which is mandatory if you want to use ZFS!!!
Please read here: http://forums.freenas.org/index.php?thr ... zfs.15449/

* How likely that all 3 brand new drives be failing so soon?

Please post the SMART values of the disks

* Could the error be originating from somewhere else?

Yes, from the memory, please run memtest
and from a bad cable, vibrations, etc, please post (again) the SMART values and the dmesg output

* "scan: scrub repaired 444M" does this mean ZFS fixed 444Mbytes of data?

it found a fault and corrected it, yes

* In an imaginary scale of 1 to 100 (1=seriously bad, 100=ok), how bad is this situation?

1, (seriously bad) if you stick to non-ECC RAM.... please post the values (SMART & dmesg) for better jugdement of the situation.

Cheers,
Crowi

navi · Post by **navi** » 01 Oct 2014 13:00

Thank you for your reply "Crowi"

here are the S.M.A.R.T. Results. Please note there are 2x other drives ( 250GB & 1TB HDD /dev/ada3 & /dev/ada4) connected to the system. they are not part of ZFS Pool and are not in question.

Code: Select all

Device /dev/ada0 - Seagate Barracuda 7200.14 (AF)

=== START OF INFORMATION SECTION ===
Model Family:     Seagate Barracuda 7200.14 (AF)
Device Model:     ST2000DM001-1CH164
Serial Number:    Z1E75XR8
LU WWN Device Id: 5 000c50 066187638
Firmware Version: CC27
User Capacity:    2,000,397,852,160 bytes [2.00 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    7200 rpm
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   ACS-2, ACS-3 T13/2161-D revision 3b
SATA Version is:  SATA 3.1, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Wed Oct  1 18:44:11 2014 UTC

==> WARNING: A firmware update for this drive may be available,
see the following Seagate web pages:
http://knowledge.seagate.com/articles/en_US/FAQ/207931en
http://knowledge.seagate.com/articles/en_US/FAQ/223651en

SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x00)	Offline data collection activity
					was never started.
					Auto Offline Data Collection: Disabled.
Self-test execution status:      (   0)	The previous self-test routine completed
					without error or no self-test has ever
					been run.
Total time to complete Offline
data collection: 		(  584) seconds.
Offline data collection
capabilities: 			 (0x73) SMART execute Offline immediate.
					Auto Offline data collection on/off support.
					Suspend Offline collection upon new
					command.
					No Offline surface scan supported.
					Self-test supported.
					Conveyance Self-test supported.
					Selective Self-test supported.
SMART capabilities:            (0x0003)	Saves SMART data before entering
					power-saving mode.
					Supports SMART auto save timer.
Error logging capability:        (0x01)	Error logging supported.
					General Purpose Logging supported.
Short self-test routine
recommended polling time: 	 (   1) minutes.
Extended self-test routine
recommended polling time: 	 ( 223) minutes.
Conveyance self-test routine
recommended polling time: 	 (   2) minutes.
SCT capabilities: 	       (0x3085)	SCT Status supported.

SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x000f   117   099   006    Pre-fail  Always       -       118572024
  3 Spin_Up_Time            0x0003   096   096   000    Pre-fail  Always       -       0
  4 Start_Stop_Count        0x0032   100   100   020    Old_age   Always       -       27
  5 Reallocated_Sector_Ct   0x0033   100   100   010    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x000f   070   060   030    Pre-fail  Always       -       11172943
  9 Power_On_Hours          0x0032   096   096   000    Old_age   Always       -       4362
 10 Spin_Retry_Count        0x0013   100   100   097    Pre-fail  Always       -       0
 12 Power_Cycle_Count       0x0032   100   100   020    Old_age   Always       -       67
183 Runtime_Bad_Block       0x0032   100   100   000    Old_age   Always       -       0
184 End-to-End_Error        0x0032   100   100   099    Old_age   Always       -       0
187 Reported_Uncorrect      0x0032   100   100   000    Old_age   Always       -       0
188 Command_Timeout         0x0032   100   100   000    Old_age   Always       -       0 0 0
189 High_Fly_Writes         0x003a   100   100   000    Old_age   Always       -       0
190 Airflow_Temperature_Cel 0x0022   065   061   045    Old_age   Always       -       35 (Min/Max 29/39)
191 G-Sense_Error_Rate      0x0032   100   100   000    Old_age   Always       -       0
192 Power-Off_Retract_Count 0x0032   100   100   000    Old_age   Always       -       42
193 Load_Cycle_Count        0x0032   100   100   000    Old_age   Always       -       601
194 Temperature_Celsius     0x0022   035   040   000    Old_age   Always       -       35 (0 21 0 0 0)
197 Current_Pending_Sector  0x0012   100   100   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0010   100   100   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x003e   200   200   000    Old_age   Always       -       0
240 Head_Flying_Hours       0x0000   100   253   000    Old_age   Offline      -       3309h+02m+56.988s
241 Total_LBAs_Written      0x0000   100   253   000    Old_age   Offline      -       2035255514
242 Total_LBAs_Read         0x0000   100   253   000    Old_age   Offline      -       7163421593

SMART Error Log Version: 1
No Errors Logged

SMART Self-test log structure revision number 1
No self-tests have been logged.  [To run self-tests, use: smartctl -t]


SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

Device /dev/ada1 - Seagate Barracuda 7200.14 (AF)

=== START OF INFORMATION SECTION ===
Model Family:     Seagate Barracuda 7200.14 (AF)
Device Model:     ST2000DM001-1CH164
Serial Number:    Z1E76C9S
LU WWN Device Id: 5 000c50 066187060
Firmware Version: CC27
User Capacity:    2,000,398,934,016 bytes [2.00 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    7200 rpm
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   ACS-2, ACS-3 T13/2161-D revision 3b
SATA Version is:  SATA 3.1, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Wed Oct  1 18:44:11 2014 UTC

==> WARNING: A firmware update for this drive may be available,
see the following Seagate web pages:
http://knowledge.seagate.com/articles/en_US/FAQ/207931en
http://knowledge.seagate.com/articles/en_US/FAQ/223651en

SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x00)	Offline data collection activity
					was never started.
					Auto Offline Data Collection: Disabled.
Self-test execution status:      (   0)	The previous self-test routine completed
					without error or no self-test has ever
					been run.
Total time to complete Offline
data collection: 		(  575) seconds.
Offline data collection
capabilities: 			 (0x73) SMART execute Offline immediate.
					Auto Offline data collection on/off support.
					Suspend Offline collection upon new
					command.
					No Offline surface scan supported.
					Self-test supported.
					Conveyance Self-test supported.
					Selective Self-test supported.
SMART capabilities:            (0x0003)	Saves SMART data before entering
					power-saving mode.
					Supports SMART auto save timer.
Error logging capability:        (0x01)	Error logging supported.
					General Purpose Logging supported.
Short self-test routine
recommended polling time: 	 (   1) minutes.
Extended self-test routine
recommended polling time: 	 ( 220) minutes.
Conveyance self-test routine
recommended polling time: 	 (   2) minutes.
SCT capabilities: 	       (0x3085)	SCT Status supported.

SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x000f   118   099   006    Pre-fail  Always       -       175136840
  3 Spin_Up_Time            0x0003   096   096   000    Pre-fail  Always       -       0
  4 Start_Stop_Count        0x0032   100   100   020    Old_age   Always       -       27
  5 Reallocated_Sector_Ct   0x0033   100   100   010    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x000f   070   060   030    Pre-fail  Always       -       11739102
  9 Power_On_Hours          0x0032   095   095   000    Old_age   Always       -       4387
 10 Spin_Retry_Count        0x0013   100   100   097    Pre-fail  Always       -       0
 12 Power_Cycle_Count       0x0032   100   100   020    Old_age   Always       -       67
183 Runtime_Bad_Block       0x0032   100   100   000    Old_age   Always       -       0
184 End-to-End_Error        0x0032   100   100   099    Old_age   Always       -       0
187 Reported_Uncorrect      0x0032   100   100   000    Old_age   Always       -       0
188 Command_Timeout         0x0032   100   100   000    Old_age   Always       -       0 0 2
189 High_Fly_Writes         0x003a   100   100   000    Old_age   Always       -       0
190 Airflow_Temperature_Cel 0x0022   064   060   045    Old_age   Always       -       36 (Min/Max 29/39)
191 G-Sense_Error_Rate      0x0032   100   100   000    Old_age   Always       -       0
192 Power-Off_Retract_Count 0x0032   100   100   000    Old_age   Always       -       42
193 Load_Cycle_Count        0x0032   100   100   000    Old_age   Always       -       632
194 Temperature_Celsius     0x0022   036   040   000    Old_age   Always       -       36 (0 21 0 0 0)
197 Current_Pending_Sector  0x0012   100   100   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0010   100   100   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x003e   200   200   000    Old_age   Always       -       5
240 Head_Flying_Hours       0x0000   100   253   000    Old_age   Offline      -       3315h+59m+45.729s
241 Total_LBAs_Written      0x0000   100   253   000    Old_age   Offline      -       2034739145
242 Total_LBAs_Read         0x0000   100   253   000    Old_age   Offline      -       7158951948

SMART Error Log Version: 1
No Errors Logged

SMART Self-test log structure revision number 1
No self-tests have been logged.  [To run self-tests, use: smartctl -t]


SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

Device /dev/ada2 - Seagate Barracuda 7200.14 (AF)

=== START OF INFORMATION SECTION ===
Model Family:     Seagate Barracuda 7200.14 (AF)
Device Model:     ST2000DM001-1CH164
Serial Number:    Z340KNX4
LU WWN Device Id: 5 000c50 0652d239f
Firmware Version: CC27
User Capacity:    2,000,398,934,016 bytes [2.00 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    7200 rpm
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   ACS-2, ACS-3 T13/2161-D revision 3b
SATA Version is:  SATA 3.1, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Wed Oct  1 18:44:11 2014 UTC

==> WARNING: A firmware update for this drive may be available,
see the following Seagate web pages:
http://knowledge.seagate.com/articles/en_US/FAQ/207931en
http://knowledge.seagate.com/articles/en_US/FAQ/223651en

SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x00)	Offline data collection activity
					was never started.
					Auto Offline Data Collection: Disabled.
Self-test execution status:      (   0)	The previous self-test routine completed
					without error or no self-test has ever
					been run.
Total time to complete Offline
data collection: 		(  592) seconds.
Offline data collection
capabilities: 			 (0x73) SMART execute Offline immediate.
					Auto Offline data collection on/off support.
					Suspend Offline collection upon new
					command.
					No Offline surface scan supported.
					Self-test supported.
					Conveyance Self-test supported.
					Selective Self-test supported.
SMART capabilities:            (0x0003)	Saves SMART data before entering
					power-saving mode.
					Supports SMART auto save timer.
Error logging capability:        (0x01)	Error logging supported.
					General Purpose Logging supported.
Short self-test routine
recommended polling time: 	 (   1) minutes.
Extended self-test routine
recommended polling time: 	 ( 227) minutes.
Conveyance self-test routine
recommended polling time: 	 (   2) minutes.
SCT capabilities: 	       (0x3085)	SCT Status supported.

SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x000f   117   099   006    Pre-fail  Always       -       135125512
  3 Spin_Up_Time            0x0003   094   094   000    Pre-fail  Always       -       0
  4 Start_Stop_Count        0x0032   100   100   020    Old_age   Always       -       29
  5 Reallocated_Sector_Ct   0x0033   100   100   010    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x000f   070   060   030    Pre-fail  Always       -       11332376
  9 Power_On_Hours          0x0032   096   096   000    Old_age   Always       -       4363
 10 Spin_Retry_Count        0x0013   100   100   097    Pre-fail  Always       -       0
 12 Power_Cycle_Count       0x0032   100   100   020    Old_age   Always       -       69
183 Runtime_Bad_Block       0x0032   100   100   000    Old_age   Always       -       0
184 End-to-End_Error        0x0032   100   100   099    Old_age   Always       -       0
187 Reported_Uncorrect      0x0032   100   100   000    Old_age   Always       -       0
188 Command_Timeout         0x0032   100   100   000    Old_age   Always       -       0 0 0
189 High_Fly_Writes         0x003a   100   100   000    Old_age   Always       -       0
190 Airflow_Temperature_Cel 0x0022   062   058   045    Old_age   Always       -       38 (Min/Max 31/42)
191 G-Sense_Error_Rate      0x0032   100   100   000    Old_age   Always       -       0
192 Power-Off_Retract_Count 0x0032   100   100   000    Old_age   Always       -       44
193 Load_Cycle_Count        0x0032   100   100   000    Old_age   Always       -       621
194 Temperature_Celsius     0x0022   038   042   000    Old_age   Always       -       38 (0 21 0 0 0)
197 Current_Pending_Sector  0x0012   100   100   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0010   100   100   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x003e   200   200   000    Old_age   Always       -       0
240 Head_Flying_Hours       0x0000   100   253   000    Old_age   Offline      -       3308h+56m+15.292s
241 Total_LBAs_Written      0x0000   100   253   000    Old_age   Offline      -       2036108257
242 Total_LBAs_Read         0x0000   100   253   000    Old_age   Offline      -       7159544807

SMART Error Log Version: 1
No Errors Logged

SMART Self-test log structure revision number 1
No self-tests have been logged.  [To run self-tests, use: smartctl -t]


SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

Device /dev/ada3 - Hitachi Deskstar 7K1000.C

=== START OF INFORMATION SECTION ===
Model Family:     Hitachi Deskstar 7K1000.C
Device Model:     Hitachi HDS721010CLA332
Serial Number:    JP2940HQ3R6E3H
LU WWN Device Id: 5 000cca 35df45ec9
Firmware Version: JP4OA3EA
User Capacity:    1,000,203,804,160 bytes [1.00 TB]
Sector Size:      512 bytes logical/physical
Rotation Rate:    7200 rpm
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   ATA8-ACS T13/1699-D revision 4
SATA Version is:  SATA 2.6, 3.0 Gb/s
Local Time is:    Wed Oct  1 18:44:11 2014 UTC
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x80)	Offline data collection activity
					was never started.
					Auto Offline Data Collection: Enabled.
Self-test execution status:      (   0)	The previous self-test routine completed
					without error or no self-test has ever
					been run.
Total time to complete Offline
data collection: 		( 9811) seconds.
Offline data collection
capabilities: 			 (0x5b) SMART execute Offline immediate.
					Auto Offline data collection on/off support.
					Suspend Offline collection upon new
					command.
					Offline surface scan supported.
					Self-test supported.
					No Conveyance Self-test supported.
					Selective Self-test supported.
SMART capabilities:            (0x0003)	Saves SMART data before entering
					power-saving mode.
					Supports SMART auto save timer.
Error logging capability:        (0x01)	Error logging supported.
					General Purpose Logging supported.
Short self-test routine
recommended polling time: 	 (   1) minutes.
Extended self-test routine
recommended polling time: 	 ( 164) minutes.
SCT capabilities: 	       (0x003d)	SCT Status supported.
					SCT Error Recovery Control supported.
					SCT Feature Control supported.
					SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x000b   095   095   016    Pre-fail  Always       -       589829
  2 Throughput_Performance  0x0005   135   135   054    Pre-fail  Offline      -       97
  3 Spin_Up_Time            0x0007   121   121   024    Pre-fail  Always       -       314 (Average 311)
  4 Start_Stop_Count        0x0012   100   100   000    Old_age   Always       -       703
  5 Reallocated_Sector_Ct   0x0033   100   100   005    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x000b   100   100   067    Pre-fail  Always       -       0
  8 Seek_Time_Performance   0x0005   138   138   020    Pre-fail  Offline      -       31
  9 Power_On_Hours          0x0012   100   100   000    Old_age   Always       -       5299
 10 Spin_Retry_Count        0x0013   100   100   060    Pre-fail  Always       -       0
 12 Power_Cycle_Count       0x0032   100   100   000    Old_age   Always       -       696
192 Power-Off_Retract_Count 0x0032   100   100   000    Old_age   Always       -       867
193 Load_Cycle_Count        0x0012   100   100   000    Old_age   Always       -       867
194 Temperature_Celsius     0x0002   176   176   000    Old_age   Always       -       34 (Min/Max 15/41)
196 Reallocated_Event_Count 0x0032   100   100   000    Old_age   Always       -       0
197 Current_Pending_Sector  0x0022   100   100   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0008   100   100   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x000a   200   200   000    Old_age   Always       -       1

SMART Error Log Version: 0
No Errors Logged

SMART Self-test log structure revision number 1
No self-tests have been logged.  [To run self-tests, use: smartctl -t]


SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

Device /dev/ada4 - Hitachi Deskstar T7K250

=== START OF INFORMATION SECTION ===
Model Family:     Hitachi Deskstar T7K250
Device Model:     HDT722525DLA380
Serial Number:    VDS41DT4FHDXAJ
LU WWN Device Id: 5 000cca 20bf1488e
Firmware Version: V44OA9BA
User Capacity:    250,059,350,016 bytes [250 GB]
Sector Size:      512 bytes logical/physical
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   ATA/ATAPI-7 T13/1532D revision 1
Local Time is:    Wed Oct  1 18:44:12 2014 UTC
SMART support is: Available - device has SMART capability.
SMART support is: Disabled

SMART Disabled. Use option -s with argument 'on' to enable it.
(override with '-T permissive' option)

Copyright ? 2012-2014 The NAS4Free Project

Post by **raulfg3** » 01 Oct 2014 13:07

http://lmgtfy.com/?q=SMART+1+Raw_Read_Error_Rate+

you have a real big Raw_Read_Error_Rate

see if was a problem or not : http://lime-technology.com/wiki/index.p ... RT_Reports
http://en.wikipedia.org/wiki/S.M.A.R.T# ... attributes

Post by **b0ssman** » 01 Oct 2014 13:09

smart looks fine.
however

ada1
199 UDMA_CRC_Error_Count 0x003e 200 200 000 Old_age Always - 5
mean that the sata cable needs to be changed.

ada3 same sata cable error.
199 UDMA_CRC_Error_Count 0x000a 200 200 000 Old_age Always - 1

Post by **b0ssman** » 01 Oct 2014 13:11

thats a seagate drive.
the seagate number is a special number that is not a decimal number
see
http://www.users.on.net/~fzabkar/HDD/Se ... R_HEC.html

navi · Post by **navi** » 01 Oct 2014 13:30

Hi All,

Thanks very much for all your suggestions. Running Memtest with Memtest86+ V5.01 from (http://www.memtest.org). will post the result of changing SATA Cable and Memtest as soon as they are available.

Regards,
Navi

Post by **b0ssman** » 01 Oct 2014 13:39

get sata cables with Locking Latch

navi · Post by **navi** » 01 Oct 2014 14:06

memtest not looking good!

memtest.jpg

Post by **b0ssman** » 01 Oct 2014 14:40

so you ran a scrub with bad memory....

you might have destroyed some of your data, no way to know for sure.

Post by **crowi** » 01 Oct 2014 14:59

If you buy new RAM, take ECC RAM and a mainboard which supports it.
Or get a HPN54L, which is already equipped with 4GB ECC

navi · Post by **navi** » 01 Oct 2014 15:45

b0ssman wrote:so you ran a scrub with bad memory.... you might have destroyed some of your data, no way to know for sure.

Yes. Not "a" scrub. Many, many scrubs to be honest! almost one every week or so. Fortunately though, data is still available from the systems they originated from before coming into this pool. So we can restore the pool with quite confidence after sorted out the memory issue.

After solving the memory issue, should I ran few more scrub on this damage data, just to see if hdd produce any farther read errors or not? after scrub starts to return 0 errors, we can destroy the pool and recreate it from original sources.

crowi wrote:If you buy new RAM, take ECC RAM and a mainboard which supports it.
Or get a HPN54L, which is already equipped with 4GB ECC

Yes. after this lesson, ECC does look essential then ever for ZFS. But to be honest, I was dumb not to run a memtest before I started with the NAS/nas4free/zfs/pool. usual assumption was if memory was bad, OS will crash and burn and will be apparent from the get go. Didn't realize that OS can happily churn away with hidden bad memory and storage get destroyed from it. Biggest hurdle with ECC Memory though, not a lot desktop boards supports ECC and most of my builds are desktop centric. But lesson learned.

Once again, Thank you very much and I really appreciate the quick and effective response from all you guys.

regards,
navi

XigmaNAS

[SOLVED] ZFS says drives failing. How bad is it.

[SOLVED] ZFS says drives failing. How bad is it.

Re: ZFS says drives failing. How bad is it. Please advice!!!

Re: ZFS says drives failing. How bad is it. Please advice!!!

Re: ZFS says drives failing. How bad is it. Please advice!!!

Re: ZFS says drives failing. How bad is it. Please advice!!!

Re: ZFS says drives failing. How bad is it. Please advice!!!

Re: ZFS says drives failing. How bad is it. Please advice!!!

Re: ZFS says drives failing. How bad is it. Please advice!!!

Re: ZFS says drives failing. How bad is it. Please advice!!!

Re: ZFS says drives failing. How bad is it. Please advice!!!

Re: ZFS says drives failing. How bad is it. Please advice!!!

Re: ZFS says drives failing. How bad is it. Please advice!!!