Smart Error - Failed in Segment

[bunk3m]

Hi!

I have a mirrored pair of 3TB drives in a ZPool. Recently (~3-4 months ago) one of the drives SMART indicated a problem. So I replaced the drive and it rebuilt nicely. Until last week, the SMART reports didn't run. Thanks to RedAntz I got that going again.

Now I'm see there is a problem with the second original drive. Running the SMART test give a Failed in Segment error.

I don't really understand what this means but thought it had something to do with a bad sector on the disk. I've been doing reading on ZFS and I thought ZFS took care of those problems?? But the failed test bothers me so I have to ask for some guidance.

Here is the most recent short report. Could someone give me an idea of what I should do to further check the disk without screwing up my ZPool?

Is this a problem?

Thanks in advance.

Code: Select all

The following warning/error was logged by the smartd daemon:

Device: /dev/da1, Self-Test Log error count increased from 5 to 6

Device info:
[ATA      ST3000DM001-9YN1 CC4B], 3.00 TB

For details see host's SYSLOG.

You can also use the smartctl utility for further investigation.
No additional messages about this problem will be sent. smartctl 6.1 2013-03-16 r3800 [FreeBSD 9.1-RELEASE-p3 amd64] (local build)
Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org

User Capacity:        3,000,592,982,016 bytes [3.00 TB]
Logical block size:   512 bytes
Physical block size:  4096 bytes
Lowest aligned LBA:   0
Logical block provisioning type unreported, LBPME=0, LBPRZ=0
Rotation Rate:        7200 rpm
Device type:          disk
Local Time is:        Sat Jul 26 02:03:09 2014 EDT
SMART support is:     Available - device has SMART capability.
SMART support is:     Enabled
Temperature Warning:  Disabled or Not Supported

=== START OF READ SMART DATA SECTION ===
SMART Health Status: OK
Current Drive Temperature:     34 C

Error Counter logging not supported

[GLTSD (Global Logging Target Save Disable) set. Enable Save with '-S on']
SMART Self-test log
Num  Test              Status                 segment  LifeTime  LBA_first_err [SK ASC ASQ]
     Description                              number   (hours)
# 1  Background short  Failed in segment -->       -   11322         733127001 [0x3 0x40 0x87]
# 2  Background short  Failed in segment -->       -   11239         733127001 [0x3 0x40 0x87]
# 3  Background short  Failed in segment -->       -   11215         733127001 [0x3 0x40 0x87]
# 4  Background short  Failed in segment -->       -    8497        5860529264 [0x3 0x40 0x87]
# 5  Background long   Failed in segment -->       -    8478        5860529264 [0x3 0x40 0x87]
# 6  Background short  Failed in segment -->       -    8449        5860529264 [0x3 0x40 0x87]
Long (extended) Self Test duration: 20340 seconds [339.0 minutes]

PS Running nas4free "9.1.0.1 - Sandstorm (revision 775)"

[b0ssman]

instead of giving us the short report. give use the full report.

[bunk3m]

instead of giving us the short report. give use the full report.

Thanks b0ssman. I've run the long report but it doesn't really look much different. So I probably ran it wrong.

Here is what I got:

Code: Select all

This message was generated by the smartd daemon running on:

   host name:  nas4free
   DNS domain: local

The following warning/error was logged by the smartd daemon:

Device: /dev/da1, Self-Test Log error count increased from 6 to 7

Device info:
[ATA      ST3000DM001-9YN1 CC4B], 3.00 TB

For details see host's SYSLOG.

You can also use the smartctl utility for further investigation.
No additional messages about this problem will be sent. smartctl 6.1 2013-03-16 r3800 [FreeBSD 9.1-RELEASE-p3 amd64] (local build)
Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org

User Capacity:        3,000,592,982,016 bytes [3.00 TB]
Logical block size:   512 bytes
Physical block size:  4096 bytes
Lowest aligned LBA:   0
Logical block provisioning type unreported, LBPME=0, LBPRZ=0
Rotation Rate:        7200 rpm
Logical Unit id:      
Serial number:        
Device type:          disk
Local Time is:        Tue Jul 29 12:54:14 2014 EDT
SMART support is:     Available - device has SMART capability.
SMART support is:     Enabled
Temperature Warning:  Disabled or Not Supported

=== START OF READ SMART DATA SECTION ===
SMART Health Status: OK
Current Drive Temperature:     33 C

Error Counter logging not supported


[GLTSD (Global Logging Target Save Disable) set. Enable Save with '-S on']
SMART Self-test log
Num  Test              Status                 segment  LifeTime  LBA_first_err [SK ASC ASQ]
     Description                              number   (hours)
# 1  Background long   Failed in segment -->       -   11405         733127001 [0x3 0x40 0x87]
# 2  Background short  Failed in segment -->       -   11322         733127001 [0x3 0x40 0x87]
# 3  Background short  Failed in segment -->       -   11239         733127001 [0x3 0x40 0x87]
# 4  Background short  Failed in segment -->       -   11215         733127001 [0x3 0x40 0x87]
# 5  Background short  Failed in segment -->       -    8497        5860529264 [0x3 0x40 0x87]
# 6  Background long   Failed in segment -->       -    8478        5860529264 [0x3 0x40 0x87]
# 7  Background short  Failed in segment -->       -    8449        5860529264 [0x3 0x40 0x87]
Long (extended) Self Test duration: 20340 seconds [339.0 minutes]

Please let me know if this is more help (or not).

Thanks again.

[bunk3m]

OK, I tried from the command line with

Code: Select all

smartctl -t long /dev/da1
smartctl 6.1 2013-03-16 r3800 [FreeBSD 9.1-RELEASE-p3 amd64] (local build)
Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF OFFLINE IMMEDIATE AND SELF-TEST SECTION ===
Sending command: "Execute SMART Extended self-test routine immediately in off-line mode".
Drive command "Execute SMART Extended self-test routine immediately in off-line mode" successful.
Testing has begun.
Please wait 339 minutes for test to complete.
Test will complete after Tue Jul 29 23:23:33 2014

Use smartctl -X to abort test.

It crapped out and send another short list report.

But what I did get from

Code: Select all

smartctl -a /dev/da1

was

Code: Select all

=== START OF INFORMATION SECTION ===
Model Family:     Seagate Barracuda 7200.14 (AF)
Device Model:     ST3000DM001-9YN166
Serial Number:    
LU WWN Device Id: 
Firmware Version: CC4B
User Capacity:    3,000,592,982,016 bytes [3.00 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    7200 rpm
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   ATA8-ACS T13/1699-D revision 4
SATA Version is:  SATA 3.0, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Tue Jul 29 18:55:17 2014 EDT

==> WARNING: A firmware update for this drive may be available,
see the following Seagate web pages:
http://knowledge.seagate.com/articles/en_US/FAQ/207931en
http://knowledge.seagate.com/articles/en_US/FAQ/223651en

SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x00)	Offline data collection activity
					was never started.
					Auto Offline Data Collection: Disabled.
Self-test execution status:      ( 121)	The previous self-test completed having
					the read element of the test failed.
Total time to complete Offline 
data collection: 		(  575) seconds.
Offline data collection
capabilities: 			 (0x73) SMART execute Offline immediate.
					Auto Offline data collection on/off support.
					Suspend Offline collection upon new
					command.
					No Offline surface scan supported.
					Self-test supported.
					Conveyance Self-test supported.
					Selective Self-test supported.
SMART capabilities:            (0x0003)	Saves SMART data before entering
					power-saving mode.
					Supports SMART auto save timer.
Error logging capability:        (0x01)	Error logging supported.
					General Purpose Logging supported.
Short self-test routine 
recommended polling time: 	 (   1) minutes.
Extended self-test routine
recommended polling time: 	 ( 339) minutes.
Conveyance self-test routine
recommended polling time: 	 (   2) minutes.
SCT capabilities: 	       (0x3085)	SCT Status supported.

SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x000f   096   093   006    Pre-fail  Always       -       213477912
  3 Spin_Up_Time            0x0003   092   092   000    Pre-fail  Always       -       0
  4 Start_Stop_Count        0x0032   100   100   020    Old_age   Always       -       50
  5 Reallocated_Sector_Ct   0x0033   099   099   036    Pre-fail  Always       -       1472
  7 Seek_Error_Rate         0x000f   066   060   030    Pre-fail  Always       -       4268433
  9 Power_On_Hours          0x0032   087   087   000    Old_age   Always       -       11412
 10 Spin_Retry_Count        0x0013   100   100   097    Pre-fail  Always       -       0
 12 Power_Cycle_Count       0x0032   100   100   020    Old_age   Always       -       50
183 Runtime_Bad_Block       0x0032   100   100   000    Old_age   Always       -       0
184 End-to-End_Error        0x0032   100   100   099    Old_age   Always       -       0
187 Reported_Uncorrect      0x0032   001   001   000    Old_age   Always       -       577
188 Command_Timeout         0x0032   100   100   000    Old_age   Always       -       0 0 0
189 High_Fly_Writes         0x003a   100   100   000    Old_age   Always       -       0
190 Airflow_Temperature_Cel 0x0022   067   061   045    Old_age   Always       -       33 (Min/Max 19/37)
191 G-Sense_Error_Rate      0x0032   100   100   000    Old_age   Always       -       0
192 Power-Off_Retract_Count 0x0032   100   100   000    Old_age   Always       -       47
193 Load_Cycle_Count        0x0032   081   081   000    Old_age   Always       -       39780
194 Temperature_Celsius     0x0022   033   040   000    Old_age   Always       -       33 (0 18 0 0 0)
197 Current_Pending_Sector  0x0012   100   001   000    Old_age   Always       -       104
198 Offline_Uncorrectable   0x0010   100   001   000    Old_age   Offline      -       104
199 UDMA_CRC_Error_Count    0x003e   200   200   000    Old_age   Always       -       0
240 Head_Flying_Hours       0x0000   100   253   000    Old_age   Offline      -       5450h+16m+46.154s
241 Total_LBAs_Written      0x0000   100   253   000    Old_age   Offline      -       69060217374042
242 Total_LBAs_Read         0x0000   100   253   000    Old_age   Offline      -       22938081608512

SMART Error Log Version: 1
No Errors Logged

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Extended offline    Completed: read failure       90%     11411         733127001
# 2  Extended offline    Completed: read failure       90%     11405         733127001
# 3  Short offline       Completed: read failure       90%     11322         733127001
# 4  Short offline       Completed: read failure       90%     11239         733127001
# 5  Short offline       Completed: read failure       90%     11215         733127001
# 6  Short offline       Completed: read failure       90%      8497         -
# 7  Extended offline    Completed: read failure       10%      8478         -
# 8  Short offline       Completed: read failure       90%      8449         -
# 9  Extended offline    Completed: read failure       10%      8431         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

[b0ssman]

5 Reallocated_Sector_Ct 0x0033 099 099 036 Pre-fail Always - 1472
187 Reported_Uncorrect 0x0032 001 001 000 Old_age Always - 577
198 Offline_Uncorrectable 0x0010 100 001 000 Old_age Offline - 104

Your drive is a walking zombie, please shoot in the head and put it out of its misery.

[bunk3m]

5 Reallocated_Sector_Ct 0x0033 099 099 036 Pre-fail Always - 1472
187 Reported_Uncorrect 0x0032 001 001 000 Old_age Always - 577
198 Offline_Uncorrectable 0x0010 100 001 000 Old_age Offline - 104

Your drive is a walking zombie, please shoot in the head and put it out of its misery.

Thanks for this comment. As a newbie I'm still a bit confused. I'll google what these mean but how does the drive

Code: Select all

SMART overall-health self-assessment test result: PASSED

it it is a zombie?

Should I reformat the drive and add to the pool again; or see if there is a firmware update; or try to RMA the drive? I think it is under warranty.

[b0ssman]

rma the drive.

the smart values mean the drive is unusable

[bunk3m]

Just checked and the drive is off warranty. So I guess it's time to replace this. Given this is the same model as the other Seagate drive that failed a few months back, I'll be switching manufacturers.

I see you use WD Red. Are you happy with them?

[crowi]

The quality of Seagate drives is varying, I had some good ones and some bad drives.
WD seems to be more stable, please look here:
http://blog.backblaze.com/2014/01/21/wh ... uld-i-buy/


You can either choose WD greens or WD red for NAS, or, if you have enough money, the enterprise class

[b0ssman]

i am happy with the red drives.

i did not want to take green drives because of the missing TLER und the LCC issue.

[bunk3m]

Thanks for the link and additional info! That was really helpful! Looks like I'll be buy a replacement Red drive. Hitachi are still a bit too expensive.