one disk lost some time

[françois ROLAND]

Hi

I met a problem with my Nas4Free on ZFS pool :

I have 1 ZFS pool with 6 hard disk 1To each

Some time, 1 of them (ada0) is missing and my ZFS pool is DEGRADED

If I reboot my Nas4Free, disk is present and it's working fine, but after some time (1 or 2 days or more) it's happend again

I tried to replace SATA cable but I've got nothing more

Have you an idea?

Is it an HD failure? a power supply failure, ...?

So, if I want to change HD with a nex one, what should I do? remove old one and plug new one (same size or bigger) and that's all or should I do someting on new HD before?

Thanks for your help

[b0ssman]

post the output of diagnosis| log when this happens again.
also post the smart values of all drives.

[françois ROLAND]

ADA0


22/09/2014 00:31:01 [1229847] From:FREENAS (192.168.1.11) Fac:0 Sev:2 Msg >>> Sep 22 00:30:12 kernel: (pass0:ata2:0:0:0): passdevgonecb: devfs entry is gone

22/09/2014 00:31:01 [1229846] From:FREENAS (192.168.1.11) Fac:0 Sev:2 Msg >>> Sep 22 00:30:12 kernel: (ada0:ata2:0:0:0): lost device

22/09/2014 00:31:01 [1229843] From:FREENAS (192.168.1.11) Fac:0 Sev:2 Msg >>> Sep 22 00:30:12 kernel: (ada0:ata2:0:0:0): FLUSHCACHE48. ACB: ea 00 00 00 00 40 00 00 00 00 00 00

22/09/2014 00:31:01 [1229844] From:FREENAS (192.168.1.11) Fac:0 Sev:2 Msg >>> Sep 22 00:30:12 kernel: (ada0:ata2:0:0:0): CAM status: Command timeout

22/09/2014 00:31:01 [1229845] From:FREENAS (192.168.1.11) Fac:0 Sev:2 Msg >>> Sep 22 00:30:12 kernel: (ada0:ata2:0:0:0): Retrying command

22/09/2014 00:31:02 [1229848] From:FREENAS (192.168.1.11) Fac:0 Sev:2 Msg >>> Sep 22 00:30:13 kernel: (ada0:ata2:0:0:0): removing device entry

I haven't SMART value vhen problem occur, but I can send it next time

[b0ssman]

you seem to be using an very old version.
and what hardware are you using?

[françois ROLAND]

I'm using Nas4Free 9.1.0.1 - Sandstorm (revision 847)

My zfs pool enclose 6 HD : 3 WD green and 3 Seagate (I met problem with a segate)

[b0ssman]

motherboard?

[françois ROLAND]

ASUSTeK Computer Inc. P4C800-E

[françois ROLAND]

If problem come from motherboard, how could I forward my ZFS pool on a new system?

backup config could do it?

Should I put HD on same ada port?

[b0ssman]

you can just move the pool to a new computer.
just put the usb stick into the new computer and it should work.
you might have to press clear disc and import config in the disk management.

that board only has 4 sata ports. how do you connect 6 discs to it?

[françois ROLAND]

well seen

I have added a PCI card with 2 sata port (but ada0 is on the motherboard)

[raulfg3]

My experience with this error is:

bad SATA cable ( or bad connection), and/or bad Power cable (molex highly used that have a bad connection).

My recomendation:
Buy a new board and new cables, export your pool and reimport in your new hardware, must work, this is the magic of ZFS that is hardware independant.

PD: Perhaps your motherboard still works, but is from 2004 ( 10 years) and if you apreciate your data, must agree that a new hardware is wellcome ( not neccesary last state of the art board, but a 2 or 3 years old is good and cheap)

[françois ROLAND]

Thanks for your answers

I already have changed SATA cables

For power cable idea, maybe could I switch 2 HD power supplies to see if problem move to an othe ada port ?

I have found an other motherboard with 8 SATA port. Could you explain me how to export and import my ZFS pool

Regards

[raulfg3]

1 - on your old (actual) NAS from a shell export your pool: http://docs.oracle.com/cd/E19253-01/819 ... index.html
2 - on your new hardware detect your disk ( button "Clear config & Import Disk" on Disk webGUI
3 - import your pool http://docs.oracle.com/cd/E19253-01/819 ... index.html
4 - Use sync in Disks > ZFS > Configuration > Synchronize to sync you pool with webGUI so you can see in WEBGUI you pool.

done.

[françois ROLAND]

thanks for your help

I will try to replace power supply to get one with new molex

I have tried to install a new Nas4Free on an other machin (younger one) with 8 SATA port but I got an error when I boot on CDROM (cda0 error 5)
I have changed cd driver and IDE cable but it's same

Other problem ...

[raulfg3]

You do not need a working CD-ROM, if use embeded, as b0ssman say, only need to move actual USBkey to new board, or burn a new USBKey with apropiate *.img of N4F.

[françois ROLAND]

You do not need a working CD-ROM, if use embeded, as b0ssman say, only need to move actual USBkey to new board, or burn a new USBKey with apropiate *.img of N4F.

Maybe I'm stupid, but I can't boot on USBkey with new motherboard (Asus A8N SLI Premium)

I have tried to move my current system hard disk (IDE). I can start system but I can't reach network (and from this new Nas4Free, I can't ping other computer)

Crasy

[raulfg3]

have tried to move my current system hard disk (IDE). I can start system but I can't reach network (and from this new Nas4Free, I can't ping other computer)

use shell menu to change NIC & IP .

[b0ssman]

you really need to post the smart values first.

[françois ROLAND]

you really need to post the smart values first.

I think smart values could help you if problem occur?

So, below SMART values today (but it's working fine

ZFS pool list:
--------------
NAME SIZE ALLOC FREE CAP DEDUP HEALTH ALTROOT
data 5.46T 876G 4.60T 15% 1.00x ONLINE -

ZFS pool status:
----------------
pool: data
state: ONLINE
status: One or more devices has experienced an error resulting in data
corruption. Applications may be affected.
action: Restore the file in question if possible. Otherwise restore the
entire pool from backup.
see: http://illumos.org/msg/ZFS-8000-8A
scan: resilvered 1.63G in 0h9m with 8 errors on Mon Sep 22 12:26:14 2014
config:

NAME STATE READ WRITE CKSUM
data ONLINE 0 0 10.7K
raidz1-0 ONLINE 0 0 42.8K
ada0 ONLINE 0 0 0
ada1 ONLINE 0 0 0
ada2 ONLINE 0 0 0
ada3 ONLINE 0 0 0
ada5 ONLINE 0 0 0
ada6 ONLINE 0 0 0

errors: 1 data errors, use '-v' for a list

ATA disk:
---------
atacontrol:
ATA_CAM option is enabled in kernel.
Please use camcontrol instead.

SCSI disk:
----------
<ST31000333AS CC1F> at scbus0 target 0 lun 0 (ada0,pass0)
<WDC WD10EADS-00L5B1 01.01A01> at scbus1 target 0 lun 0 (ada1,pass1)
<ST1000NM0011 SN02> at scbus3 target 0 lun 0 (ada2,pass2)
<ST1000NM0011 SN02> at scbus4 target 0 lun 0 (ada3,pass3)
<ST3250820A 3.AAE> at scbus6 target 0 lun 0 (ada4,pass4)
<WDC WD10EADS-00L5B1 01.01A01> at scbus8 target 0 lun 0 (ada5,pass5)
<WDC WD10EADS-00L5B1 01.01A01> at scbus9 target 0 lun 0 (ada6,pass6)

S.M.A.R.T. [/dev/ada0]:
-----------------------
smartctl 6.2 2013-07-26 r3841 [FreeBSD 9.1-RELEASE-p5 i386] (local build)
Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family: Seagate Barracuda 7200.11
Device Model: ST31000333AS
Serial Number: 6TE07GTM
LU WWN Device Id: 5 000c50 009f8977c
Firmware Version: CC1F
User Capacity: 1,000,204,886,016 bytes [1.00 TB]
Sector Size: 512 bytes logical/physical
Rotation Rate: 7200 rpm
Device is: In smartctl database [for details use: -P show]
ATA Version is: ATA8-ACS T13/1699-D revision 4
SATA Version is: SATA 2.6, 3.0 Gb/s
Local Time is: Tue Sep 23 01:00:00 2014 CEST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status: (0x82) Offline data collection activity
was completed without error.
Auto Offline Data Collection: Enabled.
Self-test execution status: ( 0) The previous self-test routine completed
without error or no self-test has ever
been run.
Total time to complete Offline
data collection: ( 625) seconds.
Offline data collection
capabilities: (0x7b) SMART execute Offline immediate.
Auto Offline data collection on/off support.
Suspend Offline collection upon new
command.
Offline surface scan supported.
Self-test supported.
Conveyance Self-test supported.
Selective Self-test supported.
SMART capabilities: (0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability: (0x01) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time: ( 1) minutes.
Extended self-test routine
recommended polling time: ( 207) minutes.
Conveyance self-test routine
recommended polling time: ( 2) minutes.
SCT capabilities: (0x103f) SCT Status supported.
SCT Error Recovery Control supported.
SCT Feature Control supported.
SCT Data Table supported.

SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE
1 Raw_Read_Error_Rate 0x000f 114 099 006 Pre-fail Always - 74958903
3 Spin_Up_Time 0x0003 100 094 000 Pre-fail Always - 0
4 Start_Stop_Count 0x0032 094 094 020 Old_age Always - 7015
5 Reallocated_Sector_Ct 0x0033 098 098 036 Pre-fail Always - 82
7 Seek_Error_Rate 0x000f 078 060 030 Pre-fail Always - 78869327
9 Power_On_Hours 0x0032 064 064 000 Old_age Always - 31827
10 Spin_Retry_Count 0x0013 100 100 097 Pre-fail Always - 5
12 Power_Cycle_Count 0x0032 099 099 020 Old_age Always - 1588
184 End-to-End_Error 0x0032 100 100 099 Old_age Always - 0
187 Reported_Uncorrect 0x0032 085 085 000 Old_age Always - 15
188 Command_Timeout 0x0032 100 098 000 Old_age Always - 60130459666
189 High_Fly_Writes 0x003a 050 050 000 Old_age Always - 50
190 Airflow_Temperature_Cel 0x0022 062 047 045 Old_age Always - 38 (Min/Max 34/41)
194 Temperature_Celsius 0x0022 038 053 000 Old_age Always - 38 (0 13 0 0 0)
195 Hardware_ECC_Recovered 0x001a 039 020 000 Old_age Always - 74958903
197 Current_Pending_Sector 0x0012 100 100 000 Old_age Always - 160
198 Offline_Uncorrectable 0x0010 100 100 000 Old_age Offline - 160
199 UDMA_CRC_Error_Count 0x003e 200 200 000 Old_age Always - 0
240 Head_Flying_Hours 0x0000 100 253 000 Old_age Offline - 148846386625155
241 Total_LBAs_Written 0x0000 100 253 000 Old_age Offline - 2766407971
242 Total_LBAs_Read 0x0000 100 253 000 Old_age Offline - 2908439603

SMART Error Log Version: 1
ATA Error Count: 14 (device log contains only the most recent five errors)
CR = Command Register [HEX]
FR = Features Register [HEX]
SC = Sector Count Register [HEX]
SN = Sector Number Register [HEX]
CL = Cylinder Low Register [HEX]
CH = Cylinder High Register [HEX]
DH = Device/Head Register [HEX]
DC = Device Command Register [HEX]
ER = Error register [HEX]
ST = Status register [HEX]
Powered_Up_Time is measured from power on, and printed as
DDd+hh:mm:SS.sss where DD=days, hh=hours, mm=minutes,
SS=sec, and sss=millisec. It "wraps" after 49.710 days.

Error 14 occurred at disk power-on lifetime: 18057 hours (752 days + 9 hours)
When the command that caused the error occurred, the device was active or idle.

After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
40 51 00 ff ff ff 0f Error: UNC at LBA = 0x0fffffff = 268435455

Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
-- -- -- -- -- -- -- -- ---------------- --------------------
25 00 20 ff ff ff 4f 00 00:15:10.455 READ DMA EXT
25 00 20 ff ff ff 4f 00 00:15:07.606 READ DMA EXT
25 00 20 ff ff ff 4f 00 00:15:04.750 READ DMA EXT
25 00 20 ff ff ff 4f 00 00:15:01.894 READ DMA EXT
25 00 20 ff ff ff 4f 00 00:14:59.130 READ DMA EXT

Error 13 occurred at disk power-on lifetime: 18057 hours (752 days + 9 hours)
When the command that caused the error occurred, the device was active or idle.

After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
40 51 00 ff ff ff 0f Error: UNC at LBA = 0x0fffffff = 268435455

Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
-- -- -- -- -- -- -- -- ---------------- --------------------
25 00 20 ff ff ff 4f 00 00:15:07.606 READ DMA EXT
25 00 20 ff ff ff 4f 00 00:15:04.750 READ DMA EXT
25 00 20 ff ff ff 4f 00 00:15:01.894 READ DMA EXT
25 00 20 ff ff ff 4f 00 00:14:59.130 READ DMA EXT
25 00 20 ff ff ff 4f 00 00:14:59.125 READ DMA EXT

Error 12 occurred at disk power-on lifetime: 18057 hours (752 days + 9 hours)
When the command that caused the error occurred, the device was active or idle.

After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
40 51 00 ff ff ff 0f Error: UNC at LBA = 0x0fffffff = 268435455

Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
-- -- -- -- -- -- -- -- ---------------- --------------------
25 00 20 ff ff ff 4f 00 00:15:04.750 READ DMA EXT
25 00 20 ff ff ff 4f 00 00:15:01.894 READ DMA EXT
25 00 20 ff ff ff 4f 00 00:14:59.130 READ DMA EXT
25 00 20 ff ff ff 4f 00 00:14:59.125 READ DMA EXT
25 00 20 ff ff ff 4f 00 00:14:59.116 READ DMA EXT

Error 11 occurred at disk power-on lifetime: 18057 hours (752 days + 9 hours)
When the command that caused the error occurred, the device was active or idle.

After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
40 51 00 ff ff ff 0f Error: UNC at LBA = 0x0fffffff = 268435455

Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
-- -- -- -- -- -- -- -- ---------------- --------------------
25 00 20 ff ff ff 4f 00 00:15:01.894 READ DMA EXT
25 00 20 ff ff ff 4f 00 00:14:59.130 READ DMA EXT
25 00 20 ff ff ff 4f 00 00:14:59.125 READ DMA EXT
25 00 20 ff ff ff 4f 00 00:14:59.116 READ DMA EXT
25 00 20 ff ff ff 4f 00 00:14:59.110 READ DMA EXT

Error 10 occurred at disk power-on lifetime: 18057 hours (752 days + 9 hours)
When the command that caused the error occurred, the device was active or idle.

After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
40 51 00 ff ff ff 0f Error: UNC at LBA = 0x0fffffff = 268435455

Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
-- -- -- -- -- -- -- -- ---------------- --------------------
25 00 20 ff ff ff 4f 00 00:14:59.130 READ DMA EXT
25 00 20 ff ff ff 4f 00 00:14:59.125 READ DMA EXT
25 00 20 ff ff ff 4f 00 00:14:59.116 READ DMA EXT
25 00 20 ff ff ff 4f 00 00:14:59.110 READ DMA EXT
25 00 20 ff ff ff 4f 00 00:14:59.100 READ DMA EXT

SMART Self-test log structure revision number 1
Num Test_Description Status Remaining LifeTime(hours) LBA_of_first_error
# 1 Extended offline Aborted by host 90% 22697 -
# 2 Extended offline Aborted by host 90% 22696 -
# 3 Short offline Completed without error 00% 22696 -
# 4 Short offline Completed without error 00% 18081 -
# 5 Short offline Completed without error 00% 18080 -
# 6 Short offline Completed without error 00% 18057 -
# 7 Extended offline Aborted by host 90% 18055 -

SMART Selective self-test log data structure revision number 1
SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS
1 0 0 Not_testing
2 0 0 Not_testing
3 0 0 Not_testing
4 0 0 Not_testing
5 0 0 Not_testing
Selective self-test flags (0x0):
After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.


S.M.A.R.T. [/dev/ada1]:
-----------------------
smartctl 6.2 2013-07-26 r3841 [FreeBSD 9.1-RELEASE-p5 i386] (local build)
Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family: Western Digital Caviar Green
Device Model: WDC WD10EADS-00L5B1
Serial Number: WD-WCAU46904150
LU WWN Device Id: 5 0014ee 257cca11e
Firmware Version: 01.01A01
User Capacity: 1,000,204,886,016 bytes [1.00 TB]
Sector Size: 512 bytes logical/physical
Device is: In smartctl database [for details use: -P show]
ATA Version is: ATA8-ACS (minor revision not indicated)
SATA Version is: SATA 2.5, 3.0 Gb/s
Local Time is: Tue Sep 23 01:00:01 2014 CEST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status: (0x84) Offline data collection activity
was suspended by an interrupting command from host.
Auto Offline Data Collection: Enabled.
Self-test execution status: ( 0) The previous self-test routine completed
without error or no self-test has ever
been run.
Total time to complete Offline
data collection: (22800) seconds.
Offline data collection
capabilities: (0x7b) SMART execute Offline immediate.
Auto Offline data collection on/off support.
Suspend Offline collection upon new
command.
Offline surface scan supported.
Self-test supported.
Conveyance Self-test supported.
Selective Self-test supported.
SMART capabilities: (0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability: (0x01) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time: ( 2) minutes.
Extended self-test routine
recommended polling time: ( 262) minutes.
Conveyance self-test routine
recommended polling time: ( 5) minutes.
SCT capabilities: (0x303f) SCT Status supported.
SCT Error Recovery Control supported.
SCT Feature Control supported.
SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE
1 Raw_Read_Error_Rate 0x002f 200 200 051 Pre-fail Always - 0
3 Spin_Up_Time 0x0027 160 159 021 Pre-fail Always - 6991
4 Start_Stop_Count 0x0032 099 099 000 Old_age Always - 1988
5 Reallocated_Sector_Ct 0x0033 200 200 140 Pre-fail Always - 0
7 Seek_Error_Rate 0x002e 200 200 000 Old_age Always - 0
9 Power_On_Hours 0x0032 083 083 000 Old_age Always - 12792
10 Spin_Retry_Count 0x0032 100 100 000 Old_age Always - 0
11 Calibration_Retry_Count 0x0032 100 100 000 Old_age Always - 0
12 Power_Cycle_Count 0x0032 099 099 000 Old_age Always - 1765
192 Power-Off_Retract_Count 0x0032 199 199 000 Old_age Always - 826
193 Load_Cycle_Count 0x0032 200 200 000 Old_age Always - 1988
194 Temperature_Celsius 0x0022 113 100 000 Old_age Always - 37
196 Reallocated_Event_Count 0x0032 200 200 000 Old_age Always - 0
197 Current_Pending_Sector 0x0032 200 200 000 Old_age Always - 1
198 Offline_Uncorrectable 0x0030 200 200 000 Old_age Offline - 1
199 UDMA_CRC_Error_Count 0x0032 200 200 000 Old_age Always - 17
200 Multi_Zone_Error_Rate 0x0008 200 200 000 Old_age Offline - 1

SMART Error Log Version: 1
No Errors Logged

SMART Self-test log structure revision number 1
No self-tests have been logged. [To run self-tests, use: smartctl -t]


SMART Selective self-test log data structure revision number 1
SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS
1 0 0 Not_testing
2 0 0 Not_testing
3 0 0 Not_testing
4 0 0 Not_testing
5 0 0 Not_testing
Selective self-test flags (0x0):
After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.


S.M.A.R.T. [/dev/ada2]:
-----------------------
smartctl 6.2 2013-07-26 r3841 [FreeBSD 9.1-RELEASE-p5 i386] (local build)
Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family: Seagate Constellation ES (SATA 6Gb/s)
Device Model: ST1000NM0011
Serial Number: Z1N1NXAN
LU WWN Device Id: 5 000c50 04d2acb73
Firmware Version: SN02
User Capacity: 1,000,204,886,016 bytes [1.00 TB]
Sector Size: 512 bytes logical/physical
Rotation Rate: 7202 rpm
Device is: In smartctl database [for details use: -P show]
ATA Version is: ATA8-ACS T13/1699-D revision 4
SATA Version is: SATA 3.0, 6.0 Gb/s (current: 1.5 Gb/s)
Local Time is: Tue Sep 23 01:00:01 2014 CEST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status: (0x82) Offline data collection activity
was completed without error.
Auto Offline Data Collection: Enabled.
Self-test execution status: ( 0) The previous self-test routine completed
without error or no self-test has ever
been run.
Total time to complete Offline
data collection: ( 617) seconds.
Offline data collection
capabilities: (0x7b) SMART execute Offline immediate.
Auto Offline data collection on/off support.
Suspend Offline collection upon new
command.
Offline surface scan supported.
Self-test supported.
Conveyance Self-test supported.
Selective Self-test supported.
SMART capabilities: (0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability: (0x01) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time: ( 1) minutes.
Extended self-test routine
recommended polling time: ( 162) minutes.
Conveyance self-test routine
recommended polling time: ( 2) minutes.
SCT capabilities: (0x10bd) SCT Status supported.
SCT Error Recovery Control supported.
SCT Feature Control supported.
SCT Data Table supported.

SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE
1 Raw_Read_Error_Rate 0x000f 079 063 044 Pre-fail Always - 97134920
3 Spin_Up_Time 0x0003 095 093 000 Pre-fail Always - 0
4 Start_Stop_Count 0x0032 100 100 020 Old_age Always - 783
5 Reallocated_Sector_Ct 0x0033 100 100 036 Pre-fail Always - 1
7 Seek_Error_Rate 0x000f 078 060 030 Pre-fail Always - 4354149672
9 Power_On_Hours 0x0032 091 091 000 Old_age Always - 8163
10 Spin_Retry_Count 0x0013 100 100 097 Pre-fail Always - 0
12 Power_Cycle_Count 0x0032 100 100 020 Old_age Always - 100
184 End-to-End_Error 0x0032 100 100 099 Old_age Always - 0
187 Reported_Uncorrect 0x0032 100 100 000 Old_age Always - 0
188 Command_Timeout 0x0032 100 100 000 Old_age Always - 0
189 High_Fly_Writes 0x003a 100 100 000 Old_age Always - 0
190 Airflow_Temperature_Cel 0x0022 059 049 045 Old_age Always - 41 (Min/Max 33/43)
191 G-Sense_Error_Rate 0x0032 100 100 000 Old_age Always - 40
192 Power-Off_Retract_Count 0x0032 100 100 000 Old_age Always - 47
193 Load_Cycle_Count 0x0032 099 099 000 Old_age Always - 2810
194 Temperature_Celsius 0x0022 041 051 000 Old_age Always - 41 (0 17 0 0 0)
195 Hardware_ECC_Recovered 0x001a 115 099 000 Old_age Always - 97134920
197 Current_Pending_Sector 0x0012 100 100 000 Old_age Always - 0
198 Offline_Uncorrectable 0x0010 100 100 000 Old_age Offline - 0
199 UDMA_CRC_Error_Count 0x003e 200 200 000 Old_age Always - 0

SMART Error Log Version: 1
No Errors Logged

SMART Self-test log structure revision number 1
No self-tests have been logged. [To run self-tests, use: smartctl -t]


SMART Selective self-test log data structure revision number 1
SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS
1 0 0 Not_testing
2 0 0 Not_testing
3 0 0 Not_testing
4 0 0 Not_testing
5 0 0 Not_testing
Selective self-test flags (0x0):
After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.


S.M.A.R.T. [/dev/ada3]:
-----------------------
smartctl 6.2 2013-07-26 r3841 [FreeBSD 9.1-RELEASE-p5 i386] (local build)
Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family: Seagate Constellation ES (SATA 6Gb/s)
Device Model: ST1000NM0011
Serial Number: Z1N1P5FQ
LU WWN Device Id: 5 000c50 04d2c5933
Firmware Version: SN02
User Capacity: 1,000,204,886,016 bytes [1.00 TB]
Sector Size: 512 bytes logical/physical
Rotation Rate: 7202 rpm
Device is: In smartctl database [for details use: -P show]
ATA Version is: ATA8-ACS T13/1699-D revision 4
SATA Version is: SATA 3.0, 6.0 Gb/s (current: 1.5 Gb/s)
Local Time is: Tue Sep 23 01:00:01 2014 CEST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status: (0x82) Offline data collection activity
was completed without error.
Auto Offline Data Collection: Enabled.
Self-test execution status: ( 0) The previous self-test routine completed
without error or no self-test has ever
been run.
Total time to complete Offline
data collection: ( 609) seconds.
Offline data collection
capabilities: (0x7b) SMART execute Offline immediate.
Auto Offline data collection on/off support.
Suspend Offline collection upon new
command.
Offline surface scan supported.
Self-test supported.
Conveyance Self-test supported.
Selective Self-test supported.
SMART capabilities: (0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability: (0x01) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time: ( 1) minutes.
Extended self-test routine
recommended polling time: ( 155) minutes.
Conveyance self-test routine
recommended polling time: ( 2) minutes.
SCT capabilities: (0x10bd) SCT Status supported.
SCT Error Recovery Control supported.
SCT Feature Control supported.
SCT Data Table supported.

SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE
1 Raw_Read_Error_Rate 0x000f 081 063 044 Pre-fail Always - 140239604
3 Spin_Up_Time 0x0003 095 094 000 Pre-fail Always - 0
4 Start_Stop_Count 0x0032 100 100 020 Old_age Always - 793
5 Reallocated_Sector_Ct 0x0033 100 100 036 Pre-fail Always - 0
7 Seek_Error_Rate 0x000f 077 060 030 Pre-fail Always - 56210234
9 Power_On_Hours 0x0032 091 091 000 Old_age Always - 8147
10 Spin_Retry_Count 0x0013 100 100 097 Pre-fail Always - 0
12 Power_Cycle_Count 0x0032 100 100 020 Old_age Always - 100
184 End-to-End_Error 0x0032 100 100 099 Old_age Always - 0
187 Reported_Uncorrect 0x0032 100 100 000 Old_age Always - 0
188 Command_Timeout 0x0032 100 054 000 Old_age Always - 103080788036
189 High_Fly_Writes 0x003a 100 100 000 Old_age Always - 0
190 Airflow_Temperature_Cel 0x0022 061 050 045 Old_age Always - 39 (Min/Max 32/41)
191 G-Sense_Error_Rate 0x0032 100 100 000 Old_age Always - 0
192 Power-Off_Retract_Count 0x0032 100 100 000 Old_age Always - 59
193 Load_Cycle_Count 0x0032 099 099 000 Old_age Always - 2841
194 Temperature_Celsius 0x0022 039 050 000 Old_age Always - 39 (0 16 0 0 0)
195 Hardware_ECC_Recovered 0x001a 117 099 000 Old_age Always - 140239604
197 Current_Pending_Sector 0x0012 100 100 000 Old_age Always - 0
198 Offline_Uncorrectable 0x0010 100 100 000 Old_age Offline - 0
199 UDMA_CRC_Error_Count 0x003e 200 165 000 Old_age Always - 6136

SMART Error Log Version: 1
No Errors Logged

SMART Self-test log structure revision number 1
No self-tests have been logged. [To run self-tests, use: smartctl -t]


SMART Selective self-test log data structure revision number 1
SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS
1 0 0 Not_testing
2 0 0 Not_testing
3 0 0 Not_testing
4 0 0 Not_testing
5 0 0 Not_testing
Selective self-test flags (0x0):
After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.


S.M.A.R.T. [/dev/ada4]:
-----------------------
smartctl 6.2 2013-07-26 r3841 [FreeBSD 9.1-RELEASE-p5 i386] (local build)
Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family: Seagate Barracuda 7200.10
Device Model: ST3250820A
Serial Number: 5QE277G2
Firmware Version: 3.AAE
User Capacity: 250,059,350,016 bytes [250 GB]
Sector Size: 512 bytes logical/physical
Device is: In smartctl database [for details use: -P show]
ATA Version is: ATA/ATAPI-7 (minor revision not indicated)
Local Time is: Tue Sep 23 01:00:01 2014 CEST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status: (0x82) Offline data collection activity
was completed without error.
Auto Offline Data Collection: Enabled.
Self-test execution status: ( 0) The previous self-test routine completed
without error or no self-test has ever
been run.
Total time to complete Offline
data collection: ( 430) seconds.
Offline data collection
capabilities: (0x5b) SMART execute Offline immediate.
Auto Offline data collection on/off support.
Suspend Offline collection upon new
command.
Offline surface scan supported.
Self-test supported.
No Conveyance Self-test supported.
Selective Self-test supported.
SMART capabilities: (0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability: (0x01) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time: ( 1) minutes.
Extended self-test routine
recommended polling time: ( 92) minutes.

SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE
1 Raw_Read_Error_Rate 0x000f 104 090 006 Pre-fail Always - 75254733
3 Spin_Up_Time 0x0003 095 095 000 Pre-fail Always - 0
4 Start_Stop_Count 0x0032 096 096 020 Old_age Always - 4282
5 Reallocated_Sector_Ct 0x0033 100 100 036 Pre-fail Always - 0
7 Seek_Error_Rate 0x000f 062 060 030 Pre-fail Always - 386689086318
9 Power_On_Hours 0x0032 089 089 000 Old_age Always - 9829
10 Spin_Retry_Count 0x0013 100 100 097 Pre-fail Always - 0
12 Power_Cycle_Count 0x0032 100 100 020 Old_age Always - 520
187 Reported_Uncorrect 0x0032 100 100 000 Old_age Always - 0
189 High_Fly_Writes 0x003a 100 100 000 Old_age Always - 0
190 Airflow_Temperature_Cel 0x0022 057 047 045 Old_age Always - 43 (Min/Max 36/45)
194 Temperature_Celsius 0x0022 043 053 000 Old_age Always - 43 (0 15 0 0 0)
195 Hardware_ECC_Recovered 0x001a 053 048 000 Old_age Always - 112278182
197 Current_Pending_Sector 0x0012 100 100 000 Old_age Always - 0
198 Offline_Uncorrectable 0x0010 100 100 000 Old_age Offline - 0
199 UDMA_CRC_Error_Count 0x003e 200 200 000 Old_age Always - 0
200 Multi_Zone_Error_Rate 0x0000 100 253 000 Old_age Offline - 0
202 Data_Address_Mark_Errs 0x0032 100 253 000 Old_age Always - 0

SMART Error Log Version: 1
No Errors Logged

SMART Self-test log structure revision number 1

SMART Selective self-test log data structure revision number 1
SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS
1 0 0 Not_testing
2 0 0 Not_testing
3 0 0 Not_testing
4 0 0 Not_testing
5 0 0 Not_testing
Selective self-test flags (0x0):
After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.


S.M.A.R.T. [/dev/ada5]:
-----------------------
smartctl 6.2 2013-07-26 r3841 [FreeBSD 9.1-RELEASE-p5 i386] (local build)
Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family: Western Digital Caviar Green
Device Model: WDC WD10EADS-00L5B1
Serial Number: WD-WCAU46890238
LU WWN Device Id: 5 0014ee 2ad22c097
Firmware Version: 01.01A01
User Capacity: 1,000,204,886,016 bytes [1.00 TB]
Sector Size: 512 bytes logical/physical
Device is: In smartctl database [for details use: -P show]
ATA Version is: ATA8-ACS (minor revision not indicated)
SATA Version is: SATA 2.5, 3.0 Gb/s
Local Time is: Tue Sep 23 01:00:01 2014 CEST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status: (0x84) Offline data collection activity
was suspended by an interrupting command from host.
Auto Offline Data Collection: Enabled.
Self-test execution status: ( 0) The previous self-test routine completed
without error or no self-test has ever
been run.
Total time to complete Offline
data collection: (22800) seconds.
Offline data collection
capabilities: (0x7b) SMART execute Offline immediate.
Auto Offline data collection on/off support.
Suspend Offline collection upon new
command.
Offline surface scan supported.
Self-test supported.
Conveyance Self-test supported.
Selective Self-test supported.
SMART capabilities: (0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability: (0x01) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time: ( 2) minutes.
Extended self-test routine
recommended polling time: ( 262) minutes.
Conveyance self-test routine
recommended polling time: ( 5) minutes.
SCT capabilities: (0x303f) SCT Status supported.
SCT Error Recovery Control supported.
SCT Feature Control supported.
SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE
1 Raw_Read_Error_Rate 0x002f 200 200 051 Pre-fail Always - 1
3 Spin_Up_Time 0x0027 163 160 021 Pre-fail Always - 6833
4 Start_Stop_Count 0x0032 099 099 000 Old_age Always - 1023
5 Reallocated_Sector_Ct 0x0033 200 200 140 Pre-fail Always - 0
7 Seek_Error_Rate 0x002e 200 200 000 Old_age Always - 0
9 Power_On_Hours 0x0032 083 083 000 Old_age Always - 12982
10 Spin_Retry_Count 0x0032 100 100 000 Old_age Always - 0
11 Calibration_Retry_Count 0x0032 100 100 000 Old_age Always - 0
12 Power_Cycle_Count 0x0032 100 100 000 Old_age Always - 519
192 Power-Off_Retract_Count 0x0032 200 200 000 Old_age Always - 222
193 Load_Cycle_Count 0x0032 200 200 000 Old_age Always - 1023
194 Temperature_Celsius 0x0022 112 098 000 Old_age Always - 38
196 Reallocated_Event_Count 0x0032 200 200 000 Old_age Always - 0
197 Current_Pending_Sector 0x0032 200 200 000 Old_age Always - 0
198 Offline_Uncorrectable 0x0030 200 200 000 Old_age Offline - 0
199 UDMA_CRC_Error_Count 0x0032 200 200 000 Old_age Always - 3
200 Multi_Zone_Error_Rate 0x0008 200 200 000 Old_age Offline - 0

SMART Error Log Version: 1
No Errors Logged

SMART Self-test log structure revision number 1
No self-tests have been logged. [To run self-tests, use: smartctl -t]


SMART Selective self-test log data structure revision number 1
SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS
1 0 0 Not_testing
2 0 0 Not_testing
3 0 0 Not_testing
4 0 0 Not_testing
5 0 0 Not_testing
Selective self-test flags (0x0):
After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.


S.M.A.R.T. [/dev/ada6]:
-----------------------
smartctl 6.2 2013-07-26 r3841 [FreeBSD 9.1-RELEASE-p5 i386] (local build)
Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family: Western Digital Caviar Green
Device Model: WDC WD10EADS-00L5B1
Serial Number: WD-WCAU47166376
LU WWN Device Id: 5 0014ee 257ce52af
Firmware Version: 01.01A01
User Capacity: 1,000,204,886,016 bytes [1.00 TB]
Sector Size: 512 bytes logical/physical
Device is: In smartctl database [for details use: -P show]
ATA Version is: ATA8-ACS (minor revision not indicated)
SATA Version is: SATA 2.5, 3.0 Gb/s
Local Time is: Tue Sep 23 01:00:01 2014 CEST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status: (0x84) Offline data collection activity
was suspended by an interrupting command from host.
Auto Offline Data Collection: Enabled.
Self-test execution status: ( 0) The previous self-test routine completed
without error or no self-test has ever
been run.
Total time to complete Offline
data collection: (22800) seconds.
Offline data collection
capabilities: (0x7b) SMART execute Offline immediate.
Auto Offline data collection on/off support.
Suspend Offline collection upon new
command.
Offline surface scan supported.
Self-test supported.
Conveyance Self-test supported.
Selective Self-test supported.
SMART capabilities: (0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability: (0x01) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time: ( 2) minutes.
Extended self-test routine
recommended polling time: ( 262) minutes.
Conveyance self-test routine
recommended polling time: ( 5) minutes.
SCT capabilities: (0x303f) SCT Status supported.
SCT Error Recovery Control supported.
SCT Feature Control supported.
SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE
1 Raw_Read_Error_Rate 0x002f 200 200 051 Pre-fail Always - 1
3 Spin_Up_Time 0x0027 161 160 021 Pre-fail Always - 6916
4 Start_Stop_Count 0x0032 099 099 000 Old_age Always - 1080
5 Reallocated_Sector_Ct 0x0033 200 200 140 Pre-fail Always - 0
7 Seek_Error_Rate 0x002e 100 253 000 Old_age Always - 0
9 Power_On_Hours 0x0032 083 083 000 Old_age Always - 12932
10 Spin_Retry_Count 0x0032 100 100 000 Old_age Always - 0
11 Calibration_Retry_Count 0x0032 100 100 000 Old_age Always - 0
12 Power_Cycle_Count 0x0032 100 100 000 Old_age Always - 569
192 Power-Off_Retract_Count 0x0032 200 200 000 Old_age Always - 275
193 Load_Cycle_Count 0x0032 200 200 000 Old_age Always - 1080
194 Temperature_Celsius 0x0022 111 098 000 Old_age Always - 39
196 Reallocated_Event_Count 0x0032 200 200 000 Old_age Always - 0
197 Current_Pending_Sector 0x0032 200 200 000 Old_age Always - 2
198 Offline_Uncorrectable 0x0030 200 200 000 Old_age Offline - 8
199 UDMA_CRC_Error_Count 0x0032 200 200 000 Old_age Always - 0
200 Multi_Zone_Error_Rate 0x0008 200 200 000 Old_age Offline - 2

SMART Error Log Version: 1
Warning: ATA error count 445 inconsistent with error log pointer 1

ATA Error Count: 445 (device log contains only the most recent five errors)
CR = Command Register [HEX]
FR = Features Register [HEX]
SC = Sector Count Register [HEX]
SN = Sector Number Register [HEX]
CL = Cylinder Low Register [HEX]
CH = Cylinder High Register [HEX]
DH = Device/Head Register [HEX]
DC = Device Command Register [HEX]
ER = Error register [HEX]
ST = Status register [HEX]
Powered_Up_Time is measured from power on, and printed as
DDd+hh:mm:SS.sss where DD=days, hh=hours, mm=minutes,
SS=sec, and sss=millisec. It "wraps" after 49.710 days.

Error 445 occurred at disk power-on lifetime: 12919 hours (538 days + 7 hours)
When the command that caused the error occurred, the device was active or idle.

After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
40 51 00 1f 02 00 e0 Error: UNC at LBA = 0x0000021f = 543

Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
-- -- -- -- -- -- -- -- ---------------- --------------------
c8 00 10 10 02 00 00 02 00:10:10.728 READ DMA
c8 00 10 10 02 00 00 02 00:10:07.842 READ DMA
c8 00 10 10 02 00 00 02 00:10:04.956 READ DMA
c8 00 10 10 02 00 00 02 00:10:02.070 READ DMA
c8 00 10 10 02 00 00 02 00:09:59.051 READ DMA

Error 444 occurred at disk power-on lifetime: 12919 hours (538 days + 7 hours)
When the command that caused the error occurred, the device was active or idle.

After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
40 51 00 1f 02 00 e0 Error: UNC at LBA = 0x0000021f = 543

Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
-- -- -- -- -- -- -- -- ---------------- --------------------
c8 00 10 10 02 00 00 02 00:10:07.842 READ DMA
c8 00 10 10 02 00 00 02 00:10:04.956 READ DMA
c8 00 10 10 02 00 00 02 00:10:02.070 READ DMA
c8 00 10 10 02 00 00 02 00:09:59.051 READ DMA
c8 00 00 00 01 00 00 02 00:09:59.050 READ DMA

Error 443 occurred at disk power-on lifetime: 12919 hours (538 days + 7 hours)
When the command that caused the error occurred, the device was active or idle.

After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
40 51 00 1f 02 00 e0 Error: UNC at LBA = 0x0000021f = 543

Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
-- -- -- -- -- -- -- -- ---------------- --------------------
c8 00 10 10 02 00 00 02 00:10:04.956 READ DMA
c8 00 10 10 02 00 00 02 00:10:02.070 READ DMA
c8 00 10 10 02 00 00 02 00:09:59.051 READ DMA
c8 00 00 00 01 00 00 02 00:09:59.050 READ DMA
c8 00 00 00 00 00 00 02 00:09:59.049 READ DMA

Error 442 occurred at disk power-on lifetime: 12919 hours (538 days + 7 hours)
When the command that caused the error occurred, the device was active or idle.

After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
40 51 00 1f 02 00 e0 Error: UNC at LBA = 0x0000021f = 543

Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
-- -- -- -- -- -- -- -- ---------------- --------------------
c8 00 10 10 02 00 00 02 00:10:02.070 READ DMA
c8 00 10 10 02 00 00 02 00:09:59.051 READ DMA
c8 00 00 00 01 00 00 02 00:09:59.050 READ DMA
c8 00 00 00 00 00 00 02 00:09:59.049 READ DMA

Error 441 occurred at disk power-on lifetime: 12919 hours (538 days + 7 hours)
When the command that caused the error occurred, the device was active or idle.

After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
40 51 00 1f 02 00 e0 Error: UNC at LBA = 0x0000021f = 543

Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
-- -- -- -- -- -- -- -- ---------------- --------------------
c8 00 10 10 02 00 00 02 00:09:59.051 READ DMA
c8 00 00 00 01 00 00 02 00:09:59.050 READ DMA
c8 00 00 00 00 00 00 02 00:09:59.049 READ DMA

SMART Self-test log structure revision number 1
No self-tests have been logged. [To run self-tests, use: smartctl -t]


SMART Selective self-test log data structure revision number 1
SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS
1 0 0 Not_testing
2 0 0 Not_testing
3 0 0 Not_testing
4 0 0 Not_testing
5 0 0 Not_testing
Selective self-test flags (0x0):
After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

[françois ROLAND]

I'll send smart values again as soon problem occur again

[b0ssman]

turn off your machine NOW.
buy some drives and then try to copy as much data from your array as you can. dont try to safe that array.

ada0 is a walking zombie, replace that drive immediately
5 Reallocated_Sector_Ct 0x0033 098 098 036 Pre-fail Always - 82
187 Reported_Uncorrect 0x0032 085 085 000 Old_age Always - 15
197 Current_Pending_Sector 0x0012 100 100 000 Old_age Always - 160
198 Offline_Uncorrectable 0x0010 100 100 000 Old_age Offline - 160

ada1 has a bad sata cable and is starting to fail. replace this one as well
197 Current_Pending_Sector 0x0032 200 200 000 Old_age Always - 1
198 Offline_Uncorrectable 0x0030 200 200 000 Old_age Offline - 1
199 UDMA_CRC_Error_Count 0x0032 200 200 000 Old_age Always - 17
200 Multi_Zone_Error_Rate 0x0008 200 200 000 Old_age Offline - 1

ada2 is starting to fail
5 Reallocated_Sector_Ct 0x0033 100 100 036 Pre-fail Always - 1

ada3 has a bad sata cable
199 UDMA_CRC_Error_Count 0x003e 200 165 000 Old_age Always - 6136

ada4 is fine

ada5 bad sata cable UDMA_CRC_Error_Count 0x0032 200 200 000 Old_age Always - 3

ada6 is starting to fail
1 Raw_Read_Error_Rate 0x002f 200 200 051 Pre-fail Always - 1
197 Current_Pending_Sector 0x0032 200 200 000 Old_age Always - 2
198 Offline_Uncorrectable 0x0030 200 200 000 Old_age Offline - 8
200 Multi_Zone_Error_Rate 0x0008 200 200 000 Old_age Offline - 2

[françois ROLAND]

Ouahhh

too many problems ...

To summarise :

I will buy some sata cable and replace all of them by new (to be sure)

For ada1, ada2 and ada6 : starting to fail. What the solution ?

For ada0 is walking zomie, could I only remove and put a new hard disk or should I do something more to replace it ?


Many thaks for your help

[b0ssman]

see my first paragraph

turn off your machine NOW.
buy some drives and then try to copy as much data from your array as you can. dont try to safe that array.

[françois ROLAND]

Sorry

I didn't see the first line

I'll do it and let you know ASAP

[françois ROLAND]

To help me to rebuild my nas :

Currently I'm using motherboard : ASUSTeK Computer Inc. P4C800-E and CPU 3.0Ghz HT

I have 4 sata port on it and 2 on an additionnal PCI card

I have, avialable an other motherboard : Asus A8N SLI Premium with CPU AMD 2.2Ghs (64 bits) and 8 sata ports

What choise you could say to me to do?

6 or 8 ports is same thing for me

Thanks for your help

[substr]

Seeing that you have a new drive (in the other thread), you can either start copying data off the pool, or you can replace the failing drive with the new drive and let the pool attempt to repair itself.

If you move the pool to the 8-port motherboard, you can connect the new drive to ada6 or ada7 and leave the old drive on ada0, and then let the replacement run. I would recommend that, because it leaves the best chance (if the failing ada0 is working at that moment) that you get all the data. When it is done replacing, remove ada0.

I recommend that before copying data off the pool, because if a failure is going to happen, it is going to happen since the resilver and a full copy are very similar loads. However, if it fails with some of your redundancy restored during a resilver, the damage could be less.

bossman care to comment?

[b0ssman]

as i said in my earlier post. he should not try to save the pool and copy data of as soon as possible,
he has 5 out of 6 drives failing.
resilvering in this state will almost certainly end up in corrupted data.

since you are using zfs. the amd board supports ecc memory. buy some ecc memory for that board and use that.