Page 1 of 1
[SOLVED] pool degraded, ada0 disappeared, 2 disks apparently swapped
Posted: 30 Dec 2016 03:51
by riki
Hello and happy New Year everyone.
Just before Xmas I replaced 2 disks in my Nas4Free box, but at first I put one of the new disks in the wrong slot. I noticed the mistake immediately, so I shut down the box again and put everything where it belonged. However, I am left with 3 problems, which are probably all connected.
1) The pool is degraded, and 2) I can't seem to zpool online one of the new disks. It's "unformatted or unknown".
Code: Select all
# zpool status p01
pool: p01
state: DEGRADED
status: One or more devices could not be opened. Sufficient replicas exist for
the pool to continue functioning in a degraded state.
action: Attach the missing device and online it using 'zpool online'.
see: http://illumos.org/msg/ZFS-8000-2Q
scan: resilvered 2.17T in 5h24m with 0 errors on Thu Dec 29 03:21:35 2016
config:
NAME STATE READ WRITE CKSUM
p01 DEGRADED 0 0 0
mirror-0 ONLINE 0 0 0
ada3 ONLINE 0 0 0
ada1 ONLINE 0 0 0
mirror-1 DEGRADED 0 0 0
ada2 ONLINE 0 0 0
13757337943089075871 UNAVAIL 0 0 0 was /dev/ada3
mirror-2 ONLINE 0 0 0
ada6 ONLINE 0 0 0
ada7 ONLINE 0 0 0
errors: No known data errors
# zpool online p01 13757337943089075871
warning: device '13757337943089075871' onlined, but remains in faulted state
use 'zpool replace' to replace devices that are no longer present
# zpool online p01 ada0
cannot online ada0: no such device in pool
The disk ada0 has apparently disappeared from the pool, so I can't revive it with the zpool online command; however, the disk is there because the command "camcontrol identify ada0" lists the info for the disk that should be (and indeed is) physically attached in ada0's place. I suspect it is indeed the disk listed as 13757337943089075871 in the output of zpool status.
The last problem is: 3) The mirrors should be ada0+ada1 and ada2+ada3, since ada0-ada1 are the same brand/model (WD Red), as are ada2+ada3 (Toshiba). At the moment, however, the mirrors are ada1+ad3 and ada2+13757337943089075871. I think the system got confused during the resilvering because I had briefly mounted one disk in the wrong place.
Here's how it looks in the webGUI,
Disks|Management|HDD Management
How do I sort out this mess?
Thanks for any help!
Re: pool degraded, ada0 disappeared, 2 disks apparently swapped
Posted: 30 Dec 2016 15:47
by sleid
First:
Clear Config and Import Disks : if ada0 is unformatted
format ada0 for zfs storage pool
zpool offline p01 13757337943089075871
zpool online p01 ada0
if ok
secondly:
zpool replace p01 13757337943089075871 /dev/ada0
Re: pool degraded, ada0 disappeared, 2 disks apparently swapped
Posted: 31 Dec 2016 00:06
by riki
Hello sleid, thanks for your reply.
sleid wrote:First:
Clear Config and Import Disks : if ada0 is unformatted
format ada0 for zfs storage pool
I'd already thought of reformatting, but it seems like I can't.
So as you suggested, again I just cleared config and imported, OK. Applied new info, OK.
However, ada0 appears in the WebGUI at
Disks|Management|HDD Management (just as in the screenshot in my first post),
but it doesn't appear in the disks I can format at
Disks|Management|HDD Format|Step 1.
There, it only lists da0 (that is, the usb stick with the boot partition).
Previously, I also had tried to detach one disk; that is,
Code: Select all
zpool detach p01 13757337943089075871
but when I did that, the system hanged for hours and hours, so I had to power-cycle it.
Re: pool degraded, ada0 disappeared, 2 disks apparently swapped
Posted: 31 Dec 2016 07:07
by sleid
" but at first I put one of the new disks in the wrong slot. I noticed the mistake immediately, so I shut down the box again"
Had the resilvering of the new hard drive started?
ada0 (and other if possible) smart report.
Re: pool degraded, ada0 disappeared, 2 disks apparently swapped
Posted: 31 Dec 2016 16:37
by riki
Thanks for your help, sleid!
sleid wrote:" but at first I put one of the new disks in the wrong slot. I noticed the mistake immediately, so I shut down the box again"
Had the resilvering of the new hard drive started?
I didn't check but I think so, given the present situation.
ada0 (and other if possible) smart report.
Code: Select all
$ smartctl -x /dev/ada0
smartctl 6.5 2016-05-07 r4318 [FreeBSD 10.3-RELEASE-p7 amd64] (local build)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org
=== START OF INFORMATION SECTION ===
Device Model: TOSHIBA HDWE140
Serial Number: Z5R2Y2CQF58D
LU WWN Device Id: 5 000039 6bce00218
Firmware Version: FP2A
User Capacity: 4,000,787,030,016 bytes [4.00 TB]
Sector Sizes: 512 bytes logical, 4096 bytes physical
Rotation Rate: 7200 rpm
Form Factor: 3.5 inches
Device is: Not in smartctl database [for details use: -P showall]
ATA Version is: ATA8-ACS (minor revision not indicated)
SATA Version is: SATA 3.0, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is: Sat Dec 31 16:27:17 2016 CET
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
AAM feature is: Unavailable
APM level is: 1 (minimum power consumption with standby)
Rd look-ahead is: Enabled
Write cache is: Enabled
ATA Security is: Disabled, NOT FROZEN [SEC1]
Wt Cache Reorder: Enabled
=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
General SMART Values:
Offline data collection status: (0x82) Offline data collection activity
was completed without error.
Auto Offline Data Collection: Enabled.
Self-test execution status: ( 0) The previous self-test routine completed
without error or no self-test has ever
been run.
Total time to complete Offline
data collection: ( 120) seconds.
Offline data collection
capabilities: (0x5b) SMART execute Offline immediate.
Auto Offline data collection on/off support.
Suspend Offline collection upon new
command.
Offline surface scan supported.
Self-test supported.
No Conveyance Self-test supported.
Selective Self-test supported.
SMART capabilities: (0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability: (0x01) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time: ( 2) minutes.
Extended self-test routine
recommended polling time: ( 475) minutes.
SCT capabilities: (0x003d) SCT Status supported.
SCT Error Recovery Control supported.
SCT Feature Control supported.
SCT Data Table supported.
SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME FLAGS VALUE WORST THRESH FAIL RAW_VALUE
1 Raw_Read_Error_Rate PO-R-- 100 100 050 - 0
2 Throughput_Performance P-S--- 100 100 050 - 0
3 Spin_Up_Time POS--K 100 100 001 - 6860
4 Start_Stop_Count -O--CK 100 100 000 - 663
5 Reallocated_Sector_Ct PO--CK 100 100 050 - 0
7 Seek_Error_Rate PO-R-- 100 100 050 - 0
8 Seek_Time_Performance P-S--- 100 100 050 - 0
9 Power_On_Hours -O--CK 089 089 000 - 4421
10 Spin_Retry_Count PO--CK 113 100 030 - 0
12 Power_Cycle_Count -O--CK 100 100 000 - 43
191 G-Sense_Error_Rate -O--CK 100 100 000 - 3
192 Power-Off_Retract_Count -O--CK 100 100 000 - 15
193 Load_Cycle_Count -O--CK 100 100 000 - 664
194 Temperature_Celsius -O---K 100 100 000 - 24 (Min/Max 21/68)
196 Reallocated_Event_Count -O--CK 100 100 000 - 0
197 Current_Pending_Sector -O--CK 100 100 000 - 0
198 Offline_Uncorrectable ----CK 100 100 000 - 0
199 UDMA_CRC_Error_Count -O--CK 200 253 000 - 0
220 Disk_Shift -O---- 100 100 000 - 0
222 Loaded_Hours -O--CK 100 100 000 - 338
223 Load_Retry_Count -O--CK 100 100 000 - 0
224 Load_Friction -O---K 100 100 000 - 0
226 Load-in_Time -OS--K 100 100 000 - 213
240 Head_Flying_Hours P----- 100 100 001 - 0
||||||_ K auto-keep
|||||__ C event count
||||___ R error rate
|||____ S speed/performance
||_____ O updated online
|______ P prefailure warning
General Purpose Log Directory Version 1
SMART Log Directory Version 1 [multi-sector log support]
Address Access R/W Size Description
0x00 GPL,SL R/O 1 Log Directory
0x01 SL R/O 1 Summary SMART error log
0x02 SL R/O 51 Comprehensive SMART error log
0x03 GPL R/O 64 Ext. Comprehensive SMART error log
0x04 GPL,SL R/O 8 Device Statistics log
0x06 SL R/O 1 SMART self-test log
0x07 GPL R/O 1 Extended self-test log
0x08 GPL R/O 2 Power Conditions log
0x09 SL R/W 1 Selective self-test log
0x10 GPL R/O 1 SATA NCQ Queued Error log
0x11 GPL R/O 1 SATA Phy Event Counters log
0x24 GPL R/O 12288 Current Device Internal Status Data log
0x30 GPL,SL R/O 9 IDENTIFY DEVICE data log
0x80-0x9f GPL,SL R/W 16 Host vendor specific log
0xa7 GPL VS 8 Device vendor specific log
0xe0 GPL,SL R/W 1 SCT Command/Status
0xe1 GPL,SL R/W 1 SCT Data Transfer
SMART Extended Comprehensive Error Log Version: 1 (64 sectors)
No Errors Logged
SMART Extended Self-test Log Version: 1 (1 sectors)
No self-tests have been logged. [To run self-tests, use: smartctl -t]
SMART Selective self-test log data structure revision number 1
SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS
1 0 0 Not_testing
2 0 0 Not_testing
3 0 0 Not_testing
4 0 0 Not_testing
5 0 0 Not_testing
Selective self-test flags (0x0):
After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.
SCT Status Version: 3
SCT Version (vendor specific): 1 (0x0001)
SCT Support Level: 1
Device State: Active (0)
Current Temperature: 24 Celsius
Power Cycle Min/Max Temperature: 23/48 Celsius
Lifetime Min/Max Temperature: 21/68 Celsius
Under/Over Temperature Limit Count: 0/387
SCT Temperature History Version: 2
Temperature Sampling Period: 1 minute
Temperature Logging Interval: 1 minute
Min/Max recommended Temperature: 5/55 Celsius
Min/Max Temperature Limit: 5/55 Celsius
Temperature History Size (Index): 478 (11)
Index Estimated Time Temperature Celsius
12 2016-12-31 08:30 48 *****************************
... ..( 16 skipped). .. *****************************
29 2016-12-31 08:47 48 *****************************
30 2016-12-31 08:48 ? -
31 2016-12-31 08:49 48 *****************************
... ..( 17 skipped). .. *****************************
49 2016-12-31 09:07 48 *****************************
50 2016-12-31 09:08 ? -
51 2016-12-31 09:09 26 *******
52 2016-12-31 09:10 27 ********
53 2016-12-31 09:11 27 ********
54 2016-12-31 09:12 28 *********
55 2016-12-31 09:13 29 **********
56 2016-12-31 09:14 29 **********
57 2016-12-31 09:15 30 ***********
58 2016-12-31 09:16 30 ***********
59 2016-12-31 09:17 31 ************
... ..( 2 skipped). .. ************
62 2016-12-31 09:20 31 ************
63 2016-12-31 09:21 ? -
64 2016-12-31 09:22 32 *************
65 2016-12-31 09:23 32 *************
66 2016-12-31 09:24 33 **************
67 2016-12-31 09:25 33 **************
68 2016-12-31 09:26 33 **************
69 2016-12-31 09:27 34 ***************
70 2016-12-31 09:28 34 ***************
71 2016-12-31 09:29 34 ***************
72 2016-12-31 09:30 35 ****************
... ..( 2 skipped). .. ****************
75 2016-12-31 09:33 35 ****************
76 2016-12-31 09:34 36 *****************
... ..( 6 skipped). .. *****************
83 2016-12-31 09:41 36 *****************
84 2016-12-31 09:42 ? -
85 2016-12-31 09:43 37 ******************
... ..( 3 skipped). .. ******************
89 2016-12-31 09:47 37 ******************
90 2016-12-31 09:48 38 *******************
... ..( 5 skipped). .. *******************
96 2016-12-31 09:54 38 *******************
97 2016-12-31 09:55 39 ********************
... ..( 6 skipped). .. ********************
104 2016-12-31 10:02 39 ********************
105 2016-12-31 10:03 ? -
106 2016-12-31 10:04 39 ********************
107 2016-12-31 10:05 40 *********************
... ..( 8 skipped). .. *********************
116 2016-12-31 10:14 40 *********************
117 2016-12-31 10:15 41 **********************
... ..( 7 skipped). .. **********************
125 2016-12-31 10:23 41 **********************
126 2016-12-31 10:24 ? -
127 2016-12-31 10:25 41 **********************
... ..( 6 skipped). .. **********************
134 2016-12-31 10:32 41 **********************
135 2016-12-31 10:33 42 ***********************
136 2016-12-31 10:34 41 **********************
137 2016-12-31 10:35 42 ***********************
... ..( 8 skipped). .. ***********************
146 2016-12-31 10:44 42 ***********************
147 2016-12-31 10:45 ? -
148 2016-12-31 10:46 42 ***********************
... ..( 18 skipped). .. ***********************
167 2016-12-31 11:05 42 ***********************
168 2016-12-31 11:06 ? -
169 2016-12-31 11:07 42 ***********************
... ..( 18 skipped). .. ***********************
188 2016-12-31 11:26 42 ***********************
189 2016-12-31 11:27 ? -
190 2016-12-31 11:28 42 ***********************
... ..( 18 skipped). .. ***********************
209 2016-12-31 11:47 42 ***********************
210 2016-12-31 11:48 ? -
211 2016-12-31 11:49 42 ***********************
... ..( 18 skipped). .. ***********************
230 2016-12-31 12:08 42 ***********************
231 2016-12-31 12:09 ? -
232 2016-12-31 12:10 42 ***********************
... ..( 18 skipped). .. ***********************
251 2016-12-31 12:29 42 ***********************
252 2016-12-31 12:30 ? -
253 2016-12-31 12:31 42 ***********************
254 2016-12-31 12:32 42 ***********************
255 2016-12-31 12:33 42 ***********************
256 2016-12-31 12:34 43 ************************
257 2016-12-31 12:35 42 ***********************
258 2016-12-31 12:36 43 ************************
259 2016-12-31 12:37 42 ***********************
... ..( 6 skipped). .. ***********************
266 2016-12-31 12:44 42 ***********************
267 2016-12-31 12:45 43 ************************
268 2016-12-31 12:46 42 ***********************
269 2016-12-31 12:47 42 ***********************
270 2016-12-31 12:48 42 ***********************
271 2016-12-31 12:49 43 ************************
272 2016-12-31 12:50 42 ***********************
273 2016-12-31 12:51 ? -
274 2016-12-31 12:52 42 ***********************
275 2016-12-31 12:53 43 ************************
276 2016-12-31 12:54 43 ************************
277 2016-12-31 12:55 42 ***********************
278 2016-12-31 12:56 43 ************************
... ..( 5 skipped). .. ************************
284 2016-12-31 13:02 43 ************************
285 2016-12-31 13:03 42 ***********************
286 2016-12-31 13:04 43 ************************
287 2016-12-31 13:05 42 ***********************
288 2016-12-31 13:06 42 ***********************
289 2016-12-31 13:07 42 ***********************
290 2016-12-31 13:08 43 ************************
291 2016-12-31 13:09 42 ***********************
292 2016-12-31 13:10 43 ************************
293 2016-12-31 13:11 43 ************************
294 2016-12-31 13:12 ? -
295 2016-12-31 13:13 43 ************************
296 2016-12-31 13:14 43 ************************
297 2016-12-31 13:15 42 ***********************
298 2016-12-31 13:16 42 ***********************
299 2016-12-31 13:17 43 ************************
... ..( 9 skipped). .. ************************
309 2016-12-31 13:27 43 ************************
310 2016-12-31 13:28 42 ***********************
311 2016-12-31 13:29 43 ************************
312 2016-12-31 13:30 42 ***********************
313 2016-12-31 13:31 43 ************************
314 2016-12-31 13:32 43 ************************
315 2016-12-31 13:33 ? -
316 2016-12-31 13:34 26 *******
317 2016-12-31 13:35 26 *******
318 2016-12-31 13:36 26 *******
319 2016-12-31 13:37 27 ********
320 2016-12-31 13:38 27 ********
321 2016-12-31 13:39 28 *********
322 2016-12-31 13:40 29 **********
323 2016-12-31 13:41 ? -
324 2016-12-31 13:42 29 **********
325 2016-12-31 13:43 29 **********
326 2016-12-31 13:44 30 ***********
327 2016-12-31 13:45 30 ***********
328 2016-12-31 13:46 31 ************
... ..( 2 skipped). .. ************
331 2016-12-31 13:49 31 ************
332 2016-12-31 13:50 32 *************
333 2016-12-31 13:51 32 *************
334 2016-12-31 13:52 32 *************
335 2016-12-31 13:53 33 **************
... ..( 2 skipped). .. **************
338 2016-12-31 13:56 33 **************
339 2016-12-31 13:57 34 ***************
... ..( 3 skipped). .. ***************
343 2016-12-31 14:01 34 ***************
344 2016-12-31 14:02 ? -
345 2016-12-31 14:03 26 *******
346 2016-12-31 14:04 ? -
347 2016-12-31 14:05 26 *******
348 2016-12-31 14:06 27 ********
349 2016-12-31 14:07 27 ********
350 2016-12-31 14:08 28 *********
351 2016-12-31 14:09 28 *********
352 2016-12-31 14:10 29 **********
353 2016-12-31 14:11 29 **********
354 2016-12-31 14:12 30 ***********
355 2016-12-31 14:13 30 ***********
356 2016-12-31 14:14 31 ************
... ..( 2 skipped). .. ************
359 2016-12-31 14:17 31 ************
360 2016-12-31 14:18 32 *************
361 2016-12-31 14:19 32 *************
362 2016-12-31 14:20 32 *************
363 2016-12-31 14:21 33 **************
364 2016-12-31 14:22 33 **************
365 2016-12-31 14:23 33 **************
366 2016-12-31 14:24 34 ***************
367 2016-12-31 14:25 ? -
368 2016-12-31 14:26 32 *************
369 2016-12-31 14:27 33 **************
370 2016-12-31 14:28 33 **************
371 2016-12-31 14:29 33 **************
372 2016-12-31 14:30 34 ***************
... ..( 2 skipped). .. ***************
375 2016-12-31 14:33 34 ***************
376 2016-12-31 14:34 35 ****************
... ..( 2 skipped). .. ****************
379 2016-12-31 14:37 35 ****************
380 2016-12-31 14:38 36 *****************
381 2016-12-31 14:39 36 *****************
382 2016-12-31 14:40 36 *****************
383 2016-12-31 14:41 ? -
384 2016-12-31 14:42 32 *************
385 2016-12-31 14:43 32 *************
386 2016-12-31 14:44 33 **************
387 2016-12-31 14:45 33 **************
388 2016-12-31 14:46 33 **************
389 2016-12-31 14:47 34 ***************
390 2016-12-31 14:48 34 ***************
391 2016-12-31 14:49 34 ***************
392 2016-12-31 14:50 35 ****************
... ..( 2 skipped). .. ****************
395 2016-12-31 14:53 35 ****************
396 2016-12-31 14:54 36 *****************
... ..( 5 skipped). .. *****************
402 2016-12-31 15:00 36 *****************
403 2016-12-31 15:01 37 ******************
... ..( 4 skipped). .. ******************
408 2016-12-31 15:06 37 ******************
409 2016-12-31 15:07 38 *******************
410 2016-12-31 15:08 ? -
411 2016-12-31 15:09 34 ***************
412 2016-12-31 15:10 34 ***************
413 2016-12-31 15:11 35 ****************
414 2016-12-31 15:12 35 ****************
415 2016-12-31 15:13 35 ****************
416 2016-12-31 15:14 36 *****************
417 2016-12-31 15:15 36 *****************
418 2016-12-31 15:16 36 *****************
419 2016-12-31 15:17 ? -
420 2016-12-31 15:18 25 ******
421 2016-12-31 15:19 25 ******
422 2016-12-31 15:20 26 *******
423 2016-12-31 15:21 26 *******
424 2016-12-31 15:22 26 *******
425 2016-12-31 15:23 27 ********
426 2016-12-31 15:24 27 ********
427 2016-12-31 15:25 28 *********
428 2016-12-31 15:26 28 *********
429 2016-12-31 15:27 29 **********
430 2016-12-31 15:28 29 **********
431 2016-12-31 15:29 30 ***********
432 2016-12-31 15:30 ? -
433 2016-12-31 15:31 28 *********
434 2016-12-31 15:32 28 *********
435 2016-12-31 15:33 29 **********
436 2016-12-31 15:34 29 **********
437 2016-12-31 15:35 30 ***********
438 2016-12-31 15:36 30 ***********
439 2016-12-31 15:37 ? -
440 2016-12-31 15:38 29 **********
441 2016-12-31 15:39 29 **********
442 2016-12-31 15:40 30 ***********
443 2016-12-31 15:41 30 ***********
444 2016-12-31 15:42 30 ***********
445 2016-12-31 15:43 31 ************
... ..( 2 skipped). .. ************
448 2016-12-31 15:46 31 ************
449 2016-12-31 15:47 32 *************
450 2016-12-31 15:48 ? -
451 2016-12-31 15:49 25 ******
452 2016-12-31 15:50 25 ******
453 2016-12-31 15:51 25 ******
454 2016-12-31 15:52 26 *******
455 2016-12-31 15:53 26 *******
456 2016-12-31 15:54 ? -
457 2016-12-31 15:55 23 ****
458 2016-12-31 15:56 23 ****
459 2016-12-31 15:57 24 *****
460 2016-12-31 15:58 24 *****
461 2016-12-31 15:59 25 ******
462 2016-12-31 16:00 ? -
463 2016-12-31 16:01 24 *****
464 2016-12-31 16:02 25 ******
465 2016-12-31 16:03 25 ******
466 2016-12-31 16:04 ? -
467 2016-12-31 16:05 24 *****
468 2016-12-31 16:06 24 *****
469 2016-12-31 16:07 25 ******
470 2016-12-31 16:08 25 ******
471 2016-12-31 16:09 26 *******
472 2016-12-31 16:10 26 *******
473 2016-12-31 16:11 26 *******
474 2016-12-31 16:12 27 ********
475 2016-12-31 16:13 ? -
476 2016-12-31 16:14 24 *****
477 2016-12-31 16:15 24 *****
0 2016-12-31 16:16 25 ******
1 2016-12-31 16:17 26 *******
2 2016-12-31 16:18 26 *******
3 2016-12-31 16:19 26 *******
4 2016-12-31 16:20 27 ********
5 2016-12-31 16:21 27 ********
6 2016-12-31 16:22 28 *********
7 2016-12-31 16:23 28 *********
8 2016-12-31 16:24 29 **********
9 2016-12-31 16:25 29 **********
10 2016-12-31 16:26 ? -
11 2016-12-31 16:27 24 *****
SCT Error Recovery Control:
Read: Disabled
Write: Disabled
Device Statistics (GP Log 0x04)
Page Offset Size Value Flags Description
0x01 ===== = = === == General Statistics (rev 2) ==
0x01 0x008 4 43 --- Lifetime Power-On Resets
0x01 0x010 4 4421 --- Power-on Hours
0x01 0x018 6 9488468464 --- Logical Sectors Written
0x01 0x020 6 38925225 --- Number of Write Commands
0x01 0x028 6 4664998478 --- Logical Sectors Read
0x01 0x030 6 19086345 --- Number of Read Commands
0x02 ===== = = === == Free-Fall Statistics (rev 1) ==
0x02 0x010 4 3 --- Overlimit Shock Events
0x03 ===== = = === == Rotating Media Statistics (rev 1) ==
0x03 0x008 4 315 --- Spindle Motor Power-on Hours
0x03 0x010 4 338 --- Head Flying Hours
0x03 0x018 4 664 --- Head Load Events
0x03 0x020 4 0 --- Number of Reallocated Logical Sectors
0x03 0x028 4 0 --- Read Recovery Attempts
0x03 0x030 4 0 --- Number of Mechanical Start Failures
0x04 ===== = = === == General Errors Statistics (rev 1) ==
0x04 0x008 4 0 --- Number of Reported Uncorrectable Errors
0x04 0x010 4 1 --- Resets Between Cmd Acceptance and Completion
0x05 ===== = = === == Temperature Statistics (rev 1) ==
0x05 0x008 1 24 --- Current Temperature
0x05 0x010 1 24 N-- Average Short Term Temperature
0x05 0x018 1 25 N-- Average Long Term Temperature
0x05 0x020 1 68 --- Highest Temperature
0x05 0x028 1 21 --- Lowest Temperature
0x05 0x030 1 55 N-- Highest Average Short Term Temperature
0x05 0x038 1 22 N-- Lowest Average Short Term Temperature
0x05 0x040 1 38 N-- Highest Average Long Term Temperature
0x05 0x048 1 25 N-- Lowest Average Long Term Temperature
0x05 0x050 4 786 --- Time in Over-Temperature
0x05 0x058 1 55 --- Specified Maximum Operating Temperature
0x05 0x060 4 0 --- Time in Under-Temperature
0x05 0x068 1 5 --- Specified Minimum Operating Temperature
0x06 ===== = = === == Transport Statistics (rev 1) ==
0x06 0x008 4 192 --- Number of Hardware Resets
0x06 0x018 4 0 --- Number of Interface CRC Errors
0x07 ===== = = === == Solid State Device Statistics (rev 1) ==
|||_ C monitored condition met
||__ D supports DSN
|___ N normalized value
SATA Phy Event Counters (GP Log 0x11)
ID Size Value Description
0x0001 4 0 Command failed due to ICRC error
0x0002 4 0 R_ERR response for data FIS
0x0003 4 0 R_ERR response for device-to-host data FIS
0x0004 4 0 R_ERR response for host-to-device data FIS
0x0005 4 0 R_ERR response for non-data FIS
0x0006 4 0 R_ERR response for device-to-host non-data FIS
0x0007 4 0 R_ERR response for host-to-device non-data FIS
0x0008 4 0 Device-to-host non-data FIS retries
0x0009 4 23 Transition from drive PhyRdy to drive PhyNRdy
0x000a 4 22 Device-to-host register FISes sent due to a COMRESET
0x000b 4 0 CRC errors within host-to-device FIS
0x000d 4 0 Non-CRC errors within host-to-device FIS
0x000f 4 0 R_ERR response for host-to-device data FIS, CRC
0x0010 4 0 R_ERR response for host-to-device data FIS, non-CRC
0x0012 4 0 R_ERR response for host-to-device non-data FIS, CRC
0x0013 4 0 R_ERR response for host-to-device non-data FIS, non-CRC
The other disk can't be probed with smartctl.
Code: Select all
Smartctl open device: /dev/13757337943089075871 failed: No such file or directory
I don't want to spam the forum with tons of data if it's useless, so I'm not posting output of smartctl or camcontrol for the other disks right now; but of course if you ask for any other info, I'll be glad to provide it.
In short, the devices connected are what they appear to be in the
Disks|Management|HDD Management screenshot above. That is, ada0 and ada1 are WD Red, ada2 and ada3 are Toshiba.
HAPPY NEW YEAR EVERYBODY!
Re: pool degraded, ada0 disappeared, 2 disks apparently swapped
Posted: 01 Jan 2017 07:05
by sleid
Happy New Year 2017,
Do you have a backup of your data, or do you have the possibility to make one?
The best solution would be to leave with a rebuilt pool.
Re: pool degraded, ada0 disappeared, 2 disks apparently swapped
Posted: 01 Jan 2017 12:46
by erico.bettoni
Just do a replace and wait for resilver:
Code: Select all
zpool replace p01 13757337943089075871 /dev/ada0
Re: pool degraded, ada0 disappeared, 2 disks apparently swapped
Posted: 01 Jan 2017 20:20
by riki
Thanks for all the helpful replies!
sleid wrote:
Do you have a backup of your data, or do you have the possibility to make one?
The best solution would be to leave with a rebuilt pool.
That pool is too large: it
is indeed the backup of most of my other machines. So no, no other backup and no easy way to back it up - I wouldn't know where to put all the data. Later this year I'm going to have one more Nas4Free box built, so I'll be able to backup the backup
, but for the time being I'm looking for a solution that doesn't entail rebuilding the pool.
erico.bettoni wrote:Just do a replace and wait for resilver:
Code: Select all
zpool replace p01 13757337943089075871 /dev/ada0
Good, thanks, I'm currently waiting for the resilver to finish. When it does, if all went well I'll be left with the problem of swapping ada0 and ada3, possibly as follows:
- [1] detaching ada0, destroying it, reformatting, attaching to ada1.
[2] detaching ada3, destroying it, reformatting, attaching to ada2.
This operation, I'm afraid, will require one or two more resilverings. Poor disks!
Any sensible shortcuts?
Re: pool degraded, ada0 disappeared, 2 disks apparently swapped
Posted: 02 Jan 2017 02:08
by erico.bettoni
No shortcuts... if you eventually rebuild the pool go with raidz2. Safer and more usable space.
Re: pool degraded, ada0 disappeared, 2 disks apparently swapped
Posted: 02 Jan 2017 06:59
by sleid
sleid wrote:
secondly:
zpool replace p01 13757337943089075871 /dev/ada0
It is common for ZFS to label discs differently for its use, this often occurs when adding disks with multiple controllers. This does not affect the operation of the pool.
Re: pool degraded, ada0 disappeared, 2 disks apparently swapped
Posted: 03 Jan 2017 04:40
by riki
sleid wrote:
secondly:
zpool replace p01 13757337943089075871 /dev/ada0
Indeed, I couldn't get to Step 2 of your procedure because I was stuck at Step 1.
Eventually I solved the problem. I had to offline/detach both offending disk, destroy them by zeroing out some select sectors with dd (I found a useful wiki page here:
http://wiki.nas4free.org/doku.php?id=faq:0129 ), take them out physically, replace one of them, resilver, replace the other, resilver again.
sleid wrote:It is common for ZFS to label discs differently for its use, this often occurs when adding disks with multiple controllers. This does not affect the operation of the pool.
Besides, I found out that when there are missing disks, the adaX numbers are changed in an unpredictable way, so great care must be exercised. I used camcontrol identify adaX to check make, model and serial no. before destroying the disks.
Also ada0 appearing unformatted was just a quirk, some discrepancy between the WebGUI and the actual system state that solved itself once the pool got back to full health. I'm glad the WebGUI didn't let me format it
THANKS AGAIN for the great help!