Destroy and re-create the pool?

[lindsay]

I know there is one hdd wich holds the data, and there is tv-series i want to save.
So how to do this? as i recall it is ada7 wich holds the data

[raulfg3]

please post more info about your pool config, (how many vdev have, if is raiz1 or raidz2, etc.. )

and why you need to destroy and re-create a pool

[lindsay]

It`s a raidz holding ada7,ada9,ada10 wich is named hdc this pool i want to save

Other raidz is hda wich has ada0,ada1,ada2.
Other raidz is hdb wich has ada3,ada4,ada5
other raidz is hdd wich had ada6,ada8,ada11

All of them is western digital red 2TB

[raulfg3]

You do not say why need to destroy the pool.

But easy and only way is to copy data to other site ( other pool, and external HD, etc...), destroy pool and recreate it

[lindsay]

Why i say this is because when i run zpool import -f hdc i get an output saying this.

So how save the data 770GB of series?

[lindsay]

Is there any options to create only ada7 in read only mode to access the data and copy?

[raulfg3]

Is there any options to create only ada7 in read only mode to access the data and copy?

no.

and because how ZFS works , I'm totally sure that your series are not only in one drive ( I'm sure that are split in the 3 disk that you use to create the pool).

So your atemps can be in the direction of import your hdc pool and recover your valuable data.

please keep in mind that RAID of any kind ( including ZFS raid) IS NOT a BACKUP.

If your data is valuable , you need to have copy of then in other physical places.

Please post your problem with import hdc

[b0ssman]

you forgot to tell us what what output of zpool import -f hdc was

[lindsay]

zpool import -f hdc
Destroy and re-create the pool from
a backup source

[b0ssman]

what is the output from zpool status?

[raulfg3]

zpool import -f hdc
Destroy and re-create the pool from
a backup source

Is like if your metadata are corrupt, if is your case, you are lose your data, your option is recreate the pool and copy data from a backup.

some links from google:

http://forums.freenas.org/threads/zpool ... help.7222/

https://github.com/zfsonlinux/zfs/issues/1128
http://askubuntu.com/questions/99266/wh ... d-zfs-pool
http://comments.gmane.org/gmane.os.sola ... .zfs/44594

Perhaps some switchs like -R or -fF -R can work, please google a bit and try before to do the data lost.

[lindsay]

My question is also can i have mixed up the hdd`s?
So thats why i have some problems pool hdd is not coming up eitghter but this is empty anyway

[b0ssman]

thats why i am asking for the output of zpool status.

at the moment we dont even know whats wrong with your pool

[lindsay]

Code: Select all

nas4free: ~ # zpool import
   pool: hdc
     id: 13012647312364876994
  state: UNAVAIL
 status: One or more devices are missing from the system.
 action: The pool cannot be imported. Attach the missing
        devices and try again.
   see: http://illumos.org/msg/ZFS-8000-3C
 config:

        hdc                       UNAVAIL  insufficient replicas
          raidz1-0                UNAVAIL  insufficient replicas
            ada7                  ONLINE
            13066297810879048127  UNAVAIL  cannot open
            18394673642247110083  UNAVAIL  cannot open

Code: Select all

nas4free: ~ # zpool status
  pool: hda
 state: ONLINE
  scan: scrub repaired 0 in 4h37m with 0 errors on Wed Jul 17 15:13:25 2013
config:

        NAME        STATE     READ WRITE CKSUM
        hda         ONLINE       0     0     0
          raidz1-0  ONLINE       0     0     0
            ada0    ONLINE       0     0     0
            ada1    ONLINE       0     0     0
            ada2    ONLINE       0     0     0

errors: No known data errors

  pool: hdb
 state: ONLINE
  scan: scrub repaired 0 in 5h19m with 0 errors on Wed Jul 17 15:54:50 2013
config:

        NAME        STATE     READ WRITE CKSUM
        hdb         ONLINE       0     0     0
          raidz1-0  ONLINE       0     0     0
            ada3    ONLINE       0     0     0
            ada4    ONLINE       0     0     0
            ada5    ONLINE       0     0     0

errors: No known data errors

  pool: hdd
 state: ONLINE
  scan: none requested
config:

        NAME           STATE     READ WRITE CKSUM
        hdd            ONLINE       0     0     0
          raidz1-0     ONLINE       0     0     0
            ada6.nop   ONLINE       0     0     0
            ada8.nop   ONLINE       0     0     0
            ada11.nop  ONLINE       0     0     0

errors: No known data errors

[b0ssman]

so what happend to ada9,ada10?

have they died?

[lindsay]

No not in the managments of hdd and when you create virtual discs.
Maybe there is some permission problems i do not know

[b0ssman]

No not in the managments of hdd and when you create virtual discs.
Maybe there is some permission problems i do not know

i dont quite understand.

are they still visible in the system. as in you can provide smart outout?

[lindsay]

I can see them information S.M.A.R.T section and in status disks section and also in managment disks as they are online

These disks is hooked to an esata controller by marvel 92xx.

[lindsay]

Code: Select all

ada0	1907730MB	WDC WD20EFRX-68AX9N0 80.00A80 	WDC WD20EFRX-68AX9N0 	WD-WMC300505790 	60 	ZFS storage pool device 	ONLINE 	Edit disk   Delete disk
ada1	1907730MB	WDC WD20EFRX-68AX9N0 80.00A80 	WDC WD20EFRX-68AX9N0 	WD-WMC300287480 	60 	ZFS storage pool device 	ONLINE 	Edit disk   Delete disk
ada2	1907730MB	WDC WD20EFRX-68AX9N0 80.00A80 	WDC WD20EFRX-68AX9N0 	WD-WMC300225568 	60 	ZFS storage pool device 	ONLINE 	Edit disk   Delete disk
ada3	1907730MB	WDC WD20EFRX-68AX9N0 80.00A80 	WDC WD20EFRX-68AX9N0 	WD-WMC301112406 	60 	ZFS storage pool device 	ONLINE 	Edit disk   Delete disk
ada4	1907730MB	WDC WD20EFRX-68AX9N0 80.00A80 	WDC WD20EFRX-68AX9N0 	WD-WMC300997772 	60 	ZFS storage pool device 	ONLINE 	Edit disk   Delete disk
ada5	1907730MB	WDC WD20EFRX-68AX9N0 80.00A80 	WDC WD20EFRX-68AX9N0 	WD-WMC300522594 	60 	ZFS storage pool device 	ONLINE 	Edit disk   Delete disk
ada6	1907730MB	WDC WD20EADS-00R6B0 01.00A01 	WDC WD20EADS-00R6B0 	WD-WCAVY1942901 	60 	ZFS storage pool device 	ONLINE 	Edit disk   Delete disk
ada7	1907730MB	WDC WD20EFRX-68AX9N0 80.00A80 	WDC WD20EFRX-68AX9N0 	WD-WMC300488699 	60 	ZFS storage pool device 	ONLINE 	Edit disk   Delete disk
ada8	1907730MB	WDC WD20EADS-00R6B0 01.00A01 	WDC WD20EADS-00R6B0 	WD-WCAVY1942916 	60 	ZFS storage pool device 	ONLINE 	Edit disk   Delete disk
ada9	1907730MB	WDC WD20EFRX-68AX9N0 80.00A80 	WDC WD20EFRX-68AX9N0 	WD-WMC300489718 	60 	ZFS storage pool device 	ONLINE 	Edit disk   Delete disk
ada10	1907730MB	WDC WD20EFRX-68AX9N0 80.00A80 	WDC WD20EFRX-68AX9N0 	WD-WMC300997617 	60 	ZFS storage pool device 	ONLINE 	Edit disk   Delete disk
ada11	1907730MB	WDC WD20EADS-00R6B0 01.00A01 	WDC WD20EADS-00R6B0 	WD-WCAVY1968136 	60 	ZFS storage pool device 	ONLINE 	Edit disk   Delete disk
ada12	953870MB	ST31000528AS CC37 	ST31000528AS 	9VP25796 	60 	UFS 	ONLINE 

[lindsay]

Code: Select all

ada0	1907730MB	WDC WD20EFRX-68AX9N0 80.00A80 	WDC WD20EFRX-68AX9N0 	WD-WMC300505790 	ZFS storage pool device 	11.85 KiB/t, 0 tps, 0.01 MiB/s 	29 °C 	ONLINE 
ada1	1907730MB	WDC WD20EFRX-68AX9N0 80.00A80 	WDC WD20EFRX-68AX9N0 	WD-WMC300287480 	ZFS storage pool device 	12.11 KiB/t, 0 tps, 0.01 MiB/s 	28 °C 	ONLINE 
ada2	1907730MB	WDC WD20EFRX-68AX9N0 80.00A80 	WDC WD20EFRX-68AX9N0 	WD-WMC300225568 	ZFS storage pool device 	12.19 KiB/t, 0 tps, 0.01 MiB/s 	28 °C 	ONLINE 
ada3	1907730MB	WDC WD20EFRX-68AX9N0 80.00A80 	WDC WD20EFRX-68AX9N0 	WD-WMC301112406 	ZFS storage pool device 	44.67 KiB/t, 1 tps, 0.04 MiB/s 	28 °C 	ONLINE 
ada4	1907730MB	WDC WD20EFRX-68AX9N0 80.00A80 	WDC WD20EFRX-68AX9N0 	WD-WMC300997772 	ZFS storage pool device 	44.99 KiB/t, 1 tps, 0.04 MiB/s 	28 °C 	ONLINE 
ada5	1907730MB	WDC WD20EFRX-68AX9N0 80.00A80 	WDC WD20EFRX-68AX9N0 	WD-WMC300522594 	ZFS storage pool device 	44.28 KiB/t, 1 tps, 0.04 MiB/s 	28 °C 	ONLINE 
ada6	1907730MB	WDC WD20EADS-00R6B0 01.00A01 	WDC WD20EADS-00R6B0 	WD-WCAVY1942901 	ZFS storage pool device 	28.99 KiB/t, 1 tps, 0.03 MiB/s 	29 °C 	ONLINE 
ada7	1907730MB	WDC WD20EFRX-68AX9N0 80.00A80 	WDC WD20EFRX-68AX9N0 	WD-WMC300488699 	ZFS storage pool device 	42.06 KiB/t, 0 tps, 0.00 MiB/s 	29 °C 	ONLINE 
ada8	1907730MB	WDC WD20EADS-00R6B0 01.00A01 	WDC WD20EADS-00R6B0 	WD-WCAVY1942916 	ZFS storage pool device 	22.40 KiB/t, 1 tps, 0.02 MiB/s 	30 °C 	ONLINE 
ada9	1907730MB	WDC WD20EFRX-68AX9N0 80.00A80 	WDC WD20EFRX-68AX9N0 	WD-WMC300489718 	ZFS storage pool device 	57.58 KiB/t, 0 tps, 0.00 MiB/s 	29 °C 	ONLINE 
ada10	1907730MB	WDC WD20EFRX-68AX9N0 80.00A80 	WDC WD20EFRX-68AX9N0 	WD-WMC300997617 	ZFS storage pool device 	56.06 KiB/t, 0 tps, 0.00 MiB/s 	30 °C 	ONLINE 
ada11	1907730MB	WDC WD20EADS-00R6B0 01.00A01 	WDC WD20EADS-00R6B0 	WD-WCAVY1968136 	ZFS storage pool device 	8.19 KiB/t, 1 tps, 0.01 MiB/s 	34 °C 	ONLINE 
ada12	953870MB	ST31000528AS CC37 	ST31000528AS 	9VP25796 	UFS 	65.62 KiB/t, 1 tps, 0.03 MiB/s 	29 °C 

[lindsay]

Code: Select all

Device /dev/ada9 - WDC WD20EFRX-68AX9N0 80.00A80
=== START OF INFORMATION SECTION ===
Model Family:     Western Digital Red (AF)
Device Model:     WDC WD20EFRX-68AX9N0
Serial Number:    WD-WMC300489718
LU WWN Device Id: 5 0014ee 0ae1bb79f
Firmware Version: 80.00A80
User Capacity:    2,000,398,934,016 bytes [2.00 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   ACS-2 (minor revision not indicated)
SATA Version is:  SATA 3.0, 6.0 Gb/s (current: 3.0 Gb/s)
Local Time is:    Thu Jul 18 14:30:11 2013 UTC
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x02)	Offline data collection activity
					was completed without error.
					Auto Offline Data Collection: Disabled.
Self-test execution status:      (   0)	The previous self-test routine completed
					without error or no self-test has ever
					been run.
Total time to complete Offline
data collection: 		(28080) seconds.
Offline data collection
capabilities: 			 (0x7b) SMART execute Offline immediate.
					Auto Offline data collection on/off support.
					Suspend Offline collection upon new
					command.
					Offline surface scan supported.
					Self-test supported.
					Conveyance Self-test supported.
					Selective Self-test supported.
SMART capabilities:            (0x0003)	Saves SMART data before entering
					power-saving mode.
					Supports SMART auto save timer.
Error logging capability:        (0x01)	Error logging supported.
					General Purpose Logging supported.
Short self-test routine
recommended polling time: 	 (   2) minutes.
Extended self-test routine
recommended polling time: 	 ( 284) minutes.
Conveyance self-test routine
recommended polling time: 	 (   5) minutes.
SCT capabilities: 	       (0x70bd)	SCT Status supported.
					SCT Error Recovery Control supported.
					SCT Feature Control supported.
					SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x002f   200   200   051    Pre-fail  Always       -       0
  3 Spin_Up_Time            0x0027   181   169   021    Pre-fail  Always       -       3941
  4 Start_Stop_Count        0x0032   100   100   000    Old_age   Always       -       174
  5 Reallocated_Sector_Ct   0x0033   200   200   140    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x002e   200   200   000    Old_age   Always       -       0
  9 Power_On_Hours          0x0032   094   094   000    Old_age   Always       -       4712
 10 Spin_Retry_Count        0x0032   100   100   000    Old_age   Always       -       0
 11 Calibration_Retry_Count 0x0032   100   100   000    Old_age   Always       -       0
 12 Power_Cycle_Count       0x0032   100   100   000    Old_age   Always       -       134
192 Power-Off_Retract_Count 0x0032   200   200   000    Old_age   Always       -       66
193 Load_Cycle_Count        0x0032   200   200   000    Old_age   Always       -       107
194 Temperature_Celsius     0x0022   118   105   000    Old_age   Always       -       29
196 Reallocated_Event_Count 0x0032   200   200   000    Old_age   Always       -       0
197 Current_Pending_Sector  0x0032   200   200   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0030   200   200   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x0032   200   200   000    Old_age   Always       -       0
200 Multi_Zone_Error_Rate   0x0008   200   200   000    Old_age   Offline      -       0

SMART Error Log Version: 1
No Errors Logged

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%      2913         -
# 2  Extended offline    Completed without error       00%      2777         -
# 3  Extended offline    Completed without error       00%      2769         -
# 4  Extended offline    Completed without error       00%      2753         -
# 5  Extended offline    Completed without error       00%      2745         -
# 6  Extended offline    Completed without error       00%      2729         -
# 7  Extended offline    Completed without error       00%      2722         -
# 8  Extended offline    Completed without error       00%      2705         -
# 9  Extended offline    Completed without error       00%      2697         -
#10  Short offline       Completed without error       00%      2668         -
#11  Extended offline    Completed without error       00%      2637         -
#12  Extended offline    Interrupted (host reset)      10%      1003         -
#13  Extended offline    Completed without error       00%       980         -
#14  Extended offline    Completed without error       00%       956         -
#15  Extended offline    Completed without error       00%       634         -
#16  Short offline       Completed without error       00%        34         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.
Device /dev/ada10 - WDC WD20EFRX-68AX9N0 80.00A80
=== START OF INFORMATION SECTION ===
Model Family:     Western Digital Red (AF)
Device Model:     WDC WD20EFRX-68AX9N0
Serial Number:    WD-WMC300997617
LU WWN Device Id: 5 0014ee 058da2f90
Firmware Version: 80.00A80
User Capacity:    2,000,398,934,016 bytes [2.00 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   ACS-2 (minor revision not indicated)
SATA Version is:  SATA 3.0, 6.0 Gb/s (current: 3.0 Gb/s)
Local Time is:    Thu Jul 18 14:30:11 2013 UTC
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x02)	Offline data collection activity
					was completed without error.
					Auto Offline Data Collection: Disabled.
Self-test execution status:      (   0)	The previous self-test routine completed
					without error or no self-test has ever
					been run.
Total time to complete Offline
data collection: 		(25920) seconds.
Offline data collection
capabilities: 			 (0x7b) SMART execute Offline immediate.
					Auto Offline data collection on/off support.
					Suspend Offline collection upon new
					command.
					Offline surface scan supported.
					Self-test supported.
					Conveyance Self-test supported.
					Selective Self-test supported.
SMART capabilities:            (0x0003)	Saves SMART data before entering
					power-saving mode.
					Supports SMART auto save timer.
Error logging capability:        (0x01)	Error logging supported.
					General Purpose Logging supported.
Short self-test routine
recommended polling time: 	 (   2) minutes.
Extended self-test routine
recommended polling time: 	 ( 262) minutes.
Conveyance self-test routine
recommended polling time: 	 (   5) minutes.
SCT capabilities: 	       (0x70bd)	SCT Status supported.
					SCT Error Recovery Control supported.
					SCT Feature Control supported.
					SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x002f   200   200   051    Pre-fail  Always       -       0
  3 Spin_Up_Time            0x0027   176   169   021    Pre-fail  Always       -       4175
  4 Start_Stop_Count        0x0032   100   100   000    Old_age   Always       -       95
  5 Reallocated_Sector_Ct   0x0033   200   200   140    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x002e   200   200   000    Old_age   Always       -       0
  9 Power_On_Hours          0x0032   098   098   000    Old_age   Always       -       2116
 10 Spin_Retry_Count        0x0032   100   253   000    Old_age   Always       -       0
 11 Calibration_Retry_Count 0x0032   100   253   000    Old_age   Always       -       0
 12 Power_Cycle_Count       0x0032   100   100   000    Old_age   Always       -       81
192 Power-Off_Retract_Count 0x0032   200   200   000    Old_age   Always       -       41
193 Load_Cycle_Count        0x0032   200   200   000    Old_age   Always       -       53
194 Temperature_Celsius     0x0022   117   108   000    Old_age   Always       -       30
196 Reallocated_Event_Count 0x0032   200   200   000    Old_age   Always       -       0
197 Current_Pending_Sector  0x0032   200   200   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0030   200   200   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x0032   200   200   000    Old_age   Always       -       0
200 Multi_Zone_Error_Rate   0x0008   200   200   000    Old_age   Offline      -       0

SMART Error Log Version: 1
No Errors Logged

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%       338         -
# 2  Extended offline    Completed without error       00%       202         -
# 3  Extended offline    Completed without error       00%       194         -
# 4  Extended offline    Completed without error       00%       178         -
# 5  Extended offline    Completed without error       00%       170         -
# 6  Extended offline    Completed without error       00%       154         -
# 7  Extended offline    Completed without error       00%       147         -
# 8  Extended offline    Completed without error       00%       130         -
# 9  Extended offline    Completed without error       00%       122         -
#10  Short offline       Completed without error       00%        93         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

[b0ssman]

ok turn off your system and take

ada7

out of the system and see what zpool status says then.

[lindsay]

The hdd`s has changed though so in mangement section there is wrong hdd`s

What i maybe can do also is to remove the hdd`s wich is a part of pool hdd?

Code: Select all

zpool status
  pool: hda
 state: ONLINE
  scan: scrub repaired 0 in 4h37m with 0 errors on Wed Jul 17 15:13:25 2013
config:

        NAME        STATE     READ WRITE CKSUM
        hda         ONLINE       0     0     0
          raidz1-0  ONLINE       0     0     0
            ada0    ONLINE       0     0     0
            ada1    ONLINE       0     0     0
            ada2    ONLINE       0     0     0

errors: No known data errors

  pool: hdb
 state: ONLINE
  scan: scrub repaired 0 in 5h19m with 0 errors on Wed Jul 17 15:54:50 2013
config:

        NAME        STATE     READ WRITE CKSUM
        hdb         ONLINE       0     0     0
          raidz1-0  ONLINE       0     0     0
            ada3    ONLINE       0     0     0
            ada4    ONLINE       0     0     0
            ada5    ONLINE       0     0     0

errors: No known data errors

  pool: hdd
 state: ONLINE
  scan: none requested
config:

        NAME          STATE     READ WRITE CKSUM
        hdd           ONLINE       0     0     0
          raidz1-0    ONLINE       0     0     0
            ada6.nop  ONLINE       0     0     0
            ada8.nop  ONLINE       0     0     0
            ada10     ONLINE       0     0     0

errors: No known data errors

[lindsay]

If i get this to be recovered i am going to buy 3 western digital 3TB hdd`s wich make backup of the pools using local rsync for sure

[b0ssman]

this is a bad sign.

its seems that the 2 external drives dont have any zfs metadata on them.

if you can even recover from this i do not know.