This is the old XigmaNAS forum in read only mode,
it will taken offline by the end of march 2021!



I like to aks Users and Admins to rewrite/take over important post from here into the new fresh main forum!
Its not possible for us to export from here and import it to the main forum!

ZFS>Pools>Tools>offline not displaying all disks

Forum rules
Set-Up GuideFAQsForum Rules
Post Reply
actyler1001
Starter
Starter
Posts: 21
Joined: 31 May 2015 04:22
Status: Offline

ZFS>Pools>Tools>offline not displaying all disks

Post by actyler1001 »

Hello again! I am in a bit of a spot here with my production NAS4Free setup and need some guidance.

I have a single 6 disk ZFS Pool and one of the disks has failed. I found a walkthrough for replacing the disk, but the first step is to venture into ZFS>Pools>Tools> and "offline" the failed disk. Unfortunately there are only 4 disks listed in this screen, not six. how do I get the interface to show all the drives so I can "offline" this bad drive? Other alternatives? :oops:

actyler1001
Starter
Starter
Posts: 21
Joined: 31 May 2015 04:22
Status: Offline

Re: ZFS>Pools>Tools>offline not displaying all disks

Post by actyler1001 »

I think I figured this out from the CLI...

zpool list # will give you a list of drives and zPools, in my case I had a drive listed as "ada2" that was in the "REMOVED" status.

zpool offline zPool_01 ada2 # this changed the status of my drive in zpool list from "REMOVED" to "OFFLINE". Guess I can continue with the tutorial.. Wonder why the GUI didn't know about ada2... Hmm..

kenZ71
Advanced User
Advanced User
Posts: 379
Joined: 27 Jun 2012 20:18
Location: Northeast, USA
Status: Offline

Re: ZFS>Pools>Tools>offline not displaying all disks

Post by kenZ71 »

Worst case just power down and swap the drive.

ZFS is truly incredible, it may just pull in the new drive and start the resilver. Or, you may need to issue the replace command.
11.2-RELEASE-p3 | ZFS Mirror - 2 x 8TB WD Red | 28GB ECC Ram
HP ML10v2 x64-embedded on Intel(R) Core(TM) i3-4150 CPU @ 3.50GHz

Extra memory so I can host a couple VMs
1) Unifi Controller on Ubuntu
2) Librenms on Ubuntu

actyler1001
Starter
Starter
Posts: 21
Joined: 31 May 2015 04:22
Status: Offline

Re: ZFS>Pools>Tools>offline not displaying all disks

Post by actyler1001 »

It sure didn't feel truly incredible.. When the drive failed it made the entire iscsi target unavailable until the system was restarted. Afterward it seemed to fail the drive and function as it should, but I could have done without rushing to the site......

User avatar
raulfg3
Site Admin
Site Admin
Posts: 4865
Joined: 22 Jun 2012 22:13
Location: Madrid (ESPAÑA)
Contact:
Status: Offline

Re: ZFS>Pools>Tools>offline not displaying all disks

Post by raulfg3 »

please post zpool status.

if you have raidZ1 , one drive fail DO NOT make innaccesible your data, only a bit slow, so I suspect that you have a simple ZFS pool wihtout redundancy.

Please post a screen capture of your detected disk and ZPool detected & current config too.
12.1.0.4 - Ingva (revision 7743) on SUPERMICRO X8SIL-F 8GB of ECC RAM, 11x3TB disk in 1 vdev = Vpool = 32TB Raw size , so 29TB usable size (I Have other NAS as Backup)

Wiki
Last changes

HP T510

actyler1001
Starter
Starter
Posts: 21
Joined: 31 May 2015 04:22
Status: Offline

Re: ZFS>Pools>Tools>offline not displaying all disks

Post by actyler1001 »

Hi there. I am sure I do NOT have a simple ZFS pool. It consists of 3 different Mirrors. I did this to achieve adequate redundancy as well as performance. See a current zpool status command below. When the failure occurred the "ada2" device was listed as "REMOVED" and the pool was in a degraded state. However the iSCSI target was completely inaccessible until the NAS4Free server was restarted. After restarting the server the "ada2" drive seemed to come back online for a short time and the resilver process completed.. Then it shortly after went into the "REMOVED" status again, however the 2nd time the iSCSI target remained available.

I shut the NAS4Free server down last night and physically replaced the "ada2" device with a new drive. Once the server came back online I did an import from the drive management screen, then ran the replace command to bring everything back online and get the "mirror-2" healthy again.

What I do not understand is why the entire target was unavailable. That shouldn't have happened. I also don't get why the drive failed. I have since put this brand new drive into a different system and it appears to run just fine. I have done quite a few tests on it, no issues yet.

Immediately after restarting the NAS4Free box the first time while the "bad" drive was still installed, the zpool status command showed a "1" value under CKSUM for "ada2".. What does this mean? This drive is a Western Digital 1.0 TB Black (WD1003FZEX).. Is this drive not compatible for some reason? It doesn't automatically spin down or something silly making the NAS think it is bad?

nas4free: ~ # zpool status
pool: zPool_01
state: ONLINE
scan: resilvered 127G in 0h49m with 0 errors on Thu Jun 25 15:27:19 2015
config:

NAME STATE READ WRITE CKSUM
zPool_01 ONLINE 0 0 0
mirror-0 ONLINE 0 0 0
ada0 ONLINE 0 0 0
ada1 ONLINE 0 0 0
mirror-1 ONLINE 0 0 0
ada3 ONLINE 0 0 0
ada4 ONLINE 0 0 0
mirror-2 ONLINE 0 0 0
ada2 ONLINE 0 0 0
ada5 ONLINE 0 0 0

errors: No known data errors

User avatar
raulfg3
Site Admin
Site Admin
Posts: 4865
Joined: 22 Jun 2012 22:13
Location: Madrid (ESPAÑA)
Contact:
Status: Offline

Re: ZFS>Pools>Tools>offline not displaying all disks

Post by raulfg3 »

actyler1001 wrote:What I do not understand is why the entire target was unavailable. That shouldn't have happened.
Yes. I agree. But no experience here in iSCSI so I can't help , sorry.
12.1.0.4 - Ingva (revision 7743) on SUPERMICRO X8SIL-F 8GB of ECC RAM, 11x3TB disk in 1 vdev = Vpool = 32TB Raw size , so 29TB usable size (I Have other NAS as Backup)

Wiki
Last changes

HP T510

User avatar
daoyama
Developer
Developer
Posts: 394
Joined: 25 Aug 2012 09:28
Location: Japan
Status: Offline

Re: ZFS>Pools>Tools>offline not displaying all disks

Post by daoyama »

actyler1001 wrote:However the iSCSI target was completely inaccessible until the NAS4Free server was restarted.
actyler1001 wrote:What I do not understand is why the entire target was unavailable. That shouldn't have happened. I also don't get why the drive failed.
This is not surprised thing if the drive is not respond long time.
ZFS request is locked until first is finished.
As a result upper layer cause timeout.
SCSI device on OS(you means windows?) -> iSCSI Initiator -> iSCSI Target -> ZFS -> broken physical device.

There are two timers. One is SCSI request timer, other is iSCSI request timer.

You might need MPIO and adjust timeout value.
https://technet.microsoft.com/en-us/lib ... s.10).aspx
NAS4Free 10.2.0.2.2115 (x64-embedded), 10.2.0.2.2258 (arm), 10.2.0.2.2258(dom0)
GIGABYTE 5YASV-RH, Celeron E3400 (Dual 2.6GHz), ECC 8GB, Intel ET/CT/82566DM (on-board), ZFS mirror (2TBx2)
ASRock E350M1/USB3, 16GB, Realtek 8111E (on-board), ZFS mirror (2TBx2)
MSI MS-9666, Core i7-860(Quad 2.8GHz/HT), 32GB, Mellanox ConnectX-2 EN/Intel 82578DM (on-board), ZFS mirror (3TBx2+L2ARC/ZIL:SSD128GB)
Develop/test environment:
VirtualBox 512MB VM, ESXi 512MB-8GB VM, Raspberry Pi, Pi2, ODROID-C1

actyler1001
Starter
Starter
Posts: 21
Joined: 31 May 2015 04:22
Status: Offline

Re: ZFS>Pools>Tools>offline not displaying all disks

Post by actyler1001 »

daoyama,

Thanks for your reply. Not sure I follow your description however. In regard to MPIO, I am actually not connecting the iSCSI target to a Windows server. It is connected to multiple VMware ESXi 5.5 servers and yes, I do have multiple network interfaces with multiple paths configured to the target.

That being said, do you have any additional input on why the iSCSI target would become unavailable due to a single drive failure?

Post Reply

Return to “ZFS (only!)”