Disks go missing?

[dark_phantom]

If there is a better section for this topic, mods please feel free to move it.

I have been meaning to migrate from freenas to nas4free for a while but there is one issue that has every time stumped me. So, I end up just going back to the stable freenas but I really want to upgrade.

Though, I believe it may have to be with the spin down and up of the disks but I'm not 100% sure why this would happen. My configuration is exactly as the older one and I am using a USB with full install but it also happens with the embedded version and just for info I'm using embedded on freenas.

Code: Select all

zpool status -v vol01
  pool: vol01
 state: UNAVAIL
status: One or more devices are faulted in response to IO failures.
action: Make sure the affected devices are connected, then run 'zpool clear'.
   see: http://illumos.org/msg/ZFS-8000-HC
  scan: resilvered 12K in 0h0m with 0 errors on Mon Dec  3 00:40:05 2012
config:

	NAME                     STATE     READ WRITE CKSUM
	vol01                    UNAVAIL      0     0     0
	  mirror-0               UNAVAIL      0     0     0
	    8354906940122045739  REMOVED      0     0     0  was /dev/ada0
	    2488650295775714691  REMOVED      0     0     0  was /dev/ada1

errors: Permanent errors have been detected in the following files:

        <metadata>:<0x0>
        <metadata>:<0x14>
        vol01:<0x3>

At first only ada1 was missing but then ada0 after a while also said it was unavailable.

Code: Select all

ada0 at ahcich0 bus 0 scbus0 target 0 lun 0
ada0: <Hitachi HDS5C3020ALA632 ML6OA180> ATA-8 SATA 3.x device
ada0: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada0: Command Queueing enabled
ada0: 1907729MB (3907029168 512 byte sectors: 16H 63S/T 16383C)
ada0: Previously was known as ad4
ada1 at ahcich1 bus 0 scbus1 target 0 lun 0
ada1: <Hitachi HDS5C3020ALA632 ML6OA180> ATA-8 SATA 3.x device
ada1: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada1: Command Queueing enabled
ada1: 1907729MB (3907029168 512 byte sectors: 16H 63S/T 16383C)
ada1: Previously was known as ad6

Code: Select all

ahcich1: Timeout on slot 25 port 0
ahcich1: is 00000002 cs 00000000 ss 00000000 rs 02000000 tfd 50 serr 00000000 cmd 00047917
ahcich1: Timeout on slot 25 port 0
ahcich1: is 00000002 cs 00000000 ss 00000000 rs 02000000 tfd 50 serr 00000000 cmd 00047917
(aprobe0:ahcich1:0:0:0): ATA_IDENTIFY. ACB: ec 00 00 00 00 40 00 00 00 00 00 00
(aprobe0:ahcich1:0:0:0): CAM status: Command timeout
(aprobe0:ahcich1:0:0:0): Error 5, Retry was blocked
ahcich1: Timeout on slot 25 port 0
ahcich1: is 00000002 cs 00000000 ss 00000000 rs 02000000 tfd 50 serr 00000000 cmd 00047917
(aprobe0:ahcich1:0:0:0): ATA_IDENTIFY. ACB: ec 00 00 00 00 40 00 00 00 00 00 00
(aprobe0:ahcich1:0:0:0): CAM status: Command timeout
(aprobe0:ahcich1:0:0:0): Error 5, Retry was blocked
(ada1:ahcich1:0:0:0): lost device
(ada1:ahcich1:0:0:0): removing device entry
(pass1:ahcich1:0:0:0): passdevgonecb: devfs entry is gone
ahcich0: Timeout on slot 21 port 0
ahcich0: is 00000002 cs 00000000 ss 00000000 rs 00200000 tfd 50 serr 00000000 cmd 00047517
ahcich0: Timeout on slot 21 port 0
ahcich0: is 00000002 cs 00000000 ss 00000000 rs 00200000 tfd 50 serr 00000000 cmd 00047517
(aprobe0:ahcich0:0:0:0): ATA_IDENTIFY. ACB: ec 00 00 00 00 40 00 00 00 00 00 00
(aprobe0:ahcich0:0:0:0): CAM status: Command timeout
(aprobe0:ahcich0:0:0:0): Error 5, Retry was blocked
ahcich0: Timeout on slot 21 port 0
ahcich0: is 00000002 cs 00000000 ss 00000000 rs 00200000 tfd 50 serr 00000000 cmd 00047517
(aprobe0:ahcich0:0:0:0): ATA_IDENTIFY. ACB: ec 00 00 00 00 40 00 00 00 00 00 00
(aprobe0:ahcich0:0:0:0): CAM status: Command timeout
(aprobe0:ahcich0:0:0:0): Error 5, Retry was blocked
(ada0:ahcich0:0:0:0): lost device
(ada0:ahcich0:0:0:0): removing device entry
ahcich0: Timeout on slot 21 port 0
ahcich0: is 40000001 cs 00200000 ss 00000000 rs 00200000 tfd 451 serr 00000800 cmd 00047517
(pass0:ahcich0:0:0:0): passdevgonecb: devfs entry is gone

The weird thing is that one of the disks apparently came back while posting the above messages.

Code: Select all

ada0 at ahcich0 bus 0 scbus0 target 0 lun 0
ada0: <Hitachi HDS5C3020ALA632 ML6OA180> ATA-8 SATA 3.x device
ada0: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada0: Command Queueing enabled
ada0: 1907729MB (3907029168 512 byte sectors: 16H 63S/T 16383C)
ada0: Previously was known as ad4

At first, I thought it was just my hitachi disks, but previously it did it with one of my samsung one and below is what it recover to after the reboot.

Code: Select all

ada2: <SAMSUNG HD154UI 1AG01118> ATA-7 SATA 2.x device
ada2: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada2: Command Queueing enabled
ada2: 1430799MB (2930277168 512 byte sectors: 16H 63S/T 16383C)
ada2: Previously was known as ad8

zpool status -v vol02
  pool: vol02
 state: ONLINE
status: One or more devices has experienced an unrecoverable error.  An
	attempt was made to correct the error.  Applications are unaffected.
action: Determine if the device needs to be replaced, and clear the errors
	using 'zpool clear' or replace the device with 'zpool replace'.
   see: http://illumos.org/msg/ZFS-8000-9P
  scan: resilvered 613K in 0h0m with 0 errors on Mon Dec  3 02:37:30 2012
config:

	NAME        STATE     READ WRITE CKSUM
	vol02       ONLINE       0     0     0
	  mirror-0  ONLINE       0     0     0
	    ada2    ONLINE       0     0     5
	    ada3    ONLINE       0     0     0

errors: No known data errors

There is nothing wrong with any of these disks because I can go back to freenas and I do not get any issues whatsoever. Anyone ran into this problem before?

PS. Sorry for the long post.

[def]

Hi,

I have the same problem with a WD15EARS drive. But I have the problem on freenas 8.3 and NAS4free 9.1.0.1. Only one disk is failing, and after a reboot it's back online (also a zfsmirror of 2 disks). You found a solution or someone else has any?
(checked the drive with WD tools, looks good (long run) )
(you hear it when I should fine one )
thanks.

[dark_phantom]

No, I have not find a solution nor have I heard from anyone on the nas4free team. And like you my disks are not having physical issues and also with random reboots they come back or sometimes they don't. So for now my only true issue free is to keep using freenas 0.7.2, unfortunately, but pretty happy for now since I mainly use it as a file server.

[daoyama]

Code: Select all

ahcich1: Timeout on slot 25 port 0
ahcich1: is 00000002 cs 00000000 ss 00000000 rs 02000000 tfd 50 serr 00000000 cmd 00047917
ahcich1: Timeout on slot 25 port 0
ahcich1: is 00000002 cs 00000000 ss 00000000 rs 02000000 tfd 50 serr 00000000 cmd 00047917
(aprobe0:ahcich1:0:0:0): ATA_IDENTIFY. ACB: ec 00 00 00 00 40 00 00 00 00 00 00
(aprobe0:ahcich1:0:0:0): CAM status: Command timeout
(aprobe0:ahcich1:0:0:0): Error 5, Retry was blocked
ahcich1: Timeout on slot 25 port 0
ahcich1: is 00000002 cs 00000000 ss 00000000 rs 02000000 tfd 50 serr 00000000 cmd 00047917
(aprobe0:ahcich1:0:0:0): ATA_IDENTIFY. ACB: ec 00 00 00 00 40 00 00 00 00 00 00
(aprobe0:ahcich1:0:0:0): CAM status: Command timeout
(aprobe0:ahcich1:0:0:0): Error 5, Retry was blocked
(ada1:ahcich1:0:0:0): lost device
(ada1:ahcich1:0:0:0): removing device entry
(pass1:ahcich1:0:0:0): passdevgonecb: devfs entry is gone
ahcich0: Timeout on slot 21 port 0
ahcich0: is 00000002 cs 00000000 ss 00000000 rs 00200000 tfd 50 serr 00000000 cmd 00047517
ahcich0: Timeout on slot 21 port 0
ahcich0: is 00000002 cs 00000000 ss 00000000 rs 00200000 tfd 50 serr 00000000 cmd 00047517
(aprobe0:ahcich0:0:0:0): ATA_IDENTIFY. ACB: ec 00 00 00 00 40 00 00 00 00 00 00
(aprobe0:ahcich0:0:0:0): CAM status: Command timeout
(aprobe0:ahcich0:0:0:0): Error 5, Retry was blocked
ahcich0: Timeout on slot 21 port 0
ahcich0: is 00000002 cs 00000000 ss 00000000 rs 00200000 tfd 50 serr 00000000 cmd 00047517
(aprobe0:ahcich0:0:0:0): ATA_IDENTIFY. ACB: ec 00 00 00 00 40 00 00 00 00 00 00
(aprobe0:ahcich0:0:0:0): CAM status: Command timeout
(aprobe0:ahcich0:0:0:0): Error 5, Retry was blocked
(ada0:ahcich0:0:0:0): lost device
(ada0:ahcich0:0:0:0): removing device entry
ahcich0: Timeout on slot 21 port 0
ahcich0: is 40000001 cs 00200000 ss 00000000 rs 00200000 tfd 451 serr 00000800 cmd 00047517
(pass0:ahcich0:0:0:0): passdevgonecb: devfs entry is gone

What hardware do you use? (MB, chipset, SATA card etc)

[def]

I'm using a intel B75 chipset, (MB: Asrock B75 Pro3-M, maby we're using the same?).
The 2 disks are on the intel SATA II ports.
(the first intel SATA-III port is still free for a caching SSD when needed )

thanks for the reply.

[dark_phantom]

I have a Biostar A770E, chipset 770/SB710, and onboard sata 2 ports. Let me know if anything else is needed, thanks.

[def]

Can you go to: http://IPNAS4free/status.php

And do a search for "ATA DISK"
(or click on the quick link)

You should find something like this:

"ATA disk
atacontrol:
ATA_CAM option is enabled in kernel.
Please use camcontrol instead.

SCSI disk
<WDC WD15EARS-00J2GB0 80.00A80> at scbus1 target 0 lun 0 (ada0,pass0)
<WDC WD15EARS-00MVWB0 51.0AB51> at scbus2 target 0 lun 0 (ada1,pass1)
<pny USB 2.0 FD 1.00> at scbus7 target 0 lun 0 (pass2,da0)
"

And copy that information here
thanks!

[dark_phantom]

Not sure how helpful this is but here it is. Note that ada1 is missing on a freshly booted cycle.

Code: Select all

ATA disk

atacontrol:
ATA_CAM option is enabled in kernel.
Please use camcontrol instead.

SCSI disk

<Hitachi HDS5C3020ALA632 ML6OA180>  at scbus0 target 0 lun 0 (ada0,pass0)
<SAMSUNG HD154UI 1AG01118>         at scbus2 target 0 lun 0 (ada2,pass2)
<SAMSUNG HD154UI 1AG01118>         at scbus3 target 0 lun 0 (ada3,pass3)
<SAMSUNG HD154UI 1AG01118>         at scbus4 target 0 lun 0 (ada4,pass4)
<SAMSUNG HD154UI 1AG01118>         at scbus4 target 1 lun 0 (ada5,pass5)
<WDC WD20EADS-00S2B0 01.00A01>     at scbus8 target 0 lun 0 (ada6,pass6)
<WDC WD20EADS-00S2B0 01.00A01>     at scbus12 target 0 lun 0 (ada7,pass7)
<SanDisk U3 Cruzer Micro 8.02>     at scbus15 target 0 lun 0 (pass8,da0)

I might as well put this as well. I do have two pci sil3114 cards which each of the wd disk is connected to a port of each card, but there are no problems with those. Just some information if anyone is wondering. The rest of the disks are on the onboard sata connections.

Code: Select all

atapci0: <ATI IXP700/800 UDMA133 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xff00-0xff0f at device 20.1 on pci0
ata0: <ATA channel> at channel 0 on atapci0
ata1: <ATA channel> at channel 1 on atapci0
hdac0: <ATI SB600 HDA Controller> mem 0xfe7f4000-0xfe7f7fff irq 16 at device 20.2 on pci0
isab0: <PCI-ISA bridge> at device 20.3 on pci0
isa0: <ISA bus> on isab0
pcib3: <ACPI PCI-PCI bridge> at device 20.4 on pci0
pci3: <ACPI PCI bus> on pcib3
atapci1: <SiI 3114 SATA150 controller> port 0xe800-0xe807,0xe400-0xe403,0xe000-0xe007,0xd800-0xd803,0xd400-0xd40f mem 0xfebffc00-0xfebfffff irq 21 at device 6.0 on pci3
ata2: <ATA channel> at channel 0 on atapci1
ata3: <ATA channel> at channel 1 on atapci1
ata4: <ATA channel> at channel 2 on atapci1
ata5: <ATA channel> at channel 3 on atapci1
atapci2: <SiI 3114 SATA150 controller> port 0xd000-0xd007,0xc800-0xc803,0xc400-0xc407,0xc000-0xc003,0xb800-0xb80f mem 0xfebff800-0xfebffbff irq 23 at device 7.0 on pci3
ata6: <ATA channel> at channel 0 on atapci2
ata7: <ATA channel> at channel 1 on atapci2
ata8: <ATA channel> at channel 2 on atapci2
ata9: <ATA channel> at channel 3 on atapci2

[al562]

Hi Dark_Phantom,

Did you see the note in NAS4Free Compatible Hardware Lists regarding this controller? Please make sure you are using the recommended firmware version (non-raid if I recall correctly). Depending on who manufactured the card you may also have to check the "do not erase MBR box" when you format the disk. In the old forum we had lengthy write-ups about the SIL based cards and how to set them up properly, unfortunatle that is all lost now and will have to be re-written in the future.

All the best,
Al