Two mirror zpool after reboot failed

[rAcHe kLoS]

I have a big problem with Nas4Free 9.3.0.2, after a reboot I lose the zfs pool. I have a zfs pool with a 2x2 mirror. I can restore with zpool export Pool and zpool import Pool.

pool: Pool
state: ONLINE
scan: none requested
config:
NAME STATE READ WRITE CKSUM
Pool ONLINE 0 0 0
mirror-0 ONLINE 0 0 0
ada0.nop ONLINE 0 0 0
ada2.nop ONLINE 0 0 0
mirror-1 ONLINE 0 0 0
ada1.nop ONLINE 0 0 0
ada3.nop ONLINE 0 0 0
errors: No known data errors

After reboot:
Pool - - - - - FAULTED -

pool: Pool
state: UNAVAIL
status: One or more devices could not be opened. There are insufficient
replicas for the pool to continue functioning.
action: Attach the missing device and online it using 'zpool online'.
see: http://illumos.org/msg/ZFS-8000-3C
scan: none requested
config:

NAME STATE READ WRITE CKSUM
Pool UNAVAIL 0 0 0
raidz2-0 UNAVAIL 0 0 0
15314831275155125031 UNAVAIL 0 0 0 was /dev/ada0.nop
15578205649871288257 UNAVAIL 0 0 0 was /dev/ada1.nop
7325675087069943551 UNAVAIL 0 0 0 was /dev/ada2.nop
9506206711686070865 UNAVAIL 0 0 0 was /dev/ada3.nop

[raulfg3]

Revise that your Disk are properly detectec by BSD, and post more info (dmesg is a good start point to see what happens in the boot).

[rAcHe kLoS]

Code: Select all

=~=~=~=~=~=~=~=~=~=~=~= PuTTY log 2015.01.27 19:34:24 =~=~=~=~=~=~=~=~=~=~=~=
Copyright (c) 1992-2014 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 9.3-RELEASE-p8 #0 r277306M: Sat Jan 17 21:53:14 CET 2015
    root@dev.nas4free.org:/usr/obj/nas4free/usr/src/sys/NAS4FREE-amd64 amd64
gcc version 4.2.1 20070831 patched [FreeBSD]
CPU: Intel(R) Pentium(R) CPU  J2900  @ 2.41GHz (2416.72-MHz K8-class CPU)
  Origin = "GenuineIntel"  Id = 0x30678  Family = 0x6  Model = 0x37  Stepping = 8
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x41d8e3bf<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,SSE4.2,MOVBE,POPCNT,TSCDLT,RDRAND>
  AMD Features=0x28100800<SYSCALL,NX,RDTSCP,LM>
  AMD Features2=0x101<LAHF,Prefetch>
  Standard Extended Features=0x2282<TSCADJ,SMEP,ENHMOVSB>
  TSC: P-state invariant, performance statistics
real memory  = 8589934592 (8192 MB)
avail memory = 7901605888 (7535 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: <ALASKA A M I >
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
FreeBSD/SMP: 1 package(s) x 4 core(s)
 cpu0 (BSP): APIC ID:  0
 cpu1 (AP): APIC ID:  2
 cpu2 (AP): APIC ID:  4
 cpu3 (AP): APIC ID:  6
WARNING: VIMAGE (virtualized network stack) is a highly experimental feature.
ACPI Warning: FADT (revision 5) is longer than ACPI 2.0 version, truncating length 268 to 244 (20110527/tbfadt-320)
WARNING: Bogus Interrupt Trigger Mode. Assume Level trigger.WARNING: Bogus Interrupt Polarity. Assume POLALITY LOWioapic0 <Version 2.0> irqs 0-86 on motherboard
lapic0: Forcing LINT1 to edge trigger
kbd1 at kbdmux0
cryptosoft0: <software crypto> on motherboard
acpi0: <ALASKA A M I > on motherboard
acpi0: Power Button (fixed)
unknown: I/O range not supported
can't fetch resources for \134_SB_.URT1.BTH0 - AE_AML_INVALID_RESOURCE_TYPE
can't fetch resources for \134_SB_.URT2.GPS0 - AE_AML_INVALID_RESOURCE_TYPE
can't fetch resources for \134_SB_.I2C4.CAM0 - AE_AML_INVALID_RESOURCE_TYPE
can't fetch resources for \134_SB_.I2C4.CAM1 - AE_AML_INVALID_RESOURCE_TYPE
can't fetch resources for \134_SB_.I2C4.STRA - AE_AML_INVALID_RESOURCE_TYPE
can't fetch resources for \134_SB_.I2C5.SHUB - AE_AML_INVALID_RESOURCE_TYPE
can't fetch resources for \134_SB_.I2C6.FWUP - AE_AML_INVALID_RESOURCE_TYPE
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
cpu2: <ACPI CPU> on acpi0
cpu3: <ACPI CPU> on acpi0
atrtc0: <AT realtime clock> port 0x70-0x77 on acpi0
atrtc0: Warning: Couldn't map I/O.
Event timer "RTC" frequency 32768 Hz quality 0
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff irq 8 on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Event timer "HPET" frequency 14318180 Hz quality 450
Event timer "HPET1" frequency 14318180 Hz quality 440
Event timer "HPET2" frequency 14318180 Hz quality 440
attimer0: <AT timer> port 0x40-0x43,0x50-0x53 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
Timecounter "ACPI-safe" frequency 3579545 Hz quality 850
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pcib0: Length mismatch for 3 range: 10816fff vs 10817000
pci0: <ACPI PCI bus> on pcib0
vgapci0: <VGA-compatible display> port 0xf080-0xf087 mem 0xd0000000-0xd03fffff,0xc0000000-0xcfffffff irq 16 at device 2.0 on pci0
vgapci0: Boot video device
ahci0: <AHCI SATA controller> port 0xf070-0xf077,0xf060-0xf063,0xf050-0xf057,0xf040-0xf043,0xf020-0xf03f mem 0xd0816000-0xd08167ff irq 19 at device 19.0 on pci0
ahci0: AHCI v1.30 with 2 3Gbps ports, Port Multiplier not supported
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich1: <AHCI channel> at channel 1 on ahci0
xhci0: <XHCI (generic) USB 3.0 controller> mem 0xd0800000-0xd080ffff irq 20 at device 20.0 on pci0
xhci0: 32 byte context size.
usbus0 on xhci0
pci0: <encrypt/decrypt> at device 26.0 (no driver attached)
hdac0: <Intel (0x0f04) HDA Controller> mem 0xd0810000-0xd0813fff irq 22 at device 27.0 on pci0
pcib1: <ACPI PCI-PCI bridge> irq 16 at device 28.0 on pci0
pci1: <ACPI PCI bus> on pcib1
pcib2: <ACPI PCI-PCI bridge> irq 17 at device 28.1 on pci0
pci2: <ACPI PCI bus> on pcib2
pcib3: <ACPI PCI-PCI bridge> irq 18 at device 28.2 on pci0
pci3: <ACPI PCI bus> on pcib3
re0: <RealTek 8168/8111 B/C/CP/D/DP/E/F/G PCIe Gigabit Ethernet> port 0xe000-0xe0ff mem 0xd0704000-0xd0704fff,0xd0700000-0xd0703fff irq 18 at device 0.0 on pci3
re0: Using 1 MSI-X message
re0: Chip rev. 0x4c000000
re0: MAC rev. 0x00000000
miibus0: <MII bus> on re0
rgephy0: <RTL8251 1000BASE-T media interface> PHY 1 on miibus0
rgephy0:  none, 10baseT, 10baseT-FDX, 10baseT-FDX-flow, 100baseTX, 100baseTX-FDX, 100baseTX-FDX-flow, 1000baseT-FDX, 1000baseT-FDX-master, 1000baseT-FDX-flow, 1000baseT-FDX-flow-master, auto, auto-flow
re0: Ethernet address: d0:50:99:47:4a:3e
pcib4: <ACPI PCI-PCI bridge> irq 19 at device 28.3 on pci0
pci4: <ACPI PCI bus> on pcib4
ahci1: <ASMedia ASM1061 AHCI SATA controller> port 0xd050-0xd057,0xd040-0xd043,0xd030-0xd037,0xd020-0xd023,0xd000-0xd01f mem 0xd0600000-0xd06001ff irq 19 at device 0.0 on pci4
ahci1: AHCI v1.20 with 2 6Gbps ports, Port Multiplier supported
ahcich2: <AHCI channel> at channel 0 on ahci1
ahcich3: <AHCI channel> at channel 1 on ahci1
ehci0: <EHCI (generic) USB 2.0 controller> mem 0xd0815000-0xd08153ff irq 23 at device 29.0 on pci0
usbus1: EHCI version 1.0
usbus1 on ehci0
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
acpi_button0: <Power Button> on acpi0
acpi_button1: <Sleep Button> on acpi0
acpi_tz0: <Thermal Zone> on acpi0
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
ppc0: cannot reserve I/O port range
coretemp0: <CPU On-Die Thermal Sensors> on cpu0
est0: <Enhanced SpeedStep Frequency Control> on cpu0
p4tcc0: <CPU Frequency Thermal Control> on cpu0
coretemp1: <CPU On-Die Thermal Sensors> on cpu1
est1: <Enhanced SpeedStep Frequency Control> on cpu1
p4tcc1: <CPU Frequency Thermal Control> on cpu1
coretemp2: <CPU On-Die Thermal Sensors> on cpu2
est2: <Enhanced SpeedStep Frequency Control> on cpu2
p4tcc2: <CPU Frequency Thermal Control> on cpu2
coretemp3: <CPU On-Die Thermal Sensors> on cpu3
est3: <Enhanced SpeedStep Frequency Control> on cpu3
p4tcc3: <CPU Frequency Thermal Control> on cpu3
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
Timecounters tick every 1.000 msec
ipfw2 (+ipv6) initialized, divert loadable, nat loadable, default to accept, logging disabled
iSCSI boot driver version 0.2.8
hdacc0: <Realtek ALC892 HDA CODEC> at cad 0 on hdac0
hdaa0: <Realtek ALC892 Audio Function Group> at nid 1 on hdacc0
pcm0: <Realtek ALC892 (Rear Analog 5.1/2.0)> at nid 20,22,21 and 24,26 on hdaa0
pcm1: <Realtek ALC892 (Front Analog)> at nid 27 and 25 on hdaa0
pcm2: <Realtek ALC892 (Rear Digital)> at nid 30 on hdaa0
hdacc1: <Intel (0x2882) HDA CODEC> at cad 2 on hdac0
hdaa1: <Intel (0x2882) Audio Function Group> at nid 1 on hdacc1
pcm3: <Intel (0x2882) (HDMI/DP 8ch)> at nid 4 on hdaa1
pcm4: <Intel (0x2882) (HDMI/DP 8ch)> at nid 5 on hdaa1
xmd version 0.4.2 by NAS4Free Project (experimental)
xmd: default blocklen 32KB, compression LZ4/LZ4HC, level 6
xmd0: Loaded preload cloop image </mfsroot.uzip> 13580288 bytes at 0xffffffff81eacee0 (128MB disk w/LZ4)
usbus0: 5.0Gbps Super Speed USB v3.0
usbus1: 480Mbps High Speed USB v2.0
ugen0.1: <0x8086> at usbus0
uhub0: <0x8086 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
ugen1.1: <Intel> at usbus1
uhub1: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
uhub0: 7 ports with 7 removable, self powered
uhub1: 8 ports with 8 removable, self powered
ugen1.2: <vendor 0x8087> at usbus1
uhub2: <vendor 0x8087 product 0x07e6, class 9/0, rev 2.00/0.14, addr 2> on usbus1
uhub2: 4 ports with 4 removable, self powered
ugen1.3: <ASRock> at usbus1
uhub3: <ASRock ASM107x, class 9/0, rev 2.10/1.00, addr 3> on usbus1
uhub3: MTT enabled
uhub3: 4 ports with 4 removable, self powered
ugen1.4: <SMI Technology> at usbus1
umass0: <SMI Technology Intenso Premium Line, class 0/0, rev 2.10/10.00, addr 4> on usbus1
umass0:  SCSI over Bulk-Only; quirks = 0x4000
umass0:4:0:-1: Attached to scbus4
ugen1.5: <vendor 0x05e3> at usbus1
uhub4: <vendor 0x05e3 USB2.0 Hub, class 9/0, rev 2.00/88.32, addr 5> on usbus1
uhub4: 3 ports with 0 removable, self powered
ada0 at ahcich0 bus 0 scbus0 target 0 lun 0
ada0: <ST3000VM002-1F316N SC25> ATA-9 SATA 3.x device
ada0: Serial Number Z31017H3
ada0: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada0: Command Queueing enabled
ada0: 2861588MB (5860533168 512 byte sectors: 16H 63S/T 16383C)
ada0: Previously was known as ad4
ada1 at ahcich1 bus 0 scbus1 target 0 lun 0
ada1: <ST3000VM002-1F316N SC25> ATA-9 SATA 3.x device
ada1: Serial Number Z3101846
ada1: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada1: Command Queueing enabled
ada1: 2861588MB (5860533168 512 byte sectors: 16H 63S/T 16383C)
ada1: Previously was known as ad6
ada2 at ahcich2 bus 0 scbus2 target 0 lun 0
ada2: <ST3000VM002-1F316N SC25> ATA-9 SATA 3.x device
ada2: Serial Number Z31018NT
ada2: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada2: Command Queueing enabled
ada2: 2861588MB (5860533168 512 byte sectors: 16H 63S/T 16383C)
ada2: Previously was known as ad8
ada3 at ahcich3 bus 0 scbus3 target 0 lun 0
ada3: <ST3000VM002-1F316N SC25> ATA-9 SATA 3.x device
ada3: Serial Number Z31019KM
ada3: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada3: Command Queueing enabled
ada3: 2861588MB (5860533168 512 byte sectors: 16H 63S/T 16383C)
ada3: Previously was known as ad10
SMP: AP CPU #3 Launched!
da0 at umass-sim0 bus 0 scbus4 target 0 lun 0
lapic2: Forcing LINT1 to edge trigger
da0: <Intenso Premium Line > Removable Direct Access SCSI-6 device 
SMP: AP CPU #1 Launched!
da0: Serial Number 14072900085488
da0: 40.000MB/s transfersSMP: AP CPU #2 Launched!

da0: 7560MB (15482880 512 byte sectors: 255H 63S/T 963C)
da0: quirks=0x2<NO_6_BYTE>
Timecounter "TSC-low" frequency 1208362198 Hz quality 1000
Trying to mount root from ufs:/dev/xmd0 []...
GEOM_NOP: Device ada0.nop created.
GEOM_NOP: Device ada2.nop created.
GEOM_NOP: Device ada1.nop created.
GEOM_NOP: Device ada3.nop created.
nas: ~ #

[Princo]

I have a big problem with Nas4Free 9.3.0.2, after a reboot I lose the zfs pool.

It's a known bug in 9.3.0.2.1310 and i described it in viewtopic.php?f=78&t=8156#p49108 and in viewtopic.php?f=78&t=8156#p49246 (which describes exactly your problem).

Workaround (simple and dirty way):
1. Download config.
2. Install embedded from scratch
3. Restore config

Workaround (more elegant)
1. via Terminal: mount (to get the actual mountpoint of /cf )
2. umount /cf
3. mount /dev/??? /cf (??? former mountpoint of /cf from 1.)
4. rm /cf/boot/zfs/zpool.cache
5. reboot

Regards
Princo

[rAcHe kLoS]

Hello Princo,

thank you, this fix my problem.