RESOLVED: having to export/import on every reboot?

LTO · Post by **LTO** » 09 Jul 2015 05:32

I autoshutdown my nas4free box on network inactivity. Recently when it started up I couldn't see any of the zfs mounts that I am exporting.

The sequence that I finally found is below. It is repeatable (at least twice; I'm leaving it on until I can get the data backed up).

Anyone see anything obvious that suggests how to resolve this?

nas: ~ # uname -an
FreeBSD nas.local 9.3-RELEASE-p13 FreeBSD 9.3-RELEASE-p13 #0 r281443M: Sun Apr 12 01:17:01 CEST 2015 root@dev.nas4free.org:/usr/obj/nas4free/usr/src/sys/NAS4FREE-amd64 amd64

nas: ~ # zpool status
pool: zfs1
state: UNAVAIL
status: One or more devices could not be opened. There are insufficient
replicas for the pool to continue functioning.
action: Attach the missing device and online it using 'zpool online'.
see: http://illumos.org/msg/ZFS-8000-3C
scan: none requested
config:

NAME STATE READ WRITE CKSUM
zfs1 UNAVAIL 0 0 0
raidz1-0 UNAVAIL 0 0 0
ada1 ONLINE 0 0 0
ada5 ONLINE 0 0 0
8383881543741899664 UNAVAIL 0 0 0 was /dev/gptid/a7b0652f-964c-11e1-8f49-00508d946b54
14026965241465730574 UNAVAIL 0 0 0 was /dev/gptid/2a8907ca-5dd0-11e2-b997-00508d946b54
gptid/cd7e6c73-a4f0-11e2-a9a4-00508d946b54 ONLINE 0 0 0

nas: ~ # zpool export zfs1
nas: ~ # zpool status
no pools available

nas: ~ # zpool import zfs1

nas: ~ # zpool status
pool: zfs1
state: ONLINE
status: Some supported features are not enabled on the pool. The pool can
still be used, but some features are unavailable.
action: Enable all features using 'zpool upgrade'. Once this is done,
the pool may no longer be accessible by software that does not support
the features. See zpool-features(7) for details.
scan: scrub repaired 0 in 13h7m with 0 errors on Tue Jul 7 21:23:25 2015
config:

NAME STATE READ WRITE CKSUM
zfs1 ONLINE 0 0 0
raidz1-0 ONLINE 0 0 0
ada1 ONLINE 0 0 0
ada5 ONLINE 0 0 0
ada3 ONLINE 0 0 0
ada4 ONLINE 0 0 0
ada2p2 ONLINE 0 0 0

errors: No known data errors

Post by **b0ssman** » 09 Jul 2015 07:22

Tell us something about your hardware and version of nas4free

Sent from my iPhone using Tapatalk

LTO · Post by **LTO** » 09 Jul 2015 08:01

mobo is an old Abit KN9 (Ultra maybe?) with an athlon in it.
RAM is 2x4G + 2x1G.

Started out with 5 x 2Tb disks, which I'm slowly changing out to 3Tb. Currently it's 3x2TB+2x3TB
They are in a RaidZ1 config (yeah, I know).

From the information tab in the webpage:

NAS4Free 9.3.0.2 (revision 1391) x64-embedded
Nvidia AWRDACPI AMD Athlon(tm) 64 X2 Dual Core Processor 6000+ 11264MiB RAM

bus=1 hubaddr=9 port=1 devaddr=2 interface=0 NVIDIA nForce MCP55 USB
2.0 controller nVidia nForce MCP55 UDMA133 controller

and from sysinfo:

nas: ~ # sysinfo cpu system mem storage
Generated by SysInfo v1.0.1 by Daniel Gerzo

CPU information

Machine class: amd64
CPU Model: AMD Athlon(tm) 64 X2 Dual Core Processor 6000+
No. of Cores: 2
Cores per CPU:

CPU usage statistics:
CPU: 0.0% user, 0.0% nice, 0.0% system, 0.0% interrupt, 100% idle

System information

/usr/local/share/sysinfo/modules/system: which: not found
WARNING: You will need to install the sysutils/dmidecode port in order to obtain this information.

Graphic card information:
vendor='nVidia Corporation'
device='G96 [GeForce 9400 GT]'
INFO: Check pciconf(8) for more information.

PCI devices with no driver attached:
none0@pci0:0:0:0: class=0x050000 card=0x1c20147b chip=0x036910de rev=0xa1 hdr=0x00
none1@pci0:0:1:1: class=0x0c0500 card=0x1c20147b chip=0x036810de rev=0xa2 hdr=0x00

bc: cannot find dc: No such file or directory
bc: cannot find dc: No such file or directory
bc: cannot find dc: No such file or directory
bc: cannot find dc: No such file or directory
bc: cannot find dc: No such file or directory
bc: cannot find dc: No such file or directory
/usr/local/share/sysinfo/modules/mem: arithmetic expression: expecting primary: " + + "

Storage information

Available hard drives:
da4: <Generic Mini SD Reader 1.06> Removable Direct Access SCSI-0 device
da4: Serial Number 058F412D8PB1
da4: 40.000MB/s transfers
da4: quirks=0x2<NO_6_BYTE>
da3: <Generic USB MS Reader 1.03> Removable Direct Access SCSI-0 device
da3: Serial Number 058F412D8PB1
da3: 40.000MB/s transfers
da3: quirks=0x2<NO_6_BYTE>
da2: <Generic USB SM Reader 1.02> Removable Direct Access SCSI-0 device
da2: Serial Number 058F412D8PB1
da2: 40.000MB/s transfers
da2: quirks=0x2<NO_6_BYTE>
da1: <Generic USB CF Reader 1.01> Removable Direct Access SCSI-0 device
da1: Serial Number 058F412D8PB1
da1: 40.000MB/s transfers
da1: quirks=0x2<NO_6_BYTE>
da0: <Generic USB SD Reader 1.00> Removable Direct Access SCSI-0 device
da0: Serial Number 058F412D8PB1
da0: 40.000MB/s transfers
da0: quirks=0x2<NO_6_BYTE>
ada5: <ST3000DM001-1CH166 CC43> ATA-8 SATA 3.x device
ada5: Serial Number S1F0N822
ada5: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes)
ada5: 2861588MB (5860533168 512 byte sectors: 16H 63S/T 16383C)
ada5: quirks=0x1<4K>
ada5: Previously was known as ad12
ada4: <ST32000641AS CC13> ATA-8 SATA 3.x device
ada4: Serial Number 9WM4221D
ada4: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes)
ada4: 1907729MB (3907029168 512 byte sectors: 16H 63S/T 16383C)
ada4: Previously was known as ad10
ada3: <ST2000DM001-9YN164 CC4C> ATA-8 SATA 3.x device
ada3: Serial Number S2407CRX
ada3: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes)
ada3: 1907729MB (3907029168 512 byte sectors: 16H 63S/T 16383C)
ada3: quirks=0x1<4K>
ada3: Previously was known as ad8
ada2: <ST2000DM001-9YN164 CC47> ATA-8 SATA 3.x device
ada2: Serial Number W2407FJT
ada2: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes)
ada2: 1907729MB (3907029168 512 byte sectors: 16H 63S/T 16383C)
ada2: quirks=0x1<4K>
ada2: Previously was known as ad6
ada1: <ST3000DM001-1CH166 CC43> ATA-8 SATA 3.x device
ada1: Serial Number S1F0N8ZT
ada1: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes)
ada1: 2861588MB (5860533168 512 byte sectors: 16H 63S/T 16383C)
ada1: quirks=0x1<4K>
ada1: Previously was known as ad4
ada0: <TRANSCEND 20070115> ATA-0 device
ada0: Serial Number 0 10001D8A
ada0: 16.700MB/s transfers (WDMA2, PIO 512bytes)
ada0: 1983MB (4062240 512 byte sectors: 16H 63S/T 4030C)
ada0: Previously was known as ad0
cd0: <ATAPI iHAS124 D 8L08> Removable CD-ROM SCSI-0 device
cd0: Serial Number 3524552 3A8244505131
cd0: 150.000MB/s transfers (SATA 1.x, UDMA5, ATAPI 12bytes, PIO 8192bytes)

Raid controllers:
umass-sim0:

Currently mounted filesystems:
/dev/xmd0 on /
devfs on /dev
/dev/xmd1 on /usr/local
/dev/ada0s1a on /cf
procfs on /proc
/dev/xmd2 on /var
tmpfs on /var/tmp
zfs1 on /zfs1
zfs1/home on /zfs1/home
zfs1/mp3 on /zfs1/mp3
zfs1/partimag on /zfs1/partimag
zfs1/videos on /zfs1/videos

WARNING: Not found in fstab(5): /dev/xmd0 on /
WARNING: Not found in fstab(5): /dev/xmd1 on /usr/local
WARNING: Not found in fstab(5): /dev/xmd2 on /var
WARNING: Not found in fstab(5): tmpfs on /var/tmp
WARNING: Not found in fstab(5): zfs1 on /zfs1
WARNING: Not found in fstab(5): zfs1/home on /zfs1/home
WARNING: Not found in fstab(5): zfs1/mp3 on /zfs1/mp3
WARNING: Not found in fstab(5): zfs1/partimag on /zfs1/partimag
WARNING: Not found in fstab(5): zfs1/videos on /zfs1/videos

NFS-exported file systems:
Exports list on localhost:

I/O statistics:
tty ada0 ada1 ada2 cpu
tin tout KB/t tps MB/s KB/t tps MB/s KB/t tps MB/s us ni sy in id
0 65 114.19 0 0.01 21.47 0 0.00 34.37 0 0.01 0 0 0 0 99
INFO: Run iostat(8) or gstat(8) to see live statistics.

Disk usage:
Filesystem Size Used Avail Capacity Mounted on
/dev/xmd0 119M 34M 85M 29% /
devfs 1.0k 1.0k 0B 100% /dev
/dev/xmd1 719M 247M 472M 34% /usr/local
/dev/ada0s1a 421M 149M 272M 35% /cf
procfs 4.0k 4.0k 0B 100% /proc
/dev/xmd2 123M 46M 67M 41% /var
tmpfs 64M 48k 64M 0% /var/tmp
zfs1 921G 664G 257G 72% /zfs1
zfs1/home 257G 888k 257G 0% /zfs1/home
zfs1/mp3 277G 19G 257G 7% /zfs1/mp3
zfs1/partimag 1.9T 1.7T 257G 87% /zfs1/partimag
zfs1/videos 3.0T 2.8T 257G 92% /zfs1/videos
/usr/local/share/sysinfo/modules/storage: which: not found
/usr/local/share/sysinfo/modules/storage: which: not found
/usr/local/share/sysinfo/modules/storage: which: not found
/usr/local/share/sysinfo/modules/storage: which: not found
/usr/local/share/sysinfo/modules/storage: which: not found
/usr/local/share/sysinfo/modules/storage: which: not found

Not sure why it can't find dmidecode, and why 'which' is giving it problems. I can send more but didn't want to overwhelm the page. Or if there's a standard sysinfo parms that folks like to see, I'm happy to do that also.

Thanks!

plegault · Post by **plegault** » 09 Jul 2015 14:09

Also interested in this thread, getting the same issue after resilvering a disk.

Code: Select all

	NAME                      STATE     READ WRITE CKSUM
	Tank                      UNAVAIL      0     0     0
	  raidz1-0                UNAVAIL      0     0     0
	    ada2                  ONLINE       0     0     0
	    ada4                  ONLINE       0     0     0
	    ada3                  ONLINE       0     0     0
	    ada1                  ONLINE       0     0     0
	    3939178219406604234   UNAVAIL      0     0     0  was /dev/ada0

Always have to export and re-import after each reboot.

Using 9.3.0.2 - Nayla (revision 1391). Not sure if there's any form of caching on how it expects to reload the disks on reboot?

Post by **b0ssman** » 09 Jul 2015 17:38

the message like

ada2: Previously was known as ad6

could be a hint to the problem.

if your drives change device ids during boot this could confuse zfs.

is the controller set to ahci in the bios?

Onichan · Post by **Onichan** » 10 Jul 2015 05:44

b0ssman wrote:the message like

ada2: Previously was known as ad6

could be a hint to the problem.

if your drives change device ids during boot this could confuse zfs.

is the controller set to ahci in the bios?

Mine does the same thing and it isn't a problem. All drives attached to the mobo do that and the M1015 ones don't. It actually only started doing that when I started using FreeBSD 10, but hasn't caused any problems.

I'm using the embedded x64 10.1.0.2.1702.

LTO · Post by **LTO** » 12 Jul 2015 21:27

I looked and the BIOS doesnt have an AHCI option anywhere (which surprised me. I guess it really is that old) There is a RAID option which is disabled.

Post by **raulfg3** » 12 Jul 2015 23:27

please post how ZFS detected and curent are in your system, I suspect you need to sync it.

plegault · Post by **plegault** » 13 Jul 2015 13:53

Thank you, that was it in my case!

raulfg3 wrote:please post how ZFS detected and curent are in your system, I suspect you need to sync it.

LTO · Post by **LTO** » 14 Jul 2015 05:14

Ditto. The sync did it.

Disks -> ZFS -> Configuration

"Current" was all gptid based. "Detected" was all /dev/ada based.

Sync made them all /dev/ada based so that now:

Virtual devices (1)
Name Type Pool Devices
zfs1_raidz1_0 raidz1 zfs1 /dev/ada1, /dev/ada5, /dev/ada3, /dev/ada4, /dev/ada2p2

And it survived a reboot

This is good.

I am curious. I did this from the web gui. What are the CLI equivalents (or perhaps more pertinent, where would I find a discussion of this process using CLI) ?

Thanks again.

XigmaNAS

RESOLVED: having to export/import on every reboot?

RESOLVED: having to export/import on every reboot?

Re: having to export/import on every reboot?

Re: having to export/import on every reboot?

Re: having to export/import on every reboot?

Re: having to export/import on every reboot?

Re: having to export/import on every reboot?

Re: having to export/import on every reboot?

Re: having to export/import on every reboot?

Re: having to export/import on every reboot?

Re: having to export/import on every reboot?