Page 1 of 1

[SOLVED] ZFS tools hang after upgrade to 11.0.0.4.3252

Posted: 26 Nov 2016 11:36
by oops741
After upgrading N4F to x64-11.0.0.4.3252 and following the suggestions in the 'read me' (clear config and import disks, synchronize configuration), when checking ZFS, Information has:
" pool: Pool1
state: ONLINE
status: Some supported features are not enabled on the pool. The pool can
still be used, but some features are unavailable.
action: Enable all features using 'zpool upgrade'. Once this is done,
the pool may no longer be accessible by software that does not support"

The pool is accessible, but trying to run ZFS, Tools causes the web-gui to hang.

Tried to execute 'zpool upgrade' from the web gui Tools, Command, but the Disks, ZFS, Tools still hangs.

Any ideas?

Re: ZFS tools hang after upgrade to 11.0.0.4.3252

Posted: 26 Nov 2016 12:01
by raulfg3
oops741 wrote:
Any ideas?
Yes.

Upgrade your pool if your plan is continue using N4F 11.x

Need to upgrade ZFS core is normal and not a big problem, plesea read about: http://docs.oracle.com/cd/E19253-01/819 ... index.html

x.jpg
If you experience problems, please use Shell, and post the output of the command:

eg:

Code: Select all

zpool upgrade

and zpool upgrade -v

example:

Code: Select all

rnas: ~# zpool upgrade -v
This system supports ZFS pool feature flags.

The following features are supported:

FEAT DESCRIPTION
-------------------------------------------------------------
async_destroy                         (read-only compatible)
     Destroy filesystems asynchronously.
empty_bpobj                           (read-only compatible)
     Snapshots use less space.
lz4_compress
     LZ4 compression algorithm support.
multi_vdev_crash_dump
     Crash dumps to multiple vdev pools.
spacemap_histogram                    (read-only compatible)
     Spacemaps maintain space histograms.
enabled_txg                           (read-only compatible)
     Record txg at which a feature is enabled
hole_birth
     Retain hole birth txg for more precise zfs send
extensible_dataset
     Enhanced dataset functionality, used by other features.
embedded_data
     Blocks which compress very well use even less space.
bookmarks                             (read-only compatible)
     "zfs bookmark" command
filesystem_limits                     (read-only compatible)
     Filesystem and snapshot limits.
large_blocks
     Support for blocks larger than 128KB.
sha512
     SHA-512/256 hash algorithm.
skein
     Skein hash algorithm.

The following legacy versions are also supported:

VER  DESCRIPTION
---  --------------------------------------------------------
 1   Initial ZFS version
 2   Ditto blocks (replicated metadata)
 3   Hot spares and double parity RAID-Z
 4   zpool history
 5   Compression using the gzip algorithm
 6   bootfs pool property
 7   Separate intent log devices
 8   Delegated administration
 9   refquota and refreservation properties
 10  Cache devices
 11  Improved scrub performance
 12  Snapshot properties
 13  snapused property
 14  passthrough-x aclinherit
 15  user/group space accounting
 16  stmf property support
 17  Triple-parity RAID-Z
 18  Snapshot user holds
 19  Log device removal
 20  Compression using zle (zero-length encoding)
 21  Deduplication
 22  Received properties
 23  Slim ZIL
 24  System attributes
 25  Improved scrub stats
 26  Improved snapshot deletion performance
 27  Improved snapshot creation performance
 28  Multiple vdev replacements

For more information on a particular version, including supported releases,
see the ZFS Administration Guide.

rnas: ~#
and

Code: Select all

rnas: ~# zpool upgrade
This system supports ZFS pool feature flags.

All pools are formatted using feature flags.

Every feature flags pool has all supported features enabled.
rnas: ~#

Code: Select all

zpool history
History for 'RPool':
2015-05-30.18:29:05 zpool create -m /mnt/RPool RPool raidz1 /dev/ada1.nop /dev/ada2.nop /dev/ada3.nop /dev/ada4.nop raidz1 /dev/da0.nop /dev/da1.nop /dev/da2.nop /dev/da3.nop raidz1 /dev/da4.nop /dev/da5.nop /dev/da6.nop /dev/da7.nop
2015-05-30.18:30:40 zfs create -o compression=off -o dedup=off -o sync=standard -o atime=off -o aclinherit=restricted -o aclmode=discard RPool/Video
2015-05-30.18:31:20 zfs create -o compression=off -o dedup=off -o sync=standard -o atime=off -o aclinherit=restricted -o aclmode=discard RPool/ISO
2015-05-30.18:31:47 zfs create -o compression=off -o dedup=off -o sync=standard -o atime=off -o aclinherit=restricted -o aclmode=discard RPool/Datos
2015-05-30.18:32:34 zfs create -o compression=off -o dedup=off -o sync=standard -o atime=off -o aclinherit=restricted -o aclmode=discard RPool/Varios
2015-05-30.20:37:01 zpool export RPool
2015-05-30.20:38:37 zpool import RPool
2015-05-30.20:41:33 zpool export RPool
2015-05-30.20:42:06 zpool import RPool
2015-06-15.15:24:40 zpool export RPool
2015-06-15.15:27:58 zpool import RPool
2015-06-15.15:28:22 zpool export RPool
2015-06-15.15:29:24 zpool import RPool
2015-07-01.15:23:06 zpool import -d /dev -f -a
2015-07-01.16:14:45 zpool import -d /dev -f -a
2015-07-02.20:00:27 zpool import -d /dev -f -a
2015-08-30.23:41:34 zpool import -d /dev -f -a
2015-08-30.23:54:48 zpool import -d /dev -f -a
2015-08-31.00:55:58 zpool import -d /dev -f -a
2015-09-01.00:25:12 zpool import -d /dev -f -a
2015-09-01.17:57:09 zpool import -d /dev -f -a
2015-09-01.18:16:37 zpool import -d /dev -f -a
2015-09-01.18:32:57 zpool import -d /dev -f -a
2015-09-01.18:37:58 zpool upgrade RPool
2015-09-02.16:05:45 zpool import -d /dev -f -a
2015-09-03.19:28:23 zpool import -d /dev -f -a
2015-09-04.20:12:09 zpool import -d /dev -f -a
2015-09-05.14:37:14 zpool import -d /dev -f -a
2015-09-05.20:49:57 zpool import -d /dev -f -a
2015-09-05.21:16:02 zpool import -d /dev -f -a
2015-09-05.21:40:10 zpool import -d /dev -f -a
2015-09-06.12:46:29 zpool import -d /dev -f -a
2015-09-07.21:13:27 zpool import -d /dev -f -a
2015-09-09.14:59:23 zpool import -d /dev -f -a
2015-09-10.18:44:10 zpool import -d /dev -f -a
2015-09-14.15:53:04 zpool import -d /dev -f -a
2015-09-15.20:39:00 zpool import -d /dev -f -a
2015-09-16.21:13:59 zpool import -d /dev -f -a
2015-09-16.21:54:51 zpool import -d /dev -f -a
2015-09-17.18:33:34 zpool import -d /dev -f -a
2015-09-17.19:18:45 zpool import -d /dev -f -a
2015-09-17.19:54:03 zpool import -d /dev -f -a
2015-09-19.13:40:35 zpool import -d /dev -f -a
2015-09-20.10:17:33 zpool import -d /dev -f -a
2015-09-21.13:41:24 zpool import -d /dev -f -a
2015-09-23.13:21:36 zpool import -d /dev -f -a
2015-09-23.14:47:58 zpool import -d /dev -f -a
2015-09-25.15:38:29 zpool import -d /dev -f -a
2015-09-27.15:39:30 zpool import -d /dev -f -a
2015-09-27.15:49:46 zpool scrub RPool
2015-09-29.15:55:58 zpool import -d /dev -f -a
2015-09-29.16:38:06 zpool import -d /dev -f -a
2015-09-30.14:53:20 zpool import -d /dev -f -a
2015-10-05.20:18:10 zpool import -d /dev -f -a
2015-10-05.20:33:51 zpool import -d /dev -f -a
2015-10-05.21:33:32 zpool import -d /dev -f -a
2015-10-05.21:38:03 zpool import -d /dev -f -a
2015-10-06.15:45:30 zpool import -d /dev -f -a
2015-10-07.16:58:22 zpool import -d /dev -f -a
2015-10-07.17:02:58 zpool import -d /dev -f -a
2015-10-10.10:36:06 zpool import -d /dev -f -a
2015-10-11.19:08:59 zpool import -d /dev -f -a
2015-10-11.19:38:54 zpool import -d /dev -f -a
2015-10-11.21:58:03 zpool import -d /dev -a -f
2015-10-14.14:45:54 zpool import -d /dev -f -a
2015-10-14.14:52:17 zpool import -d /dev -f -a
2015-10-17.11:15:05 zpool import -d /dev -f -a
2015-10-18.10:12:20 zpool import -d /dev -f -a
2015-10-20.14:53:07 zpool import -d /dev -f -a
2015-10-20.15:25:17 zpool import -d /dev -f -a
2015-10-21.20:42:35 zpool import -d /dev -f -a
2015-10-24.10:52:49 zpool import -d /dev -f -a
2015-10-24.11:08:33 zpool import -d /dev -f -a
2015-10-24.20:31:27 zpool import -d /dev -f -a
2015-10-28.19:56:18 zpool import -d /dev -f -a
2015-11-02.17:56:38 zpool import -d /dev -f -a
2015-11-02.22:57:46 zpool import -d /dev -f -a
2015-11-07.10:40:41 zpool import -d /dev -f -a
2015-11-07.19:15:21 zpool import -d /dev -f -a
2015-11-13.15:43:10 zpool import -d /dev -f -a
2015-11-16.19:27:24 zpool import -d /dev -f -a
2015-11-21.08:33:00 zpool import -d /dev -f -a
2015-11-21.18:45:11 zpool import -d /dev -f -a
2015-11-21.19:10:21 zpool import -d /dev -f -a
2015-11-23.15:33:59 zpool import -d /dev -f -a
2015-11-29.17:02:37 zpool import -d /dev -f -a
2015-12-01.20:25:11 zpool import -d /dev -f -a
2015-12-08.17:34:44 zpool import -d /dev -f -a
2015-12-08.18:31:21 zpool import -d /dev -f -a
2015-12-11.21:34:00 zpool import -d /dev -f -a
2015-12-11.22:09:45 zfs set compression=off RPool/Video
2015-12-11.22:09:46 zfs set dedup=off RPool/Video
2015-12-11.22:09:46 zfs set sync=standard RPool/Video
2015-12-11.22:09:46 zfs set atime=off RPool/Video
2015-12-11.22:09:46 zfs set aclinherit=restricted RPool/Video
2015-12-11.22:09:46 zfs set aclmode=discard RPool/Video
2015-12-11.22:09:46 zfs set canmount=on RPool/Video
2015-12-11.22:09:46 zfs set readonly=off RPool/Video
2015-12-11.22:09:46 zfs set reservation=none RPool/Video
2015-12-11.22:09:47 zfs set quota=none RPool/Video
2015-12-11.22:09:52 zfs set snapdir=hidden RPool/Video
2015-12-11.22:11:08 zfs set compression=off RPool/Varios
2015-12-11.22:11:08 zfs set dedup=off RPool/Varios
2015-12-11.22:11:08 zfs set sync=standard RPool/Varios
2015-12-11.22:11:08 zfs set atime=off RPool/Varios
2015-12-11.22:11:08 zfs set aclinherit=restricted RPool/Varios
2015-12-11.22:11:08 zfs set aclmode=discard RPool/Varios
2015-12-11.22:11:08 zfs set canmount=on RPool/Varios
2015-12-11.22:11:08 zfs set readonly=off RPool/Varios
2015-12-11.22:11:09 zfs set reservation=none RPool/Varios
2015-12-11.22:11:09 zfs set quota=none RPool/Varios
2015-12-11.22:11:14 zfs set snapdir=hidden RPool/Varios
2015-12-11.22:11:21 zfs set compression=off RPool/ISO
2015-12-11.22:11:21 zfs set dedup=off RPool/ISO
2015-12-11.22:11:21 zfs set sync=standard RPool/ISO
2015-12-11.22:11:21 zfs set atime=off RPool/ISO
2015-12-11.22:11:21 zfs set aclinherit=restricted RPool/ISO
2015-12-11.22:11:22 zfs set aclmode=discard RPool/ISO
2015-12-11.22:11:22 zfs set canmount=on RPool/ISO
2015-12-11.22:11:22 zfs set readonly=off RPool/ISO
2015-12-11.22:11:22 zfs set reservation=none RPool/ISO
2015-12-11.22:11:22 zfs set quota=none RPool/ISO
2015-12-11.22:11:27 zfs set snapdir=hidden RPool/ISO
2015-12-11.22:11:32 zfs set compression=off RPool/Datos
2015-12-11.22:11:32 zfs set dedup=off RPool/Datos
2015-12-11.22:11:32 zfs set sync=standard RPool/Datos
2015-12-11.22:11:32 zfs set atime=off RPool/Datos
2015-12-11.22:11:32 zfs set aclinherit=restricted RPool/Datos
2015-12-11.22:11:32 zfs set aclmode=discard RPool/Datos
2015-12-11.22:11:32 zfs set canmount=on RPool/Datos
2015-12-11.22:11:32 zfs set readonly=off RPool/Datos
2015-12-11.22:11:32 zfs set reservation=none RPool/Datos
2015-12-11.22:11:32 zfs set quota=none RPool/Datos
2015-12-11.22:11:38 zfs set snapdir=hidden RPool/Datos
2015-12-12.18:49:06 zpool import -d /dev -f -a
2015-12-12.18:34:46 zpool scrub RPool
2015-12-13.08:28:31 zpool import -d /dev -f -a
2015-12-17.19:27:44 zpool import -d /dev -f -a
2015-12-18.14:47:12 zpool import -d /dev -f -a
2015-12-20.12:07:17 zpool import -d /dev -f -a
2015-12-20.22:10:11 zpool import -d /dev -f -a
2015-12-21.15:46:57 zpool import -d /dev -f -a
2015-12-22.15:52:41 zpool import -d /dev -f -a
2015-12-26.10:53:42 zpool import -d /dev -f -a
2015-12-28.22:55:21 zpool import -d /dev -f -a
2016-01-07.17:41:24 zpool import -d /dev -f -a
2016-01-10.11:18:31 zpool import -d /dev -f -a
2016-01-11.07:41:42 zpool import -d /dev -f -a
2016-01-18.20:51:37 zpool import -d /dev -f -a
2016-01-18.22:38:16 zpool import -d /dev -f -a
2016-01-19.18:46:36 zpool import -d /dev -f -a
2016-01-23.09:32:49 zpool import -d /dev -f -a
2016-01-30.09:22:57 zpool import -d /dev -f -a
2016-01-30.09:30:37 zpool import -d /dev -f -a
2016-02-02.07:40:15 zpool import -d /dev -f -a
2016-02-02.14:45:46 zpool import -d /dev -f -a
2016-02-05.17:09:36 zpool import -d /dev -f -a
2016-02-13.22:41:08 zpool import -d /dev -f -a
2016-02-14.21:30:59 zpool import -d /dev -f -a
2016-02-14.21:47:29 zpool import -d /dev -f -a
2016-02-14.21:57:57 zpool replace RPool 15552626430793865166 /dev/da7
2016-02-15.20:42:02 zpool import -d /dev -f -a
2016-02-19.07:46:00 zpool import -d /dev -f -a
2016-02-19.16:31:41 zpool import -d /dev -f -a
2016-02-21.19:51:18 zpool import -d /dev -f -a
2016-02-26.07:15:43 zpool import -d /dev -f -a
2016-02-27.16:43:57 zpool import -d /dev -f -a
2016-02-27.20:53:57 zpool import -d /dev -f -a
2016-02-27.21:04:59 zpool import -d /dev -f -a
2016-03-01.14:15:07 zpool import -d /dev -f -a
2016-03-04.20:07:20 zpool import -d /dev -f -a
2016-03-06.12:35:13 zpool import -d /dev -f -a
2016-03-06.22:46:21 zpool import -d /dev -f -a
2016-03-09.15:10:48 zpool import -d /dev -f -a
2016-03-09.20:10:28 zpool import -d /dev -f -a
2016-03-09.20:48:35 zpool import -d /dev -f -a
2016-03-14.16:43:48 zpool import -d /dev -f -a
2016-03-28.03:28:21 zpool import -d /dev -f -a
2016-03-28.09:05:57 zpool import -d /dev -f -a
2016-03-28.12:47:27 zpool import -d /dev -f -a
2016-03-28.13:00:18 zpool import -d /dev -f -a
2016-03-28.17:41:05 zpool import -d /dev -f -a
2016-03-31.17:48:34 zpool import -d /dev -f -a
2016-04-01.15:28:07 zpool import -d /dev -f -a
2016-04-04.19:59:47 zpool import -d /dev -f -a
2016-04-05.19:48:36 zpool import -d /dev -f -a
2016-04-08.07:28:23 zpool import -d /dev -f -a
2016-04-09.08:57:46 zpool import -d /dev -f -a
2016-04-12.14:02:51 zpool import -d /dev -f -a
2016-04-13.19:45:05 zpool import -d /dev -f -a
2016-04-13.20:16:36 zpool import -d /dev -f -a
2016-04-13.20:23:45 zpool import -d /dev -f -a
2016-04-16.08:22:58 zpool import -d /dev -f -a
2016-04-16.10:03:14 zpool import -d /dev -f -a
2016-04-16.18:48:33 zpool import -d /dev -f -a
2016-04-18.18:37:32 zpool import -d /dev -f -a
2016-04-21.09:25:09 zpool import -d /dev -f -a
2016-04-22.07:14:43 zpool import -d /dev -f -a
2016-04-23.11:35:36 zpool import -d /dev -f -a
2016-04-27.19:28:50 zpool import -d /dev -f -a
2016-05-04.07:29:12 zpool import -d /dev -f -a
2016-05-06.22:03:09 zpool import -d /dev -f -a
2016-05-08.19:15:38 zpool import -d /dev -f -a
2016-05-14.11:39:00 zpool import -d /dev -f -a
2016-05-21.19:51:10 zpool import -d /dev -f -a
2016-06-03.16:35:20 zpool import -d /dev -f -a
2016-06-03.20:12:15 zpool import -d /dev -f -a
2016-06-21.21:51:39 zpool import -d /dev -f -a
2016-06-21.21:56:59 zpool import -d /dev -f -a
2016-07-02.17:25:33 zpool import -d /dev -f -a
2016-07-03.20:57:25 zpool import -d /dev -f -a
2016-07-03.22:00:32 zpool import -d /dev -f -a
2016-07-06.23:24:33 zpool import -d /dev -f -a
2016-07-10.20:22:21 zpool import -d /dev -f -a
2016-07-10.23:39:05 zpool import -d /dev -f -a
2016-07-12.19:54:40 zpool import -d /dev -f -a
2016-07-13.19:52:38 zpool import -d /dev -f -a
2016-07-13.22:43:36 zpool import -d /dev -f -a
2016-07-14.02:14:36 zpool import -d /dev -f -a
2016-07-14.20:44:45 zpool import -d /dev -f -a
2016-07-15.14:24:49 zpool import -d /dev -f -a
2016-07-15.18:06:37 zpool import -d /dev -f -a
2016-07-20.22:38:53 zpool import -d /dev -f -a
2016-07-22.00:19:38 zpool import -d /dev -f -a
2016-07-28.07:38:43 zpool import -d /dev -f -a
2016-07-28.14:51:55 zpool import -d /dev -f -a
2016-08-09.17:37:12 zpool import -d /dev -f -a
2016-09-03.09:19:05 zpool import -d /dev -f -a
2016-09-11.13:56:09 zpool import -d /dev -f -a
2016-09-24.13:01:12 zpool import -d /dev -f -a
2016-09-24.18:29:38 zpool import -d /dev -f -a
2016-10-15.13:48:18 zpool import -d /dev -f -a
2016-10-15.17:45:16 zpool import -d /dev -f -a
2016-10-23.17:39:02 zpool import -d /dev -f -a
2016-11-03.18:38:40 zpool import -d /dev -f -a
2016-11-11.19:25:47 zpool import -d /dev -f -a
2016-11-15.14:01:26 zpool import -d /dev -f -a
2016-11-19.10:30:41 zpool import -d /dev -f -a
2016-11-19.13:19:27 zpool import -d /dev -f -a
2016-11-19.13:25:59 zpool import -d /dev -f -a
2016-11-19.15:48:15 zpool import -d /dev -f -a
2016-11-19.17:24:57 zpool import -d /dev -f -a
2016-11-19.17:29:08 zpool import -d /dev -f -a
2016-11-19.17:44:38 zpool upgrade RPool
2016-11-21.07:32:58 zpool import -d /dev -f -a
2016-11-21.07:37:20 zpool import -d /dev -f -a
2016-11-26.10:20:14 zpool import -d /dev -f -a
2016-11-26.10:30:59 zpool import -d /dev -f -a


Re: ZFS tools hang after upgrade to 11.0.0.4.3252

Posted: 26 Nov 2016 12:16
by oops741
Raul,
Thanks for the quick and detailed response. Is it possible to enter these zpool upgrade commands from the web-gui, Tools, Command?

Re: ZFS tools hang after upgrade to 11.0.0.4.3252

Posted: 26 Nov 2016 12:35
by oops741
Could not access Disks, ZFS, Tools (this is the part the 'hangs' the web-gui).
Tried to use the web-gui Tools, Command.

Code: Select all

zpool upgrade
Output was

Code: Select all

$ zpool upgrade
This system supports ZFS pool feature flags.

All pools are formatted using feature flags.

output:

Some supported features are not enabled on the following pools. Once a
feature is enabled the pool may become incompatible with software
that does not support the feature. See zpool-features(7) for details.

POOL  FEATURE
---------------
Pool1
      sha512
      skein
pool2
      sha512
      skein
	the features. See zpool-features(7) for details.
Tried also the

Code: Select all

zpool upgrade -v
This system supports ZFS pool feature flags.

The following features are supported:

FEAT DESCRIPTION
-------------------------------------------------------------
async_destroy                         (read-only compatible)
     Destroy filesystems asynchronously.
empty_bpobj                           (read-only compatible)
     Snapshots use less space.
lz4_compress                         
     LZ4 compression algorithm support.
multi_vdev_crash_dump                
     Crash dumps to multiple vdev pools.
spacemap_histogram                    (read-only compatible)
     Spacemaps maintain space histograms.
enabled_txg                           (read-only compatible)
     Record txg at which a feature is enabled
hole_birth                           
     Retain hole birth txg for more precise zfs send
extensible_dataset                   
     Enhanced dataset functionality, used by other features.
embedded_data                        
     Blocks which compress very well use even less space.
bookmarks                             (read-only compatible)
     "zfs bookmark" command
filesystem_limits                     (read-only compatible)
     Filesystem and snapshot limits.
large_blocks                         
     Support for blocks larger than 128KB.
sha512                               
     SHA-512/256 hash algorithm.
skein                                
     Skein hash algorithm.

The following legacy versions are also supported:

VER  DESCRIPTION
---  --------------------------------------------------------
 1   Initial ZFS version
 2   Ditto blocks (replicated metadata)
 3   Hot spares and double parity RAID-Z
 4   zpool history
 5   Compression using the gzip algorithm
 6   bootfs pool property
 7   Separate intent log devices
 8   Delegated administration
 9   refquota and refreservation properties
 10  Cache devices
 11  Improved scrub performance
 12  Snapshot properties
 13  snapused property
 14  passthrough-x aclinherit
 15  user/group space accounting
 16  stmf property support
 17  Triple-parity RAID-Z
 18  Snapshot user holds
 19  Log device removal
 20  Compression using zle (zero-length encoding)
 21  Deduplication
 22  Received properties
 23  Slim ZIL
 24  System attributes
 25  Improved scrub stats
 26  Improved snapshot deletion performance
 27  Improved snapshot creation performance
 28  Multiple vdev replacements
The Disks, ZFS, Tools still hangs. Is there anything else that can be done?

Re: ZFS tools hang after upgrade to 11.0.0.4.3252

Posted: 26 Nov 2016 12:54
by oops741
After restarting the N4F box (using a keyboard connected directly to it), ran

Code: Select all

$ zpool status
  pool: Pool1
 state: ONLINE
status: Some supported features are not enabled on the pool. The pool can
	still be used, but some features are unavailable.
action: Enable all features using 'zpool upgrade'. Once this is done,
	the pool may no longer be accessible by software that does not support
	the features. See zpool-features(7) for details.
  scan: resilvered 0 in 0h0m with 0 errors on Sun Oct 23 12:38:11 2016
config:

	NAME        STATE     READ WRITE CKSUM
	Pool1       ONLINE       0     0     0
	  raidz2-0  ONLINE       0     0     0
	    ada0    ONLINE       0     0     0
	    ada1    ONLINE       0     0     0
	    ada2    ONLINE       0     0     0
	    ada3    ONLINE       0     0     0

errors: No known data errors

  pool: pool2
 state: ONLINE
status: Some supported features are not enabled on the pool. The pool can
	still be used, but some features are unavailable.
action: Enable all features using 'zpool upgrade'. Once this is done,
	the pool may no longer be accessible by software that does not support
	the features. See zpool-features(7) for details.
  scan: scrub repaired 0 in 1h52m with 0 errors on Sun Oct 30 20:27:08 2016
config:

	NAME        STATE     READ WRITE CKSUM
	pool2       ONLINE       0     0     0
	  ada4      ONLINE       0     0     0
	  ada5      ONLINE       0     0     0

errors: No known data errors
So as per the http://docs.oracle.com/cd/E19253-01/819 ... index.html suggestion, ran

Code: Select all

$ zpool upgrade -a
This system supports ZFS pool feature flags.

Enabled the following features on 'Pool1':
  sha512
  skein

Enabled the following features on 'pool2':
  sha512
  skein
Followed by

Code: Select all

$ zpool upgrade
This system supports ZFS pool feature flags.

All pools are formatted using feature flags.

Every feature flags pool has all supported features enabled.
Now the status seems fine:

Code: Select all

$ zpool status
  pool: Pool1
 state: ONLINE
  scan: resilvered 0 in 0h0m with 0 errors on Sun Oct 23 12:38:11 2016
config:

	NAME        STATE     READ WRITE CKSUM
	Pool1       ONLINE       0     0     0
	  raidz2-0  ONLINE       0     0     0
	    ada0    ONLINE       0     0     0
	    ada1    ONLINE       0     0     0
	    ada2    ONLINE       0     0     0
	    ada3    ONLINE       0     0     0

errors: No known data errors

  pool: pool2
 state: ONLINE
  scan: scrub repaired 0 in 1h52m with 0 errors on Sun Oct 30 20:27:08 2016
config:

	NAME        STATE     READ WRITE CKSUM
	pool2       ONLINE       0     0     0
	  ada4      ONLINE       0     0     0
	  ada5      ONLINE       0     0     0

errors: No known data errors
Unfortunately, the web-gui Disks, ZFS, Tools still causes the web-gui to hang... :roll:

Re: ZFS tools hang after upgrade to 11.0.0.4.3252

Posted: 26 Nov 2016 14:44
by JoseMR
oops741 wrote:The Disks, ZFS, Tools still hangs. Is there anything else that can be done?
Hello oops741, you can enable SSH with permit root login then try to access the WebGUI ZFS tools, after the GUI hang, you can SSH login trough WinSCP to "/var/log" and zip/tar the logs files, then post here a brief system specs of the affected server followed by the zip/tar archive, this can help to sort out the root cause.

Regards

Re: ZFS tools hang after upgrade to 11.0.0.4.3252

Posted: 26 Nov 2016 22:23
by oops741
Hi JoseMR
Here is the system log (slightly sanitized) downloaded through the web-gui.

System description:
11.0.0.4 - Sayyadina (revision 3252)
Compiled Monday November 21 07:58:54 AEDT 2016
Platform OS FreeBSD 11.0-RELEASE-p3 #0 r308871M: Sun Nov 20 02:21:03 CET 2016
Platform x64-embedded on Intel(R) Celeron(R) CPU G3900 @ 2.80GHz
System Gigabyte Technology Co., Ltd. H110M-S2H-CF
Memory 8GB, DDR4 (non-ECC)

After trying to upgrade again ZFS through the Tools, Command in the web-gui, managed to reach a status of

Code: Select all

$ zpool status
  pool: Pool1
 state: ONLINE
  scan: resilvered 0 in 0h0m with 0 errors on Sun Oct 23 12:38:11 2016
config:

	NAME        STATE     READ WRITE CKSUM
	Pool1       ONLINE       0     0     0
	  raidz2-0  ONLINE       0     0     0
	    ada0    ONLINE       0     0     0
	    ada1    ONLINE       0     0     0
	    ada2    ONLINE       0     0     0
	    ada3    ONLINE       0     0     0

errors: No known data errors

  pool: pool2
 state: ONLINE
  scan: scrub repaired 0 in 1h52m with 0 errors on Sun Oct 30 20:27:08 2016
config:

	NAME        STATE     READ WRITE CKSUM
	pool2       ONLINE       0     0     0
	  ada4      ONLINE       0     0     0
	  ada5      ONLINE       0     0     0

errors: No known data errors
The Disks, ZFS, Tools still hangs the WebGui. So far had issues with SSH access, so hope for another solution.

Cheers

Re: ZFS tools hang after upgrade to 11.0.0.4.3252

Posted: 26 Nov 2016 23:25
by raulfg3
sometimes, save the actual config and do a fresh embeded re-install and restore config solve errors like this.

Re: ZFS tools hang after upgrade to 11.0.0.4.3252

Posted: 26 Nov 2016 23:45
by oops741
sometimes, save the actual config and do a fresh embeded re-install and restore config solve errors like this.
Thanks. Will try to re-install and restore config.

Re: ZFS tools hang after upgrade to 11.0.0.4.3252

Posted: 27 Nov 2016 00:23
by oops741
Tried the fresh embedded re-install, then restored config, but the problem of Disks, ZFS, Tools causing the web-gui to hang is still there.
While it is possible to perform ZFS management through Tools, Command it is still an issue.
On my other N4F box I am considering going back to 10.3.0.3.3105 (as the ZFS version there was not upgraded).
On a third N4F box with a single ZFS pool, it does not have an issue with ZFS, Tools after a similar upgrade... :roll:

Re: ZFS tools hang after upgrade to 11.0.0.4.3252

Posted: 27 Nov 2016 01:23
by bgold
How long have you let it sit on loading before closing the web gui? It seems that the new tools interface does load slow and even slower if there is any activity on the pools.

Re: ZFS tools hang after upgrade to 11.0.0.4.3252

Posted: 27 Nov 2016 03:04
by oops741
How long have you let it sit on loading before closing the web gui? It seems that the new tools interface does load slow and even slower if there is any activity on the pools.
Previously waited for more than 10 minutes at a time. Trying to wait longer this time, so far after 20 minutes it is still hanging ('spinning wheel'). I'll wait some more time, but suspect that it won't make a difference.

Cheers

Re: ZFS tools hang after upgrade to 11.0.0.4.3252

Posted: 27 Nov 2016 14:52
by ms49434
oops741 wrote:
How long have you let it sit on loading before closing the web gui? It seems that the new tools interface does load slow and even slower if there is any activity on the pools.
Previously waited for more than 10 minutes at a time. Trying to wait longer this time, so far after 20 minutes it is still hanging ('spinning wheel'). I'll wait some more time, but suspect that it won't make a difference.

Cheers
could you please post the output of the following (please zip):

zdb -C Pool1
zdb -C pool2
sysctl -b kern.geom.confxml

Re: ZFS tools hang after upgrade to 11.0.0.4.3252

Posted: 28 Nov 2016 04:09
by oops741
ms49434 wrote: could you please post the output of the following (please zip):

zdb -C Pool1
zdb -C pool2
sysctl -b kern.geom.confxml
Tried to get the
zdb -C Pool1
zdb -C pool2
but attempting to do that through the WebGui (Tools, Command) causes it to hang...
Tried through SSH (Putty) and after a long wait got the response

Code: Select all

zdb: can't open 'Pool1': Permission denied

Code: Select all

$ zdb -C Pool2
zdb: can't open 'Pool2': Permission denied
Enclosed is the kern.geom.confxml output (device serial numbers removed).

Any ideas?

Re: ZFS tools hang after upgrade to 11.0.0.4.3252

Posted: 28 Nov 2016 09:29
by oops741
logs.zip
JoseMR wrote:
oops741 wrote:The Disks, ZFS, Tools still hangs. Is there anything else that can be done?
Hello oops741, you can enable SSH with permit root login then try to access the WebGUI ZFS tools, after the GUI hang, you can SSH login trough WinSCP to "/var/log" and zip/tar the logs files, then post here a brief system specs of the affected server followed by the zip/tar archive, this can help to sort out the root cause.

Regards
Not sure how to permit root login in SSH.
Here are some recent log files from "/var/log" (slightly sanitized) (downloaded through the WebGui, but not sure if these capture the 'hand event').
These are from the N4F2 described in the signature.

Re: ZFS tools hang after upgrade to 11.0.0.4.3252

Posted: 28 Nov 2016 12:42
by oops741
ms49434 wrote: could you please post the output of the following (please zip):

zdb -C Pool1
zdb -C pool2
Found how to SSH as root, so here are the 2 requested outputs (took a very long time, more than 72 minutes for the larger Pool1)

Thanks for looking into this

Re: ZFS tools hang after upgrade to 11.0.0.4.3252

Posted: 30 Nov 2016 12:46
by oops741
Found a 'workaround', which is to install 10.3.0.3.3286 over the same USB stick and import the last saved configuration on the NF42 box. Now both Zpools on this box can be accessed and the Disks|ZFS|Tools can be accessed without 'hanging' the WebGui. Note that the ZFS version was upgraded during earlier attempts to resolve the hanging WebGui issue on 11.0.0.4.3252. Looks like 11.0.0.4.3252 needs some fixes.

Re: ZFS tools hang after upgrade to 11.0.0.4.3252

Posted: 30 Nov 2016 13:00
by raulfg3
oops741 wrote:Found a 'workaround', which is to install 10.3.0.3.3286 over the same USB stick and import the last saved configuration on the NF42 box. Now both Zpools on this box can be accessed and the Disks|ZFS|Tools can be accessed without 'hanging' the WebGui. Note that the ZFS version was upgraded during earlier attempts to resolve the hanging WebGui issue on 11.0.0.4.3252. Looks like 11.0.0.4.3252 needs some fixes.
Thanks for the input.

Developers still try to find the offending code, but your input are really apreciated.

Re: ZFS tools hang after upgrade to 11.0.0.4.3252

Posted: 01 Dec 2016 02:03
by ms49434
Reading the pool configuration straight from the disks seem to cause issues on some installations. We've developed a module that reads the configuration from the cache instead. Performance looks promising.

improvement: ability to read zfs tools configuration from cache
https://sourceforge.net/p/nas4free/code ... l_info.inc

Re: ZFS tools hang after upgrade to 11.0.0.4.3252

Posted: 02 Dec 2016 10:54
by oops741
The issue of hanging WebGui when using Disks|ZFS|Tools is now resolved after same N4F1 box had x64-embedded-11.0.0.4.3305 installed and previous configuration restored.
Thanks! :D