Can't write to Z1 Pool after Upgrade

[Ferdinand]

I upgraded from 9.3.0.2 1681 to 10.3.0.3 2870, needed to detect and sync my Z1 ZFS Pool, reconstructed the Shares by hand and made a zfs upgrade

I can read my shares but I can't write to Shares

Via SSH
cp: ./DSC_0249.JPG: No space left on device

df
Filesystem 1K-blocks Used Avail Capacity Mounted on
/dev/xmd0 122606 83872 38734 68% /
devfs 1 1 0 100% /dev
/dev/xmd1 736430 434922 301508 59% /usr/local
procfs 4 4 0 100% /proc
PoolZ1 298257 298257 0 100% /mnt/PoolZ1
PoolZ1/Backup 98700798 98700798 0 100% /mnt/PoolZ1/Backup
PoolZ1/Music 229 229 0 100% /mnt/PoolZ1/Music
PoolZ1/Photo 332195459 332195459 0 100% /mnt/PoolZ1/Photo
PoolZ1/Video 5057731021 5057731021 0 100% /mnt/PoolZ1/Video
/dev/xmd2 507420 4396 462432 1% /var
tmpfs 262144 44 262100 0% /var/tmp
/dev/da0s1a 761134 193290 567844 25% /cf

But the webgui shows

Total: 8.12T | Alloc: 7.97T | Free: 161G | State: ONLINE

I tried to change smb settings, pool settings but no success. Can anyone help me with a hint?

My setup
HP N40L 8GB, 3x Seagate 3TB in a ZFS Pool (Z1). Booting from USB Stick

[crowi]

seems your pool is full!
you should never fill it beyond 80%

[Ferdinand]

"Free: 161G"?

This was no problem with 9.3.0.2

edit: I can't even delete files...

nas4free: dc 720p# rm -r d-dc-720p.mkv
rm: d-dc-720p.mkv: No space left on device

[b0ssman]

yes reaching 100% on a zfs pool breaks it.

find a large file and do dd /dev/null > large file

[Ferdinand]

I know, I already reached 100% several times with the old system

So I deleted a 3 Gig File and reached
98% of 8.12TB
Total: 8.12T | Alloc: 7.96T | Free: 165G | State: ONLINE

but... still cant write and df still shows

0 100% on each share.

Do I need to delete more to reach 80%???? Why? Is this a "feature" of the new version?

[crowi]

Did you really delete it or did you put it in the wastebin?
And, as mentioned before, never fill your pool more than ~80%

[djiceman]

The newer version of ZFS reserves much more space for the pool. That's why eventhough you see like 2% free you still can't write to the pool. You will need to free up more space. Check your pool with zpool list.

[Ferdinand]

So, I need to free 8/5 = 1,6TB to be able to write/delete/change files on my Z1 Pool?

What a fine update... I just made an update via webgui, landed in a bootloop, needed to make a boot cd, copied to USB Stick, imported ZFS Pool, made config changes by hand (because import old config made a bootloop) and now I have to delete 20% of my nas.. very cool!

[sleid]

expand your pool !!!

[crowi]

The best practize guide says:
http://www.solarisinternals.com/wiki/in ... iderations
"Keep pool space under 80% utilization to maintain pool performance. Currently, pool performance can degrade when a pool is very full and file systems are updated frequently, such as on a busy mail server. Full pools might cause a performance penalty, but no other issues. If the primary workload is immutable files (write once, never remove), then you can keep a pool in the 95-96% utilization range. Keep in mind that even with mostly static content in the 95-96% range, write, read, and resilvering performance might suffer. "

You can expand your pool by adding more vDevs

[Ferdinand]

It came back to work after deleting about 90 Gig, thank you all for your answers and patience

zpool list
NAME SIZE ALLOC FREE EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT
PoolZ1 8.12T 7.86T 268G - 4% 96% 1.00x ONLINE -