NAS4Free 11.0.0.4.4040 released (FreeBSD 11.0-RELEASE-P8)

[zoon01]

The NAS4Free Team is pleased to announce a maintenance release of version 11.0.0.4.4040 - Sayyadina

download build 11.0.0.4.4040
Read the readme_11.0

Because of PHP upgrade and its related code changes: extensions like Extended GUI are not compatible!
Extensions should be disabled before and after upgrades until their creators have updated it's sources.
As we understood, OBI plugin is now compatible with this release.


Major Change!
Note for 32-bits users:
===================
We believe that the use of 32-bits versions can not give the end users it's full potential of the OS, for this
further development on the (i386) 32-bits architecture has been stopped upon the 11.0.0.3.xxxx series.
Current 32-bits users are able to use 32-bits 10.3.0.3.xxxx series until their end of life or do reinstall
to use 64-bits NAS4Free and restore config.

Again TIP: Do not upgrade from 10 series directly!
reinstall and restore config is the way to go because of increased partition size!
You avoid lots of problems later on.

Upgrade note:
=============
RRDGraphs extension can no longer be used with 11.x series, disable and deinstall before upgrade!
RRDGraphs are now included in 11.x series, you can setup on webgui System > Advanced > Monitoring Setup.
Do not reinstall the extension!!!

BUILD 11.0.0.4.4040

Changes after release 11.0.0.4.4029
===============================
- Update translations.
- Add several kernel patches.
- Add code improvements.
- Add localized extension menu
- Hide reboot notifier before reboot/shutdown is performed.
- Fix deleting group was calling update processor with wrong notifier id.

Known bugs:
===========
- IE11 and Edge browser does not operate correctly with novnc. Enter & Escape button problematic,
this will be fixed at a later release, use Chrome or other browser or connect with putty client.

Enjoy!

Regards,
The NAS4Free Team

[adultery_nas]

Thanks @zoon01

[Earendil]

Yes, thanks Zoon.

[loozhengyuan]

thanks devs

[crest]

...
Because of PHP upgrade and its related code changes: extensions like Extended GUI are not compatible!
Extensions should be disabled before and after upgrades until their creators have updated it's sources.
As we understood, OBI plugin is now compatible with this release.
...

Thanks to the devs, upgrade from 4029 worked perfectly without problems!

I checked all extensions against r4040, just DNSMasq DHCP Server, NextOnwCloud and TheBrig are NOT compatibel with this release

Please obey the compatibility version notes in the OneButtonInstaller extensions list

It is strongly recommended to activate the switch Update extensions list automatically in OneButtonInstaller to see the most recent versions notes.

Best regards
crest

[sleid]

Nextcloud 11 IS compatible with 4040

[slaycock]

Yet another upgrade fail.

Upgrading from 3940 to 4029 went without a hitch. Just the hassle of clearing the broswer cache in Chrome.

Upgrading from 4029 to 4040 resulted in a fail due to messages saying the zpool was busy. Rebooting showed that 4040 had installed but there was no config (an ongoing intermittent issue). Changed the ip to 192.168.2.25 so I could access my network and then loaded the config which produced an encryption error message. Turned off encryption and reloaded config which seemed to go OK until I got a 'no operating system message' on rebooting.

[crest]

Nextcloud 11 IS compatible with 4040

You're absolutely right about Nextcloud 11 and PHP 7.1.x but NOT in this regard because I was talking about the extension NextOwnCloud
The extension needs some work regarding PHP 7.1 and also to use the appropriate Nextcloud (or OwnCloud) version for N4F 10.3 up to 11.0.0.4.3460 which uses PHP 7.0.x and for 11.0.0.4.3882 and higher which comes with PHP 7.1.x.

Regards
crest

[slaycock]

Turned off encryption and reloaded config which seemed to go OK until I got a 'no operating system message' on rebooting.

Turned out that the MB once again decided to reset which drive it booted from. Once I pointed it back at the relavant USB stick it booted into 4040 just fine.

BUT

When I went to also upgrade the backup server I get an error

The following input errors were detected:
Failed to create in-memory file system.

[JoseMR]

When I went to also upgrade the backup server I get an error

The following input errors were detected:
Failed to create in-memory file system.

Hello, did the target backup machine memory is/was lets say over 95% usage?,
If the target machine is very thigh in memory, the upgrade process will may fail to create a tmpfs which mounts on /var/tmp/ftmp, still dunno if the system is properly releasing cached memory wen needed, need more investigation.

[GDixon]

using 4040 embedded all is working well except the new switch i found in advanced.

Using the switch to shrink the header works for the established time i'm logged in but when i log out and in again it hasn't been saved and i need to click the box and resave it again.

[zoon01]

using 4040 embedded all is working well except the new switch i found in advanced.

Using the switch to shrink the header works for the established time i'm logged in but when i log out and in again it hasn't been saved and i need to click the box and resave it again.

Sorry, that's not a bug, Shrink Page Header is only session valid in case some uses a very small screen, it is not intended to have the top header permanent hidden on systems.

[GDixon]

Got it, It is perfect for when i use the acer 10 inch netbook.

[thomasev]

I got this screen after upgrading, seems like php is broken. Base for all firmware was first release of version 11. All firmwareupgrades after first release of 11 has been OK except last one..

[ms49434]

please clear your browser cache, navbar.css needs to be reloaded

[thomasev]

That did the magic, thx very much..

[GDixon]

using 4040 embedded all is working well except the new switch i found in advanced.

Using the switch to shrink the header works for the established time i'm logged in but when i log out and in again it hasn't been saved and i need to click the box and resave it again.

Sorry, that's not a bug, Shrink Page Header is only session valid in case some uses a very small screen, it is not intended to have the top header permanent hidden on systems.

since the system status page is the first page to pop up how can I move the button to shrink the header to the footer of the system status page? What pages should have the file I can make the changes?
It would be more convenient for the 10 inch screen than going to other menus to do so.

Greg

[ms49434]

The main page is an informal page and not a configuration page. Therefore no form elements exist. We also have no plans to add a button to the footer section.

[crest]

...
Because of PHP upgrade and its related code changes: extensions like Extended GUI are not compatible!
Extensions should be disabled before and after upgrades until their creators have updated it's sources.
As we understood, OBI plugin is now compatible with this release.
...

Thanks to the devs, upgrade from 4029 worked perfectly without problems!

I checked all extensions against r4040, just DNSMasq DHCP Server, NextOnwCloud and TheBrig are NOT compatibel with this release

Please obey the compatibility version notes in the OneButtonInstaller extensions list

It is strongly recommended to activate the switch Update extensions list automatically in OneButtonInstaller to see the most recent versions notes.

Best regards
crest

OneButtonInstaller extensions list upgraded, the updated extension NextOwnCloud v0.2.2 is now PHP 7.1 compatibel.

Regards
crest

[slaycock]

Hello, did the target backup machine memory is/was lets say over 95% usage?,

I've tried updating with memory usage reported from between 55% and 89% according to the status page. I get the same error each time.

[JoseMR]

Hello, did the target backup machine memory is/was lets say over 95% usage?,

I've tried updating with memory usage reported from between 55% and 89% according to the status page. I get the same error each time.

your issue is quite peculiar to me and I'm still wondering, please could you post your system specs i.e MB used and Ram amount ECC/Non-ECC etc.

Regards

[NAS4Free4Me]

Hello:

I'm curious as to your system specs as well. Would you please provide info regarding the Motherboard, CPU, Hard drives (manufacturer, type, size, etc.), etc, in addition to what JoseMR has requested. I only ask as I think you may have a one off system as I have never had the amount of trouble you are experiencing with upgrades. Maybe I'm just lucky, who knows. I only ask because if you look at my specs for my NAS system (see below), it is pretty modest by today's standard. I will point out my NAS has 13.6TB of ZFS RAID 1 total, 10.1TB Allocated, 3.53TB free. The NIC is an Intel with 4 GB ports setup to do LAGG (switch is a Netgear ProSafe GS724T configured for the 4 ports as LAGG). So I'm guessing I'll be upgrading the drives to 5 x 6TB or 8TB Seagate NAS drive in the near future (my luck been pretty good with the Seagate brand but I do my due diligence when I get to the purchasing stage). Regarding my memory I use 16GB non-ECC and when the system first starts it basically uses about 5% of the 16086MiB. But... each morning at 4:30AM I do a RSYNC to my QNAP TS-869 Pro with 8 x 4TB Seagate drive and 3GB RAM. As soon as there is ANY kind of serious demand put on the NAS (NAS4Free not QNAP) the NAS memory usage jumps to 97% of 16086MiB and it NEVER falls below, regardless if the NAS system drive sleeps or not. Most times the NAS is idle and waiting for a request so I don't know why the memory is not released. If your curious as to what the NAS does... Nightly starting at midnight my windows systems (4 of them) start jobs to backup data only to the NAS. This usually takes less than 30 minutes for each system. At the 1st of each month an Image (Acronis) is set to create a total image (not incremental or differential) and keep the prior 2 months (IE 3 months of images on hand) and this is done a 7AM. Lastly is also serves as a file storage for my HTPC (MKV) files. This is where the majority of the data usage is located as most of the files are Blu-ray (main movie only) and I haven't done any compression to them as I want them to as true as possible (hence the reason to upgrade to larger hard drives). Now I don't access the HTPC movies all the time but 2 or 3 times a week so again I don't see why 16086MiB of memory is so heavily taxed. Yes, I know ZFS uses a lot of memory but in today's age you would think they (or whomever) could do a better job of (dynamic) memory allocation. I mean if M$ can figure it out...

The point being is when I do my embedded upgrade AFTER doing a System Backup, the System Firmware Update works without any troubles. I guess I'm just lucky when doing upgrades. Here's hoping the geniuses can help you to a smoother upgrade process.

[JoseMR]

The point being is when I do my embedded upgrade AFTER doing a System Backup, the System Firmware Update works without any troubles. I guess I'm just lucky when doing upgrades. Here's hoping the geniuses can help you to a smoother upgrade process.

Thank you a lot for sharing a detailed experience with NAS4Free, ZFS etc, the high amount of RAM you been experiencing is just the ZFS ARC(Adaptive Replacement Cache) filling up, the bigger the zpool(s) then more ARC is requested, while this supposedly should be smart and self dynamically controlled, the user always can tune/limit this behavior from the GUI.

Regarding NAS4Free Embedded firmware upgrade failures, this is a very deep topic and there are lots of factors which affects this process, from a simple miss-configured system to problems far beyond our imagination(inner hardware issues), but I will try to post most common problems here for reference, instead being too technical.

The NAS4Free Embedded platform highly relies on available system RAM, this is because the running system is structured in the RAM on independent memory disks(md0, md1, md2) with a fourth memory file system(tmpfs) for tmp, in the event the system is very thigh on system RAM, SWAP will try to take care/compensate so will start paging, therefore memory exhaustion without SWAP, could result in many unpredictable system errors or even plain system crashes.

*But I have lots of RAM why my system randomly crash?*, This is where the previous above statement comes into play, a NAS4Free Embedded system with decent amount of RAM still can even experience unpredictable system errors wen it runs low on RAM if there is no SWAP partition present.

*But I have a Swap partition and Free RAM whats going on?*, This is where the far and deeper technical issues comes into play, but a common one is that many NAS4Free users are running Embedded platforms from a USB(slow USB 2.0 generally) and they SWAP partition is placed on the USB, this USB drives are connected to a far lower speed, higher latency USB HUB/bridges and generally they don't take advantages of DMA(direct memory access) unlike conventional HDD's/SSD's, thus a small interruption and/or latency on SWAP paging could also results in unpredictable issues preventing the system from being upgraded properly; Note that This will vastly vary from system to system and specifications.

In regards to the "inner hardware issues", well this is one of the electronics phenomena devils we have to live with, just to sum it up, as this topic is extremely deep and far beyond the average users knowledge.

Regards

[slaycock]

your issue is quite peculiar to me and I'm still wondering, please could you post your system specs i.e MB used and Ram amount ECC/Non-ECC etc.

Main Server

Code: Select all

Hostname	laurelnas.local	



Version	11.0.0.4 - Sayyadina (revision 4040)
Compiled	Sunday March 12 23:28:30 GMT 2017
Platform OS	FreeBSD 11.0-RELEASE-p8 #0 r315000M: Sat Mar 11 22:46:00 CET 2017
Platform	x64-embedded on Intel(R) Core(TM) i5-2500K CPU @ 3.30GHz
System	Gigabyte Technology Co., Ltd. PH67-UD3-B3
System BIOS	Award Software International, Inc. version: F8 03/21/2012
System Time	Thursday March 16 09:30:16 GMT 2017
System Uptime	2 Days 19 Hours 5 Minutes 31 Seconds
Last Configuration Change	Thursday March 16 09:29:50 GMT 2017
CPU Frequency	
3300MHz
CPU Usage	 
2%
Core Usage	 Core 0: 
2%
Temp: 
28.0
°C Core 1: 
0%
Temp: 
30.0
°C Core 2: 
0%
Temp: 
28.0
°C Core 3: 
7%
Temp: 
30.0
°C
Memory Usage	  
78% of 16198MiB
Swap Usage	
 0% of 4GB || Device: da1p3 | Total: 4G | Used: 0B | Free: 4G
Load averages	
0.51, 0.46, 0.41
 [Show Process Information]
Disk Space Usage	
LaurelPool
     	51% of 16.2TB	|| Total: 16.2T | Used: 8.37T | Free: 7.88T ||	
ada5	= Spinning	| Temp: 29 °C
ada0	= Spinning	| Temp: 28 °C
ada2	= Spinning	| Temp: 30 °C
ada1	= Spinning	| Temp: 29 °C
ada3	= Spinning	| Temp: 30 °C
ada4	= Spinning	| Temp: 29 °C
  

Disks

Code: Select all

Device	Device Model	Size	Serial Number	Controller	Controller Model	Standby	Filesystem	Status	Toolbox
	ada0	TOSHIBA DT01ABA300	3.00TB	13V77Z3AS	ahcich0	Intel Cougar Point AHCI SATA controller	Always On	ZFS Storage Pool	ONLINE	
Edit Disk		
	ada1	TOSHIBA DT01ABA300	3.00TB	13VB225GS	ahcich1	Intel Cougar Point AHCI SATA controller	Always On	ZFS Storage Pool	ONLINE	
Edit Disk		
	ada2	TOSHIBA DT01ABA300	3.00TB	13U91PDGS	ahcich2	Intel Cougar Point AHCI SATA controller	Always On	ZFS Storage Pool	ONLINE	
Edit Disk		
	ada3	TOSHIBA DT01ABA300	3.00TB	13VB0M7GS	ahcich3	Intel Cougar Point AHCI SATA controller	Always On	ZFS Storage Pool	ONLINE	
Edit Disk		
	ada4	TOSHIBA DT01ABA300	3.00TB	13U91X6GS	ahcich4	Intel Cougar Point AHCI SATA controller	Always On	ZFS Storage Pool	ONLINE	
Edit Disk		
	ada5	TOSHIBA DT01ABA300	3.00TB	13V63VXGS	ahcich5	Intel Cougar Point AHCI SATA controller	Always On	ZFS Storage Pool	ONLINE	
Edit Disk		
	da1	Kingston DataTraveler 3.0	7.74GB	60A44C3FAC04FFB1B97A00E9	umass-sim1	EHCI (generic) USB 2.0 controller	Always On	UFS	ONLINE	
Edit Disk		

ZFS

Code: Select all

Pools (1)
Name	Size	Alloc	Free	Expandsz	Frag	Dedup	Health	Mount Point	AltRoot
LaurelPool	16.2T	8.37T (51%)	7.88T	-	14%	1.00x	ONLINE	/LaurelPool	-
Virtual Devices (1)
Name	Type	Pool	Devices
LaurelPool_raidz2_0	raidz2	LaurelPool	/dev/ada5, /dev/ada0, /dev/ada2, /dev/ada1, /dev/ada3, /dev/ada4
Datasets (6)
Name	Pool	Compression	Dedup	Sync	ACL Inherit	ACL Mode	Canmount	Quota	Readonly	Snapshot Visibility
.system	LaurelPool	off	off	standard	passthrough	passthrough	on	none	off	hidden
.system/cores	LaurelPool	off	off	standard	passthrough	passthrough	on	none	off	hidden
.system/rrd-adb946163d914f088dc14617dbc0bec3	LaurelPool	off	off	standard	passthrough	passthrough	on	none	off	hidden
.system/samba4	LaurelPool	off	off	standard	passthrough	passthrough	on	none	off	hidden
.system/syslog-adb946163d914f088dc14617dbc0bec3	LaurelPool	off	off	standard	passthrough	passthrough	on	none	off	hidden
LaurelDataset	LaurelPool	off	off	standard	passthrough	passthrough	on	none	off	visible

Processs stats

Code: Select all

last pid: 54421;  load averages:  0.85,  0.53,  0.44  up 2+19:11:46    09:37:01
30 processes:  1 running, 29 sleeping

Mem: 147M Active, 2872M Inact, 12G Wired, 11M Buf, 315M Free
ARC: 9763M Total, 7719M MFU, 705M MRU, 54M Anon, 90M Header, 1194M Other
Swap: 4096M Total, 4096M Free


  PID USERNAME      THR PRI NICE   SIZE    RES STATE   C   TIME    WCPU COMMAND
 2545 root           31  20    0  1318M  1312M uwait   2 338:05  36.67% syncthing
 2168 vboxusers       9  20    0   111M 11384K select  2   1:24   0.00% VBoxSVC
 1893 root            1  20    0 10436K  1480K select  1   1:18   0.00% powerd
 2544 root           11  52    0 22004K  7592K uwait   1   1:18   0.00% syncthing
 2429 root            1  20    0 55664K  4696K kqread  2   0:18   0.00% lighttpd
 2163 vboxusers       6  20    0   125M 10672K select  2   0:10   0.00% vboxwebsrv
 1980 root            1  20    0   232M  7540K select  1   0:09   0.00% nmbd
 2166 vboxusers       1  20    0 81108K  8020K select  0   0:03   0.00% VBoxXPCOMIPCD
 1673 root            1  20    0 10492K  1628K select  0   0:02   0.00% syslogd
 1982 root            1  20    0   298M 12696K select  1   0:01   0.00% smbd
 2347 root            1  20    0  8784K  1952K select  0   0:01   0.00% mDNSResponderPosix
42698 root            1  20    0   398M 39328K piperd  0   0:01   0.00% php-cgi
43130 root            1  20    0   398M 39008K accept  0   0:01   0.00% php-cgi
 2267 root            1  20    0 12564K  1748K nanslp  3   0:01   0.00% cron
 1985 root            1  20    0   296M  9592K select  1   0:01   0.00% smbd
 1988 root            1  20    0   296M  9540K select  3   0:01   0.00% smbd
 1530 root            1  20    0  9512K  5012K select  0   0:00   0.00% devd
 2431 root            1  52    0   392M 37676K accept  1   0:00   0.00% php-cgi
 2433 root            1  35    0   389M 31592K wait    1   0:00   0.00% php-cgi
 2430 root            1  52    0   389M 31592K wait    2   0:00   0.00% php-cgi
 2432 root            1  21    0   390M 34556K accept  1   0:00   0.00% php-cgi
51969 root            1  52    0 13768K  2880K wait    2   0:00   0.00% bash
 2702 root            1  52    0 21732K  3040K pause   1   0:00   0.00% csh
 2699 root            1  52    0 43732K  2176K wait    2   0:00   0.00% login
 2717 root            1  52    0 13224K  2524K ttyin   2   0:00   0.00% sh

Backup Server #1

Code: Select all

Version	11.0.0.4 - Sayyadina (revision 3379)
Compiled	Sun 01 Jan 2017 21:21:49 GMT +0000
Platform OS	FreeBSD 11.0-RELEASE-p6 #0 r310777M: Thu Dec 29 16:15:15 CET 2016
Platform	x64-embedded on Intel(R) Core(TM)2 Duo CPU E8400 @ 3.00GHz
System	ASUSTeK Computer INC. P5K SE
System BIOS	American Megatrends Inc. Version: 1104 07/07/2008
System Time	Thu 16 Mar 2017 09:27:42 GMT +0000
System Uptime	14 Hours 43 Minutes 25 Seconds
System Config Change	Wed 15 Mar 2017 17:49:08 GMT +0000
CPU Frequency	
499MHz
CPU Usage	 
30%
CPU Core Usage	 Core 0: 
33%
Temp: 
40.0
°C Core 1: 
28%
Temp: 
38.0
°C
Memory Usage	  
81% of 8022MiB
Swap Usage	
 0% of 4GB || Device: da8s2b | Total: 4G | Used: 0B | Free: 4G
Load averages	
1.28, 0.82, 0.82
 [Show Process Information]
Disk Space Usage	
LazarusPool/LazarusDataset
     	60% of 6.7TB	|| Total: 6.7T | Used: 4.0T | Free: 2.7T ||	
ds0	= ZFS-DS	| Temp: n/a
Space OK	  
LazarusPool
     	58% of 9.06TB	|| Total: 9.06T | Used: 5.29T | Free: 3.77T ||	
da5	= Spinning	| Temp: 36 °C
da7	= Spinning	| Temp: 32 °C
da0	= Spinning	| Temp: 33 °C
ada1	= Spinning	| Temp: 35 °C
da1	= Spinning	| Temp: 34 °C
da6	= Spinning	| Temp: 33 °C
da2	= Spinning	| Temp: 30 °C
da3	= Spinning	| Temp: 30 °C
da4	= Spinning	| Temp: 33 °C
ada0	= Spinning	| Temp: 36 °C
Space OK	  

Disks

Code: Select all

Device	Device Model	Size	Serial Number	Controller	Controller Model	Standby	Filesystem	Status	
ada0	SAMSUNG HD103SJ	953870MB	S246J90ZC28585	ata4	Intel ICH9 SATA300 controller	20	ZFS Storage Pool	ONLINE	Edit disk   Delete disk
ada1	TOSHIBA HDWD110	953870MB	X5KNU1NFS	ata5	Intel ICH9 SATA300 controller	20	ZFS Storage Pool	ONLINE	Edit disk   Delete disk
da0	Hitachi HDS721010CLA332	953870MB	JP6940HZ1ZVZ8F	mpt0	LSILogic SAS/SATA Adapter	20	ZFS Storage Pool	ONLINE	Edit disk   Delete disk
da1	SAMSUNG HD103SJ	953870MB	S246J90ZC28581	mpt0	LSILogic SAS/SATA Adapter	20	ZFS Storage Pool	ONLINE	Edit disk   Delete disk
da2	SAMSUNG HD103UJ	953869MB	S13PJ1KSB03609	mpt0	LSILogic SAS/SATA Adapter	20	ZFS Storage Pool	ONLINE	Edit disk   Delete disk
da3	SAMSUNG HD103UJ	953869MB	S13PJ1KS204757	mpt0	LSILogic SAS/SATA Adapter	20	ZFS Storage Pool	ONLINE	Edit disk   Delete disk
da4	Hitachi HDS721010CLA332	953870MB	JP9960HZ2P8V6U	mpt0	LSILogic SAS/SATA Adapter	20	ZFS Storage Pool	ONLINE	Edit disk   Delete disk
da5	Hitachi HDS721010CLA332	953870MB	JP2911HQ1BG9AA	mpt0	LSILogic SAS/SATA Adapter	20	ZFS Storage Pool	ONLINE	Edit disk   Delete disk
da6	TOSHIBA HDWD110	953870MB	X5KP81RFS	mpt0	LSILogic SAS/SATA Adapter	20	ZFS Storage Pool	ONLINE	Edit disk   Delete disk
da7	SAMSUNG HD103SJ	953870MB	S246J90ZC28565	mpt0	LSILogic SAS/SATA Adapter	20	ZFS Storage Pool	ONLINE	Edit disk   Delete disk
da8	Multi Flash Reader 1.00	7696MB	058F63666471	umass-sim0	Intel 82801I (ICH9) USB 2.0 controller	Always On	UFS	ONLINE	Edit disk   Delete disk

zfs

Code: Select all

Pools (1)
Name	Size	Alloc	Free	Expandsz	Frag	Dedup	Health	Mount Point	AltRoot
LazarusPool	9.06T	5.30T (58%)	3.76T	-	26%	1.00x	ONLINE	/mnt/LazarusPool	-
Virtual Devices (1)
Name	Type	Pool	Devices
LazarusPool_raidz2_0	raidz2	LazarusPool	/dev/da5, /dev/da7, /dev/da0, /dev/ada1, /dev/da1, /dev/da6, /dev/da2, /dev/da3, /dev/da4, /dev/ada0
Datasets (1)
Name	Pool	Compression	Dedup	Sync	ACL Inherit	ACL Mode	Canmount	Quota	Readonly	Snapshot Visibility

Process status

Code: Select all

last pid: 55487;  load averages:  1.55,  1.22,  0.98  up 0+14:56:37    09:41:24
24 processes:  1 running, 23 sleeping

Mem: 122M Active, 1400M Inact, 6186M Wired, 9862K Buf, 91M Free
ARC: 4692M Total, 3467M MFU, 789M MRU, 1211K Anon, 35M Header, 400M Other
Swap: 4096M Total, 4096M Free


  PID USERNAME      THR PRI NICE   SIZE    RES STATE   C   TIME    WCPU COMMAND
 2442 root           19  20    0   750M   604M uwait   1 189:20  70.85% syncthing
55461 root            1  52    0 13688K  2816K wait    0   0:00   0.29% bash
 2409 root            9  28    0 15728K  4596K uwait   0   0:19   0.00% syncthing
 1498 root            1  20    0  9512K  4996K select  1   0:16   0.00% devd
 1850 root            1  20    0 10436K  1420K select  0   0:14   0.00% powerd
 2296 root            1  52    0 13688K  2232K wait    1   0:05   0.00% bash
 2206 root            1  20    0 51568K  4944K kqread  0   0:04   0.00% lighttpd
 1634 root            1  20    0 10492K  1556K select  1   0:03   0.00% syslogd
 1905 root            1  20    0   227M  6964K select  0   0:03   0.00% nmbd
 2211 root            1  20    0   393M 38684K piperd  0   0:02   0.00% php-cgi
 2212 root            1  52    0   391M 36592K accept  0   0:01   0.00% php-cgi
 1907 root            1  20    0   291M 11020K select  0   0:01   0.00% smbd
 2044 root            1  20    0 12564K  1652K nanslp  0   0:00   0.00% cron
 2208 root            1  52    0   393M 37104K accept  1   0:00   0.00% php-cgi
 2124 root            1  20    0  8784K  1712K select  0   0:00   0.00% mDNSResponderPosix
 2481 root            1  20    0 10460K  1468K nanslp  0   0:00   0.00% getty
 2483 root            1  20    0 10460K  1468K nanslp  1   0:00   0.00% getty
 2482 root            1  20    0 10460K  1468K nanslp  0   0:00   0.00% getty
 1909 root            1  20    0   289M  8576K select  0   0:00   0.00% smbd
 2210 root            1  52    0   389M 31380K wait    0   0:00   0.00% php-cgi
 2207 root            1  52    0   389M 31380K wait    1   0:00   0.00% php-cgi
55486 root            1  52    0 26868K  3432K cbwait  1   0:00   0.00% smartctl
55487 root            1  21    0 20120K  2424K CPU1    1   0:00   0.00% top
 2209 root            1  52    0   389M 31348K accept  0   0:00   0.00% php-cgi

I do not use ECC memory.

I must admin that I am increasingly minded to invest in a couple of low cost ssd for booting and to put them on the first sata port.

[JoseMR]

Hi slaycock, thanks for posting the the spec for the affected machine, noticed only "91M Free" on the Backup server, anyway please try another upgrade with the following instruction:

1) Turn off Extended GUI Extension if enabled.
2) Download the fresh firmware file from SourceForge and place on a permanent data location
3) Issue a Firmware upgrade from the shell with the following command:

Code: Select all

# /etc/rc.firmware upgrade /path/to/NAS4Free-x64-embedded-11.0.0.4.XXXX.img.xz

where XXXX is the revision numbers.

Hope this will help, and looking forward for the results.

Regards

[mrwinch]

I've installed new version (version "FULL") and found a small problem: webGUI doesn't start by itself. I have to start from console (option 11 - Restart webGUI): not a big problem using IPMI/kVM interface. Something wrong in my installation?

[NAS4Free4Me]

Hello:

@JoseMR

you stated the following:
"... while this supposedly should be smart and self dynamically controlled, the user always can tune/limit this behavior from the GUI." Really? Where? How (IE: upper and lower limits)? Documentation? Don't get me wrong I appreciate the info but it's the first I've heard.

I just find it weird that if I do a simple file transfer the memory doesn't alarmingly jump. But once that RSYNC kicks in then RAM goes to 97% and never releases. I get what you said about the ZFS ARC but at some point there has got to be a way for the ARC to automatically flush it's cache after a set period of time. Being the system is 90 - 95% idle, some logic has got to be incorporated to manage the ARC more efficiently. Now I'm sure I'm going to get some flak as to the definition of efficiency, but for a system to be idle 90 - 95%, using 97% of RAM makes no sense (to me) and it's not like the ARC can't be filled again if it was in fact flushed. Restarting the NAS proves this as the RAM starts at about 5% usage. All the drives of the ZFS are on-line (just not accessed), and if I go to a share from my windows system the RAM doesn't jump to 97%. Also, the RSYNC only determines what has changed (new file/folder(s), deleted file/folder(s), changed file/folder(s), etc.) and only acts on those changes. I guess what I'm getting at is... if I use my windows system to copy a file/folder or a group of files/folders to/from the NAS the RAM doesn't jump to 97%, and I find that the baffling part. As far as my swap file is concerned, I use a 32GB portion of my ZFS pool and it always indicates 0 Bytes used 32GB free, so if the swap is being used it seems it flushes itself without incident.


@slaycock

Your main NAS system M/B is a from a reputable manufacturer and you're on the latest (actually last produced) BIOS so I find it weird the M/B just changes boot drives. Not saying it's not happening, it could be a deep rooted bug and given the age Gigabyte not going back to correct, they would rather you (read: everyone) buy the latest and greatest of their M/B line. Your RAM size and mine are about the same (for all intensive purpose) so it's a mystery to me as to why the headaches on upgrades. Like JoseMR indicated some thing are hardware issues that are deep rooted given the many variables of manufacturer (of all components - M/B, RAM, H/D etc, and setup (add-ons, features turned on/off etc). Sorry I can't be of help to you at this point because everything should be working without issue based on the info you supplied.

[slaycock]

Dear JoseMR

Many thanks for your help. Unfortunately your suggestion indicates that there may be something deeply wrong with the server setup.

Hope this will help, and looking forward for the results.

Code: Select all

Welcome Lazarus on NAS4Free!
lazarusnas: ~# ls
.cshrc    .dialogrc .inputrc  .profile
lazarusnas: ~# cd ..
lazarusnas: /# ls
.snap        bin          boot         cf           conf         conf.default dev          entropy      etc          ftmp         home         lib          libexec      mnt          proc         root         sbin         tmp          usr          var
lazarusnas: /# /etc/rc.firmware upgrade /tmp/NAS4Free-x64-embedded-11.0.0.4.4040.img.xz
/etc/rc.firmware: cannot open /dev/console: Device not configured

In the meantime I've ordered a couple of low cost 32GB SSD.

[JoseMR]

Dear JoseMR

Many thanks for your help. Unfortunately your suggestion indicates that there may be something deeply wrong with the server setup.

Hello Slaycock, /tmp is still on system ram(tmpfs), I was suggesting another user created directory/pool between, unfortunately your system already experiencing OS corruption as per see, I'm afraid you need to trigger a reboot in this case for this particular machine, since performing a config backup/DD image by hand(experimental) would be a bit risky by the way and I cannot take a chance.

Regards

[JoseMR]

Hello:

@JoseMR

you stated the following:
"... while this supposedly should be smart and self dynamically controlled, the user always can tune/limit this behavior from the GUI." Really? Where? How (IE: upper and lower limits)? Documentation? Don't get me wrong I appreciate the info but it's the first I've heard.

Hi, I was referring tho the whole ZFS ARC/allocation/vkem etc and the stuff you can fine-tune wen defaults does not work for you properly(particular cases mostly), there are some reading in the net already that show some users achieving better stability in this regards, while a vastly amount using plain out-of-the-box ZFS settings with absolutely no issues, I have to note down again that this is a more notorious issue here for the Embedded users by design.

While this issues could be minimal in ZFS Full installs(HDD/SSD Only), Full install is far beyond to be recommended here for the average user, any way, but if the user is experienced enough, and don't mind to try, Full install now support ZFS installation(snapshot protected), also mirroring for high availability/stability deployments.
Regards