*New 12.1 series Release:
2019-11-08: XigmaNAS 12.1.0.4.7091 - released!

*New 11.3 series Release:
2019-10-19: XigmaNAS 11.3.0.4.7014 - released


We really need "Your" help on XigmaNAS https://translations.launchpad.net/xigmanas translations. Please help today!

Producing and hosting XigmaNAS costs money. Please consider donating for our project so that we can continue to offer you the best.
We need your support! eg: PAYPAL

Memory usage at 100% and system crashes

Posts only related to Beta Builds, all others will be removed!
Forum rules
Set-Up GuideFAQsForum Rules
Post Reply
bgold
Starter
Starter
Posts: 59
Joined: 23 May 2015 08:42
Status: Offline

Memory usage at 100% and system crashes

#1

Post by bgold » 28 Apr 2019 22:41

I am running 12.0.0.4.6625 on fairly high performance hardware.

I have 256gb ram, dual processor, 3 zfs pools with ssd cache drives.

I have been using virutalbox for a ubuntu vm and the NAS is crashing when memory usage reaches 100%.

I have reached the recommended settings for ZFS and kernel and applied some.

I can't keep the system running for more than a day without it crashing.

I understand that FreeBSD uses all available memory for cache and is supposed to free up as needed.

Not sure if there are any settings to keep a certain amount of memory available for the vm.

Any help would be appreciated.

Let me know what information is needed to help in troubleshooting.

Thanks
XigmaNAS 12.0.0.4.6625
HP ML150 Gen9, Dual 2.4ghz, 256gb, 25TB Storage, 3-ZFS pools w/SSD cache&logs, SSD boot/data, SFP+

User avatar
JoseMR
Hardware & Software Guru
Hardware & Software Guru
Posts: 1206
Joined: 16 Apr 2014 04:15
Location: PR
Contact:
Status: Offline

Re: Memory usage at 100% and system crashes

#2

Post by JoseMR » 28 Apr 2019 23:25

You no longer need to bother with "vm.kmem_size", instead limit the "vfs.zfs.arc_max" , to check if the max target has been applied use "sysctl vfs.zfs.arc_max"

with all that much RAM you have, maybe I would free up at least ~6G depending on how many VM's you have and how much RAM you've reserved for them and test, between if this is a panic, check if you can read something like "kmem_malloc" or something alike on the console/BMC.

I also assume that you have at least a 2GB Swap partition on the boot ssd?

Regards
System: FreeBSD 12 RootOnZFS, MB: Supermicro X8SI6-F, Xeon X3450, 16GB DDR3 ECC RDIMMs.
XigmaNAS RootOnZFS
Addons at GitHub
BastilleBSD
Boot Environments Intro
JoseMRPubServ(temporary down)

bgold
Starter
Starter
Posts: 59
Joined: 23 May 2015 08:42
Status: Offline

Re: Memory usage at 100% and system crashes

#3

Post by bgold » 28 Apr 2019 23:30

The vm is 65gb. I have 10gb swap on ssd. I will remove vm.kmem_size and set vfs.zfs.arc_max and free up 65gb and see if that helps.

Thanks
XigmaNAS 12.0.0.4.6625
HP ML150 Gen9, Dual 2.4ghz, 256gb, 25TB Storage, 3-ZFS pools w/SSD cache&logs, SSD boot/data, SFP+

User avatar
raulfg3
Site Admin
Site Admin
Posts: 4968
Joined: 22 Jun 2012 22:13
Location: Madrid (ESPAÑA)
Contact:
Status: Offline

Re: Memory usage at 100% and system crashes

#4

Post by raulfg3 » 29 Apr 2019 07:24

vfs.zfs.arc_max=32 is enough for enterprise use.

what value do you set?
12.0.0.4 (revision 6766)+OBI on SUPERMICRO X8SIL-F 8GB of ECC RAM, 12x3TB disk in 3 vdev in RaidZ1 = 32TB Raw size only 22TB usable

Wiki
Last changes

bgold
Starter
Starter
Posts: 59
Joined: 23 May 2015 08:42
Status: Offline

Re: Memory usage at 100% and system crashes

#5

Post by bgold » 29 Apr 2019 16:25

I have it set to 192gb. Since doing the changes yesterday it has been at 92% not any higher and the system did not lock up or loose connection with the VM. I will change it to your recommendation if that is what it should be at. I have ssd drives for cache/logs. 3 pools are there any other tweaks that I should make in the sysctl.conf file?

Thanks
XigmaNAS 12.0.0.4.6625
HP ML150 Gen9, Dual 2.4ghz, 256gb, 25TB Storage, 3-ZFS pools w/SSD cache&logs, SSD boot/data, SFP+

Post Reply

Return to “Beta Builds (Testing Only)”