Latest News:
*New 11.2 series Release:
2019-06-20: XigmaNAS 11.2.0.4.6766 - released!

*New 12.0 series Release:
2019-06-20: XigmaNAS 12.0.0.4.6766 - released!

We really need "Your" help on XigmaNAS https://translations.launchpad.net/xigmanas translations. Please help today!

Producing and hosting XigmaNAS cost money, please consider a donation to our project so we can continue to offer you the best.
We need your support! eg: PAYPAL

Errors (formally read/write) when accessing to big or many files

CIFS/SMB network sharing.
Forum rules
Set-Up GuideFAQsForum Rules
Post Reply
MikeVR
NewUser
NewUser
Posts: 9
Joined: 14 Jun 2019 21:55
Status: Offline

Errors (formally read/write) when accessing to big or many files

#1

Post by MikeVR » 14 Jun 2019 22:16

12.0.0.4 - Reticulus (revision 6743) embedded on Hyper-V 2012R2. 6Gb mem for XigmaNAS.
Share connected to Win 8.1.

If I copying to or from samba share big or many files (few Gb) I got 95% error (write or read). Operation will be success only in ~5% cases. Bigger file - less chance. Not only when copy - error If ask Total Commander to calculate CRC for example (= read not to local disk, only to mem) - error of reading file after few seconds or minute in most cases on big files.

I tried absolutely different disks (hyper-v pass-through) - from USB HDD to SATA SSD. I tried UFS and ZFS. All combinations has same error. Problem not in disk's quality or disk's interface/type.

Problem not in disks or network at all: same disks, shared as samba (too) not through XigmaNAS but from hyper-v host machine has 100% stability. Same hardware, same network.
Is it known issue in XigmaNAS's samba or in hyper-v pass-through?
But moreover - I'm not sure that it's hyper-v pass-through problem because if I share same disks through XigmaNAS's ftp, nfs - no errors. All stable.
So, I think, problem in XigmaNAS's samba...

p.s. Is it ok, that on ZFS eats 97-98% mem (in any case and when loader.conf->vfs.zfs.arc_max set to 2G)?

MikeVR
NewUser
NewUser
Posts: 9
Joined: 14 Jun 2019 21:55
Status: Offline

Re: Errors (formally read/write) when accessing to big or many files

#2

Post by MikeVR » 27 Jun 2019 17:01

Additional: when using samba - memory usage growing to 97-98% and stay on that utilization level until restart XigmaNAS. While growing - no errors. When full utilization - error can happen in any time. Value vfs.zfs.arc_max doesn't matter - enabled with any value or disabled - all memory (any volume for VM) will be used up to 97-98%.

User avatar
raulfg3
Site Admin
Site Admin
Posts: 4901
Joined: 22 Jun 2012 22:13
Location: Madrid (ESPAÑA)
Contact:
Status: Offline

Re: Errors (formally read/write) when accessing to big or many files

#3

Post by raulfg3 » 27 Jun 2019 21:56

post screen captures of:

Status > Monitoring > Memory Usage
Status > Monitoring > Load Averages
Status > Monitoring > CPU Temperature
Status > Monitoring > ZFS ARC
amd
Services > CIFS/SMB > Settings

System > Advanced > sysctl.conf




eg:
1.jpg
2.jpg

2_2.jpg
3.jpg
You do not have the required permissions to view the files attached to this post.
12.0.0.4 - BETA (revision 6625)+OBI on SUPERMICRO X8SIL-F 8GB of ECC RAM, 12x3TB disk in 3 vdev in RaidZ1 = 32TB Raw size only 22TB usable

Wiki
Last changes
Old Wiki

MikeVR
NewUser
NewUser
Posts: 9
Joined: 14 Jun 2019 21:55
Status: Offline

Re: Errors (formally read/write) when accessing to big or many files

#4

Post by MikeVR » 28 Jun 2019 03:53

raulfg3 wrote:
27 Jun 2019 21:56
post screen captures of:

Status > Monitoring > Memory Usage
Status > Monitoring > Load Averages
Status > Monitoring > CPU Temperature
Status > Monitoring > ZFS ARC
amd
Services > CIFS/SMB > Settings

System > Advanced > sysctl.conf
(XigmaNAS updated to revision 6766)

Hi, in Status > Monitoring I have only 2 tabs (System Load, CPU Load - nothing interesting).
In "Services > CIFS/SMB > Settings" I tried many variants, but problem and with default settings.
Now this (SMB3 Win 8.1 because I uses windows 8.1 - another try to fix):
smb.png
In "System > Advanced > sysctl.conf" nothing was changed by me:
sysctl.png
I repeated tests: 44GB file through NFS - no memory leaks and errors. 14Gb through DLNA - no memory leaks (moreover - I gave only 3Gb mem and was used only 58%). Opposite - any given memory (up to 16Gb) will be eaten if change test from NFS->SMB for example (and finally error on end device).
You do not have the required permissions to view the files attached to this post.

User avatar
raulfg3
Site Admin
Site Admin
Posts: 4901
Joined: 22 Jun 2012 22:13
Location: Madrid (ESPAÑA)
Contact:
Status: Offline

Re: Errors (formally read/write) when accessing to big or many files

#5

Post by raulfg3 » 28 Jun 2019 09:02

MikeVR wrote:
28 Jun 2019 03:53
Hi, in Status > Monitoring I have only 2 tabs (System Load, CPU Load - nothing interesting).
to see all usefull info , you need to install extendedGUI (I use OBI to install it).
1.jpg

please copy my config, expecially Server Max. Protocol and others like Client Min. Protocol (default values)
change Interface Selection to LAN ONLY.
3.jpg
Dos Charset & Workgroup & NetBIOS Name use your own values.

and change vfs.zfs.arc_max to 6GB and vfs.zfs.arc_min to 4GB on System > Advanced > loader.conf



You need to reboot to do test and to load this new values.



if still have problems, try to change Send Buffer & Receive Buffer in Services > CIFS/SMB > Settings to 32K = 32768
You do not have the required permissions to view the files attached to this post.
12.0.0.4 - BETA (revision 6625)+OBI on SUPERMICRO X8SIL-F 8GB of ECC RAM, 12x3TB disk in 3 vdev in RaidZ1 = 32TB Raw size only 22TB usable

Wiki
Last changes
Old Wiki

MikeVR
NewUser
NewUser
Posts: 9
Joined: 14 Jun 2019 21:55
Status: Offline

Re: Errors (formally read/write) when accessing to big or many files

#6

Post by MikeVR » 28 Jun 2019 14:38

raulfg3 wrote:
28 Jun 2019 09:02
and change vfs.zfs.arc_max to 6GB and vfs.zfs.arc_min to 4GB on System > Advanced > loader.conf
Already tried different values, include min 8GB max 12Gb. No reaction - memory full filled when using smb... NFS&DLNA&Transmission works good with 3Gb and never takes more then 60-70% (of 3Gb).
(always reboot for tests). And it's (4>6Gb) to much memory for this simple roles - before my RT-AC68U router "played" all this roles with 256KB :roll:
I think problem not in resources - it's soft problem of SMB role.
raulfg3 wrote:
28 Jun 2019 09:02
if still have problems, try to change Send Buffer & Receive Buffer in Services > CIFS/SMB > Settings to 32K = 32768
Already tried 64KB, 32Kb, 16Kb.
raulfg3 wrote:
28 Jun 2019 09:02
expecially Server Max. Protocol and others like Client Min. Protocol (default values)
change Interface Selection to LAN ONLY.
I will try it and reply, but min/max Server/Client Protocol was already tried in many combinations. More over - I tried disable/enable old smb versions on client PC through powershell, another PC clients, etc.
LAN ONLY - not tried, so will check now, thx for your patient.

MikeVR
NewUser
NewUser
Posts: 9
Joined: 14 Jun 2019 21:55
Status: Offline

Re: Errors (formally read/write) when accessing to big or many files

#7

Post by MikeVR » 28 Jun 2019 16:05

Ok. In LAN Only mode, PC client can't connect to smb share at all (other params as on yours scrsht too). Works only CARP Only or All Interfaces (repeat: I'm using VM).

mahlzeit
Starter
Starter
Posts: 44
Joined: 23 Oct 2012 19:02
Status: Offline

Re: Errors (formally read/write) when accessing to big or many files

#8

Post by mahlzeit » 11 Jul 2019 17:09

Hey MIke

it seems that i have the same problem - did you found a solution?

MikeVR
NewUser
NewUser
Posts: 9
Joined: 14 Jun 2019 21:55
Status: Offline

Re: Errors (formally read/write) when accessing to big or many files

#9

Post by MikeVR » 13 Jul 2019 15:43

mahlzeit wrote:
11 Jul 2019 17:09
Hey MIke

it seems that i have the same problem - did you found a solution?
Hi, unfortunately no. NAS must work with files "superstable" - it's it main task. It's simple task, I think.
So, I migrated to other NAS. But before I tried 11.x version - and it's won't work with new upgraded ZFS from 12...
No anyone on forum, no answers, etc. Project died?

p.s. it's very dangerous bug - files after "wrong" copy have same size but wrong content.

MikeVR
NewUser
NewUser
Posts: 9
Joined: 14 Jun 2019 21:55
Status: Offline

Re: Errors (formally read/write) when accessing to big or many files

#10

Post by MikeVR » 18 Jul 2019 01:07

remark: wrong content = all content after error cause filled with "zero" (not wrong random bytes).

Post Reply

Return to “CIFS/SMB (Samba)”