[SOLVED] Embedded change log file location storage directory

[davidb]

I am running FreeNAS 0.7.2 Sabanda (revision 8191) embedded, and it had a year of uptime with no problems, but when i turned on the FTP server for file transfers, within a month i got the following error:

kernel: pid 92840 (proftpd), uid 1001 inumber 1097 on /var: filesystem full

(df informed me that the /var filesystem was 108% full)

i tracked it down to /var/log/xferlog, which had grown to 25MB. i cleared the log file and within a month, it was back to 25MB.

is there a way to prevent manual intervention or truncate the log automatically?
Thanks,
DavidB

BTW Love the FreeNAS/now NAS4Free project!

[raulfg3]

Yes, use a full install in a 2GB or 4 GB CF/USB and use all the size in CF/USB to boot device so you are far away of 384MB in size by default.

[davidb]

I ended up just using a short script and running it weekly via cron to copy it to a larger partition (raid) and blank out the file. maybe not the most elegant solution, but it works

[raulfg3]

You can also use the default sollution that is to use a variable like described in faq:0134 http://wiki.nas4free.org/doku.php?id=faq:0134

http://wiki.nas4free.org/doku.php?id=faq:0046

[aaronb]

Script is a good solution even if maybe not the best.

Please share what, how, and why you did so that others can see it and learn.

[davidb]

Thanks for the info about the log location variable, i may use that in the future, it seems like a good way to keep persistent logs that would be handy for troubleshooting.

As for my solution, due to the excessive growth of the xferlog i just need to offload that single file. The reason it is growing so much is that i am using Acronis to run backups to the NAS via ftp (long story, i am not a fan of that software) and it has issues that cause a lot of logging, no fault of FreeNAS/NAS4Free.

script:

Code: Select all

#!/bin/sh
# check and write file size to my persistant log file
ls -lh /var/log/xferlog>>/mnt/RAID/SHARE/xferlog/xferlog.txt

# dump contents of xferlog to my log file
cat /var/log/xferlog>>/mnt/RAID/SHARE/xferlog/xferlog.txt

# clear xferlog
echo "">/var/log/xferlog

# check log file size again
ls -lh /var/log/xferlog>>/mnt/RAID/SHARE/xferlog/xferlog.txt

cron is scheduled to run this weekly on sunday mornings.

[Waliers]

Hi all,

How do I change the /var/tmp location of NAS4Free? I want it to use my 2TB drive to prevent "out of space".

I've tried:

Code: Select all

mv /tmp /mnt/new/location/tmp

ln -s /mnt/new/location/tmp /tmp

But that get's me a

Code: Select all

Warning: session_start(): open(/tmp/sess_c65dd2c7e3c9c01f4ea2e1544feccd24, O_RDWR) failed: No such file or directory (2) in /etc/inc/session.inc on line 54 Warning: session_start(): Cannot send session cache limiter - headers already sent (output started at /etc/inc/session.inc:54) in /etc/inc/session.inc on line 54 Warning: Cannot modify header information - headers already sent by (output started at /etc/inc/session.inc:54) in /usr/local/www/auth.inc on line 52 Warning: Unknown: open(/tmp/sess_c65dd2c7e3c9c01f4ea2e1544feccd24, O_RDWR) failed: No such file or directory (2) in Unknown on line 0 Warning: Unknown: Failed to write session data (files). Please verify that the current setting of session.save_path is correct (/tmp) in Unknown on line 0 

when going to the WebGUI.

However i've got the idea that the /var/tmp folder is indeed replaced but need the GUI to verify

Do i need to make a change in /etc/inc/session.inc or at an other location?

[SOLVED]
Read up and added the following command to Command Scripts as a PostInit my issue was solved!

Code: Select all

mount_unionfs /mnt/data/new/location /var/tmp

Thanks everyone for your help!


System:
NAS4Free version: 9.0.0.1 - Sandstorm (revision 148)
CPU: x64-full on Intel(R) Atom(TM) CPU 330 @ 1.60GHz
RAM: DDR2 1024 MB with 2 GB swap file
Motherboard: ASRock A330GC Bios: P1.10 07/16/2009

[raulfg3]

not sure, I never need to do it, my workarround is to install full Nas4Free on a 4GB USB and use all the size of USB, not only the 384MB suggest by instaler.

PD: There are variables to move logs, but I don't know what variable is used to move /tmp:

viewtopic.php?f=75&t=204&p=459&hilit=clog#p459

http://wiki.nas4free.org/doku.php?id=faq:0046

[Waliers]

Hiya, thanks for the quick reply.

Currently Nas4Free is installed on a 16 GB USB Flash drive. Full version with no SWAP file and just 100 MB of data.

The problem is i'm using Syncrify which is kinda sloppy with his temp files. When a backup failes i've got a .chuck file in the /var/tmp folder which are sometime 5á6 GB. Hence with 4 or 5 failed backup's the flashdrive is full.
When manually deleting the files solves any problem I want my backups to continue when Im not able to delete the failed backups right away.

So when /var/tmp is on my /mnt/Drive of 2 TB I can delete it once a week and still have backups.

I also asked a question at Syncrify to change the location of TMP in the software = but it's only possible in the Windows version -_-'

EDIT:
Checked the links you provided but when running :

Code: Select all

awk -F'[=|$|{|:]' 'NF>2 && $1==$4' /etc/rc.d/*

Didn't see a variable for the /var/tmp

EDIT2:
I've seen on a post in the forum the following commands for embedded:

Code: Select all

# mount_unionfs /mnt/data/opt/usr_local /usr/local
# mount_unionfs /mnt/data/opt/var /var

However does unionfs kicks in in PreInit or in PostInit? I shall try in the morning to let you know if I can mount /var and var/temp on /mnt/new/location

[SOLVED]
Read up and added the following command to Command Scripts as a PostInit my issue was solved!

Code: Select all

mount_unionfs /mnt/data/new/location /var/tmp

Thanks everyone for your help!

[cirkit]

Using the rc.conf cheat sheet I was able to re-direct the log files to store on the /mnt/HDD but I noticed that the FTP-File Transfer log still wipes out after reboot, How do I make the FTP File Transfer log survive a Reboot

Thanks
cirkit

[davidb]

I offloaded my xfer.log by using a script run by cron. I wasn't trying to get full availablility of the log so i had it scheduled weekly to keep the file size down. see following link, adjust cron to run every hour or minute.

viewtopic.php?f=57&t=389&p=1288

in a nutshell:

Code: Select all

#!/bin/sh
# dump contents of xferlog to my log file
cat /var/log/xferlog>>/mnt/RAID/SHARE/xferlog/xferlog.txt
# clear xferlog so it doesn't grow or dump same contents again
echo "">/var/log/xferlog

[fsbruva]

The other option is to add some stuff to the "Auxiliary Parameters" of your ftp: http://www.proftpd.org/docs/modules/mod ... ransferLog

Seems like you can just make the daemon store its transfer logs elsewhere.

[davidb]

Seems like you can just make the daemon store its transfer logs elsewhere.

Yup, sure looks that way. some people read the documentation, some people (me) want to do it the hard way.

[cirkit]

I cannot locate any file called xferlog under /var/log

[Onichan]

I found the best solution is to just to move the entire /var/log directory to wherever and symbolic link it back to the normal place. That way all current and future logs stay where you want them. I use a thumb drive as my OS drive so I just moved it to my pool doing the following command via CLI
ln -s /mnt/pool/log /var/log

[fthuijs]

Looking at the logfile I think my /var filesystem is full. Entries in the logfile are:
- lighttpd[2314]: (connections.c.1130) denying upload as writing to file failed: /var/tmp/ftmp/lighttpd-upload-pGFehI No space left on device
- kernel: pid 2314 (lighttpd), uid 0 inumber 1206 on /var: filesystem full
- lighttpd[2314]: (connections.c.1715) SSL (error): 5 -1 54 Connection reset by peer

I use the x64 embedded version of NAS4FREE, revision 427 (the newest).

Is there something I can/should do about the size of the /var? Is that posible using the embedded version?

I also see in the logfile (maybe it is related): kernel: GEOM: ada2s1: media size does not match label.
The ada2 is the disk (TRANSEND 2GB SSD disk) on which NAS4FREE is installed.

Whenever I switch tot a newer revision I use the update firmware function of NAS4FREE.

I'm looking forward to your answers...

Frank

[danic]

Under System -> Advanced -> rc.conf -> varsize you can change it to something larger than 32m. I have my n4f box set to 128m. Do you know what produces this error? /var is a ramdisk so don't make it too large.

[fthuijs]

Thanks Danic. I changed the value from 32m to 128m and got rid of the error message /var full. I don't now (yet) what caused it. I see a lot of files (and dirs) in /var but none of them is gigantic. Let's wait if 128m will do the trick also on the longer term.

[fsbruva]

The thing that is filling up 32m will also fill up 128m - it will just take longer.

With embedded, make sure you are redirecting the logs to a different place, or are ensuring they don't get too large.

[fthuijs]

Thanks fsbruva, I will especially pay attention to the logfiles in /var (and subdirs).

[raulfg3]

you can easy move your log adding clog_logdir=/mnt/yourmount/yourlogfolder

viewtopic.php?f=75&t=204