Setting up jail for sab

[pjdw]

I am trying to set up jails but after creating the dir's and using mount_nullfs fetching gives me the following:

fetch ftp://ftp.freebsd.org/pub/FreeBSD/releases/`uname -m`/`uname -m`/`uname -r | cut -d- -f1-2`/base.txz
base.txz 9% of 57 MB 1917 kBps
/: write failed, filesystem is full
base.txz 10% of 57 MB 2022 kBps
fetch: base.txz: No space left on device

I have just updated to 9.1 573

I fetch inside:
nasraid:/jail/work#

i have more then enough space on my disks. nas mem is as follows.
Mem: 42M Active, 42M Inact, 200M Wired, 8K Cache, 134M Buf, 1450M Free

I have read several post about the subject, but i cannot find a solution. So if anybody has a clue

[raulfg3]

Please post your previous step, remember that data in wiki, must be replaced by your pool ( your /mnt/yourdatamount/ ).

http://wiki.nas4free.org/doku.php?id=do ... owto:jails

post Diagnostics|Information|Space Used too.

for example mine is:

Code: Select all

/dev/ufsid/50b1233560844913      2G    323M    1.5G    18%    /
devfs                          1.0k    1.0k      0B   100%    /dev
procfs                         4.0k    4.0k      0B   100%    /proc
NAS-A                          7.1T    6.8T    319G    96%    /mnt/NAS-A
/mnt/NAS-A/jail                7.1T    6.8T    319G    96%    /jail
<above>:/usr                   7.1T    7.1T    1.5G   100%    /jail/conf/root/usr
/mnt/NAS-A/Video               7.1T    6.8T    319G    96%    /jail/serviio/mnt/Video
/mnt/NAS-A/Musica              7.1T    6.8T    319G    96%    /jail/serviio/mnt/Musica
/mnt/NAS-A/Fotos               7.1T    6.8T    319G    96%    /jail/serviio/mnt/Fotos
devfs                          1.0k    1.0k      0B   100%    /jail/serviio/dev
/mnt/NAS-A/Video               7.1T    6.8T    319G    96%    /jail/kissdx/mnt/Video
/mnt/NAS-A/Musica              7.1T    6.8T    319G    96%    /jail/kissdx/mnt/Musica
/mnt/NAS-A/Fotos               7.1T    6.8T    319G    96%    /jail/kissdx/mnt/Fotos
devfs                          1.0k    1.0k      0B   100%    /jail/kissdx/dev
/mnt/NAS-A/Video               7.1T    6.8T    319G    96%    /jail/minidlna/mnt/Video
/mnt/NAS-A/Musica              7.1T    6.8T    319G    96%    /jail/minidlna/mnt/Musica
/mnt/NAS-A/Fotos               7.1T    6.8T    319G    96%    /jail/minidlna/mnt/Fotos
devfs                          1.0k    1.0k      0B   100%    /jail/minidlna/dev

[pjdw]

Code: Select all

Filesystem                     Size    Used   Avail Capacity  Mounted on
/dev/md0                       206M    199M    6.3M    97%    /
devfs                          1.0k    1.0k      0B   100%    /dev
/dev/da0a                      103M     94M    8.8M    92%    /cf
procfs                         4.0k    4.0k      0B   100%    /proc
/dev/ufsid/502614b7b31b2031    1.8T    821G    975G    46%    /mnt/Raid
/dev/md1                        30M    1.3M     28M     4%    /var
/mnt/Raid/jail                 1.8T    821G    975G    46%    /jail

I also so in a post that increase var in rc.conf could help (32->128). So I did this but i have to use Raid instead of data. Silly me.
My next time in madrid i buy you a beer, wine, coffee what ever suits you
I will continue continue with download and extract.

[pjdw]

I would like to start all over from zero. Messed up somehow but i cannot remove the jail dir/folder. rm -rf gives me: Operation not permitted and Directory not empty.
Can somebody explain how to get rid of all the folders.

[pjdw]

Read the wiki. info at the end: Change flags -R noschg /mnt . . Etc

[raulfg3]

please read this topic too, is other user with similar problems , so you can teach from his errors: viewtopic.php?f=79&t=1851

[pjdw]

Thanks for your help and wise advice. You have to be very awake and fit and read and work carefully indeed!
I have made several attempts, but somehow my nas reboots when i start to edit
conf/rc.conf.local
Looks like my nas is not running stable after upgrading? Maybe left overs from my previous sab install?
Fresh install from cd and restore settings??
I do hope my data will be safe

[raulfg3]

Looks like my nas is not running stable after upgrading? Maybe left overs from my previous sab install?
Fresh install from cd and restore settings??
I do hope my data will be safe

Do a fresh install, and configure all settings by hand ( do not import old config file).

To do this in safe mode, you need to save jpg or htm of your actual config, or open your config.xml using notepad and use like guide.

YES, you DATA is SAFE, if your do a fresh install, but you need to be previsor and save your actual config to do not forget any config that you need ( shares / user / rc.conf /etc...).

There are a new buttons in the disk section to automatically detect your disks, and others in the ZFS sections to import and sincrhonize your pool , so this steps are really simple and safe.

[pjdw]

NEARLY THERE!
Made a fresh install from CD and import disks and raid went perfect!. Groups/users etc all done manually and the wiki commands for jail went perfect untill the very last part.
I have applied the postinit command /mnt/nas/jail/conf/jail_start (nas in my case; not data in the wiki example).
Rebooting went ok. Only the very last part jls didnot gave the expected output. Also rehash didnot help. Output:

Welcome to NAS4Free!
nas4free:~# jls
JID IP Address Hostname Path
nas4free:~# rehash
nas4free:~# jls
JID IP Address Hostname Path
nas4free:~#

After ssh conf/rc.conf.local file is empty and when copying the lines back in and correcting i cannot save. Also jail_start is gone and i am sure i have saved them . . . saving . . lines. Wonder if i chmod 755 jail_start to be honest. it is getting to late again.
When i ls i can see both jail_start and the other file

nas4free:/mnt/nas/jail/conf# ls
fstab.proto jail_start rc.conf.local root

If somebody has a clue. Thanks

[raulfg3]

Before to add /mnt/nas/jail/conf/jail_start as postinit, you need to check that jails are configured properly and can start.

please open a shell ( using putty from PC or similar) , and test that you have /jail properly mounted.

this mean that if you do a cd /jail , you need to see all the files that you have on /mnt/nas/jail/ .
if works, you do not need to use more /mnt/nas/jail/, in fact you need to use /jail ( like described on wiki).

atach your fstab.proto and provide usefull info to understand path in file ( where you stored your videos, in my case in /mnt/NAS-A/Video).
atach conf/rc.conf.local too to revise that do not hace errors

once you check all and provide this info, I can continue helping you.

[pjdw]

My media is in mnt/nas/media/{film, TV, muziek} have mounted this in stab
Don't see an mistakes in rc.conf.local and jail_start
When i execute the commands from jail_start it goes wrong at /etc/rc.d/jail start:
Cannot 'start' jail. Set jail_enable to YES in /etc/rc.conf or use 'onestart' instead of 'start'.

I cannot find rc.conf in ?? (proto/etc?) to check

[pilothaz]

I am making a jail setup for all the apps I use on my NAS4Free. Currently I was running my apps through the older way of unionfs install that was on the freeNAS forums. It worked great but have been having an issue now with it and serviio not starting up, so wanted to try it with it own little sandbox (jail).

Running on:

Code: Select all

Version	9.1.0.1 - Sandstorm (revision 608)
Build date	Fri Jan 4 23:06:10 CET 2013
Platform OS	 FreeBSD 9.1-RELEASE (reldate 901000)
Platform	 x64-embedded on Intel(R) Atom(TM) CPU D525 @ 1.80GHz

My setup that I would like to do is broken down by applications that utilize the same libraries.

python jail:

• 1. Sabnzbd++
  2. Sickbeard
  3. Couchpotato
  4. Headphones

java jail:

• 1. Serviio

I have created my proto jail successfully but when I try and create the other new ones in the step ( Creating A New Jail ), you can see that when I mount_nullfs it works supposedly but I cannot find the /mnt in proto when I try and make installworld.

Here is the code to show I have jails running, and i canot find python in the /mnt of the proto jail to be able to run the command. Am I missing something? Would you be able to help me out please.

Code: Select all

nas4free:/mnt/extensions/jail/conf# /mnt/extensions/jail/conf/jail_start
mkdir /jail
mount_nullfs /mnt/extensions/jail /jail
cp -r /jail/conf/root/ /
ln -s /jail/conf/rc.conf.local /etc
/etc/rc.d/jail start
Configuring jails:.
Starting jails: proto.domain.local.
nas4free:/mnt/extensions/jail/conf# cd /jail/
conf/       proto/      serviio/
headphones/ python/     work/
nas4free:/mnt/extensions/jail/conf# cd /jail/p
proto/  python/
nas4free:/mnt/extensions/jail/conf# cd /jail/python/
nas4free:/jail/python# mount_nullfs /jail/python/ /jail/proto/mnt/
nas4free:/jail/python# jls
   JID  IP Address      Hostname                      Path
     1  192.168.2.100   proto.domain.local            /jail/proto
nas4free:/jail/python# jexec 1 csh
root@proto:/ # ls
.cshrc          dev             mnt             sys
.profile        etc             proc            tmp
COPYRIGHT       lib             rescue          usr
bin             libexec         root            var
boot            media           sbin
root@proto:/ # cd /mnt/
root@proto:/mnt # ls
root@proto:/mnt #

A final question would be how much is a base jail for everyone before you even install anything but the base from your proto? It seems my proto is 2.3GB but that is also with all the source code in it. I guess once I get this correctly setup to installworld in my python I would have a better idea for my base jail sizes.

Thanks in advance for the posts and help.
Haz

[raulfg3]

please post files that I ask, I do not help you if I do not see fstab.proto , rc.conf.local and jail_start

and do a

Code: Select all

ls -l /jail/proto/mnt 
ls -l /
ls -l /jail

to check correct creation of folders and permision

[pjdw]

jail_start.png

fstab.proto.png

ls -l /jail/proto/mnt
total 0

ls -l /
total 35
drwxrwxr-x 2 root operator 512 Jan 4 23:06 .snap
-rw------- 1 www www 0 Jan 6 16:04 .websrv_htpasswd
drwxr-xr-x 2 root wheel 1024 Jan 4 23:01 bin
drwxr-xr-x 6 root wheel 512 Jan 3 17:23 boot
drwxr-xr-x 5 root wheel 512 Jan 4 23:07 cf
lrwxr-xr-x 1 root wheel 7 Jan 3 17:08 conf -> cf/conf
drwxr-xr-x 2 root wheel 512 Jan 4 23:06 conf.default
dr-xr-xr-x 13 root wheel 512 Jan 6 16:04 dev
drwxr-xr-x 14 root wheel 2048 Jan 6 16:53 etc
drwxr-xr-x 2 root wheel 512 Jan 3 17:08 ftmp
lrwxr-xr-x 1 root wheel 8 Jan 6 16:04 home -> usr/home
drwxr-xr-x 5 root Users 512 Jan 5 22:54 jail
drwxr-xr-x 3 root wheel 1024 Jan 4 23:01 lib
drwxr-xr-x 3 root wheel 512 Jan 3 17:23 libexec
drwxr-xr-x 3 root wheel 512 Jan 6 16:04 mnt
dr-xr-xr-x 1 root wheel 0 Jan 6 19:54 proc
drwxr-xr-x 4 root wheel 512 Jan 6 17:09 root
drwxr-xr-x 2 root wheel 2048 Jan 4 23:01 sbin
lrwxr-xr-x 1 root wheel 8 Jan 3 17:08 tmp -> /var/tmp
drwxr-xr-x 9 root wheel 512 Jan 6 16:04 usr
drwxr-xr-x 13 root wheel 512 Jan 6 16:04 var

ls -l /jail
total 12
drwxr-xr-x 3 root Users 512 Jan 5 23:17 conf
drwxr-xr-x 17 root wheel 512 Dec 4 10:34 proto
drwxr-xr-x 2 root Users 512 Jan 5 23:00 work

Know idea how to check this.

[raulfg3]

ok try to use this jail_start:

Code: Select all

#!/bin/tcsh -x
#create /jail if is the first time or a new install
mkdir /jail
#mounting to /jail
mount_nullfs /mnt/nas/jail /jail
# link config files to /etc
ln -s /jail/conf/rc.conf.local /etc/rc.conf.local
# Attach jail files to /usr and /etc
mount_unionfs /usr /jail/conf/root/usr/
rehash
#start all jails
/etc/rc.d/jail start

and this fstab.proto:

Code: Select all

/mnt/nas/media /jail/proto/mnt/media nullfs ro 0 0

you need to execute next comand to work previous:

Code: Select all

mkdir /jail/proto/mnt/media

and you need to edit file rc.conf to add jail_enable="YES"

go to webGUI System|Advanced|rc.conf and add jail_enable="YES"

rnas.local - SystemAdvancedrc.conf - Mozilla Firefox.jpg

now your jail must start, to test it, execute from shell:

Code: Select all

/mnt/jail/conf/jail_start

(PD: Perhaps you need to do executable, revise wiki)

if work, you can add this script like postinit in System|Advanced|Command scripts


PD: in rc.conf.local I use

Code: Select all

jail_proto_hostname="proto"

instead of:

Code: Select all

jail_proto_hostname="proto.domain.local"

this is not important but is easy to type in PC //proto , that type //proto.domain.local

[raulfg3]

I have created my proto jail successfully but when I try and create the other new ones in the step ( Creating A New Jail ), you can see that when I mount_nullfs it works supposedly but I cannot find the /mnt in proto when I try and make installworld.

.

OK, you only need to do step to create jail work, to create other jail is as easy as create a new folder and repeat previous steps eg:

you have in /jail 3 folders {conf,work,proto}
so create a new folder named phyton

Code: Select all

mkdir /jail/phyton

because you previosly fetch base & lib32, you only need to untar:

Code: Select all

# tar xvf /jail/work/base.txz -C /jail/phyton/
# tar xvf /jail/work/lib32.txz -C /jail/phyton/

and continue step in wiki from: Configuring the prototype jail

Code: Select all

cp /etc/resolv.conf /jail/phyton/etc/

Code: Select all

cp /jail/phyton/usr/share/zoneinfo/Europe/Berlin /jail/phyton/etc/localtime

<- in my case I replace Berlin by Madrid

Code: Select all

touch /jail/conf/fstab.phyton

edit this file to mount your media folders , in my case:

Code: Select all

/mnt/NAS-A/Video /jail/upnp/mnt/Video nullfs ro 0 0
/mnt/NAS-A/Musica /jail/upnp/mnt/Musica nullfs ro 0 0
/mnt/NAS-A/Fotos /jail/upnp/mnt/Fotos nullfs ro 0 0

<- Remember to change acording to your config ( my pool is named NAS-A, I do not Know yours)

And edit existing rc.conf.local, to add phyton info (remember this is a eg do not copy & paste):

Code: Select all

### EXAMPLE - MODIFY TO FIT YOUR NEEDS ###
jail_enable="YES"				# enable jails YES|NO
jail_list="proto phyton"				# name of the jails to start "proto www..."
jail_proto_rootdir="/jail/proto"		# path to our jail
jail_proto_hostname="proto"       		# hostname 
jail_proto_ip="192.168.1.201"			# ip of the jail 
jail_proto_interface="em0"			# Network Interface to use,replace on your NAS interface name
jail_proto_devfs_enable="YES"			# use devfs 
jail_proto_mount_enable="YES"			# mount YES|NO 
jail_proto_fstab="/jail/conf/fstab.proto"	# File with Filesystems to mount
jail_phyton_rootdir="/jail/phyton"			# path to our jail
jail_phyton_hostname="phyton"       		# hostname 
jail_phyton_ip="192.168.1.202"			# ip of the jail 
jail_phyton_interface="em0"			# Network Interface to use,replace on your NAS interface name
jail_phyton_devfs_enable="YES"			# use devfs 
jail_phyton_mount_enable="YES"			# mount YES|NO 
jail_phyton_fstab="/jail/conf/fstab.phyton" 	# File with Filesystems to mount

once done you can restart your nas, and if all works fine you have 2 jails when you execute jls.

once you have 2 working jails that do not fail to start, you can enter inside the apropiate jail to start process of install packages.



I have similar problems like you, you can see my dubitative steps in: viewtopic.php?f=79&t=1892

and more info on: viewtopic.php?f=79&t=1809

[pilothaz]

I understand how you say to just redo it like the other with the same process, but i thought the second part for creating a new jail, by utilizing the information from the proto.

Code: Select all

Creating A New Jail

Now we have our proto jail which is ready to use. It is possible to create a copy of this folder and after adding a new entry to /jail/conf/rc.conf.local, it would be ready to fire up, but we will do it in FreeBSD style, which is to say, we use our previous buildworld to create a new jail.

In this section of the HowTo, we create a new jail called 'www'. It will later contain an Apache webserver + PHP + MySQL database. This is a good base to create some additional services like a server for a Content Management System like Joomla or a backup server with BackupPC. The good thing about jails is you can create as many as you want. Virtual machines like vmware need plenty of CPU power just to run, but our jails have nearly 0 overhead.

It is also possible to put each service in its own jail ( apache jail, mysql jail, etc. ) but here I like to use jails for easily adding services to NAS4Free, not to play ISP for thousands of customers. But I'm talking too much.

Lets set-up the jail, and I assume you'll get some ideas what to do with it.

We start on the NAS4Free host. Create a new folder for the new jail:

nas4free# mkdir /jail/www
Mount the www folder to your running proto jail:

nas4free# mount_nullfs /jail/www /jail/proto/mnt/
Enter the proto jail:

nas4free# jexec 1 csh
proto#
Installworld to the www jail mounted on /mnt:

proto# cd /usr/src
proto# make installworld DESTDIR=/mnt
It should be clear what DESTDIR= means:

proto# make distribution DESTDIR=/mnt
“make installworld” will only install the necessary binaries for a functioning system, “make distribution” will install the default configuration files as well.

Would this not make the install smaller? As to not have the source all within it?

[pilothaz]

I tried your setup for adding the python and this is what has come of it when rebooting. My startup script in postinit doens't seem to work, so here is code of what it looks like when I run it:

Code: Select all

Welcome to NAS4Free!
nas4free:~# jls
   JID  IP Address      Hostname                      Path
nas4free:~# /mnt/extensions/jail/conf/jail_start
mkdir /jail
mount_nullfs /mnt/extensions/jail /jail
cp -r /jail/conf/root/ /
ln -s /jail/conf/rc.conf.local /etc
/etc/rc.d/jail start
Configuring jails:.
Starting jails:mount: /jail/python/mnt/audio: No such file or directory
df: /jail/pthon/dev: No such file or directory
mount: /jail/pthon: No such file or directory
/etc/rc.d/jail: WARNING: devfs_domount(): Unable to mount devfs on /jail/pthon/dev
/etc/rc.d/jail: WARNING: devfs_mount_jail: devfs was not mounted on /jail/pthon/dev
ln: /jail/pthon/dev/log: No such file or directory
 cannot start jail "python":
.
nas4free:~#

[raulfg3]

sorry for inconvenience but I merge both post because , both need the same :

create a working jail proto and then install sab ( and create other jails like phyton).
Please re-read carefully all thread to try to create a working jail proto that works when you type jls.

once done, can continue with creation of a second jail.

[pjdw]

Thanks Raul for helping out.
This is my output:

nas4free:/# /jail/conf/jail_start
mkdir /jail
mkdir: /jail: File exists
mount_nullfs /mnt/nas/jail /jail
mount_nullfs: Resource deadlock avoided
ln -s /jail/conf/rc.conf.local /etc/rc.conf.local
ln: /etc/rc.conf.local: File exists
mount_unionfs /usr /jail/conf/root/usr/
rehash
/etc/rc.d/jail start
Configuring jails:.
Starting jails: proto.
nas4free:/# jls
JID IP Address Hostname Path
1 192.168.0.6 proto /jail/proto

Looks like its working. Up to the next step and get san running!!

Manually it starts. Have added the post init command in webgui, but no start when rebooting. Second time copy and paste from the command prompt to be sure, but still have to start via ssh / command. Running 608 and that might be the cause.
I will try to downgrade to 573 and see if this might help.

My jail_start is different from wiki. i have placed '#' for "cp -r /jail/conf/root/ /"
Also the line:
mount_unionfs /usr /jail/conf/root/usr/
is new compared to wiki.
Again thanks very much for help. will search forum how to install sab, couch, etc