transmission and RSS

[lasdem]

As far as I know, the developers of transmission are not planning on adding the feature to automatically download files from RSS feeds.
At the moment I use µTorrent and am very happy with that feature, but I want to move my torrent downloads to my nas4free because it is running all the time and is the location where I store my stuff anyway.

I know there are some tools which download the files to the watched folder of transmission, but I use the embedded installation so I cannot simply add any software to it.

My question is, has anyone of you any experience with this?

[raulfg3]

I use Transmission remote dot net to do the job: http://code.google.com/p/transmission-remote-dotnet/

[lasdem]

Thank you for the tipp, i will definitely use it.
But I also would like the RSS feature to work without my Windows machine running.

I found the following extension for the FreeNAS transmission client, do you think it is possible to adapt and install it on an nas4free embedded install?
I do not want anyone of you to do that for me, but if you think it would be possible at all. (Except of couse somebody allready adapted it to nas4free)

http://code.google.com/p/freenas-rss-extension/

[danic]

I use FlexGet but its on a machine dedicated to downloading/hosting and nas4free is for storage. Its RSS feed reader (and more) that can import torrents into a transmission client (Local or remote).
It can run on any platform that can run python (Windows, Linux, Mac). Not sure if python is installed on nas4free embedded so you may need to run it on another PC.


Good luck.

[lasdem]

Thank you for your suggestion, FlexGet sound pretty much like the program I would need.
But a quick test suggests that python is not installed:

Code: Select all

nas4free:~# python -v
python: Command not found.

[raulfg3]

Thank you for the tipp, i will definitely use it.
But I also would like the RSS feature to work without my Windows machine running.

You Don't need windows running, Transmission remote is a front end so you only need to execute when add torrent, magnet or rss to donwload , you need to asociate .torrent, etc,, to transmision remote, so when you click a link, donwload start automatically, and close and wait until donwload complete.

[eskalibur]

Your best option is rss extension http://code.google.com/p/freenas-rss-extension/ .The correct rss for nas4free is this one because the other is for freenas http://code.google.com/p/freenas-rss-ex ... tail?id=42.
Here the instructions http://code.google.com/p/freenas-rss-ex ... stallation

[theoldlove]

I had the same problem and followed eskalibur's suggestion, which turned out to work out well for me. Thanks so much!

My only problem is that pirate bay RSS feeds don't seem to be working: the extension accepts the feeds, but it doesn't actually detect or download any of the torrents. Does anybody have any thoughts?

[helios]

The issue with piratebay is from when they stopped with torrents and started using magnet links. If someone could get that working with the rss plugin that would be great!

[Quesadilla]

Your best option is rss extension http://code.google.com/p/freenas-rss-extension/ .The correct rss for nas4free is this one because the other is for freenas http://code.google.com/p/freenas-rss-ex ... tail?id=42.
Here the instructions http://code.google.com/p/freenas-rss-ex ... stallation

Sweet just what i wanted, Thank you sir!

Just one problem with the filter "Enter a Perl regular expression."
Anyone with a giant brain care to give me a example of a Perl regular expression?
Lets say i want to download any torrent with the words "Santa" :p
Googled my brains out but nothing seemed to work

[Quesadilla]

To answer my own question, incase someone else is as silly as myself

(?i:santa) works as a Perl regular expression change out "santa" with whatever

Thx to the nas4free people for making my life easier

[Zapp]

The issue with piratebay is from when they stopped with torrents and started using magnet links. If someone could get that working with the rss plugin that would be great!

Looks like Torrent.php already is up to date to handle magnet links:
https://github.com/adriengibrat/torrent-rw

Now someone have to do some rewriting of the code to handle this.

/Jonas...

[jrb1979]

Your best option is rss extension http://code.google.com/p/freenas-rss-extension/ .The correct rss for nas4free is this one because the other is for freenas http://code.google.com/p/freenas-rss-ex ... tail?id=42.
Here the instructions http://code.google.com/p/freenas-rss-ex ... stallation

Followed the instructions and got this error:

Parse error: syntax error, unexpected '/' in /usr/local/www/exec.php(214) : eval()'d code on line 1

Any help would be greatly appreciated. Thanks.

[jdforsythe]

For anyone who's trying to do this lately, I have some help for you. I had trouble at several turns so I'll give you the benefit of my experience.

1) First you need to install the RSS extension. go to https://code.google.com/p/freenas-rss-e ... stallation
Download the two files, the install-blah.php and the RSS-blah.tgz. Rename the install-blah.php to just install.php and the RSS-blah.tgz to just RSS.tgz

2) Now you need to edit the install.php file because the newer NAS4FREE has changed the PHP install. Open it in a text editor change:

Code: Select all

#! /usr/local/bin/php -q

to

Code: Select all

#! /usr/local/bin/php-cgi -f

Save it.

3) Open up your explorer / finder window to the share on the NAS4FREE box (your data partition on the box) and create an RSS folder there. Copy the two files there.

4) Open up your browser and load the NAS4FREE WebUI. Open Advanced | Command and execute the following commands, one at a time:

Code: Select all

chmod 777 /mnt/YOURSHARENAME/RSS/install.php

then

Code: Select all

/mnt/YOURSHARENAME/RSS/install.php

You should see some output, there will be one error.

5) go back to your network share, delete the RSS.tgz file.

6) Go here https://code.google.com/p/freenas-rss-e ... tail?id=42 and download the RSS.tar file from post #5. Rename it to RSS.tgz and copy it to your network share where the old RSS.tgz file was.

7) Go back to the WebUI and execute the command again:

Code: Select all

/mnt/YOURSHARENAME/RSS/install.php

You will get an error.

8) Now execute it again (the first time will unpack replacement install.php and cron files, so you need to run it again with the updated files)
This time the error should go away.

9) Refresh your browser and you should see a new menu entry in the WebUI called Extensions. Click that, then RSS. You may notice an error in the list. My install created some kind of phantom rss feed in the config file and gave me this error about Illegal String Offset all over the place. I could add new feeds and I'd get the error but the feeds added and downloaded correctly. If you have this issue continue following the numbers, otherwise you're ready to use the RSS extension.

10) Okay, so if you get these errors, there is probably a phantom empty feed in your config file. Here's how to go about removing it. Go back to the WebUI to execute a command. Enter this:

Code: Select all

cp /conf/config.xml /mnt/YOURSHARENAME/RSS/

and

Code: Select all

chmod 777 /mnt/YOURSHARENAME/RSS/config.xml

11) Now in your explorer / finder window open the config.xml file you just copied for editing. Scroll to the bottom of the file or search for "feed". It will look something like this (if you've added a feed):

Code: Select all

<rss>
		<feeds>
			<rule/>
			<rule>
				<uuid>4bde3c01-ad6e-4b42-8d8c-505aaea4900a</uuid>
				<name>Test</name>
				<_url>http://www.dailytvtorrents.org/rss/show/embarrassing-bodies?prefer=720</_url>
				<enabled/>
				<subscribe/>
				<directory>/mnt/data/Video/</directory>
				<cookie/>
			</rule>
		</feeds>
		<filters/>
		<path>/mnt/data/RSS/</path>
	</rss>

If you haven't added a feed, you'll just have the:

Code: Select all

<rule/>

and no actual feed rules. That is a blank feed and is useless. Delete the line with the empty rule and save the config.

12) Go back to execute a command. Execute:

Code: Select all

rm /conf/config.xml

and

Code: Select all

mv /mnt/YOURSHARENAME/RSS/config.xml /conf

13) Open the Extensions | RSS and the problem should be fixed (Don't worry about chmod'ing the file back - mine changed the permissions back within minutes. You can double-check this by executing:

Code: Select all

$ ls -al /conf/

You should see something like:

Code: Select all

total 352
drwxr-xr-x  2 root  wheel    512 Mar 10 23:51 .
drwxr-xr-x  3 root  wheel    512 Jan 31 18:17 ..
-rwxr-xr-x  1 root  wheel  24183 Mar 10 23:49 config.bk0
-rw-------  1 root  wheel  23020 Mar 10 19:11 config.bk1
-rw-------  1 root  wheel  23296 Mar 10 19:11 config.bk2
-rw-------  1 root  wheel  23296 Mar 10 19:09 config.bk3
-rw-------  1 root  wheel  23020 Mar 10 19:01 config.bk4
-rw-------  1 root  wheel  22745 Mar 10 18:57 config.bk5
-rw-------  1 root  wheel  23597 Mar 10 23:51 config.xml

Notice all the -s beside config.xml - it's removed the 777 and set it back to default permissions.

I hope this helps someone. I was looking for errors in the PHP files because the error implied (correctly) that the first item in the feeds array was a string instead of an array. Because it was an empty "rule"/feed, it wasn't reading in an array of feed values, but an empty string. Good luck. I got everything working and downloading!

Also on a separate note - I'm not sure that this obeys the TTL of an RSS feed. If you use something like, for example, DailyTVTorrents that keeps track of the bandwidth of your requests, you may want to edit the cron job and set the refresh to a longer period of time. Mine defaulted to every 15 minutes, but the TTL of the feed is 60 minutes and I don't want to get banned 4 hours into each day Keep it in mind.

[jdforsythe]

btw this was on NAS4Free 9.1.0.1 - Sandstorm

[Thomm]

Thank you! This made my life so much easier

[Corban987]

Hi

I have installed this as described, the cron is not running, so if I run the cron manually using command the following error is displayed
Fatal error: Call-time pass-by-reference has been removed; If you would like to pass argument by reference, modify the declaration of add_item(). in /usr/local/www/sys/rss_cron.php on line 124

I am running on 9.1.0.1 - Sandstorm (revision 775)
FreeBSD 9.1-RELEASE-p3 (kern.osreldate: 901000)
x64-embedded on AMD Phenom(tm) 9950 Quad-Core Processor

Has anyone got a fix for this yet?

Thanks

[dhawk312]

I've been using uTorrent to pull and download torrents via RSS. Is there an easy way to import these RSS feeds into Transmission running on N4F?

[zepperdude]

Can anyone help me install this in a jail in TheBrig? New to this jail stuff and when running install.php I get an error about missing config.inc. In fact, there is no /etc/inc directory. Thanks,

[raulfg3]

if you want to install https://code.google.com/p/freenas-rss-e ... stallation .

This can't be installed on a jail, is dessingned to work in plain BSD ( in the Nas4Free install).

[zepperdude]

Initially tried to install under TheBrig on embedded – finally gave up. Installed full version of NAS4Free – then installed RSS Extension.

Extension is visible in my GUI – I have added 2 Feeds and 4 Filters. When I go to history – it says “The is no history, yet!”

It has been running for over a week – and I know some of those filters should have been hit.

How do I troubleshoot - ..ie very RSS feeds are downloading and that they are being parsed?

Thanks,

[Nostalgist92]

Anyone been able to get aXXomovies.in RSS feed working with the RSS extension?

[mekonghigh]

As an alternative you can try Deluge in Jail with the RSS plugin.

[Black_Wing]

Hello. Sorry for my bad English.
I have added rss-extension by following jdforsythe's guide. But as eskalibur I have problem with the filter "Enter a Perl regular expression." also. I want to download any torrents automatically with the words "HorribleSubs" ,"720p" and name of torrent. For example [HorribleSubs] Gin no Saji S2 - 09 [720p].mkv.
Help me please. What should I write into "Enter a Perl regular expression" in my example.

[warr3w0lf]

I manage to install using jdforsythe's guide above by i dont seem to be able to download my torrent and the CRON is not working. Currently i'm using 9.2.0.1 - Shigawire (revision 943) and i get my feed from Kickass.to. Here is an example of the RSS feed.

http://kickass.to/usearch/grimm%20s03%2 ... fum/?rss=1

[strife]

After upgrading to the latest release of NAS4Free (9.2.0.1 - Shigawire revision 972) I installed using jdforsythe's guide as well.

Installation finished just fine but I, like a few others, received a few errors when trying to use the RSS function.

Now, I'm no developer at all and I have very limited knowledge about php but I do like to tinker so I did the below which fixed my issues.
I will not support any of this nor take responsibility to anything that may or may not be related to you following my instructions. In essence, you're on your own..

When clicking edit I got "Fatal error: Call-time pass-by-reference has been removed in rss_feed_edit.php on line 53"
When investigating the actual file, row 53 is the blank row in between:

Code: Select all

    $reqdfieldsn = array(gettext("Name"), gettext("URL"));

    do_input_validation($_POST, $reqdfields, $reqdfieldsn, &$input_errors);

Some more googling led me to the fix, some stuff in php were altered and well, this is no longer supported..
The fix was to remove the "&" from the row below the empty line.

Code: Select all

    $reqdfieldsn = array(gettext("Name"), gettext("URL"));

    do_input_validation($_POST, $reqdfields, $reqdfieldsn, $input_errors);

The same error showed up again in a few places in that same file (or possibly other files), the fix in all was to find the "&" and remove it from the row below the one indicating the error.

Also, another problem was when clicking on the Filters and History tabs where "Fatal error: 'continue' operator with non-constant operand is no longer supported in /mnt/<mountpoint name>/RSS/www/ext/RSS/Torrent.php on line 323"
When investigating these lines they looked like this:

Code: Select all

                if ( empty( $info['http_code'] ) )
                        continue $scrape[$tracker] = self::set_error( new Exception( 'Tracker request timeout (' . $timeout . 's)' ), true );

                elseif ( $info['http_code'] != 200 )
                        continue $scrape[$tracker] = self::set_error( new Exception( 'Tracker request failed (' . $info['http_code'] . ' code)' ), true );

When doing some googling on this issue seem like the syntax is now changed.. My fix is to change the lines into:

Code: Select all

                if ( empty( $info['http_code'] ) )^M
                        $scrape[$tracker] = self::set_error( new Exception( 'Tracker request timeout (' . $timeout . 's)' ), true );

                elseif ( $info['http_code'] != 200 )^M
                        $scrape[$tracker] = self::set_error( new Exception( 'Tracker request failed (' . $info['http_code'] . ' code)' ), true );
                        continue;

There is one more place (at least) in the file but with more "if" and no "elseif", in those cases move the "continue" to a row below in all the if statements. Don't forget the trailing ";"

In addition to these errors which after fixing let me hit the buttons and add / edit feeds et cetera I also noticed that the cron job failed. Upon investigating /mnt/<mountpoint name>/RSS/sys/cron.sh
I found:

Code: Select all

#! /bin/sh
SCRIPT_NAME=rss_cron.php
# for /bin/bash in case /bin/sh ever disappears
#SCRIPT_FILENAME="${0/cron.sh/$SCRIPT_NAME}"
SCRIPT_FILENAME="${0%/*}/$SCRIPT_NAME"
/usr/local/bin/php -f "$SCRIPT_FILENAME"

This is wrong since the executable changed name, remember..

Code: Select all

/usr/local/bin/php-cgi -f "$SCRIPT_FILENAME"

Is the correct syntax.

Also this cronjob calls /mnt/<mountpoint name>/RSS/sys/rss_cron.php which also return some of the previously mentioned (and fixed) issues. Execute the cron.sh script from command line and it tell you at what lines the problem occur.

After this the RSS extension seem to work fine in my environment. Feeds are automatically read, filters seem to work, stuff get downloaded. I have been running it for a few hours with no issues yet.

One final note, I had to log on as root in order to edit some of the files. For this I had to set a new root password as the system would not let me in with the defaults, only option was to go Advanced > Command in the webUI and execute:

Code: Select all

echo "mynewpassword" | pw usermod root -h 0

Then I enabled SSH service and checked the allow root login setting.

I really like this extension and I wish I could keep it going rather than let it be left as abandonware but I lack the necessary developing skills. I hope that some php-savvy person someday may pick the project back up again as it is truly a great addon to NAS4Free.

[raulfg3]

thanks a lot for your time to share your experience.

PD: For your final note: root and admin password are the same for N4F default install, so you can use nas4free as default password for root and for admin.

And if you change admin password in webGUI, you can change root password too.

[nasgurl]

I get

Warning: require_once(XML/Unserializer.php): failed to open stream: No such file or directory in /mnt/rss/sys/rss_cron.php on line 4

Fatal error: require_once(): Failed opening required 'XML/Unserializer.php' (include_path='.:/etc/inc:/usr/local/www') in /mnt/rss/sys/rss_cron.php on line 4

when executing the cron.sh manually. Installed the rss extension with the modified RSS.tar (renamed to RSS.tgz) mentioned above. Any clue how to fix that?

I tried
#!/usr/local/bin/php -q
and
#! /usr/local/bin/php-cgi -f
as starting line for sys/rss_cron.php - no difference.