Audio/video stream recording forums (http://stream-recorder.com/forum/index.php)
-   Video stream recording (http://stream-recorder.com/forum/forumdisplay.php?f=4)
-   -  

How to use iView (ABC Australia) downloaders

(http://stream-recorder.com/forum/showthread.php?t=7039)

Anywho 08-15-2010 04:54 AM

Re: How to use iView (ABC Australia) downloaders


 
Quote:

Originally Posted by gxdata (Post 20870)
Often, I find that I cannot download the previous day's ABC National News (this happens with The Midday Report, and with both the older Sydney Evening News and the current ABC National News).

I'm convinced it's not put up & left online for long, before it's removed so that the next day's bulletin is loaded to the server.

Yep. Looks like they rotate quickly with the ABC National News...

As an example, I just went to the iView website and tried to view the ABC National News for Saturday. It was 8pm here and the Program Info showed that it was uploaded 21 hours ago and only had an hour left before it expired. I went to watch it and I got the "Program is unavailable" message. So, even the info on their website was wrong!

I expect the same happens with the others you mention... We should perhaps chip in and buy them another hard drive seeing as they cannot afford to hold more than a day's worth of news programs at a time :D

gxdata 08-15-2010 06:14 AM

Re: How to use iView (ABC Australia) downloaders


 
Quote:

Originally Posted by Anywho (Post 20871)
We should perhaps chip in and buy them another hard drive seeing as they cannot afford to hold more than a day's worth of news programs at a time :D

My observation is that it's an undiscplined, hit-and-miss operation. I'm sure they have plenty of resources for storage, etc - but the code maintenance is shoddy.

mce 08-15-2010 06:35 PM

Re: How to use iView (ABC Australia) downloaders


 
The illegal character for "The Link" is a question mark in the file name.

Honestly, who puts question marks in file names... ABC have no idea.

So gxdata, is there any other programmes that are failing that I need to know about before updating iViewNapper?

It also fails in 'Lite as well, so I'll put a fix in there too.

Quote:

Originally Posted by gxdata (Post 20869)
Just a note about occasional problems with iView, where there are illegal characters etc in the title names or file names (I'm not sure which).

It seems this is a problem with iViewNapper (crashes / gives error 'illegal characters in path'), but the batch downloader manages to get the episodes successfully.

The latest of these is

Another was where Episode 3 is downloaded by the batch donlaoder OK.

For that one, I can recall that the filenames were The Fabulous Beekman Boys Series 1 Episode 3 -.mp4 / .srt (a dash/hyphen somewhere between the 3 and the period).

[Edit] Just found this gem as well: "The Fabulous Beekman Boys\tSeries 1"

gxdata 08-15-2010 08:55 PM

Re: How to use iView (ABC Australia) downloaders


 
Quote:

Originally Posted by mce (Post 20881)
... any other programmes that are failing that I need to know about before updating iViewNapper?

Not that I know of, but 3 of the SBS shows passed by without my being able to download them - see my posts on Whirlpool. I think one of 4 was actually available (of course I also test with the SBS Player / iView's player).

Can I request in your changes to iViewNapper that the SRT files be downloaded by default?

mce 08-15-2010 11:02 PM

Re: How to use iView (ABC Australia) downloaders


 
iViewNapper and iViewNapperLite have been updated to version 20100816 and can be obtained from my website.

HeatVision 08-16-2010 03:27 PM

Re: How to use iView (ABC Australia) downloaders


 
Quote:

Originally Posted by Anywho (Post 20802)
I couldn't get the "Lifehacker" method to work for Hulu. Still sees me as outside USA.

Thinking about it some more, how could it work? Comms between my ISP and the Hulu server would still show the originating source IP address (me in Aus.). How else would I be able to communicate with Hulu anyway?

Doing a check with this webpage confirms it. Note that the source IP is still your current IP address even if you spoof the "X-Forward-For" address. So all a streaming server has to do is look at the source IP and make the decision - I'm pretty sure this is how ABC does it (and how it calculates the authentication token).

So no, I don't think the LifeHacker method would work with iView.

[edit: I just tried the "X-Forward-For" address using an American IP address on the iView website and iView doesn't think I'm in Australia. How bizarre! Maybe it (LifeHacker method) will work for ABC iView. ]

You're confusing two separate things:
1. The Flash-based player does a geocheck before it starts playback (using http://www.abc.net.au/tv/geo/iview/geotest.xml)
2. The Flash Media Server does a completely separate geocheck when the RTMP connection is being established. If it fails then the stream is terminated with an error (code = NetConnection.Connect.Rejected, description = AccessManager.Reject: Access denied!)

The X-Forward-For header appears to be honoured by www.abc.net.au (running AkamaiGHost) but not cp53909.edgefcs.net (running Flash Media Server). So when you did the "Lifehacker method", the geocheck failed at step 1 and you saw the "overseas copyright" error. If you had somehow managed to continue past then point then you still would have been able to establish the RTMP connection because the geocheck would have succeeded at step 2.

The downloader programs skip step 1 completely and only do step 2 (after doing a separate HTTP request to retrieve the token). There is no geocheck on the token request nor is there a check that the token request and RTMP request originate from the same IP. This did not used to be the case - originally the geocheck was done during the token request and there was no check done by the Flash Media Server so therefore it was possible to use the X-Forward-For approach.

Therefore, as you said above, the only way to access iView programs from overseas is to use an Australian proxy or VPN. As far as I am concerned, their explanation of "copyright reasons" is absolute bollocks for the shows that the ABC actually creates themselves (I understand that there are special problems created by things such as news programs, where they are reproducing footage supplied to them by other agencies, but how can this apply to the 7:30 Report, Lateline, Australian Story, etc?).

Anywho 08-16-2010 11:11 PM

Re: How to use iView (ABC Australia) downloaders


 
Quote:

Originally Posted by HeatVision (Post 20913)
You're confusing two separate things:
1. The Flash-based player does a geocheck before it starts playback (using http://www.abc.net.au/tv/geo/iview/geotest.xml)
2. The Flash Media Server does a completely separate geocheck when the RTMP connection is being established. If it fails then the stream is terminated with an error (code = NetConnection.Connect.Rejected, description = AccessManager.Reject: Access denied!)

The X-Forward-For header appears to be honoured by www.abc.net.au (running AkamaiGHost) but not cp53909.edgefcs.net (running Flash Media Server). So when you did the "Lifehacker method", the geocheck failed at step 1 and you saw the "overseas copyright" error. If you had somehow managed to continue past then point then you still would have been able to establish the RTMP connection because the geocheck would have succeeded at step 2.

The downloader programs skip step 1 completely and only do step 2 (after doing a separate HTTP request to retrieve the token). There is no geocheck on the token request nor is there a check that the token request and RTMP request originate from the same IP. This did not used to be the case - originally the geocheck was done during the token request and there was no check done by the Flash Media Server so therefore it was possible to use the X-Forward-For approach.

Therefore, as you said above, the only way to access iView programs from overseas is to use an Australian proxy or VPN. As far as I am concerned, their explanation of "copyright reasons" is absolute bollocks for the shows that the ABC actually creates themselves (I understand that there are special problems created by things such as news programs, where they are reproducing footage supplied to them by other agencies, but how can this apply to the 7:30 Report, Lateline, Australian Story, etc?).

Now it makes sense. Cheers mate! :)

Anywho 08-21-2010 08:58 PM

Re: How to use iView (ABC Australia) downloaders


 
Hey, a belated thanks goes to Peter Jeremy for updating the Technical details in the iView Downloaders Wiki page.

Yansky 08-22-2010 03:51 AM

Re: How to use iView (ABC Australia) downloaders


 
http://jobs.webdirections.org/job/12...g-corporation/

Anywho 08-22-2010 04:07 AM

Re: How to use iView (ABC Australia) downloaders


 
Quote:

Originally Posted by Yansky (Post 21058)

LOL! So who's gonna be a spy for us? Yanksy, you? Cuz I'm not good enough :D

elfst0ne 08-22-2010 09:24 PM

Re: How to use iView (ABC Australia) downloaders


 
Quote:

Originally Posted by Anywho (Post 21060)
So who's gonna be a spy for us?

Me. me. me. :D :D :D I lost my job a month ago. :(

gxdata 08-27-2010 05:56 AM

Re: How to use iView (ABC Australia) downloaders


 
I think they've done it again.
One Plus One for 27/08/2010 seems to have a date in September - cannot download it.

tabaxter 08-28-2010 05:29 AM

Re: How to use iView (ABC Australia) downloaders


 
I'm a relative newbie. Apologies if there's a better place for this to be posted.

I'm having trouble lately with iviewnapper and iviewfox maxing out my bandwidth to the point where my home network hangs and almost everything (except the rtmpdump request) times out. Is it possible to put a speed limiter into the GUIs? As far as I understand it, rtmpdump has it as an option.

I am intending to research how to use rtmpdump from the command line myself (haven't taken the time yet), but it would be a great addition for the future.

(Also, any tips on why it is maxing out my bandwidth so badly?)

By the way, thank you so much for the work you guys do.

mce 08-28-2010 07:54 PM

Re: How to use iView (ABC Australia) downloaders


 
Hi tabaxter,

You can experiment with adding your own command line options for the inbuilt bandwidth monitoring in RTMPDUMP by using and editing iViewNapperLite.

If you have troubles or you succeed, post back here with what you did and we'll see what we can do.

davey52 08-29-2010 06:18 AM

Re: How to use iView (ABC Australia) downloaders


 
Quote:

Originally Posted by gxdata (Post 21144)
I think they've done it again.
One Plus One for 27/08/2010 seems to have a date in September - cannot download it.

Yep, the ABC have broken napper, napperlite & downloader.

Sorry, I just use them, the dos box says retrieving token a few tries then closes. :mad:

servalan 08-29-2010 06:35 AM

Re: How to use iView (ABC Australia) downloaders


 
Quote:

Originally Posted by davey52 (Post 21168)
Yep, the ABC have broken napper, napperlite & downloader.

.bat file still working ok for me with 2.2b rtmpdump & hostworks.

davey52 08-30-2010 05:45 AM

Re: How to use iView (ABC Australia) downloaders


 
Quote:

Originally Posted by servalan (Post 21169)
.bat file still working ok for me with 2.2b rtmpdump & hostworks.

I've tried .bat file again and the 1st show downloaded ok. the other two worked only after I deleted the old files (0 bytes).

No idea why it wouldn't work before. :confused:

gxdata 08-30-2010 06:50 PM

Re: How to use iView (ABC Australia) downloaders


 
Off-topic, but an interesting report on ABC's video storage requirements:

http://www.computerworld.com.au/arti...storage_havoc/

ABC's video demands causing storage havoc
National broadcaster goes from 3TB in 2003 to 1600TB in 2010

3Tb - right now, that is not much storage at all, from my perspective.

conank 08-31-2010 04:25 AM

Re: How to use iView (ABC Australia) downloaders


 
Hi,

It is a great tool for downloading iview.
I wonder the legal issues whether we can share ours downloaded movies? Any idea

Thanks

any ANONYMOUS forum user 09-03-2010 05:40 AM

Re: How to use iView (ABC Australia) downloaders


 
Quote:

Originally Posted by conank (Post 21188)
I wonder the legal issues whether we can share ours downloaded movies?

Is it legal to record video streams? Can it be considered as a piracy?

tilt 09-04-2010 01:48 AM

Re: How to use iView (ABC Australia) downloaders


 
Legal situation is covered in http://www.abc.net.au/copyright.htm

which includes this

# You may retrieve the ABC's materials for information only.
# You may save a local copy or send it to your printer for your own personal use or in order to inform authorised and potential users about the ABC materials. However, you may not make any charge for such use and any commercial exploitation is expressly prohibited.
© 2010 ABC
--
So no selling it is permitted, and no changing it either. It sounds as if you can send an email or post it to a discussion board. And saving to your hard disk or DVD is OK as long as it is local and not a distribution.

Yansky 09-04-2010 01:48 AM

Re: How to use iView (ABC Australia) downloaders


 
mce, looks like Malwarebytes might be throwing a false-positive on the napper progs: http://whrl.pl/Rcp21j

Yansky 09-04-2010 02:18 AM

Re: How to use iView (ABC Australia) downloaders


 
Quote:

Originally Posted by tilt (Post 21230)
Legal situation is covered in http://www.abc.net.au/copyright.htm

which includes this

# You may retrieve the ABC's materials for information only.
# You may save a local copy or send it to your printer for your own personal use or in order to inform authorised and potential users about the ABC materials. However, you may not make any charge for such use and any commercial exploitation is expressly prohibited.
© 2010 ABC
--
So no selling it is permitted, and no changing it either. It sounds as if you can send an email or post it to a discussion board. And saving to your hard disk or DVD is OK as long as it is local and not a distribution.

The terms of service for iView are different for the rest of the site though. Specifically: http://www.abc.net.au/tv/iview/faq.htm

Quote:

ABC pays the owners of our content extra licensing fees to allow for it to be shown for at least 14 days online via iView. Streaming rights with the ABC are limited by a number of legal or business agreements that differ from program to program. A program must expire for many reasons, including music rights management, impending DVD sales and syndication deals. ABC is keen to support those content makers and therefore does not license content to be downloaded onto individual devices. Use of third party applications that allow downloadable versions of ABC iView programs is therefore unauthorised and not supported in any way.
Although you/I/we are not doing anything illegal, we are breaking the terms of service of the abc iview site.

Anywho 09-04-2010 07:04 PM

Re: How to use iView (ABC Australia) downloaders


 
Quote:

Originally Posted by conank (Post 21188)
I wonder the legal issues whether we can share ours downloaded movies? Any idea

No. Sharing or re-distribution is a definite no-no and we won't talk about that here in this thread.

Quote:

Originally Posted by Yansky (Post 21232)
Although you/I/we are not doing anything illegal, we are breaking the terms of service of the abc iview site.

I guess the equivalent would be breaking 4C. of YouTube's TOS - and we know how many YouTube downloaders there are out there that YouTube don't "authorise".

gxdata 09-10-2010 07:19 PM

Re: How to use iView (ABC Australia) downloaders


 
What's happened to the 7.30 Report (Thurs)? It's at the 7.30 website with small wmv and m4v files, but not on iView. That seems odd.:confused:

darian 09-10-2010 10:50 PM

Re: How to use iView (ABC Australia) downloaders


 
Quote:

Originally Posted by gxdata (Post 21363)
What's happened to the 7.30 Report (Thurs)? It's at the 7.30 website with small wmv and m4v files, but not on iView. That seems odd.:confused:

It does not seem to appear in the index list with iviewnapper or iviewcmd.

However if you use iviewcmd to create a download entry for 08/09/10 and then manually edit the download_list.xml file to point to 09/09/10 instead of 08/09/10, then it will download.

I guess it is on the server, but not listed properly in the index (or else it has spurious characters that are confusing the index parser).

gxdata 09-11-2010 05:32 AM

Re: How to use iView (ABC Australia) downloaders


 
Quote:

Originally Posted by darian (Post 21365)
However if you use iviewcmd to create a download entry for 08/09/10 and then manually edit the download_list.xml file to point to 09/09/10 instead of 08/09/10, then it will download.

I guess it is on the server, but not listed properly in the index (or else it has spurious characters that are confusing the index parser).

Good thinking! I did that, and it is now downloading OK.

mce 09-11-2010 12:33 PM

Re: How to use iView (ABC Australia) downloaders


 
I see and can download that episode using iViewNapper 20100816 and iViewNapperLite 20100816 as "7.30 Report 08-09-10.mp4".

Maybe they just added it?!?!

Anywho 09-11-2010 04:45 PM

Re: How to use iView (ABC Australia) downloaders


 
Quote:

Originally Posted by mce (Post 21377)
I see and can download that episode using iViewNapper 20100816 and iViewNapperLite 20100816 as "7.30 Report 08-09-10.mp4".

Maybe they just added it?!?!

No, "7.30 Report 08-09-10.mp4" has always been there. They wanted "7.30 Report 09-09-10.mp4". Unless you mean 08-09-10 is the same program as 09-09-10? It's not listed on the iView site and nobody has complained on their forum either (not very popular, eh?).

gxdata 09-12-2010 08:00 PM

Re: How to use iView (ABC Australia) downloaders


 
As Anywho says, the Wed 8Sept 7.30 Report has been there a while, but as of today (Monday) the last for the week (Thurs) isn't. Maybe it will be remedied tomorrow.

Anywho 09-14-2010 12:10 AM

Re: How to use iView (ABC Australia) downloaders


 
Quote:

Originally Posted by gxdata (Post 21388)
As Anywho says, the Wed 8Sept 7.30 Report has been there a while, but as of today (Monday) the last for the week (Thurs) isn't. Maybe it will be remedied tomorrow.

It's been fixed now. Thursday (9/Sep/10) and yesterday's (13/Sep/10) is up on iView :)

gxdata 09-23-2010 09:03 AM

Re: How to use iView (ABC Australia) downloaders


 
Wed 22/09/2010 Lateline Business isn't listed.
What do I need to do to discover if this is a typo glitch, or if they just skipped a day (forgot to mount it)?
I reckon it's another typo problem.

Anywho 09-23-2010 09:41 AM

Re: How to use iView (ABC Australia) downloaders


 
Quote:

Originally Posted by gxdata (Post 21705)
Wed 22/09/2010 Lateline Business isn't listed.
What do I need to do to discover if this is a typo glitch, or if they just skipped a day (forgot to mount it)?
I reckon it's another typo problem.

Looks like they haven't listed it. I used the batch file downloader to select the 23/09/2010 show and changed the filename in cache\download_list.xml.
Eg: Instead of news/latelinebusiness_100923.mp4 make it news/latelinebusiness_100922.mp4

gxdata 09-23-2010 09:53 AM

Re: How to use iView (ABC Australia) downloaders


 
Quote:

Originally Posted by Anywho (Post 21706)
Looks like they haven't listed it. I used the batch file downloader to select the 23/09/2010 show and changed the filename in cache\download_list.xml.
Eg: Instead of news/latelinebusiness_100923.mp4 make it news/latelinebusiness_100922.mp4

I did much the same - iViewNapper has a Debug switch, that writes a batch file; so in that .bat file I changed the episode info in a similar way to you and 'nothing happened'. Is there a switch in rtmpdump that shows a 'file not found' message? What's the URL for the cache\download_list.xml file?
Actually, I recall now that (a few weeks ago) when using the commandline batch downloader that you jointly authored, I edited that xml file while the batch operation was active, then re-ran the download request.

Anywho 09-23-2010 10:03 AM

Re: How to use iView (ABC Australia) downloaders


 
Quote:

Originally Posted by gxdata (Post 21707)
I did much the same - iViewNapper has a Debug switch, that writes a batch file; so in that .bat file I changed the episode info in a similar way to you and 'nothing happened'. Is there a switch in rtmpdump that shows a 'file not found' message? What's the URL for the cache\download_list.xml file?

Don't know why it didn't work for 'Napper, but I used iView_Downloader_v15.70.bat. Then I selected the 23/09/2010 show and went back to the main menu. After that, I edited the "download_list.xml" file (there should be a "cache" directory in the directory that iView_Downloader_v15.70.bat is in) so that the file name had the date changed from 23 to 22.

Code:

[Lateline Business 23/09/10][news/latelinebusiness_100923.mp4]
to

Code:

[Lateline Business 22/09/10][news/latelinebusiness_100922.mp4]
Then I selected the "Download the shows..." option and downloaded it. Yes, it is the 22/09/2010 show that I downloaded not the 23/09/2010 :)

gxdata 09-23-2010 10:36 PM

Re: How to use iView (ABC Australia) downloaders


 
Quote:

Originally Posted by Anywho (Post 21708)
Yes, it is the 22/09/2010 show that I downloaded not the 23/09/2010

OK, have followed that and it's downloading.
Again, thanks for your help. :D

Stream Ripper 09-23-2010 11:02 PM

Re: How to use iView (ABC Australia) downloaders


 
Awesome - glad you got it figured out! :)

MickJT 09-28-2010 08:14 PM

Re: How to use iView (ABC Australia) downloaders


 
The downloads in my client have to resume every 60 seconds. Has something changed? Can someone post an example command line input?

gxdata 09-28-2010 10:22 PM

Re: How to use iView (ABC Australia) downloaders


 
Quote:

Originally Posted by MickJT (Post 21836)
The downloads in my client have to resume every 60 seconds. Has something changed? Can someone post an example command line input?

No.

I have a problem with 3 videos, all in the series "triple j like a version 2010". Nothing else has been a problem today.

40, 41, 42 all hiccup severely at 56.5% and I have to terminate the rtmpdump.exe program.
[Edit]
Same problem 30/09

gxdata 09-29-2010 08:13 PM

Re: How to use iView (ABC Australia) downloaders


 
RSS feed for Recently Added has changed -

see iView message board post
http://www2b.abc.net.au/tmb/Client/M...624&ps=50&dm=2

You can check all iView feeds here -
http://www.abc.net.au/tv/iview/feeds.htm

Latest URL is -
http://tviview.abc.net.au/iview/rss/recent.xml


All times are GMT -6. The time now is 06:19 AM.