How to use iView (ABC Australia) downloaders

[barywhite]

Originally Posted by Anywho

I did reply to this earlier yesterday, but my post is being "moderated" (very slowly too) for some reason.


I fixed it inside the json parsers anyway... That way the iView devs don't get to see how to circumvent it. I'll eventually do it for all the other cases too... It's one of those "round 2 its"

The link to download it from is in the Wikia (see first post of this thread).

Got the new version and it works.

Thanks

[Yansky]

I have two users that are having similar problems. RTMPDump seems to connect ok for them, but then they get an Access Denied error. The weird thing is it happens after the authentication handshake succeeds. I thought at first perhaps the authentication token might have become invalid or something, but the error seems to occur almost straight away.

Here's pastebins of the two users debug output:
http://pastebin.com/EshYh9R9
http://pastebin.com/WvMhbxZi

Can you guys see anything in there that might point to the problem?

[Anywho]

Originally Posted by Yansky

I have two users that are having similar problems. RTMPDump seems to connect ok for them, but then they get an Access Denied error. The weird thing is it happens after the authentication handshake succeeds. I thought at first perhaps the authentication token might have become invalid or something, but the error seems to occur almost straight away.

Here's pastebins of the two users debug output:
http://pastebin.com/EshYh9R9
http://pastebin.com/WvMhbxZi

Can you guys see anything in there that might point to the problem?

The first one points to a non-existent program (torchwood s3e1).

Comparing the second one to mine shows the differences to mine (below), but may be different (?) with Hostworks vs Akamai :

DEBUG: Invoking connect
INFO: Connected...
DEBUG2: RTMP_ReadPacket: fd=132
DEBUG2:   0000:  02 00 00 00 00 00 04 05  00 00 00 00               ............      
DEBUG2:   0000:  00 26 25 a0                                        .&%.              
DEBUG: HandleServerBW: server BW = 2500000
DEBUG2: RTMP_ReadPacket: fd=132
DEBUG2:   0000:  02 00 00 00 00 00 05 06  00 00 00 00               ............      
DEBUG2:   0000:  00 26 25 a0 02                                     .&%..             
DEBUG: HandleClientBW: client BW = 2500000 2
DEBUG2: RTMP_ReadPacket: fd=132
DEBUG2:   0000:  02 00 00 00 00 00 03 04  00 00 00 00               ............      
DEBUG2:   0000:  00 1a 01                                           ...               
DEBUG: HandleCtrl, received ctrl. type: 26, len: 3
DEBUG: HandleCtrl, SWFVerification ping received: 
DEBUG: sending ctrl. type: 0x001b
DEBUG: Sending SWFVerification response: 
DEBUG: 00 1b 01 01 00 00 08 4a 00 00 08 4a 60 c7 35 ea
DEBUG: 6e e9 e9 4e 51 70 f9 10 75 01 87 5a 59 5b e2 36
DEBUG: a6 17 21 88 64 46 01 da c4 dd 9b 6a 
DEBUG2: RTMP_SendPacket: fd=132, size=44
DEBUG2:   0000:  42 00 00 00 00 00 2c 04                            B.....,.          
DEBUG2:   0000:  00 1b 01 01 00 00 08 4a  00 00 08 4a 60 c7 35 ea   .......J...J`.5.  
DEBUG2:   0010:  6e e9 e9 4e 51 70 f9 10  75 01 87 5a 59 5b e2 36   n..NQp..u..ZY[.6  
DEBUG2:   0020:  a6 17 21 88 64 46 01 da  c4 dd 9b 6a               ..!.dF.....j      
DEBUG2: RTMP_ReadPacket: fd=132
DEBUG2:   0000:  03 00 00 00 00 00 f2 14  00 00 00 00               ............      
DEBUG2:   0000:  02 00 07 5f 72 65 73 75  6c 74 00 3f f0 00 00 00   ..._result.?....  
DEBUG2:   0010:  00 00 00 03 00 06 66 6d  73 56 65 72 02 00 0e 46   ......fmsVer...F  
DEBUG2:   0020:  4d 53 2f 33 2c 35 2c 37  2c 37 30 30 39 00 0c 63   MS/3,5,7,7009..c  
DEBUG2:   0030:  61 70 61 62 69 6c 69 74  69 65 73 00 40 5f c0 00   apabilities.@_..  
DEBUG2:   0040:  00 00 00 00 00 04 6d 6f  64 65 00 3f f0 00 00 00   ......mode.?....  
DEBUG2:   0050:  00 00 00 00 00 09 03 00  05 6c 65 76 65 6c 02 00   .........level..  
DEBUG2:   0060:  06 73 74 61 74 75 73 00  04 63 6f 64 65 02 00 1d   .status..code...  
DEBUG2:   0070:  4e 65 74 43 6f 6e 6e 65  63 74 69 6f 6e 2e 43 6f   NetConnection.Co  
DEBUG2: RTMP_ReadPacket: fd=132
DEBUG2:   0000:  c3                                                 .                 
DEBUG2:   0000:  6e 6e 65 63 74 2e 53 75  63 63 65 73 73 00 0b 64   nnect.Success..d  
DEBUG2:   0010:  65 73 63 72 69 70 74 69  6f 6e 02 00 15 43 6f 6e   escription...Con  
DEBUG2:   0020:  6e 65 63 74 69 6f 6e 20  73 75 63 63 65 65 64 65   nection succeede  
DEBUG2:   0030:  64 2e 00 0e 6f 62 6a 65  63 74 45 6e 63 6f 64 69   d...objectEncodi  
DEBUG2:   0040:  6e 67 00 00 00 00 00 00  00 00 00 00 04 64 61 74   ng...........dat  
DEBUG2:   0050:  61 08 00 00 00 00 00 07  76 65 72 73 69 6f 6e 02   a.......version.  
DEBUG2:   0060:  00 0a 33 2c 35 2c 37 2c  37 30 30 39 00 00 09 00   ..3,5,7,7009....  
DEBUG2:   0070:  00 09                                              ..                
DEBUG: RTMP_ClientPacket, received: invoke 242 bytes
DEBUG: (object begin)

[Sandgroper12]

Problem with downloading programme from the ABC.
I used iviewNapper, which calls rtmpdump-win32-2.3r557.exe
I turned on debug (by clicking on the icon and selecting debug)
Attempted to download Dr Who S3 Ep8
Download stopped, resumed, stopped again.
Files received:
... Episode 8 Human Nature.mp4 (23465Kb)
... Episode 8 Human Nature.mp4.bat (1Kb) which had the single line:
rtmpdump-win32-2.3r557.exe -r rtmp://203.18.195.10/ondemand?auth="124C9F223E32ECA14B0E&mp4:doctorwho_ 03_08" -y "mp4:doctorwho_03_08" -o "Doctor Who Series 3 -- Doctor Who Series 3 Episode 8 Human Nature.mp4" -W "http://www.abc.net.au/iview/images/iview.jpg" --resume

_AUTH_.XML (1Kb)
<?xml version="1.0" encoding="utf-8"?>
<iview xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="http://www.abc.net.au/iView/Services/iViewHandshaker">
<ip>58.7.166.129</ip>
<isp>iiNet</isp>
<desc>iiNet Limited</desc>
<host>Hostworks</host>
<server>rtmp://203.18.195.10/ondemand</server>
<bwtest>rtmp://203.18.195.10/live</bwtest>
<token>124C9F223E32ECA14B0E</token>
<text><![CDATA[iview is unmetered for <a href="http://www.iinet.net.au/" target="_blank">iiNet</a> and <a href="http://www.westnet.com.au/freezone/" target="_blank">Westnet</a> customers.]]></text>
<free>yes</free>
</iview>
config.xml
<?xml version="1.0" encoding="utf-8"?>
<config>
<param name="api" value="http://tviview.abc.net.au/iview/api2/?"/>
<param name="auth" value="http://tviview.abc.net.au/iview/auth/?v2"/>
<param name="tray" value="xml/tray.xml"/>
<param name="categories" value="xml/categories.xml"/>
<param name="classifications" value="xml/classifications.xml" />
<param name="captions" value="http://www.abc.net.au/iview/captions/"/>
<param name="captions_offset" value="0"/>
<param name="captions_live_offset" value="-2"/>
<param name="live_streaming" value="true" />
<param name="server_streaming" value="rtmp://cp53909.edgefcs.net/ondemand" />
<param name="server_fallback" value="rtmp://cp44823.edgefcs.net/ondemand" />
<param name="highlights" value="http://www.abc.net.au/iview/api/highlights.htm" />
<param name="home" value="http://www.abc.net.au/iview/xml/home.xml" />
<param name="geo" value="http://www.abc.net.au/tv/geo/iview/geotest.xml" />
<param name="time" value="http://www.abc.net.au/iview/api/time.htm" />
<param name="feedback_url" value="http://www2b.abc.net.au/tmb/Client/Board.aspx?b=98"/>
</config>
and
config.json which appears to be a Unix listing of the programmes available but doesn't include any mention of Dr Who or Human Nature.

No other files are evident.

The mp4 file should be in the order of 220Mb.

Why might the download come unstuck? I get a success rate of well under 50% when trying to collect ABC programmes.

[Anywho]

Originally Posted by Sandgroper12

Problem with downloading programme from the ABC.
I used iviewNapper, which calls rtmpdump-win32-2.3r557.exe
I turned on debug (by clicking on the icon and selecting debug)
Attempted to download Dr Who S3 Ep8
Download stopped, resumed, stopped again.
Files received:
... Episode 8 Human Nature.mp4 (23465Kb)
... Episode 8 Human Nature.mp4.bat (1Kb) which had the single line:
rtmpdump-win32-2.3r557.exe -r rtmp://203.18.195.10/ondemand?auth="124C9F223E32ECA14B0E&mp4:doctorwho_ 03_08" -y "mp4:doctorwho_03_08" -o "Doctor Who Series 3 -- Doctor Who Series 3 Episode 8 Human Nature.mp4" -W "http://www.abc.net.au/iview/images/iview.jpg" --resume


Why might the download come unstuck? I get a success rate of well under 50% when trying to collect ABC programmes.

Using the iView_Downloader (Windows batch version), the command line should actually be something like:

rtmpdump.exe --resume  -r rtmp://203.18.195.10/ -a ondemand?auth=F9F6DFA62C4
364AED3ED -y mp4:doctorwho_03_08 -o "Doctor Who Series 3 - Doctor Who Series 3 E
pisode 8 Human Nature.mp4" -W http://www.abc.net.au/iview/images/iview.jpg

There seems to be extra data that probably shouldn't be there (the "&mp4:doctorwho_03_08") in the "auth=" parameter. The iView server would likely see that as an invalid authentication and disconnect you after a while (90 to 180 secs.).

You'll have to wait until mce investigates some more I guess

[Sandgroper12]

Thanks Anywho. I'm sure mce will look at what I've sent in and come up with some ideas.

What intrigues me is that some people consider it perfectly legal to record programmes when they are broadcast (using their DVD recorders, or VCRs for those with old technology), and those who subscribe to FetchTV get equipment which allows them to record programmes received via that internet TV service, yet it's supposedly not legal to record off the stations' web sites. The Copyright Act, with all its amendments, allows recording of TV programmes for personal use, and doesn't specify a means of getting them.

Would someone like to offer some explanation?

[mce]

I'm looking into it now, even though this episode download just fine for me.

I'll ask Sandgroper12 to trial a test version of iVN. I think my fast connection allows it to download before chucking a wobbly.

http://users.on.net/~m.elliott/ivn/i...r_20120627.exe

This is a test version for others to try if they have this problem

[gxdata]

Originally Posted by Sandgroper12

Problem with downloading programme from the ABC.
I used iviewNapper, which calls rtmpdump-win32-2.3r557.exe
<snip>
I get a success rate of well under 50% when trying to collect ABC programmes.

I wonder if your problem is similar to one I just cannot fix?

I am using iViewNapper (not the new trial one - the one before that I think) and I will get 99.99% success - not even timeouts or resumes, most of the time, when I use my old Belkin modem (bought years ago from iiNet, my ISP).

When I use my BoB2 modem with VOIP, the timeouts are excessive (they default to 30 seconds, if no parameter is passed to rtmpdump), and can make the download time 5 to 20 tiimes as long, when all the manual intervention is taken into account.

This can be tested with the 2 different modems within minutes, any time of day, with nobody using the VOIP phone service.

Indeed, I can set the ADSL Optimiser setting (at iiNet Toolbox) to anything from 'Thrillseeker' down to the slowest, with no change in the timeouts and resumes.

I have put up with this for 3-4 months, would you believe?

Amazingly, whichever downloader I use with SBS, the BoB2 modem is fast and error-free. And, using mce's p7Napper at Plus!7, it is also fast and free of timeouts.

Explain that !

[UbuntuFan]

Originally Posted by Sandgroper12

... yet it's supposedly not legal to record off the stations' web sites. The Copyright Act, with all its amendments, allows recording of TV programmes for personal use, and doesn't specify a means of getting them.

Would someone like to offer some explanation?

The restriction has always, since the beginning of streaming radio way back in the old RealPlayer days, been that online broadcasting is presented 'as if' it's the same as terrestrial broadcasting i.e no access for the audience to the whole original source, be it film, tape, disc or magnetic wire.
But access to original source is always possible with digital media. One way or another.
The management of streaming online has always been to invoke DRM (research all that yourself, it takes up quite a bit of the web to go into the explanations and arguments for what is essentially a failed paradigm). Which DRM is effected in a whole lot of silly ways, one of which is easily defeated by open source use of the rtmp protocol - as in rtmpdump which is getting used here. rtmpdump in effect gets the file **streamed**, but nice and fast, and it also copies it **dumps** it too. Nothing illegal but inconvenient for drm patsies.
The legality of **copying** a show for personal use, however you do it, isn't the question; you could run one of quite a few capture applications right now to record anything that plays on your home computer. I'm guesssing you're here because you would also like to get it **fast** copied.
But the owners of stuff that gets broadcast, often attach restrictions to it that the broadcaster has to abide by in return for broadcasting rights... one of which is to **not** allow rapid file getting, even if it's a legal method which rtmpdump is.
So illegal really isn't the problem for viewers, it's a problem for the broadcaster. And they really do know that it's impossible to manage with any drm kind of stuff, so all they can really do is look away from this kind of self-help and try not to let the word get around too quickly.
Very sad because the people who could really do with the help that rtmpdump gives are those with not enough dosh to get good gear and nice fast dsl connections, so their streaming doesn't work well.

Nothing illegal going on here, just self-help against a heap of silly roadblocks.

[davey52]

I'm still having trouble with 'napper even with the newer version. what I see is the menu coming up slower, then it will close or bring up that dialogue box giving me the option to close or continue, sometimes it just closes instead of giving the programme list or closes when I select the episode or just closes the dos box when I hit run.

What is consistent is that I get the most trouble when iview is the busiest. If I try after 11pm or 6am it tends to work. Even the weekends are better.

We are in the demographic that 'napper et al is designed for, fast broadband will never be an option, heck, the local telephone exchange isn't even adsl equipped (too few people in working distance). The only way to be able to watch ABC or SBS is via the internet. Don't even ask about NBN if you don't want a firey rant.

I could try it when it fails next week but someone will need to give me step by step instructions to enable error logging.

Edit: Just tried to download a programme and get 'index out of bounds of the array' then it freezes until I click quit.