Audio/video stream recording forums (http://stream-recorder.com/forum/index.php)
-   Video stream recording (http://stream-recorder.com/forum/forumdisplay.php?f=4)
-   -  

How to use iView (ABC Australia) downloaders

(http://stream-recorder.com/forum/showthread.php?t=7039)

MickJT 09-29-2010 11:36 PM

Re: How to use iView (ABC Australia) downloaders


 
That's not the problem i'm having. It says swfverification request ignored, and to use swfVfy (which is -W, and i'm already using that), and it interrupts the connection every 60 seconds.

Was working fine previously, so I just wanted an example command line parameter (one that is known to work) so I can test that here.

Anywho 09-30-2010 05:24 AM

Re: How to use iView (ABC Australia) downloaders


 
Quote:

Originally Posted by MickJT (Post 21866)
I just wanted an example command line parameter (one that is known to work) so I can test that here.

This is what the batch file version uses. Don't forget to change the authentication token for your session ;)

For "Catalyst Series 11 Episode 31"...

Akamai:
Code:

rtmpdump.exe --resume  -r "rtmp://cp53909.edgefcs.net///flash/playback/_definst_/mp4:catalyst_10_11_31" -a ondemand?auth="1333DC3D4D6F2D00F772" -o "Catalyst Series 11 Episode 31.mp4" -W http://www.abc.net.au/iview/images/iview.jpg
Hostworks:
Code:

rtmpdump.exe --resume  -r rtmp://203.18.195.10/ -a ondemand?auth=1333DC3D4D6F2D00F772 -y mp4:catalyst_10_11_31 -o "Catalyst Series 11 Episode 31.mp4" -W http://www.abc.net.au/iview/images/iview.jpg

GaelicAU 10-04-2010 04:05 AM

Re: How to use iView (ABC Australia) downloaders


 
Just downloaded the MAC OSX version and it doesnt seem to be working. This is the error I am getting....

Code:

Ok, you will be requesting mp4:stephenfrylive_10_xx_xx
and saving the stream with the filename Stephen Fry.mp4.flv.mp4.flv.mp4.flv.mp4.flv.mp4.flv.mp4.flv.mp4.flv.mp4.flv.mp4.flv.mp4.flv.mp4
Retrieving Token...
  % Total    % Received % Xferd  Average Speed  Time    Time    Time  Current
                                Dload  Upload  Total  Spent    Left  Speed
100  649  100  649    0    0  2250      0 --:--:-- --:--:-- --:--:--    0
from ABC iView servers on Hostworks
using the auth D9C5D82F053A0C561A74
Running Normal...
dyld: unknown required load command 0x80000022
/Users/MacMini/Downloads/iView_Downloader_OSX/iView_Downloader_OSX_6.7.3.command: line 227: 95620 Trace/BPT trap          "$CURDIR"/"$FLVSTREAMER" --resume -r rtmp://203.18.195.10/ondemand?auth=$TOKEN -y $SHOWPATH -o "$DOWNDIR"/"$FILENAME" $SWFPARAMS
Error code 133
Sleeping for 5s

Any ideas why?

MickJT 10-04-2010 11:03 PM

Re: How to use iView (ABC Australia) downloaders


 
Quote:

Originally Posted by Anywho (Post 21872)
This is what the batch file version uses. Don't forget to change the authentication token for your session ;)

Hostworks:
Code:

rtmpdump.exe --resume  -r rtmp://203.18.195.10/ -a ondemand?auth=1333DC3D4D6F2D00F772 -y mp4:catalyst_10_11_31 -o "Catalyst Series 11 Episode 31.mp4" -W http://www.abc.net.au/iview/images/iview.jpg

Exact same line (diff token though), still conks out at 60 seconds here.

WARNING: HandShake: client signature does not match!
and
ERROR: HandleCtrl: Ignoring SWFVerification request, use --swfVfy!

Hmm.

Anywho 10-05-2010 09:57 PM

Re: How to use iView (ABC Australia) downloaders


 
Quote:

Originally Posted by MickJT (Post 21942)
Exact same line (diff token though), still conks out at 60 seconds here.

WARNING: HandShake: client signature does not match!
and
ERROR: HandleCtrl: Ignoring SWFVerification request, use --swfVfy!

Hmm.

What is the exact command line delivered to rtmpdump as specified by your program? Maybe it is something to do with unrecognised characters making their way into the incantation instead - rather than an actual verification fault.

MickJT 10-06-2010 07:27 AM

Re: How to use iView (ABC Australia) downloaders


 
I typed it in manually on the command line. The exact same line you pasted, for Hostworks. but with a different token. It used to work. Next i'm going to try calculating the hash manually again and see what happens.

Edit: I think I know what's happening. I forgot to link it with a library that gives the program unix-path compatibility, so it tries to save ./.swfinfo but can't (./ is not a valid Amiga-style directory path) . .swfinfo I believe is still read, even if it has just downloaded and calculated the hash itself when .swfinfo doesn't exist. I.E It makes .swfinfo, then immediately reads it. .. or so i'm guessing, because i've tried my iView script on OS3 (68k machine) and it works like clockwork. The only difference is the unix style path compatibility layer which i'm guessing is making it work.

gxdata 10-07-2010 04:19 AM

Re: How to use iView (ABC Australia) downloaders


 
I have yet another problem - files not found. I just don't understand how I can play them on the ABC iView player, yet (both) iViewNapper and the iView batch downloader can't locate the 2 files.

These ones are for kids - a series called Jinx. Episodes 1-9 are mounted on iView. I can DL 5,6,8 - but not 7 and 9.
But they do play OK at the iView site - all of them.

Apart from getting one or other episode, I want to understand why the downloaders fail.

Examining the download_list.xml file, it shows this:

[Jinx Series 1 Episode 1][kids/jinx_10_01_01.mp4]
[Jinx Series 1 Episode 2][kids/jinx_10_01_02.mp4]
[Jinx Series 1 Episode 3][kids/jinx_10_01_03.mp4]
[Jinx Series 1 Episode 4][kids/jinx_10_01_04.mp4]
[Jinx Series 1 Episode 5][kids/jinx_10_01_05.mp4]
[Jinx Series 1 Episode 6][kids/jinx_10_01_06.mp4]
[Jinx Series 1 Episode 7][kids/jinx_10_01_07.mp4]
[Jinx Series 1 Episode 8][kids/jinx_10_01_08.mp4]
[Jinx Series 1 Episode 9][kids/jinx_10_01_09.mp4]

(opened with TextPad 5, copied and pasted to here).

No odd characters, all lines look the same - but 7 and 9 fail to download.

Both downloaders initially show Connected... in rtmpdump, then 20+ seconds later there's failure.

I'll try again in a few hours or days, but it's understanding that I would appreciate (I don't care much about these episodes, really).

[Edit]
A couple of hours elapsed, and I can download these. Strange...

MickJT 10-08-2010 02:48 AM

Re: How to use iView (ABC Australia) downloaders


 
Yes I had the same issue last night. Said connected, then paused and did nothing. Tried again a few times and it worked. Just figured that ABC were having some minor issues.

defecation 10-10-2010 08:27 AM

Re: How to use iView (ABC Australia) downloaders


 
Hi using iView Downloader LINUX 6.7.3
Tried last few nights the same show doesnt work.
Some others do. Some others don't.

Code:

DEBUG: Parsing...
DEBUG: Parsed protocol: 0
DEBUG: Parsed host    : 203.18.195.10
DEBUG: Parsed app    : ondemand?auth=6243A8FD4867E062340D
DEBUG: Protocol : RTMP
DEBUG: Hostname : 203.18.195.10
DEBUG: Port    : 1935
DEBUG: Playpath : mp4:torchwood_10_02_04
DEBUG: tcUrl    : rtmp://203.18.195.10:1935/ondemand?auth=6243A8FD4867E062340D
DEBUG: app      : ondemand?auth=6243A8FD4867E062340D
DEBUG: live    : no
DEBUG: timeout  : 30 sec
DEBUG: SWFSHA256:
DEBUG: 96 cc 76 f1 d5 38 5f b5 cd a6 e2 ce 5c 73 32 3a
DEBUG: 39 90 43 d0 bb 6c 68 7e dd 80 7e 5c 73 c4 2b 37
DEBUG: SWFSize  : 2122
DEBUG: Failed to get last keyframe.
DEBUG: Closing connection.

Anyone else with same issue?

MickJT 10-10-2010 08:59 AM

Re: How to use iView (ABC Australia) downloaders


 
Works here (Hostworks):

rtmpdump -r "rtmp://203.18.195.10" -a "ondemand?auth=yourtokenhere" -W http://www.abc.net.au/iview/images/iview.jpg -y "mp4:torchwood_10_02_04" -e -o torchwood_10_02_04.mp4

defecation 10-10-2010 06:38 PM

Re: How to use iView (ABC Australia) downloaders


 
Hi thanks it seems to be working now. Changed the script

Running with
Code:

rtmpdump --resume -r rtmp://203.18.195.10 -a ondemand?auth=12D9C4213D69EC344B0E -y mp4:torchwood_10_02_04 -W http://www.abc.net.au/iview/images/iview.jpg -o /home/twentytwo/Desktop/iview/torchwood_10_02_04.mp4
As opposed to what it used to be
Code:

rtmpdump --resume -r rtmp://203.18.195.10/ondemand?auth=ABBFFF57E1C98B3FBD26 -y mp4:torchwood_10_02_04 -o /home/twentytwo/Desktop/iview/torchwood_10_02_04.mp4 -w 96cc76f1d5385fb5cda6e2ce5c73323a399043d0bb6c687edd807e5c73c42b37 -x 2122
Also changed Akamai
Code:

"$CURDIR"/"$FLVSTREAMER" --resume -r rtmp://cp53909.edgefcs.net///flash/playback/_definst_/$SHOWPATH -a ondemand?auth=$TOKEN -W http://www.abc.net.au/iview/images/iview.jpg -o "$CURDIR"/"$FILENAME"
note one less forward slash in
rtmp://cp53909.edgefcs.net///flash/ as opposed to rtmp://cp53909.edgefcs.net////flash/
I don't know if this affects anything all my downloads are on Hostworks

Running rtmpdump 2.3 btw.
Thanks again

gxdata 10-10-2010 09:40 PM

Re: How to use iView (ABC Australia) downloaders


 
Monday 10am onwards - we can play a few things on iView, but downloaders all fail with anything that I try to download (even The Owl !) - either 0 bytes and rtmpdump ends, or even causes iViewNapper to crash (immediate exit, with no warnings).
Is the iVN debugger output any use to see what's happening here?

servalan 10-10-2010 10:41 PM

Re: How to use iView (ABC Australia) downloaders


 
They must be mucking about again...

I've had a few downloads fail (files not found on server - even though the RSS feed says they are available & play fine in iView itself) & 2 work - nothing on the iView forums suggest anything other than normal brokenness. (edit: play fine through iview most of the time - just had this one fail on me from iview as well - I'll leave it 24 hours & see what happens)

e.g.
Code:

Downloading "The Memoirs Of Sherlock Holmes Series 4 Episode 4" ...
and saving the stream with the filename "The Memoirs Of Sherlock Holmes Series 4 Episode 4.mp4"

Downloading from Hostworks server...

Retrieving Token...
RTMPDump v2.2b (r426)
(c) 2010 Andrej Stepanchuk, Howard Chu, The Flvstreamer Team; license: GPL
Connecting ...
WARNING: Trying different position for server digest!
INFO: Connected...
ERROR: RTMP_ReadPacket, failed to read RTMP packet header
mp4:memoirssherlock_10_04_04 path not found. Retrying a different path...

Retrieving Token...
Resuming previous download for "The Memoirs Of Sherlock Holmes Series 4 Episode 4"...
RTMPDump v2.2b (r426)
(c) 2010 Andrej Stepanchuk, Howard Chu, The Flvstreamer Team; license: GPL
memoirssherlock_10_04_04 path not found. Retrying a different path...

Retrieving Token...
Resuming previous download for "The Memoirs Of Sherlock Holmes Series 4 Episode 4"...
RTMPDump v2.2b (r426)
(c) 2010 Andrej Stepanchuk, Howard Chu, The Flvstreamer Team; license: GPL
memoirssherlock_10_04_04.mp4 path not found. Retrying a different path...


The show "The Memoirs Of Sherlock Holmes Series 4 Episode 4" was not found on the server.


Anywho 10-11-2010 12:16 AM

Re: How to use iView (ABC Australia) downloaders


 
1 Attachment(s)
Quote:

Originally Posted by servalan (Post 22090)
They must be mucking about again...

The show "The Memoirs Of Sherlock Holmes Series 4 Episode 4" was not found on the server.[/code]

Here ya... I've fixed it for you by replying to your post :D

servalan 10-11-2010 12:22 AM

Re: How to use iView (ABC Australia) downloaders


 
Quote:

Originally Posted by Anywho (Post 22091)
Here ya... I've fixed it for you by replying to your post :D

Yup - working again now.

I think just the as normal intermittent iView reception... if something doesn't work try again in a few hours... ;)

gxdata 10-12-2010 09:03 PM

Re: How to use iView (ABC Australia) downloaders


 
Quote:

Originally Posted by servalan (Post 22092)
Yup - working again now.

I think just the as normal intermittent iView reception... if something doesn't work try again in a few hours... ;)

2 days on, and they must be doing something drastic since batch DL and iVN both crash on startup (can't get the catalog).

Or, is this 'normal behaviour' when the catalog file is being updated or has been deleted from its usual location?

servalan 10-12-2010 09:37 PM

Re: How to use iView (ABC Australia) downloaders


 
Quote:

Originally Posted by gxdata (Post 22141)
2 days on, and they must be doing something drastic since batch DL and iVN both crash on startup (can't get the catalog).

Yup - json_parser crashing here. iView via a browser works ok... so busted again for the scripts...

darian 10-13-2010 03:42 AM

Re: How to use iView (ABC Australia) downloaders


 
I think SBS are also mucking about as neither batch or SBSnapper will obtain the catalogue. Perhaps they are working together to thwart the downloaders.

mce 10-13-2010 03:52 AM

Re: How to use iView (ABC Australia) downloaders


 
I will have a look at the Nappers over the next few days.

The mongrels have timed it well, I just started annual leave for 2 weeks, so looks like fixing these will be one or two projects in that time.

:D

blood.eaglz 10-13-2010 05:36 AM

Re: How to use iView (ABC Australia) downloaders


 
From what I've gathered ABC has completed the switch over to the new api2, and changed the formatting of the json etc

the auth url is now
Code:

http://tviview.abc.net.au/iview/auth/?v2
with handshaker now defunct with the action of the url changed to redirect to iview itself

and the new series index and series urls are
Code:

http://tviview.abc.net.au/iview/api2/?seriesIndex
http://tviview.abc.net.au/iview/api2/?series=!insert series number here!

it appears that a new formatting method is now used here meaning it cannot be fixed by a simple url switch (I know I tried :) )

this is rather annoying, especially as iviewNapper still worked for me at 1:30 this morning...


oh by the way mce, since you have to fix them anyway, can you remove the focus lock on iviewNapper and SBSnapper, it is rather annoying that you cant minimise them other than using show desktop...(forgot about it since I last asked in April :) )

I'm afraid that's about all the help I'll be, anything beyond this is out of my knowledge range.

gxdata 10-13-2010 06:37 AM

Re: How to use iView (ABC Australia) downloaders


 
blood.eaglez - Can you explain how you discovered these changes? (PM if preferred)

blood.eaglz 10-13-2010 06:39 AM

Re: How to use iView (ABC Australia) downloaders


 
initial urls through URLsnooper 2 (though got the new auth for iview through their config XML)
then I just followed what the links and subsequent xml files gave me, with a little of trial and error along the way.

gxdata 10-13-2010 07:39 AM

Re: How to use iView (ABC Australia) downloaders


 
Quote:

Originally Posted by blood.eaglz (Post 22155)
initial urls through URLsnooper 2 (though got the new auth for iview through their config XML)
then I just followed what the links and subsequent xml files gave me, with a little of trial and error along the way.

Similar to Fiddler, I presume?

blood.eaglz 10-13-2010 08:11 AM

Re: How to use iView (ABC Australia) downloaders


 
had to google it, but in principle it seems similar, would have to compare to see if same results.

EDIT: gave it a crack and yes you'd be able to use fiddler, though unlike urlsnooper it doesn't capture rtmp addresses, which isn't really important for this, but does come in handy at times to debug the downloaders.

also I don't really like the interface, but that's probably due to me being used to urlsnoooper.

gxdata 10-13-2010 08:58 AM

Re: How to use iView (ABC Australia) downloaders


 
Quote:

Originally Posted by blood.eaglz (Post 22157)
had to google it, but in principle it seems similar, would have to compare to see if same results.

EDIT: gave it a crack and yes you'd be able to use fiddler, though unlike urlsnooper it doesn't capture rtmp addresses, which isn't really important for this, but does come in handy at times to debug the downloaders.

also I don't really like the interface, but that's probably due to me being used to urlsnoooper.

I had the same reaction with URL Snooper (had to look it up) - watched the video, and copied it out of my cache, but I'll have to convert swf to flv or something else. Seems easy to use, with the filters, so it will be useful.

gxdata 10-13-2010 10:06 AM

Re: How to use iView (ABC Australia) downloaders


 
SBS

The batch and GUI downloaders can't handle one show "Can GM Food Save The World? Full Ep". It plays OK on the SBSPlayer.

Maybe it's the ?

The shows.xml first line, for Channel 94, is:

[1][24832][Can GM Food Save The World? Full Ep][DOC_FE_Can_GM_Food_Save_The_57_324832]

Otherwise, both SBS downloaders are working OK.

gxdata 10-13-2010 05:27 PM

Re: How to use iView (ABC Australia) downloaders


 
Quote:

Originally Posted by darian (Post 22146)
I think SBS are also mucking about as neither batch or SBSnapper will obtain the catalogue. Perhaps they are working together to thwart the downloaders.

No, SBS is OK - bar the usual typos, repeats, delayed mounts, etc.

I'm amazed that some episodes are completely mis-named as another in the series.

It would be nice if ABC and SBS cooperated with the more systematic approach of iView - though they (ABC) are not immune to the occasional typo or stuff-up.

gxdata 10-13-2010 05:51 PM

Re: How to use iView (ABC Australia) downloaders


 
mce - another SBS download problem (current), which you might look at when reviewing the code (though SBS isn't broken in the way iView is for the downloaders).

Made In Spain With Jose Andres Ep 11 *** unhandled exception ***

blood.eaglz 10-13-2010 07:24 PM

Re: How to use iView (ABC Australia) downloaders


 
hm, I had thought sbs had broken the downloaders as well as I couldn't retrieve the catalog, however it looks like they might have just had some server troubles.

darian 10-13-2010 08:13 PM

Re: How to use iView (ABC Australia) downloaders


 
SBSnapper is suddenly working fine again for me, so it must have just been server problems before.

mce 10-13-2010 09:59 PM

Re: How to use iView (ABC Australia) downloaders


 
There is a new version (20101014) of iViewNapper available on the website.

iViewNapperLite may take a while longer.

Good to see SBS is ok but there is one problem I think I need to look at.

Quote:

Originally Posted by gxdata (Post 22172)
Made In Spain With Jose Andres Ep 11 *** unhandled exception ***

Sorry, I don't see that episode.

miley tipton 10-13-2010 10:24 PM

Re: How to use iView (ABC Australia) downloaders


 
Hi,
I am new to this Forum, and want to explore new things related to downloading technologies. I think getting linked to different people using different technology, is the best way to live up to date. Well
I am fimiliar with Bitlord, Vuze, and now want try more efficient softwares. Hope I will learn about new technology here.

Thanks and Regards

blood.eaglz 10-13-2010 11:17 PM

Re: How to use iView (ABC Australia) downloaders


 
Quote:

Originally Posted by gxdata (Post 22159)
SBS

The batch and GUI downloaders can't handle one show "Can GM Food Save The World? Full Ep". It plays OK on the SBSPlayer.

same here, pity this looks interesting...



hey mce prior to the latest shake up I was using iViewNapper_20100715 simply cause a) it worked and b) it had subtitles off by default, and I was wondering if it would be too difficult/painful for iViewNapper to parse its own exe file name similar to how Batch picture-resize does so that if exe name is iViewNapper_20101014 then subtitles off by default or if iViewNapper_20101014s then subtitles on by default? then a simple name change keeps you preference.

miley tipton 10-13-2010 11:31 PM

Re: How to use iView (ABC Australia) downloaders


 
Hi,
I am new to this forum, and want to know more about web technology. I have used some downloading tools, Like Bitlord and Vuze, but this is entirely new for me. Is this Iview is a freeware?
I like to live up to date thats why i joined this forum.

Thanks and Regards

mce 10-13-2010 11:39 PM

Re: How to use iView (ABC Australia) downloaders


 
Quote:

Originally Posted by blood.eaglz (Post 22178)
same here, pity this looks interesting...

hey mce prior to the latest shake up I was using iViewNapper_20100715 simply cause a) it worked and b) it had subtitles off by default, and I was wondering...

I should just have a settings file that the nappers read.

ie: ivn_settings.txt with CAPTIONS=OFF in it.

gxdata 10-13-2010 11:57 PM

Re: How to use iView (ABC Australia) downloaders


 
Quote:

Originally Posted by mce (Post 22176)
There is a new version (20101014) of iViewNapper available on the website.

Thanks! Great service - much appreciated. :)

[edit] Love the log! Just need the description and expiry info ...

bluefish17 10-14-2010 12:28 AM

Re: How to use iView (ABC Australia) downloaders


 
My link to the iview napper at http://users.on.net/~m.elliott/i/index.html does not show the 20101014 version, only 20100816 version. What is the link to the new version?

mce 10-14-2010 01:18 AM

Re: How to use iView (ABC Australia) downloaders


 
Don't worry guys, there a few bugs that are causing this version to crash, so I've pulled it.

The JSON data has missing fields and these must be dealt differently than before.

[Update]

I've uploaded a new version with the same version number as before, so please re-download iViewNapper and crash test.

bluefish, please clear your browser cache and try again.

blood.eaglz 10-14-2010 02:29 AM

Re: How to use iView (ABC Australia) downloaders


 
anyone had any luck fixing the url to Can GM Food Save The World on sbs?

mce 10-14-2010 02:54 AM

Re: How to use iView (ABC Australia) downloaders


 
Quote:

Originally Posted by blood.eaglz (Post 22191)
anyone had any luck fixing the url to Can GM Food Save The World on sbs?

I just looked on sbsNapper why it was failing and I now strip some unwanted characters from the -o (output filename) field before attempting the download and it seems to work.

<title>Can GM Food Save The World? Full Ep</title>

The ? there was the culprit for me.

There is a new version up on the sbsNapper website.


All times are GMT -6. The time now is 06:12 AM.