[any ANONYMOUS forum user]

Working RTMP downloaders for SBS Online:

sbsNapper (http://users.on.net/~m.elliott/s/index.html) by MCE (Freeware / Windows)

SBS Downloader Windows (command line) by elfst0ne (Freeware / Windows) port of lightguard's script

SBS Downloader (GUI) by Anywho (Freeware / Linux)


Broken downloaders:

SBS Downloader OSX (Bash Script) (Freeware / Mac OS X)

ShowGrabberAU by lightguard (Freeware / Windows)


See also:
FAQ: How to record/download/capture/save Adobe Flash .FLV video RTMP stream from embedded player (http://all-streaming-media.com/faq/recording-media-stream/faq-record-download-capture-save-flash-flv-video-rtmp.htm)
How to record rtmp:// flash video .flv stream from embedded Adobe Flash Player

[any ANONYMOUS forum user]

SBS Downloader (GUI) by Anywho (Freeware / Linux)
I've been using Replay Media Catcher (http://all-streaming-media.com/record-video-stream/Replay-Media-Catcher-download-and-capture-streaming-music-radio-video.htm) and WM Recorder (http://all-streaming-media.com/record-video-stream/WMRecorder-One-click-online-audio-video-stream-recorder.htm) for downloading SVS video streams successfully. But I need a downloader for Linux as well. Where can I download the SBS Downloader for Linux?

[randybull]

sbsNapper_20110722 error "Cannot open Channel 94 Too many automatic redirections were attempted" :confused:

[Anywho]

Where can I download the SBS Downloader for Linux?

You can download it from here (http://www.4shared.com/file/138635990/6ca14ee/SBS_DL_LINUX.html). Note that it is currently broken. mvdk apparently has a fix (http://forums.whirlpool.net.au/forum-replies.cfm?t=1342590&p=17#r335), but hasn't posted it yet :(

If I get some more time in the next couple of weeks, I'll bash it up and see if I can convince the code to work. :eek:

(Also have to wait for SBS to get more reliable at the moment :mad: )

[gxdata]

sbsNapper_20110722 error "Cannot open Channel 94 Too many automatic redirections were attempted" :confused:

You may need to send a private message to mce, to see if he has any ideas on how to fix the SBS Napper.

[gxdata]

FTR, everything returned to normal about 36-48h ago. (I have) no explanation why browsing to the important URLs worked, but SBSNapper could not connect. :confused:

[gxdata]

SBS has increased its bitrate and number of streaming options (at different bitrates / quality), from 3 to sometimes 4.

eg, 'Trafficked' is available in (nominal bitrate) 128K, 300K, 1000K
(see hxxp://player.sbs.com.au/video/smil/index/standalone/346597)
and 'The Bombing Of Germany Full Ep' is available in 128K, 512K, 1000K, 1500K.
(see hxxp://player.sbs.com.au/video/smil/index/standalone/515791)

I discovered this while poking around, when SBSNapper was not connecting well over the last 3 days. I reverted to batch downloading (using a very ad hoc method), and this involved looking at various XML files with a browser.

Also, I noticed that some shows were very large for the time duration - due to a bigger bitrate for the video. The audio bitrate doesn't contribute much file size.

MediaInfo (hhtp://mediainfo.sourceforge.net/) is useful to see bitrate for both the video and the audio, once a show is downloaded.

afaik, unfortunately, RTMPdump (http://all-streaming-media.com/record-video-stream/rtmpdump-freeware-console-RTMP-downloading-application.htm) displays the duration, audio and video bitrates etc - but cannot feed the info back to the calling program (eg, SBSNapper or other downloaders).

SBSNapper has 3 buttons for different bitrates, which is quite useful.

I have been experimenting with some code that reads the show's XML file (eg, 515791 for 'The Bombing Of Germany '), and displays the correct number of buttons with the nominal bitrate displayed as the button text. Not a very useful function, but it amused me for an hour or so. :)

The last few days has made me contemplate whether SBS may change their streaming system quite drastically, sometime soon. That will be more fun!

[Anywho]

SBS has increased its bitrate and number of streaming options (at different bitrates / quality), from 3 to sometimes 4.

eg, 'Trafficked' is available in (nominal bitrate) 128K, 300K, 1000K
(see hxxp://player.sbs.com.au/video/smil/index/standalone/346597)
and 'The Bombing Of Germany Full Ep' is available in 128K, 512K, 1000K, 1500K.
(see hxxp://player.sbs.com.au/video/smil/index/standalone/515791)

I discovered this while poking around, when SBSNapper was not connecting well over the last 3 days. I reverted to batch downloading (using a very ad hoc method), and this involved looking at various XML files with a browser.
Mate, you are way behind the times :D
hxxp://forums.whirlpool.net.au/forum-replies.cfm?t=1342590&p=17#r333

[gxdata]

Mate, you are way behind the times

Yeh, I'm always a bit slooow :D

The video bitrate (MediaInfo) is up to 2000Kbps on some of these.

[Anywho]

The video bitrate (MediaInfo) is up to 2000Kbps on some of these.

Yeah, I've noticed similar too (over 3Mbps).

It's good that they've increased potential bit rates. It always annoys me seeing scenes that have oceans or smoke portrayed as checker-board patterns, or fast moving objects that jitter around the screen.

[gxdata]

SBS has increased its bitrate and number of streaming options (at different bitrates / quality), from 3 to sometimes 4.


Fooled by a human error again, I think:
In testing my auto-adapting buttons for downloads at different bitrates, I found that an episode of 'The Phone' (ep 21 - hxxp://player.sbs.com.au/video/smil/index/standalone/516113) has 8 entries in its XML file for the bitrates available!

They have doubled up on the 4 of them! (128,512,1000,1500)
I wonder how this affects the SBS Player?

[gxdata]

Much more at the On Demand website than the old SBS Player, now - many of the series are not going up on the Player, so these downloaders will become obsolete quite soon.

[Anywho]

Much more at the On Demand website than the old SBS Player, now - many of the series are not going up on the Player, so these downloaders will become obsolete quite soon.

What shows are available on "On Demand" that are not available on which SBS player (there's more than one remember - eg: Linux :cool:)?

SBSnapper certainly doesn't show them all, but that's because it only scrapes the "Latest Episodes" page.

[gxdata]

What shows are available on "On Demand" that are not available on which SBS player (there's more than one remember - eg: Linux :cool:)?

SBSnapper certainly doesn't show them all, but that's because it only scrapes the "Latest Episodes" page.

I think the On Demand and Player are quite separate, driven by different streaming server systems.

For instance, 'The Protectors Ep10' - which expires in 2 days - is not playable on SBS Player but is OK from the On Demand server.

The XML file for this show is actually empty!

Check out these URLs if you can do so within the next 48 hours or less:

SBS Player
_http://player.sbs.com.au/programs#/programs_08/fullepisodes/latestepisodes/playlist/

Playlist at '94':
_http://player.sbs.com.au/video/playlist/index/standalone/94/

Empty Show file at '519742':
_http://player.sbs.com.au/video/smil/index/standalone/519742

This show at the SBS Player:
_http://player.sbs.com.au/programs#/programs_08/fullepisodes/latestepisodes/playlist/The-Protectors-Ep-10/

SBS On Demand

_http://www.sbs.com.au/ondemand/

This show at On Demand
_http://www.sbs.com.au/ondemand/video/13539440/The-Protectors-Ep-10

I have had a quick look within the html file, but can't decipher the control files. The html files at On Demand are incredibly bloated.

StreamTransport (http://all-streaming-media.com/record-video-stream/StreamTransport-Download-HTTP-RTMP-RTMPE-streams.htm) will download these shows, but I will have to have a good look with Charles or Fiddler to see what is going on.

A friend recommended a downloader called DownloadStudio (http://all-streaming-media.com/record-video-stream/record-streaming-video-windows-media.htm#DownloadStudio) - perhaps it can elucidate.

[gxdata]

What shows are available on "On Demand" that are not available on which SBS player (there's more than one remember - eg: Linux :cool:)?

SBSnapper certainly doesn't show them all, but that's because it only scrapes the "Latest Episodes" page.

I have written some code (Windows .NET) that looks at different channels, but I think the difference between Player and On Demand is more fundamental.

What can you see with the Linux downloader, that SBSNapper cannot see?

On Demand has up to Ep288 of 'Letters and Numbers', whereas SBS Player has to Ep283 only - other examples, take a look.

[Anywho]

What can you see with the Linux downloader, that SBSNapper cannot see?

All the stuff you see with the SBS player (and some other stuff that goes back to last November - which is kind of strange).


On Demand has up to Ep288 of 'Letters and Numbers', whereas SBS Player has to Ep283 only - other examples, take a look.
I've noticed the "News & Current Affairs" section is not showing in the downloader. But I wanted other examples so I can track down what's missing and why, then formulate some way of getting it working. Mainly because, as you've found out, the "ondemand" system is so badly bloated and getting something that works with the "ondemand" method is a PITA.

On a side note, curiously "Internet Download Manager" (v6.07) is currently able to capture the link when you navigate to the video page and will download the videos - and even uses threaded downloading. I'm currently downloading "The Protectors" right now and it is using 4 connections to do it!

[edit: Screencap (http://i.imgur.com/xHHBN.png) ]

[Anywho]

What can you see with the Linux downloader, that SBSNapper cannot see?

On Demand has up to Ep288 of 'Letters and Numbers', whereas SBS Player has to Ep283 only - other examples, take a look.

Here's an example of the difference between SBSnapper and the SBS_Linux_Downloader...

Letters and Numbers Eps (http://i.imgur.com/AD4aP.png)

Menu List (http://i.imgur.com/VLm0D.png)

[gxdata]

Internet Download Manager (http://all-streaming-media.com/record-video-stream/Internet-Download-Manager-Youtube-grabber-FLV-downloader.htm) (IDM) is a really great tool, at SBS On Demand. Thx, Anywho - I should have tried it yonks ago.

[Core Share]

Hello,

I downloaded a documentary using SBSnapper, the output file was flash video *.flv.

Which my current media player - a WD TV (1st Gen) Media Player running B-Rad's WDLXTV firmware, will not play.

Is there a transform that I could run to convert the *.flv to a *.mp4 (for instance) with no loss of visual or auditory quality?

Any assistance most gratefully apprised, thank you.

[gxdata]

There have been 2 or 3 (maybe more) shows that are not in rtmpdump -downloadable form.

They appear to be http:// downloads - how do I do that easily, and know when the show has completed download?

Kung Fu Kitchen Ep 2 - Mochi - Japan (aired: 24/01)
How To Survive A Disaster Full Ep

[Anywho]

There have been 2 or 3 (maybe more) shows that are not in rtmpdump -downloadable form.

They appear to be http:// downloads - how do I do that easily, and know when the show has completed download?

Kung Fu Kitchen Ep 2 - Mochi - Japan (aired: 24/01)
How To Survive A Disaster Full Ep

Try CURL or WGET. They'll handle http:// links - just like a regular download ;)

[gxdata]

Hello,

I downloaded a documentary using SBSnapper, the output file was flash video *.flv.

Which my current media player - a WD TV (1st Gen) Media Player running B-Rad's WDLXTV firmware, will not play.

Is there a transform that I could run to convert the *.flv to a *.mp4 (for instance) with no loss of visual or auditory quality?

Any assistance most gratefully apprised, thank you.

This is possible using ffmpeg. Someone gave me the correct parametrs to do this for a format OK for an iPad, but I' not sure what you would need for your particular Media Player.

Could you download and install MediaInfo from here -
http://mediainfo.sourceforge.net/en/Download/Windows
then in Windows Explorer, right-click on a MP4 file that works on your Media Player, and take a look at the information?

The MediaInfo output (exported from MediaInfo in Text format) for an SBS .FLV show that I just DL @ 128K for your benefit is as follows -

General
Complete name : The Jaquie Brown Diaries Ep 1 - Brownie Points.flv
Format : Flash Video
File size : 26.9 MiB
Duration : 21mn 55s
Overall bit rate : 171 Kbps

Video
Format : AVC
Format/Info : Advanced Video Codec
Format profile : Baseline@L3.0
Format settings, CABAC : No
Format settings, ReFrames : 1 frame
Codec ID : 7
Duration : 21mn 55s
Width : 400 pixels
Height : 224 pixels
Display aspect ratio : 16:9
Frame rate mode : Constant
Frame rate : 25.000 fps
Standard : PAL
Color space : YUV
Chroma subsampling : 4:2:0
Bit depth : 8 bits
Scan type : Progressive

Audio
Format : AAC
Format/Info : Advanced Audio Codec
Format profile : HE-AAC / LC
Codec ID : 10
Duration : 21mn 55s
Channel(s) : 2 channels
Channel positions : Front: L R
Sampling rate : 44.1 KHz / 22.05 KHz
Compression mode : Lossy

[gxdata]

Try CURL or WGET. They'll handle http:// links - just like a regular download ;)

So what's the URL I give to them? The same one fed into rtmpdump I guess.
Maybe I should dump a batch file with curl syntax + the URL, when an HTTP -type address is detected rather than the expected rtmp://

[Edit]
Things change in a day. Now there are TWO entries for 'How to Survive a Disaster', both rtmp:// not http://

But I see that the XML control file (557485.XML) for the 'Kung Fu Kitchen Ep 2 - Mochi - Japan' show gives me a base address that I can't use: "E"

<meta base="E"/>

Any ideas? Anywho? Anyone?

[Anywho]

But I see that the XML control file (557485.XML) for the 'Kung Fu Kitchen Ep 2 - Mochi - Japan' show gives me a base address that I can't use: "E"

<meta base="E"/>

Any ideas? Anywho? Anyone?

KFK_Ep2... Doesn't show on the SBS website... "E" = "Expired" perhaps?

[Bahman]

But I see that the XML control file (557485.XML) for the 'Kung Fu Kitchen Ep 2 - Mochi - Japan' show gives me a base address that I can't use: "E"

<meta base="E"/>

Any ideas? Anywho? Anyone?

"E" is the folder name:
http://www.sbs.com.au/chinese/video/menu/inline/id/557485/ad/1/player/vcc_chinese
http://www.sbs.com.au/chinese/video/smil/index/standalone/557485
http://player.sbs.com.au/playerassets/videoad/v4/E/NT_F_Kung_Fu_Kitchen_p_2_21_557485_1000K.mp4
But seems they have removed video!!:D


Things change in a day. Now there are TWO entries for 'How to Survive a Disaster', both rtmp:// not http://


i don't know exactly what are looking for!! Do you wanna dl that stream?
Feed URL:
http://link.theplatform.com/s/dYtmxB/IJwpxB7r5n9xmetmvLxi7vGd02U6nseu?feed=Video - Single&mbr=true&policy=5704&dfptag=video.programs.sbs.com.au/;type=preroll;sz=530x298&ord=4436965&format=SMIL&Tracking=true&Embedded=true
<meta base="rtmp://cp98428.edgefcs.net/ondemand/?auth=daEcBc9c0dRaTaEada0c4aIcjdZd2drbmci-bpiuxl-vga-Lzn&amp;slist=vod/&amp;aifp=vod"/>
</head>
<body>
<switch>
<video src="MP4:vod/DOC_FE_How_To_Survive_A_Dis_57_557639_1500K.mp4" system-bitrate="1433072" height="360" width="640"/>
<video src="MP4:vod/DOC_FE_How_To_Survive_A_Dis_57_557639_1000K.mp4" system-bitrate="1021770" height="360" width="640"/>
<video src="MP4:vod/DOC_FE_How_To_Survive_A_Dis_57_557639_512K.mp4" system-bitrate="512000"/>
<video src="MP4:vod/DOC_FE_How_To_Survive_A_Dis_57_557639_128K.mp4" system-bitrate="128000"/>

[gxdata]

Thanks for the reply, Bahman

"E" is the folder name:
http://www.sbs.com.au/chinese/video/menu/inline/id/557485/ad/1/player/vcc_chinese

How do you discover that folder name? or, was that just an example, and the URL that I am after is:
http://player.sbs.com.au/playerassets/videoad/v4/E/NT_F_Kung_Fu_Kitchen_p_2_21_557485_1000K.mp4

I have no problems with the other video - I was just remarking that there are TWO entries for it today, with different addresses -
557223 and 557639

A day before, there was just ONE menu entry, and it had an http:// address (ie, the <meta base> tag had rtmp://).

[Bahman]

How do you discover that folder name? or, was that just an example, and the URL that I am after is:
http://player.sbs.com.au/playerassets/videoad/v4/E/NT_F_Kung_Fu_Kitchen_p_2_21_557485_1000K.mp4
I used IDM, and detects the download link automatically!! So, I understood that "E" is folder name of this video!!:)
Also I used Wireshark in order to see if there is another link or not(because That link is "not found"), after that I click on play, but I got the same url and , I didn't have any send/receive packets after server sent the url path!!

I have no problems with the other video - I was just remarking that there are TWO entries for it today, with different addresses -
557223 and 557639

A day before, there was just ONE menu entry, and it had an http:// address (ie, the <meta base> tag had rtmp://).
Perhaps, they have changed their streaming system from rtmp to http!!:)

[gxdata]

3 shows now with HTTP protocol -

One Man And His Campervan Ep 7 - Trossachs
Modern Slavery Ep 2
Love At First Hiccup

SBSNapper won't download these.

They have entries like <meta base="E"/>

Does anyone have ideas about how to download these? Adam M-W ?

[mce]

Trying to figure this weird base thing out.

If it has D or E in the base tag, is the file actually available for download at all?

[gxdata]

Trying to figure this weird base thing out.

If it has D or E in the base tag, is the file actually available for download at all?

D, E, M are base that I have seen.
But then, almost as I watch, they put up another menu / catalog item for one of those "HTTP" shows, that is a regular rtmp:// protocol address.

As of now (midday Sat 4Feb) I think all of those 3 are available as regular downloads.

What is more disturbing is that I can't browse (IE, Opera) to the SBS Player: it redirects to On Demand. Ominous?

Have you had a look at Adam M-W's python scripts for handling On Demand catalogs, menus? I'm not progressing far with understanding how to use the information.

[mce]

A new version 20120205 is available on the website.


Fix for illegal characters in output filename.
Debug mode controlled by existance of 'sbsNapper.debug' in directory.
Debug command line file now named after episode title.

[gxdata]

The maintainers of SBS Player are getting even more lax.

In the past few days, 5 separate shows have been entered in the index/catalog in both rtmp:// and http:// modes (separate entries, separate XML files).

Tonight, one movie - "The French Kissers" - has 1 x rtmp:// and 2 x http:// entries in the menu.

You can see this in SBSNapper. But you won't be able to tell which are http:// protocol.

(mce - it may be useful to tag those that appear as http:// protocol - or filter them out? They don't seem to be downloadable, anyway - not that I try to, any more).

[mce]

The maintainers of SBS Player are getting even more lax.

(mce - it may be useful to tag those that appear as http:// protocol - or filter them out? They don't seem to be downloadable, anyway - not that I try to, any more).

Yeah I'll look into it, it shouldn't be that hard.

[gxdata]

There are numerous "HTTP" shows now.

Stream Transport (http://www.google.com/url?q=http://stream-recorder.com/forum/streamtransport-tool-download-http-rtmp-rtmpe-streams-t5917.html&sa=U&ei=RI9ET6aEAZDNtgfHvYCBAw&ved=0CAQQFjAA&client=internal-uds-cse&usg=AFQjCNFCJida6nH8QuoXJPq0tTTfJYdttg) will capture them, from OnDemand website, but it is very slow to download a show that way, compared with using rtmpdump.exe

[gxdata]

Channel 94 Index/catalog is blank now @ 2012-02-22_1640 AEDST

~ 4hrs later, it has reappeared.

[mvdk]

Dear chaps,

I have made a python script that gets its stuff from sbs-on-demand instead of channel 94. It builds on others' work, notably adammw & others. It is available for windows at https://github.com/mvanderkolff/sbsOnDemand/downloads

You must install python 2.7 from python.org first, and put rtmpdump.exe in the same folder as the script.

Please feel free to offer any feedback; the script is more meant as a demonstrator for the library than anything. Please let me know if there are any bugs, any additional features, etc. Feel free to fork - I'm happy to merge stuff that others offer via a pull request.

Hoping that you have a pleasant evening,

Michael

[gxdata]

Dear chaps,

I have made a python script that gets its stuff from sbs-on-demand instead of channel 94. It builds on others' work, notably adammw & others. It is available for windows at https://github.com/mvanderkolff/sbsOnDemand/downloads

You must install python 2.7 from python.org first, and put rtmpdump.exe in the same folder as the script.

Please feel free to offer any feedback; the script is more meant as a demonstrator for the library than anything. Please let me know if there are any bugs, any additional features, etc. Feel free to fork - I'm happy to merge stuff that others offer via a pull request.

Hoping that you have a pleasant evening,

Michael

mvdk
Thanks - it is working fine, within the limitations of the text menu display.

It would be nice to add resume into the rtmpdump command. Oh, did not check the py code any further, but the default bitrate for the download seems to be the max - 1500Kbps. I' already wanting the options in mce's SBSNapper - some shows are not worth the wasted bandwidth.

Mad Men Ep11 halts at 1.6% or so; auto-resume might help to get it all downloaded eventually.

(Incidentally, I never did see MM 11 and 12 at the SBS Player website.)

It seems the On Demand structure is successfully unpicked, from the few I have checked so far. :)

Last update of the SBS Player folder structures (Ch94, etc) seems to have been 3 days ago. Total shows loaded (incl the ?http ones with "D", "E", "M") has dropped from 126 to 96.

Do we regard it as officially abandoned, now - so SBSNapper and other downloaders will be redundant in a few days? :mad:


[Edit]
I will substitute rtmpdump v2.4 for Windows for the 2.2d version.

[mvdk]

mvdk
Thanks - it is working fine, within the limitations of the text menu display.

It would be nice to add resume into the rtmpdump command. Oh, did not check the py code any further, but the default bitrate for the download seems to be the max - 1500Kbps. I' already wanting the options in mce's SBSNapper - some shows are not worth the wasted bandwidth.



Reason I just grabbed the largest was because it was the easiest thing to do - it didn't involve checking for a bit rate. I suppose I could implement a "-1" option, meaning "allow me to set the preferred bit rate, please..."

I agree that the text interface is not friendly - I implemented a text interface because it was fast to do, provides a service quickly, and provides me with quick feedback.

Cheers,

Michael

[gxdata]

Reason I just grabbed the largest was because it was the easiest thing to do - it didn't involve checking for a bit rate. I suppose I could implement a "-1" option, meaning "allow me to set the preferred bit rate, please..."

I agree that the text interface is not friendly - I implemented a text interface because it was fast to do, provides a service quickly, and provides me with quick feedback.

Grateful that you implemented it.

I don't know the *nix commandline downloaders (SBS, iView) but the Windows batch downloader for iView has some nice features to guard against wrong entries (I keep forgetting to key in 0 = Go Back for your py script, and put in a Series number like 68 when the allowable values might be only 0,1,2).
Would you mind taking a look (not at the batch code, more its behaviour)? See the iView thread here, and the batch downloader by Anywho et al.

[mvdk]

Would you mind taking a look (not at the batch code, more its behaviour)? See the iView thread here, and the batch downloader by Anywho et al.
It's a 51 page thread, and the only entries I could find all had 4shared.com links that are dead :(. That said, it does allow you to select more than one item out of a category by saying, e.g. "48) Letters and Numbers" and then typing "15 16" to select both of them out of that list.

Would you prefer that it exits to the top-level menu after every set of successful downloads?

Cheers,

Michael

BTW: Latest version on github allows you to select bitrate.

[darian]

Just tried the Python OnDemand downloader.

Although it works when selecting Carrier Ep3, the resulting file is Carrier Ep3 (128K).flv and is only 400x224 no matter what I set in the bitrate field.

Are some videos only stored at lower resolution in OnDemand?

Could not get the old sbsnapper to work on this item at all.

[gxdata]

Batch downloader v15.84 (http://www.4shared.com/file/750EOTqx/iView_Downloader_v1584.html) at 4shared isn't loading for me, either.

Here's the downloaders Wiki (http://iviewdownloaders.wikia.com/wiki/ABC_iView_Downloaders_Wiki)- but best to send a PM to Anywho (cap A) who will be able to give you the download URL for that batch downloader for iView.

Would you prefer that it exits to the top-level menu after every set of successful downloads?

Yes, I think it makes it easy to understand. The iView batch downloader also accumulates (batch) shows to download, from different 'Series'. That is very handy, but ...

I find it really hard to get my head around just what is at SBS On Demand. The 'slick' web menus are a real PITA, the categories are incomplete, ... it can take just too long to see what is there, even using the search.

What I am saying is that it may be wise to just make the python script work 'well enough', and improve it slowly. Getting the rtmpdump parameters right is probably a priority.

[mvdk]

Are some videos only stored at lower resolution in OnDemand?

Could be, for all I know... That said, the Carrier is not. Instead, I forgot to multiply the wished-for bitrate by 1000 :o

It should now be working.

Cheers,

Michael

[darian]

Could be, for all I know... That said, the Carrier is not. Instead, I forgot to multiply the wished-for bitrate by 1000 :o

It should now be working.

Thanks for the fix and the original program: seems to be working okay with (1473K).flv now.

Would it be useful me specifying say 3000K, in case there are higher quality versions available?

I should mention that when starting the py file the blank cmd window seems to be doing nothing for a long time and initially I thought it had hung, but eventually the list appears. Might be worth echoing some text at the start to show that it is doing something and not to panic.

[mvdk]

Thanks for the fix and the original program: seems to be working okay with (1473K).flv now.

Would it be useful me specifying say 3000K, in case there are higher quality versions available?

I should mention that when starting the py file the blank cmd window seems to be doing nothing for a long time and initially I thought it had hung, but eventually the list appears. Might be worth echoing some text at the start to show that it is doing something and not to panic.

Sure, you can specify a higher bit rate - it just selects whatever bitrate is numerically closest. I don't think it's likely that SBS will start distributing stuff with a higher bit rate because it probably costs them money to do so, but hey, it will still work...

I have uploaded a new version with a shiny new message stating that it's all OK, and not to panic :)

It's past time to get to bed - good night!

Cheers,

Michael

[Anywho]

Batch downloader v15.84 (http://www.4shared.com/file/750EOTqx/iView_Downloader_v1584.html) at 4shared isn't loading for me, either.


Links are working fine for me :confused: Checked from 3 sources of links and each one downloaded fine this morning (6:12AM).

The first time I tried, I was presented with a "copyright" message (which was kind of odd), but I think that was just fallout from the MegaUpload case. Perhaps you need JS enabled on your browser to see it?

Other than that, you may have tried the download during a server backup/overload/update phase...

[darian]

I have uploaded a new version with a shiny new message stating that it's all OK, and not to panic :)
Thanks.

What is the purpose of SbsOnDemand-0.0.20120222.win32.msi ?

Although you made no mention of it in the previous installation instructions, I installed it anyway as it was in the download folder and seemed important.

Is it likely to change?

[mvdk]

Thanks.

What is the purpose of SbsOnDemand-0.0.20120222.win32.msi ?

Although you made no mention of it in the previous installation instructions, I installed it anyway as it was in the download folder and seemed important.

Is it likely to change?
It's the library I adapted that does the request & parsing of sbs-on-demand. The script is just making the results semi-presentable...

The reason that's a reasonable model is that it makes it more adaptable to being a GUI later on.

Cheers,

Michael

[mvdk]

Just as an aside on the previous post, all of the source is actually available at github.com/mvanderkolff/sbsOnDemand

Feel free to fork it, I'm happy to take code contributions as well.

Cheers,

Michael

[darian]

Hmmm, running sbsOnDemand tonight only populated the list with 10 entries.

Has SBS changed things to thwart your script?

UPDATE: now its back to 85 entries, WTF?

Seems to be a bit flaky in operation: a friend installed it, but the cmd window disappeared after a short time; tried it again and it reported "You haven't specified a port ..Using default port 1935" and then continued and seemed to work.

[mvdk]

Hmmm, running sbsOnDemand tonight only populated the list with 10 entries.

Has SBS changed things to thwart your script?

UPDATE: now its back to 85 entries, WTF?

Seems to be a bit flaky in operation: a friend installed it, but the cmd window disappeared after a short time; tried it again and it reported "You haven't specified a port ..Using default port 1935" and then continued and seemed to work.

As part of retrieving a list of everything, I find what the number of entries are and then retrieve items 1..total number of entries.

10 is the default range - it's possible that it somehow misreported the number of items available.

As for "You haven't specified a port ..Using default port 1935", that would indicate that it's functioning normally - I don't specify a port when using RTMP since there isn't anything to indicate they're using a different port.

Cheers,

Michael

[darian]

sbsOnDemand seems to be working well enough now, at least in grabbing the better quality 1500K versions.

Is there any way to gain access to programs that have disappeared from the list, or does SBS remove them from the website?

I was wondering if someone saved the list from an earlier time, whether it could be used to access programs that are now not available.

I missed out on Carrier Episode 1 (1500K) and a friend only has the quarter sized version.

[mvdk]

Shouldn't think so; the rtmp urls include an authentication token that times out. I'm sorry to be the bearer of bad news.

Cheers,

Michael

[darian]

sbsOnDemand no longer working for me with the latest py file WinXP: cmd window shows the "waiting" message briefly then closes.

[mvdk]

New release at https://github.com/mvanderkolff/sbsOnDemand/downloads

Get the msi & the script dated 20120228a.

Cheers,

Michael

[mvdk]

I have started a (as yet non-working, GUI skeleton not fully dressed) project for a GUI version of my script; it's available at https://github.com/mvanderkolff/gtk-AUTV-Downloader

Feel free to fork and contribute; I will consider all pull requests, and upon request, add you to the "About" screen, and if I make an AUTHORS file, add you to it :)

Cheers,

Michael

[mce]

Below is a link to the sbsNapper beta for SBS OD.

http://users.on.net/~m.elliott/s/sbsNapper_20120304beta.zip

There will be problems, it's a beta, so download and extract the zip into a new fresh directory and run from there.

Make sure you discount that any firewall/AV Suites/etc aren't the issue before posting.

[darian]

Below is a link to the sbsNapper beta for SBS OD.


Looking good so far.

I would like to thank mvdk for getting the ball rolling and providing the first option to download from SBS on-demand.

[gxdata]

Below is a link to the sbsNapper beta for SBS OD.

http://users.on.net/~m.elliott/s/sbsNapper_20120304beta.zip

There will be problems, it's a beta, so download and extract the zip into a new fresh directory and run from there.

Make sure you discount that any firewall/AV Suites/etc aren't the issue before posting.

Unhandled exception with both 'SOS - La Maison' and 'SOS - Toyland' - "The given key was not present in the dictionary" (KeyNotFoundException).

[Edit: next day]
I did check just an hour or so later, and found that these shows had disappeared from the index - perhaps changes had been made before I quit, then re-loaded the application. That is the only way to 'refresh' the index that it works on.

[trainman75]

mvdk: Thanks for the script. Had it working on Win7, now it works well on the Mac, after I resolved a permission problem from rtmpdump install.

[gxdata]

Below is a link to the sbsNapper beta for SBS OD.

http://users.on.net/~m.elliott/s/sbsNapper_20120304beta.zip

There will be problems, it's a beta, so download and extract the zip into a new fresh directory and run from there.

Make sure you discount that any firewall/AV Suites/etc aren't the issue before posting.

It is working very well for me. Good work.:)

One suggestion: perhaps some of the other menus could be accessed - eg, there are many RocKwiz episodes that are retained and available for quite a time before expiry/removal @ On Demand, but the 'recent' or 'current' menu includes only ONE right now.

What do you think?

There is a small number other series that this also applies to.

[mce]

What are the links please?

[gxdata]

Yes, that is the problem.

RocKwiz: http://www.sbs.com.au/ondemand/program/3/RocKwiz]#Programs.children.6.children.4

Hard to locate these from the URLs on the sub-menus. Above is what I get from links on Programs sub-menus, but they do not seem useful. I need to dig into the acutal pages again. I think it is related to the 'children' structures.
Programs.children.6.children.4

Letters and Numbers:
Danger 5:
Danger 5 - The Diamond Girls

Note that on the 'main' menu, there is only 1 Danger 5 show of the 9 available via the 2 sub-menus I am viewing)

There are other long-running series that have many downloadable shows available through On Demand, but not on your 'main' menu.

Dateline:
Insight:
World News Australia:

(more)

[gxdata]

Problems with 4 shows –

100 Places To Remember Ep55 – Tokyo, Japan
Made In Spain With Jose Andres S1 Ep21
Dateline 27-03-2012
Living Black S16 Ep2

(NullReference)

[mce]

New Version 20120328.

Detects Geolocation Blocked URLs.

[gxdata]

New Version 20120328.

Detects Geolocation Blocked URLs.

- and does LOTS more. Excellent.

[gxdata]

It seems that something other than the geolocation blocking is causing a problem for the latest SBSNapper -

These (and other) shows create only a zero-byte file, and then end

Who Do You Think You Are S2 Ep8 - Christine Anu
Who Do You Think You Are S2 Ep 9 - John Butler
Who Do You Think You Are S2 Ep10 - Ron Barassi
Who Do You Think You Are S2 Ep12 - Maggie Beer

- whereas they do play OK at the website.

[mce]

Working on something now.

Looks like they are transitioning from FLV to MP4 files and the RTMPDUMP command line is slightly different for each.

[gxdata]

Working on something now.

Looks like they are transitioning from FLV to MP4 files and the RTMPDUMP command line is slightly different for each.

Interesting ...

[gxdata]

Problem today with any rtmp:// protocol shows (the http:// ones are still downloadable with curl).

[edit]
Worse than that - it looks like a rethink on the parsing is needed.

[mce]

Problem today with any rtmp:// protocol shows (the http:// ones are still downloadable with curl).

[edit]
Worse than that - it looks like a rethink on the parsing is needed.

Yep...

[mce]

A lot tougher than I thought it might be.

[gxdata]

A lot tougher than I thought it might be.

Is a security token needed?

[mce]

Umm, sort of yes.

The url to get a http download is now:

hxxp://sbsauvod-f.akamaihd.net/SBS_Production/managed/2012/03/2219572018%20_,128,512,1000,1500,K.mp4.csmil/bitrate=0?v=2.5.14&fp=WIN%2011,2,202,233&r=QGAJN&g=PNQYTSDEJQSX

Of course its http.

That is for James May's Man Lab S02E07

the r= and g= seem to be the token checking and I havent yet found where that is from.

The other ones I'm assuming are from the player.

[gxdata]

Is that derivable from any of the JSON files? That is, can you find that SMIL file within one?

And rtmp:// - is the trend to all http:// do you think?

(also, we may lose WP as a forum for SBS - as with iView)

[gxdata]

It looks like the r= and g= tokens change with time. I will check this more rigorously, later.

Saying that, I had failures with -

The World's Most Beautiful Sites S2 Ep37 - El Escorial Monastery

--- 2 attempts, same URL (r, g as follows)

'http://sbsauvod-f.akamaihd.net/SBS_Production/managed/2012/04/2222341564_,128,512,1000,1500,K.mp4.csmil/bitrate=2?v=2.5.14&fp=WIN%2011,1,102,55&r=MADHF&g=XDFCPGQCWAKW'

--- a few minutes later, used FF/FG to get URL, tried again

'http://sbsauvod-f.akamaihd.net/SBS_Production/managed/2012/04/2222341564_,128,512,1000,1500,K.mp4.csmil/bitrate=2?v=2.5.14&fp=WIN%2011,1,102,55&r=LNQSO&g=BXINBBBTSGRJ'
---

(that failed, too - unusual, as several downloads using this method with VLC to do the actual download have all worked, albeit very slowly)

[edit]
--- 19/04/2012 @ 7:55 PM WAST
'http://sbsauvod-f.akamaihd.net/SBS_Production/managed/2012/04/2222341564_,128,512,1000,1500,K.mp4.csmil/bitrate=3?v=2.5.14&fp=WIN%2011,1,102,55&r=QUIPW&g=BXINBBBTSGRJ&seek=82.92'
(left off seek when using VLC)
---
Note changed r and g values, again
(bitrate=3 this time)
(downloading now)

[eegee]

Anyone tried using Firefox for the actual downloads?

Now that we've been rudely flung from the akamai world of rtmp streaming to that of adobe http dynamic streaming (and hope that there's a buffering/multi-threading/downloading solution on the horizon), I've finally had a chance this evening to go down the new long-winded downloading path:

- rather than extra addons, just used coojah6 the url sniffer;
- tweaked the bitrate in the video url;
- downloaded with Firefox, saving as .mp4 file;
- had concurrent downloads running in Firefox;
- although the initial file-size is reported as 2GB, it stops without problem once the actual (much shorter) stream finishes;
- remuxed ok with ffmpeg;

[gxdata]

Anyone tried using Firefox for the actual downloads?
<snip>
- downloaded with Firefox, saving as .mp4 file;


That's probably neater/quicker than using FoxGet/DTA and finishing with VLC Media Player. I am finding the VLC streaming download to be very very slow.

I will try a 'download finish' with a standa-alone multi-streaming download manager (using a sniffed URL), if they work.

Did you note the download rate (or, time for XXMb final file size)?

[gxdata]

used coojah6 the url sniffer;


I remember now - the Chinese UI of Coojah 6 installer was so off-putting, when I tried it in October 2010, that I removed it before trying its functionality. The same version (identical checksum on EXE) is still available (no updates). But there is a newer, similar product - MediaBox - last updated in 2012.

So I downloaded MediaBox (same webpage/developer)

But it is not useful for me, though it has English-language buttons etc - because on 64-bit Windows it does not function at all (warning messages, in English) unless the browsers (FireFox, IE9, etc) that it is URL-sniffing are run as Administrator.

Then, the URL has to be changed (ie, the bitrate), and I could not get its accompanying downloader to download the corrected URL that I gave it. Of course, another downloader could be used.

Frankly, I found that FF+FG+DTA, then VLC Media Player to save, was just as simple.

But I will try again with other combinations....

[eegee]

Did you note the download rate (or, time for XXMb final file size)?

Download rates reported by FF (as MB/s) pretty much correspond to video bitrate (~64MB/s for 512K video...factor of 8). Time taken~running time displayed by viewer.

[gxdata]

For those still unable to download easily from SBS On Demand, and who do not follow the SBS DOwnloaders thread on Whirlpool

mce has a new (beta = trial/test) version of his SBSNapper for On Demand.

Check this post at Whirlpool, and a few after that time:

http://forums.whirlpool.net.au/forum-replies.cfm?t=1342590&p=34#r669

[darian]

I'm using the latest September version and noticed that for a 290MB final file size, each of the 5 parts was getting to about 100MB before finishing, although the joined file size was correct. This doesn't sound quite right and seems like some duplication of downloading effort is happening.

Am I missing something here? The previous July version seemed to stop at the correct part size.

Curiously I just downloaded a 546MB file and each part ended at about 110MB, which was correct.

My mistake, with more experimentation it seems that each of the parts reflects percentage completion rather than MB. I was sure it always used to represent MB.

[mce]

As of about 24/09/2012 SBS has switched to using http dynamic streaming recording instead of RTMP.

Until something is worked out, then there will be nothing. :(

[mce]

Version sbsNapper_20121000Experimental.zip.

New HTTP Dynamic Streaming introduced.

http://users.on.net/~m.elliott/s/index.html


Read the read.me in the file. :)

[bcni]

This seems to work quite well on the programs I have tried. It indicates it is downloading at the lowest bit rate but the final file appears to be at the value chosen. Well done mate. Given the lengthy discussion on this new protocol, I was beginning to think it was impossible. Keep up the good work. Much appreciated.

[bcni]

As a follow up, I found that direct viewing of SBS on Demand with the dynamic streaming often caused the video to freeze part way through. It could be restarted from scratch but you then had to find roughly where you were before so that you could continue viewing. After doing this half a dozen times just to watch a program was a real pain. Vive the download - it han't failed yet!

[bcni]

Finally read the Whirlpool Forum and updated the script to show the correct bitrate. Must admit using DOS really strained the grey matter but it worked. Downloaded Mythbusters using cable and Win 7 64 bit in 3 min 20 sec. I don't use the debug switch but everthing seems OK. What does this switch actually do? I'm a bit of a novice so please excuse the question if it is a bit simple.

[mce]

@bnci,

The debug switch dumps a copy of all the files it downloads (and some more) into the temp dir, so people who are having trouble or are just curious or for me when I am debugging the program, can look at what is happening behind the scenes.

[bcni]

Thanks mce. I'm gradually learning.

[mce]

Version sbsNapper_20121007.zip is now available.


Added auth token to download parameters.
Fixed double filename extension bug.
Updated AdobeHDS.php to latest.

[gxdata]

SBS On Demand downloading with the KVS HDS Downloader php script: This is how I understand the happenings since about Friday 5Oct (for the benefit of those who may have come on the scene lately) -

(skipping the need for KSV's php script, etc - others will need to read posts for the past 5 or 6 days)

The authorization requirement has now been lifted (Monday 8/10), but as it was operating in the preceding 48 hours, it had to be re-entered daily. A new code was required each 24 hours, which meant that it first had to be discovered, then 'added' to the php script. KSV discovered the first 'password', and provided it here. mce amended SBSNapper to work with the KSV HDS Downloader php script + this authorization 'password'. Then SBSNapper stopped working again - the 'password' had changed. KSV again discovered the new 'password' - importantly, its location is known, so when it again changes, it can be discovered and SBSNapper made to work again. With mce's SBSNapper + the php script from KSV, the best way was for SBSNapper to 'discover' the new daily authorization password, and 'append' it to the php script before trying a download.

Although now (? temporarily) lifted, the same requirement - a 'password' or authorization - could be very easily re-introduced at random by the operators of the SBS server. (So, it may be s precautionary move for mce to test to the 'auth' token in SBSNapper.)

[mce]

After starting to decode the new HDS stream I've struck the dreaded DRM problem.

KSV Adobe HDS Downloader

Processing manifest info....
Quality Selection:
Available: 1490 1059 361 165
Selected : 1490
This stream is encrypted with Akamai DRM. Decryption of such streams isn't currently possible with this script.

So I'll probably have to not show valid bitrates for these episodes. :(

[CristianoA]

After starting to decode the new HDS stream I've struck the dreaded DRM problem.



So I'll probably have to not show valid bitrates for these episodes. :(

try use GetFLV in iPad mode

[mce]

I regret to inform you all that I will not be maintaining any Nappers projects from this day on.

Downloads will still be available for the foreseeable future on http://www.nappers.net.

It is time to pass the mantle onto the next generation of coders for these types of programs.

Thanks for all the feedback and help over the 5 or so years, as without you the users of the Nappers, these projects would not have been possible.

Cheers all.

[gxdata]

The March 2014 version of SBSNapper isn't working at present (I just tried, after an absence of some weeks during which I hadn't tried to download).

As pointed out on the iView thread on this board, it's a possibility to decompile mce's executable, but much simpler if mce could make the code available.

I would be willing to make the upgrades - eg, the buffer for the catalogue encoding that the March 2014 version of SBSNapper handles has been exceeded in the last weeks (I haven't tried since late August), so an increase in that buffer value in code would allow the SBSNapper to handle today's available load.

[Calvin1961]

Hi Western Wombat,

I've been using SBS Napper all along, and all was well until about 3 days ago.

Looks like the SBS on-demand catalogue has gotten too large and has outstripped SBS Nappers allocated JSON buffer size again. I'm a little surprised that considering SBS on-demand has been growing like crazy in the last year that mce was a bit more conservative in his design and "over-engineered" the buffers to anticipate continued growth :-(

Hopefully this problem can be solved, it is a VERY useful tool :-)

Calvin.

[gxdata]

For those who do not check the Whirlpool thread on SBS downloaders (where there is a much more active discussion of the SBS downloaders, currently only SBSNapper), the Napper website has a new download available today.

[getuper]

I use Avdshare Video Downloader to download videos from sbs on demand
or other video sharing websites.