www.sbs.com.au- Download RTMP video from Australian TV web-site

www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Working RTMP downloaders for SBS Online:

• sbsNapper by MCE (Freeware / Windows)
  
• SBS Downloader Windows (command line) by elfst0ne (Freeware / Windows) port of lightguard's script
  
• SBS Downloader (GUI) by Anywho (Freeware / Linux)

Broken downloaders:

• SBS Downloader OSX (Bash Script) (Freeware / Mac OS X)
  
• ShowGrabberAU by lightguard (Freeware / Windows)

See also:
FAQ: How to record/download/capture/save Adobe Flash .FLV video RTMP stream from embedded player
How to record rtmp:// flash video .flv stream from embedded Adobe Flash Player

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

I've been using Replay Media Catcher and WM Recorder for downloading SVS video streams successfully. But I need a downloader for Linux as well. Where can I download the SBS Downloader for Linux?

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

sbsNapper_20110722 error "Cannot open Channel 94 Too many automatic redirections were attempted" :confused:

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

You can download it from here. Note that it is currently broken. mvdk apparently has a fix, but hasn't posted it yet :(

If I get some more time in the next couple of weeks, I'll bash it up and see if I can convince the code to work. :eek:

(Also have to wait for SBS to get more reliable at the moment :mad: )

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

You may need to send a private message to mce, to see if he has any ideas on how to fix the SBS Napper.

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

FTR, everything returned to normal about 36-48h ago. (I have) no explanation why browsing to the important URLs worked, but SBSNapper could not connect. :confused:

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

SBS has increased its bitrate and number of streaming options (at different bitrates / quality), from 3 to sometimes 4.

eg, 'Trafficked' is available in (nominal bitrate) 128K, 300K, 1000K
(see hxxp://player.sbs.com.au/video/smil/index/standalone/346597)
and 'The Bombing Of Germany Full Ep' is available in 128K, 512K, 1000K, 1500K.
(see hxxp://player.sbs.com.au/video/smil/index/standalone/515791)

I discovered this while poking around, when SBSNapper was not connecting well over the last 3 days. I reverted to batch downloading (using a very ad hoc method), and this involved looking at various XML files with a browser.

Also, I noticed that some shows were very large for the time duration - due to a bigger bitrate for the video. The audio bitrate doesn't contribute much file size.

MediaInfo (hhtp://mediainfo.sourceforge.net/) is useful to see bitrate for both the video and the audio, once a show is downloaded.

afaik, unfortunately, RTMPdump displays the duration, audio and video bitrates etc - but cannot feed the info back to the calling program (eg, SBSNapper or other downloaders).

SBSNapper has 3 buttons for different bitrates, which is quite useful.

I have been experimenting with some code that reads the show's XML file (eg, 515791 for 'The Bombing Of Germany '), and displays the correct number of buttons with the nominal bitrate displayed as the button text. Not a very useful function, but it amused me for an hour or so. :)

The last few days has made me contemplate whether SBS may change their streaming system quite drastically, sometime soon. That will be more fun!

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Mate, you are way behind the times :D
hxxp://forums.whirlpool.net.au/forum-replies.cfm?t=1342590&p=17#r333

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Yeh, I'm always a bit slooow :D

The video bitrate (MediaInfo) is up to 2000Kbps on some of these.

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Yeah, I've noticed similar too (over 3Mbps).

It's good that they've increased potential bit rates. It always annoys me seeing scenes that have oceans or smoke portrayed as checker-board patterns, or fast moving objects that jitter around the screen.

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Fooled by a human error again, I think:
In testing my auto-adapting buttons for downloads at different bitrates, I found that an episode of 'The Phone' (ep 21 - hxxp://player.sbs.com.au/video/smil/index/standalone/516113) has 8 entries in its XML file for the bitrates available!

They have doubled up on the 4 of them! (128,512,1000,1500)
I wonder how this affects the SBS Player?

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Much more at the On Demand website than the old SBS Player, now - many of the series are not going up on the Player, so these downloaders will become obsolete quite soon.

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

What shows are available on "On Demand" that are not available on which SBS player (there's more than one remember - eg: Linux :cool:)?

SBSnapper certainly doesn't show them all, but that's because it only scrapes the "Latest Episodes" page.

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

I think the On Demand and Player are quite separate, driven by different streaming server systems.

For instance, 'The Protectors Ep10' - which expires in 2 days - is not playable on SBS Player but is OK from the On Demand server.

The XML file for this show is actually empty!

Check out these URLs if you can do so within the next 48 hours or less:

SBS Player
_http://player.sbs.com.au/programs#/programs_08/fullepisodes/latestepisodes/playlist/

Playlist at '94':
_http://player.sbs.com.au/video/playlist/index/standalone/94/

Empty Show file at '519742':
_http://player.sbs.com.au/video/smil/index/standalone/519742

This show at the SBS Player:
_http://player.sbs.com.au/programs#/programs_08/fullepisodes/latestepisodes/playlist/The-Protectors-Ep-10/

SBS On Demand

_http://www.sbs.com.au/ondemand/

This show at On Demand
_http://www.sbs.com.au/ondemand/video/13539440/The-Protectors-Ep-10

I have had a quick look within the html file, but can't decipher the control files. The html files at On Demand are incredibly bloated.

StreamTransport will download these shows, but I will have to have a good look with Charles or Fiddler to see what is going on.

A friend recommended a downloader called DownloadStudio - perhaps it can elucidate.

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

I have written some code (Windows .NET) that looks at different channels, but I think the difference between Player and On Demand is more fundamental.

What can you see with the Linux downloader, that SBSNapper cannot see?

On Demand has up to Ep288 of 'Letters and Numbers', whereas SBS Player has to Ep283 only - other examples, take a look.

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

All the stuff you see with the SBS player (and some other stuff that goes back to last November - which is kind of strange).

I've noticed the "News & Current Affairs" section is not showing in the downloader. But I wanted other examples so I can track down what's missing and why, then formulate some way of getting it working. Mainly because, as you've found out, the "ondemand" system is so badly bloated and getting something that works with the "ondemand" method is a PITA.

On a side note, curiously "Internet Download Manager" (v6.07) is currently able to capture the link when you navigate to the video page and will download the videos - and even uses threaded downloading. I'm currently downloading "The Protectors" right now and it is using 4 connections to do it!

[edit: Screencap ]

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Here's an example of the difference between SBSnapper and the SBS_Linux_Downloader...

Letters and Numbers Eps

Menu List

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Internet Download Manager (IDM) is a really great tool, at SBS On Demand. Thx, Anywho - I should have tried it yonks ago.

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Hello,

I downloaded a documentary using SBSnapper, the output file was flash video *.flv.

Which my current media player - a WD TV (1st Gen) Media Player running B-Rad's WDLXTV firmware, will not play.

Is there a transform that I could run to convert the *.flv to a *.mp4 (for instance) with no loss of visual or auditory quality?

Any assistance most gratefully apprised, thank you.

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

There have been 2 or 3 (maybe more) shows that are not in rtmpdump -downloadable form.

They appear to be http:// downloads - how do I do that easily, and know when the show has completed download?

Kung Fu Kitchen Ep 2 - Mochi - Japan (aired: 24/01)
How To Survive A Disaster Full Ep

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Try CURL or WGET. They'll handle http:// links - just like a regular download ;)

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

This is possible using ffmpeg. Someone gave me the correct parametrs to do this for a format OK for an iPad, but I' not sure what you would need for your particular Media Player.

Could you download and install MediaInfo from here -
http://mediainfo.sourceforge.net/en/Download/Windows
then in Windows Explorer, right-click on a MP4 file that works on your Media Player, and take a look at the information?

The MediaInfo output (exported from MediaInfo in Text format) for an SBS .FLV show that I just DL @ 128K for your benefit is as follows -

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

So what's the URL I give to them? The same one fed into rtmpdump I guess.
Maybe I should dump a batch file with curl syntax + the URL, when an HTTP -type address is detected rather than the expected rtmp://

[Edit]
Things change in a day. Now there are TWO entries for 'How to Survive a Disaster', both rtmp:// not http://

But I see that the XML control file (557485.XML) for the 'Kung Fu Kitchen Ep 2 - Mochi - Japan' show gives me a base address that I can't use: "E"

<meta base="E"/>

Any ideas? Anywho? Anyone?

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

KFK_Ep2... Doesn't show on the SBS website... "E" = "Expired" perhaps?

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

"E" is the folder name:
But seems they have removed video!!:D

i don't know exactly what are looking for!! Do you wanna dl that stream?
Feed URL:

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Thanks for the reply, Bahman

How do you discover that folder name? or, was that just an example, and the URL that I am after is:
I have no problems with the other video - I was just remarking that there are TWO entries for it today, with different addresses -
557223 and 557639

A day before, there was just ONE menu entry, and it had an http:// address (ie, the <meta base> tag had rtmp://).

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

I used IDM, and detects the download link automatically!! So, I understood that "E" is folder name of this video!!:)
Also I used Wireshark in order to see if there is another link or not(because That link is "not found"), after that I click on play, but I got the same url and , I didn't have any send/receive packets after server sent the url path!!

Perhaps, they have changed their streaming system from rtmp to http!!:)

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

3 shows now with HTTP protocol -

One Man And His Campervan Ep 7 - Trossachs
Modern Slavery Ep 2
Love At First Hiccup

SBSNapper won't download these.

They have entries like <meta base="E"/>

Does anyone have ideas about how to download these? Adam M-W ?

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Trying to figure this weird base thing out.

If it has D or E in the base tag, is the file actually available for download at all?

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

D, E, M are base that I have seen.
But then, almost as I watch, they put up another menu / catalog item for one of those "HTTP" shows, that is a regular rtmp:// protocol address.

As of now (midday Sat 4Feb) I think all of those 3 are available as regular downloads.

What is more disturbing is that I can't browse (IE, Opera) to the SBS Player: it redirects to On Demand. Ominous?

Have you had a look at Adam M-W's python scripts for handling On Demand catalogs, menus? I'm not progressing far with understanding how to use the information.

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

A new version 20120205 is available on the website.

• Fix for illegal characters in output filename.
• Debug mode controlled by existance of 'sbsNapper.debug' in directory.
• Debug command line file now named after episode title.

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

The maintainers of SBS Player are getting even more lax.

In the past few days, 5 separate shows have been entered in the index/catalog in both rtmp:// and http:// modes (separate entries, separate XML files).

Tonight, one movie - "The French Kissers" - has 1 x rtmp:// and 2 x http:// entries in the menu.

You can see this in SBSNapper. But you won't be able to tell which are http:// protocol.

(mce - it may be useful to tag those that appear as http:// protocol - or filter them out? They don't seem to be downloadable, anyway - not that I try to, any more).

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Yeah I'll look into it, it shouldn't be that hard.

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

There are numerous "HTTP" shows now.

Stream Transport will capture them, from OnDemand website, but it is very slow to download a show that way, compared with using rtmpdump.exe

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Channel 94 Index/catalog is blank now @ 2012-02-22_1640 AEDST

~ 4hrs later, it has reappeared.

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Dear chaps,

I have made a python script that gets its stuff from sbs-on-demand instead of channel 94. It builds on others' work, notably adammw & others. It is available for windows at https://github.com/mvanderkolff/sbsOnDemand/downloads

You must install python 2.7 from python.org first, and put rtmpdump.exe in the same folder as the script.

Please feel free to offer any feedback; the script is more meant as a demonstrator for the library than anything. Please let me know if there are any bugs, any additional features, etc. Feel free to fork - I'm happy to merge stuff that others offer via a pull request.

Hoping that you have a pleasant evening,

Michael

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

mvdk
Thanks - it is working fine, within the limitations of the text menu display.

It would be nice to add resume into the rtmpdump command. Oh, did not check the py code any further, but the default bitrate for the download seems to be the max - 1500Kbps. I' already wanting the options in mce's SBSNapper - some shows are not worth the wasted bandwidth.

Mad Men Ep11 halts at 1.6% or so; auto-resume might help to get it all downloaded eventually.

(Incidentally, I never did see MM 11 and 12 at the SBS Player website.)

It seems the On Demand structure is successfully unpicked, from the few I have checked so far. :)

Last update of the SBS Player folder structures (Ch94, etc) seems to have been 3 days ago. Total shows loaded (incl the ?http ones with "D", "E", "M") has dropped from 126 to 96.

Do we regard it as officially abandoned, now - so SBSNapper and other downloaders will be redundant in a few days? :mad:


[Edit]
I will substitute rtmpdump v2.4 for Windows for the 2.2d version.

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Reason I just grabbed the largest was because it was the easiest thing to do - it didn't involve checking for a bit rate. I suppose I could implement a "-1" option, meaning "allow me to set the preferred bit rate, please..."

I agree that the text interface is not friendly - I implemented a text interface because it was fast to do, provides a service quickly, and provides me with quick feedback.

Cheers,

Michael

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Grateful that you implemented it.

I don't know the *nix commandline downloaders (SBS, iView) but the Windows batch downloader for iView has some nice features to guard against wrong entries (I keep forgetting to key in 0 = Go Back for your py script, and put in a Series number like 68 when the allowable values might be only 0,1,2).
Would you mind taking a look (not at the batch code, more its behaviour)? See the iView thread here, and the batch downloader by Anywho et al.

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

It's a 51 page thread, and the only entries I could find all had 4shared.com links that are dead :(. That said, it does allow you to select more than one item out of a category by saying, e.g. "48) Letters and Numbers" and then typing "15 16" to select both of them out of that list.

Would you prefer that it exits to the top-level menu after every set of successful downloads?

Cheers,

Michael

BTW: Latest version on github allows you to select bitrate.