www.sbs.com.au- Download RTMP video from Australian TV web-site

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Just tried the Python OnDemand downloader.

Although it works when selecting Carrier Ep3, the resulting file is Carrier Ep3 (128K).flv and is only 400x224 no matter what I set in the bitrate field.

Are some videos only stored at lower resolution in OnDemand?

Could not get the old sbsnapper to work on this item at all.

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Batch downloader v15.84 at 4shared isn't loading for me, either.

Here's the downloaders Wiki - but best to send a PM to Anywho (cap A) who will be able to give you the download URL for that batch downloader for iView.

Yes, I think it makes it easy to understand. The iView batch downloader also accumulates (batch) shows to download, from different 'Series'. That is very handy, but ...

I find it really hard to get my head around just what is at SBS On Demand. The 'slick' web menus are a real PITA, the categories are incomplete, ... it can take just too long to see what is there, even using the search.

What I am saying is that it may be wise to just make the python script work 'well enough', and improve it slowly. Getting the rtmpdump parameters right is probably a priority.

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Could be, for all I know... That said, the Carrier is not. Instead, I forgot to multiply the wished-for bitrate by 1000 :o

It should now be working.

Cheers,

Michael

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Thanks for the fix and the original program: seems to be working okay with (1473K).flv now.

Would it be useful me specifying say 3000K, in case there are higher quality versions available?

I should mention that when starting the py file the blank cmd window seems to be doing nothing for a long time and initially I thought it had hung, but eventually the list appears. Might be worth echoing some text at the start to show that it is doing something and not to panic.

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Sure, you can specify a higher bit rate - it just selects whatever bitrate is numerically closest. I don't think it's likely that SBS will start distributing stuff with a higher bit rate because it probably costs them money to do so, but hey, it will still work...

I have uploaded a new version with a shiny new message stating that it's all OK, and not to panic :)

It's past time to get to bed - good night!

Cheers,

Michael

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Links are working fine for me :confused: Checked from 3 sources of links and each one downloaded fine this morning (6:12AM).

The first time I tried, I was presented with a "copyright" message (which was kind of odd), but I think that was just fallout from the MegaUpload case. Perhaps you need JS enabled on your browser to see it?

Other than that, you may have tried the download during a server backup/overload/update phase...

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Thanks.

What is the purpose of SbsOnDemand-0.0.20120222.win32.msi ?

Although you made no mention of it in the previous installation instructions, I installed it anyway as it was in the download folder and seemed important.

Is it likely to change?

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

It's the library I adapted that does the request & parsing of sbs-on-demand. The script is just making the results semi-presentable...

The reason that's a reasonable model is that it makes it more adaptable to being a GUI later on.

Cheers,

Michael

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Just as an aside on the previous post, all of the source is actually available at github.com/mvanderkolff/sbsOnDemand

Feel free to fork it, I'm happy to take code contributions as well.

Cheers,

Michael

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Hmmm, running sbsOnDemand tonight only populated the list with 10 entries.

Has SBS changed things to thwart your script?

UPDATE: now its back to 85 entries, WTF?

Seems to be a bit flaky in operation: a friend installed it, but the cmd window disappeared after a short time; tried it again and it reported "You haven't specified a port ..Using default port 1935" and then continued and seemed to work.

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

As part of retrieving a list of everything, I find what the number of entries are and then retrieve items 1..total number of entries.

10 is the default range - it's possible that it somehow misreported the number of items available.

As for "You haven't specified a port ..Using default port 1935", that would indicate that it's functioning normally - I don't specify a port when using RTMP since there isn't anything to indicate they're using a different port.

Cheers,

Michael

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

sbsOnDemand seems to be working well enough now, at least in grabbing the better quality 1500K versions.

Is there any way to gain access to programs that have disappeared from the list, or does SBS remove them from the website?

I was wondering if someone saved the list from an earlier time, whether it could be used to access programs that are now not available.

I missed out on Carrier Episode 1 (1500K) and a friend only has the quarter sized version.

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Shouldn't think so; the rtmp urls include an authentication token that times out. I'm sorry to be the bearer of bad news.

Cheers,

Michael

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

sbsOnDemand no longer working for me with the latest py file WinXP: cmd window shows the "waiting" message briefly then closes.

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

New release at https://github.com/mvanderkolff/sbsOnDemand/downloads

Get the msi & the script dated 20120228a.

Cheers,

Michael

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

I have started a (as yet non-working, GUI skeleton not fully dressed) project for a GUI version of my script; it's available at https://github.com/mvanderkolff/gtk-AUTV-Downloader

Feel free to fork and contribute; I will consider all pull requests, and upon request, add you to the "About" screen, and if I make an AUTHORS file, add you to it :)

Cheers,

Michael

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Below is a link to the sbsNapper beta for SBS OD.

http://users.on.net/~m.elliott/s/sbs...120304beta.zip

There will be problems, it's a beta, so download and extract the zip into a new fresh directory and run from there.

Make sure you discount that any firewall/AV Suites/etc aren't the issue before posting.

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Looking good so far.

I would like to thank mvdk for getting the ball rolling and providing the first option to download from SBS on-demand.

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Unhandled exception with both 'SOS - La Maison' and 'SOS - Toyland' - "The given key was not present in the dictionary" (KeyNotFoundException).

[Edit: next day]
I did check just an hour or so later, and found that these shows had disappeared from the index - perhaps changes had been made before I quit, then re-loaded the application. That is the only way to 'refresh' the index that it works on.

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

mvdk: Thanks for the script. Had it working on Win7, now it works well on the Mac, after I resolved a permission problem from rtmpdump install.

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

It is working very well for me. Good work.:)

One suggestion: perhaps some of the other menus could be accessed - eg, there are many RocKwiz episodes that are retained and available for quite a time before expiry/removal @ On Demand, but the 'recent' or 'current' menu includes only ONE right now.

What do you think?

There is a small number other series that this also applies to.

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

What are the links please?

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Yes, that is the problem.

RocKwiz: http://www.sbs.com.au/ondemand/progr...n.6.children.4

Hard to locate these from the URLs on the sub-menus. Above is what I get from links on Programs sub-menus, but they do not seem useful. I need to dig into the acutal pages again. I think it is related to the 'children' structures.
Programs.children.6.children.4

Letters and Numbers:
Danger 5:
Danger 5 - The Diamond Girls

Note that on the 'main' menu, there is only 1 Danger 5 show of the 9 available via the 2 sub-menus I am viewing)

There are other long-running series that have many downloadable shows available through On Demand, but not on your 'main' menu.

Dateline:
Insight:
World News Australia:

(more)

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Problems with 4 shows –

100 Places To Remember Ep55 – Tokyo, Japan
Made In Spain With Jose Andres S1 Ep21
Dateline 27-03-2012
Living Black S16 Ep2

(NullReference)

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

New Version 20120328.

• Detects Geolocation Blocked URLs.

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

- and does LOTS more. Excellent.

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

It seems that something other than the geolocation blocking is causing a problem for the latest SBSNapper -

These (and other) shows create only a zero-byte file, and then end

Who Do You Think You Are S2 Ep8 - Christine Anu
Who Do You Think You Are S2 Ep 9 - John Butler
Who Do You Think You Are S2 Ep10 - Ron Barassi
Who Do You Think You Are S2 Ep12 - Maggie Beer

- whereas they do play OK at the website.

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Working on something now.

Looks like they are transitioning from FLV to MP4 files and the RTMPDUMP command line is slightly different for each.

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Interesting ...

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Problem today with any rtmp:// protocol shows (the http:// ones are still downloadable with curl).

[edit]
Worse than that - it looks like a rethink on the parsing is needed.

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Yep...

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

A lot tougher than I thought it might be.

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Is a security token needed?

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Umm, sort of yes.

The url to get a http download is now:

Of course its http.

That is for James May's Man Lab S02E07

the r= and g= seem to be the token checking and I havent yet found where that is from.

The other ones I'm assuming are from the player.

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Is that derivable from any of the JSON files? That is, can you find that SMIL file within one?

And rtmp:// - is the trend to all http:// do you think?

(also, we may lose WP as a forum for SBS - as with iView)

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

It looks like the r= and g= tokens change with time. I will check this more rigorously, later.

Saying that, I had failures with -

The World's Most Beautiful Sites S2 Ep37 - El Escorial Monastery

--- 2 attempts, same URL (r, g as follows)

'http://sbsauvod-f.akamaihd.net/SBS_Production/managed/2012/04/2222341564_,128,512,1000,1500,K.mp4.csmil/bitrate=2?v=2.5.14&fp=WIN%2011,1,102,55&r=MADHF&g= XDFCPGQCWAKW'

--- a few minutes later, used FF/FG to get URL, tried again

'http://sbsauvod-f.akamaihd.net/SBS_Production/managed/2012/04/2222341564_,128,512,1000,1500,K.mp4.csmil/bitrate=2?v=2.5.14&fp=WIN%2011,1,102,55&r=LNQSO&g= BXINBBBTSGRJ'
---

(that failed, too - unusual, as several downloads using this method with VLC to do the actual download have all worked, albeit very slowly)

[edit]
--- 19/04/2012 @ 7:55 PM WAST
'http://sbsauvod-f.akamaihd.net/SBS_Production/managed/2012/04/2222341564_,128,512,1000,1500,K.mp4.csmil/bitrate=3?v=2.5.14&fp=WIN%2011,1,102,55&r=QUIPW&g= BXINBBBTSGRJ&seek=82.92'
(left off seek when using VLC)
---
Note changed r and g values, again
(bitrate=3 this time)
(downloading now)

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Anyone tried using Firefox for the actual downloads?

Now that we've been rudely flung from the akamai world of rtmp streaming to that of adobe http dynamic streaming (and hope that there's a buffering/multi-threading/downloading solution on the horizon), I've finally had a chance this evening to go down the new long-winded downloading path:

- rather than extra addons, just used coojah6 the url sniffer;
- tweaked the bitrate in the video url;
- downloaded with Firefox, saving as .mp4 file;
- had concurrent downloads running in Firefox;
- although the initial file-size is reported as 2GB, it stops without problem once the actual (much shorter) stream finishes;
- remuxed ok with ffmpeg;

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

That's probably neater/quicker than using FoxGet/DTA and finishing with VLC Media Player. I am finding the VLC streaming download to be very very slow.

I will try a 'download finish' with a standa-alone multi-streaming download manager (using a sniffed URL), if they work.

Did you note the download rate (or, time for XXMb final file size)?

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

I remember now - the Chinese UI of Coojah 6 installer was so off-putting, when I tried it in October 2010, that I removed it before trying its functionality. The same version (identical checksum on EXE) is still available (no updates). But there is a newer, similar product - MediaBox - last updated in 2012.

So I downloaded MediaBox (same webpage/developer)

But it is not useful for me, though it has English-language buttons etc - because on 64-bit Windows it does not function at all (warning messages, in English) unless the browsers (FireFox, IE9, etc) that it is URL-sniffing are run as Administrator.

Then, the URL has to be changed (ie, the bitrate), and I could not get its accompanying downloader to download the corrected URL that I gave it. Of course, another downloader could be used.

Frankly, I found that FF+FG+DTA, then VLC Media Player to save, was just as simple.

But I will try again with other combinations....

Re: www.sbs.com.au- Download RTMP video from Australian TV web-site

 

Download rates reported by FF (as MB/s) pretty much correspond to video bitrate (~64MB/s for 512K video...factor of 8). Time taken~running time displayed by viewer.