Trying to Download VoD from CBC Sports / CBC Olympics for Rio 2016

Impulse1234 · #1 08-04-2016, 01:16 AM

I've been trying for months to figure out how to download videos from the CBC sports website, to no avail; in particular, that of the upcoming Rio Olympics. I prefer having them downloaded and able to watch at any time instead of having to use slow bandwidth / phone data to stream them, but I've had zero luck being able to download anything off of there in good shape.

Example of something I want to download (first round of women's soccer, Canada vs. Australia): http://olympics.cbc.ca/video/vod/soc...d-can-aus.html.

If someone knows how to do this, you would be my saviour!

I read through a couple of threads to pull something like this from Adblock Plus (http://dvr-i.rio2016.cbc.ca/dvr/9c8f...nglishnumeris), but I have no clue how to proceed afterwards, so some guidance would be really well appreciated.

ehurdler · #2 08-04-2016, 08:50 AM

I am in the US, so I am not sure if this will be the same for you or not. I have nbcolympics.com, so if you have access to use that instead this will work 100%. The Canada vs. Australia game is there in full replay.

http://stream.nbcolympics.com/womens-soccer-match-2

To capture the video you will need the HDS Link Detector installed in Firefox. Just search for how to do this, install it, configure if you don’t have it already. I don’t remember the process off the top of my head. Make sure you have the updated AdobeHDS.php, set and configured properly too. Again, search for this if you don’t have it already. I am using a Macintosh, not that it makes a difference but telling you my process.

With everything installed and configured, make sure the HDS Link detector add-on is enabled. Now navigate to the game in question. Once the game starts playing you will see the add-on show the banner showing the video fragment link it captures. With this link you can capture the video fragments for this full video, and also the audio fragments for the full audio. The fragments will have to be merged together as well as the video and the audio into one full video. Those processes are rather quick and seamless.

So once the add-on gives you a link, you can modify the link and download the fragments you need and merge them together.

This is an example of the code you will need for this

Code:

Video:

php AdobeHDS.php --quality 7000 --manifest "" --delete


Audio:

php AdobeHDS.php --quality 56 --manifest "" --delete


Join: 

ffmpeg -i video.flv -i audio.flv -c copy joined.mp4

Example, Given this link from the add-on:

Code:

php AdobeHDS.php --manifest "http://olystreameast.nbcolympics.com/vod/690c26d3-280d-4d17-9d86-4ef9e406480f/nbc-olympics0803094426.ism/manifest(format=f4m-f4f,filtername=vodcut).f4m?token=st=1470317712~exp=1470317832~acl=/vod/690c26d3-280d-4d17-9d86-4ef9e406480f/nbc-olympics0803094426.ism/*~hmac=ee008b15c134623c079477ea82ebbc6bd9ef5a56e3b75d0c134162d2f37f8a30" --delete

With that link, if you take the url between the “”’s and place it within the code strings I posted above it will start capturing the video fragments, then the audio fragments in Terminal (for me since I am using a Macintosh) or a cmd prompt if you are using Windows. The link above will expire in a minute or so. So I always capture the video fragments first. This will download all the video fragments, then it will put them all together with no user interaction into a .flv file. Then I reload the soccer match in the browser to capture a new link in the add-on and paste that within the code string Above. This will as well capture all the audio fragments and put them together. All you will have to do is the last line of code I gave you to Join them with ffmpeg. Will create a video with audio into an .mp4. That will give you the highest video and audio quality possible through the nbcolympics website. You can change the video quality if you would like, but you’ll have to run the -debug script on the add-on link that is captured:

Code:

php AdobeHDS.php --manifest "http://olystreameast.nbcolympics.com/vod/690c26d3-280d-4d17-9d86-4ef9e406480f/nbc-olympics0803094426.ism/manifest(format=f4m-f4f,filtername=vodcut).f4m?token=st=1470317712~exp=1470317832~acl=/vod/690c26d3-280d-4d17-9d86-4ef9e406480f/nbc-olympics0803094426.ism/*~hmac=ee008b15c134623c079477ea82ebbc6bd9ef5a56e3b75d0c134162d2f37f8a30" -debug

That will give you a whole bunch of info that will just keep scrolling. So let it run and you are looking for the info at the top. So after a few seconds stop the debug script. You want to capture Fragments, not Keyframes.

Code:

Bitrate URL
 7001    QualityLevels(7000000)/Keyframes(video,format=f4m-f4f)
 7000    QualityLevels(7000000)/Fragments(video,format=f4m-f4f)
 4001    QualityLevels(4000000)/Keyframes(video,format=f4m-f4f)
 4000    QualityLevels(4000000)/Fragments(video,format=f4m-f4f)
 2201    QualityLevels(2200000)/Keyframes(video,format=f4m-f4f)
 2200    QualityLevels(2200000)/Fragments(video,format=f4m-f4f)
 1401    QualityLevels(1400000)/Keyframes(video,format=f4m-f4f)
 1400    QualityLevels(1400000)/Fragments(video,format=f4m-f4f)
 901     QualityLevels(900000)/Keyframes(video,format=f4m-f4f)
 900     QualityLevels(900000)/Fragments(video,format=f4m-f4f)
 601     QualityLevels(600000)/Keyframes(video,format=f4m-f4f)
 600     QualityLevels(600000)/Fragments(video,format=f4m-f4f)
 301     QualityLevels(300000)/Keyframes(video,format=f4m-f4f)
 300     QualityLevels(300000)/Fragments(video,format=f4m-f4f)
 56      QualityLevels(56000)/Fragments(audio_en_0,format=f4m-f4f)

Sorry if this is long winded, I just wrote this out quickly with what I do, so if it is too much detail that is why. Any questions let me know. Good luck, maybe this will also work for the CBC site.

mtepper27 · #3 08-04-2016, 05:21 PM

Thank you, that works perfectly!!! I have been searching for help on this for a while.

Would you happen to know how to download WatchESPN streams?

KSV's AdobeHDS Link Detector doesn't detect any links from ESPN streams

Any help would be greatly appreciated.

BusterAvis · #4 08-04-2016, 06:55 PM

Where do you type these 3 codes in?
Command prompt? And if so, where in command prompt?
What folder?

I'm used to using Livestreamer and FFmpeg, both in command prompt.
Never used AdobeHDS before. Thanks.
I'm pretty sure I have some sort of AdobeHDS, because I was able to successfully add the HDS Link Detector "add-on" to Firefox a few minutes ago, and it sniffed out this code:

php AdobeHDS.php --manifest "http://olystreameast.nbcolympics.com/vod/690c26d3-280d-4d17-9d86-4ef9e406480f/nbc-olympics0803094426.ism/manifest(format=f4m-f4f,filtername=vodcut).f4m?token=st=1470355147~exp =1470355267~acl=/vod/690c26d3-280d-4d17-9d86-4ef9e406480f/nbc-olympics0803094426.ism/*~hmac=640871a65a4ccb7fa5f588156d061d7dd2d9f2604b4 dc2b433f73481f32bbb07" --delete

Here are the 3 codes from the first example box above that I'm confused about ............

Video:
php AdobeHDS.php --quality 7000 --manifest "" --delete

Audio:
php AdobeHDS.php --quality 56 --manifest "" --delete

Join:
ffmpeg -i video.flv -i audio.flv -c copy joined.mp4

BusterAvis · #5 08-04-2016, 07:38 PM

I might be on to something.
I found something from a YouTube video:
https://www.youtube.com/watch?v=6DXZHYRqM5A

When trying to grab the manifest code from this NBC Olympics link referenced above:
http://stream.nbcolympics.com/womens-soccer-match-2

I downloaded Grab Any Media for AdobeHDS helper from that YouTube link.
I just don't know the exact code I need to paste into the top left of the image below where you put in the Manifest or Fragment code. Nothing seems to work. I keep trying all the codes I can grab, and I try to click on "Start" in the right (as circled in red) in the image below, but it won't do anything.

Impulse1234 · #6 08-04-2016, 08:37 PM

Quote:

Originally Posted by ehurdler

I am in the US, so I am not sure if this will be the same for you or not. I have nbcolympics.com, so if you have access to use that instead this will work 100%. The Canada vs. Australia game is there in full replay.

http://stream.nbcolympics.com/womens-soccer-match-2

To capture the video you will need the HDS Link Detector installed in Firefox. Just search for how to do this, install it, configure if you don’t have it already. I don’t remember the process off the top of my head. Make sure you have the updated AdobeHDS.php, set and configured properly too. Again, search for this if you don’t have it already. I am using a Macintosh, not that it makes a difference but telling you my process.

With everything installed and configured, make sure the HDS Link detector add-on is enabled. Now navigate to the game in question. Once the game starts playing you will see the add-on show the banner showing the video fragment link it captures. With this link you can capture the video fragments for this full video, and also the audio fragments for the full audio. The fragments will have to be merged together as well as the video and the audio into one full video. Those processes are rather quick and seamless.

So once the add-on gives you a link, you can modify the link and download the fragments you need and merge them together.

This is an example of the code you will need for this

Code:

Video:

php AdobeHDS.php --quality 7000 --manifest "" --delete


Audio:

php AdobeHDS.php --quality 56 --manifest "" --delete


Join: 

ffmpeg -i video.flv -i audio.flv -c copy joined.mp4

Example, Given this link from the add-on:

Code:

php AdobeHDS.php --manifest "http://olystreameast.nbcolympics.com/vod/690c26d3-280d-4d17-9d86-4ef9e406480f/nbc-olympics0803094426.ism/manifest(format=f4m-f4f,filtername=vodcut).f4m?token=st=1470317712~exp=1470317832~acl=/vod/690c26d3-280d-4d17-9d86-4ef9e406480f/nbc-olympics0803094426.ism/*~hmac=ee008b15c134623c079477ea82ebbc6bd9ef5a56e3b75d0c134162d2f37f8a30" --delete

With that link, if you take the url between the “”’s and place it within the code strings I posted above it will start capturing the video fragments, then the audio fragments in Terminal (for me since I am using a Macintosh) or a cmd prompt if you are using Windows. The link above will expire in a minute or so. So I always capture the video fragments first. This will download all the video fragments, then it will put them all together with no user interaction into a .flv file. Then I reload the soccer match in the browser to capture a new link in the add-on and paste that within the code string Above. This will as well capture all the audio fragments and put them together. All you will have to do is the last line of code I gave you to Join them with ffmpeg. Will create a video with audio into an .mp4. That will give you the highest video and audio quality possible through the nbcolympics website. You can change the video quality if you would like, but you’ll have to run the -debug script on the add-on link that is captured:

Code:

php AdobeHDS.php --manifest "http://olystreameast.nbcolympics.com/vod/690c26d3-280d-4d17-9d86-4ef9e406480f/nbc-olympics0803094426.ism/manifest(format=f4m-f4f,filtername=vodcut).f4m?token=st=1470317712~exp=1470317832~acl=/vod/690c26d3-280d-4d17-9d86-4ef9e406480f/nbc-olympics0803094426.ism/*~hmac=ee008b15c134623c079477ea82ebbc6bd9ef5a56e3b75d0c134162d2f37f8a30" -debug

That will give you a whole bunch of info that will just keep scrolling. So let it run and you are looking for the info at the top. So after a few seconds stop the debug script. You want to capture Fragments, not Keyframes.

Code:

Bitrate URL
 7001    QualityLevels(7000000)/Keyframes(video,format=f4m-f4f)
 7000    QualityLevels(7000000)/Fragments(video,format=f4m-f4f)
 4001    QualityLevels(4000000)/Keyframes(video,format=f4m-f4f)
 4000    QualityLevels(4000000)/Fragments(video,format=f4m-f4f)
 2201    QualityLevels(2200000)/Keyframes(video,format=f4m-f4f)
 2200    QualityLevels(2200000)/Fragments(video,format=f4m-f4f)
 1401    QualityLevels(1400000)/Keyframes(video,format=f4m-f4f)
 1400    QualityLevels(1400000)/Fragments(video,format=f4m-f4f)
 901     QualityLevels(900000)/Keyframes(video,format=f4m-f4f)
 900     QualityLevels(900000)/Fragments(video,format=f4m-f4f)
 601     QualityLevels(600000)/Keyframes(video,format=f4m-f4f)
 600     QualityLevels(600000)/Fragments(video,format=f4m-f4f)
 301     QualityLevels(300000)/Keyframes(video,format=f4m-f4f)
 300     QualityLevels(300000)/Fragments(video,format=f4m-f4f)
 56      QualityLevels(56000)/Fragments(audio_en_0,format=f4m-f4f)

Sorry if this is long winded, I just wrote this out quickly with what I do, so if it is too much detail that is why. Any questions let me know. Good luck, maybe this will also work for the CBC site.

Turns out I can't access NBC Olympics, region-locked of course :/
And I tried downloading HDS Link Detector (the addon for Firefox), and when I tried playing the video nothing popped up in terms of coding. :/

mtepper27 · #7 08-05-2016, 03:33 PM

All you have to do is use an IP changer or VPN. They cost about $5 a month. Use an IP within the United States and you'll have access to NBCOlympics

mtepper27 · #8 08-05-2016, 03:47 PM

And if you're interested in the Canadian Women's Soccer Team.... I record all of the Women's football, so if you PM me, I can share the matches with you via torrent. I record in 8mbps, 720p, 60fps. I would be happy to help

BusterAvis · #9 08-05-2016, 05:14 PM

Quote:

Originally Posted by mtepper27

And if you're interested in the Canadian Women's Soccer Team.... I record all of the Women's football, so if you PM me, I can share the matches with you via torrent. I record in 8mbps, 720p, 60fps. I would be happy to help

WOW, thank you.
Whatever matches you are willing share.
Would certainly like to have all of them, however that sounds rude to request all.

USA, Canada, Australia, Sweden, and New Zealand's matches would be good though. But if it's quick to set up a torrent file, then all matches would be great, but certainly wouldn't expect you to take up too much time.

Thanks again.

mtepper27 · #10 08-05-2016, 05:53 PM

Not rude, I offered to help.

Are you familiar with using UTorrent? I can do the Canada matches within 24 hours after the match happens. But if you want all the matches of the teams you listed, would you mind waiting until after the Olympics finish? I ask because I'm going be extremely busy recording all of the Olympics the next 2 weeks.

My email address is mtepper27@gmail.com, so we can communicate further via email.