Stream capture from NBCOlympics

[nwtim]

Originally Posted by KSV

I have looked into the issue and pushed an update to fix it...

PS: regarding the problem with converting some of the fragments downloded with DTA it's actually DTA's fault. sometimes it saves the error message sent by server instead of actual fragment data. also you don't have to rename the downloaded fragments. read the wiki again to understand how to do it properly.

That's an awesome fix! Thanks!!

As for the renaming, the reason I was doing it was because even when I tried to use it with a base filename it seemed to require that the first fragment was "1", while the files I was working with at the time had fragments starting at about Seg1-Frag620 or so, and the base filename method didn't seem to like that.

[nwtim]

Originally Posted by KSV

...
When you run the updated script with debug switch it will show the following content.

php AdobeHDS.php -manifest "http://olyvodeast.nbcolympics.com/vod/c2940c3f-3bd7-4a0c-8101-fd847ee226ba/KRII_VOD_OZ0221_AllAround_Sochi_Today_Show.ism/manifest(format=f4m-f4f).f4m" -debug

...

This is working great with the special feature videos, but I was also hoping to download a number of event replays which have a manifest that includes a token, and I can't seem to get anything with those.

Here's an example of an event replay's manifest script as captured with the HDS Links Detector add-on for Firefox:

"http://olystreameast.nbcolympics.com/vod/a3ceaf1c-15b3-4cb0-a83a-00af8e5e08de/pairs-short-program0211061442.ism/manifest(format=f4m-f4f,filtername=vodcut).f4m?token=st=1393308775~exp=1393308895~acl=/vod/a3ceaf1c-15b3-4cb0-a83a-00af8e5e08de/pairs-short-program0211061442.ism/*~hmac=2defc70d894a7774c2fbf749cdc5a3458c9151f212b608410b10a44df134921e"

Can you show me what to parse out in order for the -debug switch to work with such a manifest?

Thanks!

[KSV]

Originally Posted by nwtim

As for the renaming, the reason I was doing it was because even when I tried to use it with a base filename it seemed to require that the first fragment was "1", while the files I was working with at the time had fragments starting at about Seg1-Frag620 or so, and the base filename method didn't seem to like that.

You can use start switch to specify the starting fragment.

php AdobeHDS.php --fragments "Fragments(video,format=f4m-f4f)Seg1-Frag" --start 620

or

php AdobeHDS.php "Fragments(video,format=f4m-f4f)Seg1-Frag" --start 620

Originally Posted by nwtim

This is working great with the special feature videos, but I was also hoping to download a number of event replays which have a manifest that includes a token, and I can't seem to get anything with those.

Here's an example of an event replay's manifest script as captured with the HDS Links Detector add-on for Firefox:

"http://olystreameast.nbcolympics.com/vod/a3ceaf1c-15b3-4cb0-a83a-00af8e5e08de/pairs-short-program0211061442.ism/manifest(format=f4m-f4f,filtername=vodcut).f4m?token=st=1393308775~exp=1393308895~acl=/vod/a3ceaf1c-15b3-4cb0-a83a-00af8e5e08de/pairs-short-program0211061442.ism/*~hmac=2defc70d894a7774c2fbf749cdc5a3458c9151f212b608410b10a44df134921e"

Can you show me what to parse out in order for the -debug switch to work with such a manifest?

i am not sure what you are asking for. you can append "--debug" switch to the command line provided by "HDS Link Detector" addon without modifying the command line in any other way.

[blimey]

Originally Posted by nwtim

This is working great with the special feature videos, but I was also hoping to download a number of event replays which have a manifest that includes a token, and I can't seem to get anything with those.
.
.
Can you show me what to parse out in order for the -debug switch to work with such a manifest?

Thanks!

The event programs use authenticated time-limited urls for the f4m manifest. The syntax would be much like the example given by ehurdler in post #10 of this thread... only adjusted to reflect your authentication particulars.

You probably don't want to waste time, or an authenticated f4m manifest url access, doing a debug command. You know the quality levels already, have separate command windows open and do one each for the audio and video before the manifest url expires. Or you could do them consecutively, but you'd have to get a new manifest url before you do the second one as the first will likely have expired.

What was the problem you had using the ios url (m3u8) w/ffmpeg (as provided by chap) for an event program? I had no trouble, although I did the audio and video in separate consecutive ffmpeg sequences, rather than as two inputs to ffmpeg as a single command as chap has it. The ios urls for the manifest need no authentication even for event programs.

[nwtim]

Originally Posted by KSV

You can use start switch to specify the starting fragment.

php AdobeHDS.php --fragments "Fragments(video,format=f4m-f4f)Seg1-Frag" --start 620

or

php AdobeHDS.php "Fragments(video,format=f4m-f4f)Seg1-Frag" --start 620

Oops - my bad. Being new to the whole "Fragment" world, I guess I wasn't confident as to the exact syntax for the start switch so I was taking the extra minute to rename the files. I won't waste my time on that anymore. Thanks!

i am not sure what you are asking for. you can append "--debug" switch to the command line provided by "HDS Link Detector" addon without modifying the command line in any other way.

Wouldn't you know it - I couldn't get it to work last night on my other PC and just now when I tried it it worked. Must be that my other PC is clogged up with Windows Media Center, recording multiple shows at once off our HDHomeRun Tuners, and is only Win7x86. With that PC I was getting no quality header from the manifest or an "Unauthorized" error when omitting the "?token=" stuff from the HDS Link.

Thanks for all your help!

[nwtim]

Originally Posted by blimey

The event programs use authenticated time-limited urls for the f4m manifest. The syntax would be much like the example given by ehurdler in post #10 of this thread... only adjusted to reflect your authentication particulars.

You probably don't want to waste time, or an authenticated f4m manifest url access, doing a debug command. You know the quality levels already, have separate command windows open and do one each for the audio and video before the manifest url expires. Or you could do them consecutively, but you'd have to get a new manifest url before you do the second one as the first will likely have expired.

What was the problem you had using the ios url (m3u8) w/ffmpeg (as provided by chap) for an event program? I had no trouble, although I did the audio and video in separate consecutive ffmpeg sequences, rather than as two inputs to ffmpeg as a single command as chap has it. The ios urls for the manifest need no authentication even for event programs.

Right - I normally don't take the time to use the debug switch. I was only using it looking for possible explanations why I couldn't get a couple event replays to work last night with KSV's Adobe HDS downloader.

After giving up on that approach, I tried chap's ffmpeg method of getting the m3u8 streams and had amazing success grabbing a couple 4-hour events. Perhaps it was due to being able to bypass whatever issue I was having with the tokens I was getting (I never waited more than a minute between getting the authentication token and trying to run with it - it just wasn't working).

I'm thinking the problems I've had with these downloads could be - and probably are - tied to having spotty internet service both at home and at work over the last week or so (using Comcast in greater Seattle area). I'm not sure how tolerant these methods are of connection interruptions, but last night and this morning seem to have been far better in that regard, and correspondingly any download attempts I've made have been successful.

For example, one I had great difficulty with a couple days ago - the Women's Moguls Qualification 1 - now seems to be coming down without a hitch using KSV's Adobe HDS downloader. Since the connection is throttled down a bit, I imagine I'll need to get a new authentication token for the audio, but so far so good.

Thanks!

[nwtim]

Okay, I've got a problem like the one I was getting last night. It's for the "Figure Skating: Team Event: Men's SP, Pairs SP". The HDS Link I get is

php AdobeHDS.php --manifest "http://olystreameast.nbcolympics.com/vod/724e2f71-42bf-43c2-a878-ff6c305e318b/team--men-s-sp--pairs-sp0206063549.ism/manifest(format=f4m-f4f).f4m?token=st=1393370184~exp=1393370304~acl=/vod/724e2f71-42bf-43c2-a878-ff6c305e318b/team--men-s-sp--pairs-sp0206063549.ism/*~hmac=f96ea87266758164ee32a2a220d6f3f6ac3773ee108bdd6da1279c86199f9c88" --delete

and when I replace --delete with --debug I get "Access Denied! Unable to download the manifest." And this is while I have it playing in the browser and keep refreshing the HDS link.

I tried chap's ffmpeg method to get the m3u8 streams and it isn't working either using the string

http://olystreameast.nbcolympics.com/vod/724e2f71-42bf-43c2-a878-ff6c305e318b/team--men-s-sp--pairs-sp0206063549.ism

in the syntax.

[chap]

nwtim
try

ffmpeg -i "http://olystreameast.nbcolympics.com/vod/724e2f71-42bf-43c2-a878-ff6c305e318b/team--men-s-sp--pairs-sp0206063549.ism/QualityLevels(56000)/Manifest(audio_en_0,format=m3u8-aapl)" -i "http://olystreameast.nbcolympics.com/vod/724e2f71-42bf-43c2-a878-ff6c305e318b/team--men-s-sp--pairs-sp0206063549.ism/QualityLevels(3450000)/Manifest(video,format=m3u8-aapl)" -c copy t.ts

[nwtim]

Somehow the Manifest argument I had in my template had been changed to "(audio_en_0,format=m3u8-aapl,filtername=vodcut)" and the same ",filtername=vodcut" for the video. Now it's running just fine.

Thanks chap!

[blimey]

Originally Posted by nwtim

I get "Access Denied! Unable to download the manifest." And this is while I have it playing in the browser and keep refreshing the HDS link

I've now seen a few of these "Access Denied" errors for some authentication-required events. The f4m manifest link, or even a f4f fragment link, reports this error if used outside of the browser. But if the link is accessed inside the browser (in which the authentication is stored), it is okay. There must be browser cookies, or more likely flash/adobe cookies. Some special files are downloaded from adobe the first time authentication goes through.