Audio/video stream recording forums (http://stream-recorder.com/forum/index.php)
-   Video stream recording (http://stream-recorder.com/forum/forumdisplay.php?f=4)
-   -  

How to Capture stream of NBCOlympics.com

(http://stream-recorder.com/forum/showthread.php?t=13287)

bulldog12 07-29-2012 06:00 AM

How to Capture stream of NBCOlympics.com


 
Hello all,

Been reading here for a couple days trying to figure this out. I am trying to download the direct stream from NBC Olympics and having great difficulty. Here is the link I have been trying to download:

http://www.nbcolympics.com/video/wei...mens-48kg.html

Here is a list of all the applications I have tried:

Orbit Downloader/Grab++
Jaksta Streaming Media Recorder
FLV Recorder
StreamTrasport -- Defaults using IE is there way to change that?
GetFLV -- Again uses IE as default browser. Can you change that?
ReplayMediaCather 4

Basically what all these programs do for me is download all the ads ok but when the main video starts they don't see it.

I have also tried to learn the rtmpdump but wow what a learning curve. I'm really hoping someone here can help me with this. I don't mind purchasing a software package to do this but I just wish I could find one that works.

Thanks in advance for any help.

svnpenn 07-29-2012 10:22 AM

Re: How to Capture stream of NBCOlympics.com


 
Post or PM

Login
Pass

If you reply "No" to this request, plan on getting help from no one.

bulldog12 07-29-2012 11:27 AM

Re: How to Capture stream of NBCOlympics.com


 
I thought that would probably be the case. Hate how NBC has made you authenticate to these videos this year.

I have found out the video is streamed in small pieces so probably no way to do a direct capture anyway.

One question I did have is which software in your opinion is best for screen capturing? I am currently using wm capture. If you know of one that offers better quality please let me know.

Thanks!

svnpenn 07-29-2012 11:38 AM

Re: How to Capture stream of NBCOlympics.com


 
Quote:

Originally Posted by bulldog12 (Post 50161)
I thought that would probably be the case. Hate how NBC has made you authenticate to these videos this year. I have found out the video is streamed in small pieces so probably no way to do a direct capture anyway.

AdobeHDS.php will capture the small pieces. That is all I am going to say unless you want to offer up a login.

evol 07-30-2012 03:53 AM

Re: How to Capture stream of NBCOlympics.com


 
Dont know if NBC is like the BBC this year like here in the UK but all streams can be downloaded using the firefox extension DownloadHelper ?

_http://www.downloadhelper.net/

MrPaul 07-30-2012 06:59 PM

Re: How to Capture stream of NBCOlympics.com


 
NBC Olympics uses Apple HLC and not Adobe HDS.

Stream Ripper 08-01-2012 12:41 AM

Re: How to Capture stream of NBCOlympics.com


 
Best thing for these is Screen Capture software such as RVC

moshimoshi 08-01-2012 02:31 AM

Re: How to Capture stream of NBCOlympics.com


 
Quote:

Originally Posted by evol (Post 50214)
Dont know if NBC is like the BBC this year like here in the UK but all streams can be downloaded using the firefox extension DownloadHelper ?

_http://www.downloadhelper.net/

I tried it, it doesn't detect most videos embedded on the BBC website (news clips etc).

With the Olympic streams on the website, whether live or available to play back, it just sees file fragments (like net transport and other programs).

svnpenn 08-01-2012 09:42 AM

Re: How to Capture stream of NBCOlympics.com


 
FFmpeg can do this



Code:

$ ffmpeg -i "http://www.youtube.com/api/manifest/hls_playlist/id/4a1ca8e7641361
8e/itag/93/source/yt_live_broadcast/ratebypass/yes/cmbypass/yes/playlist_type/C
LEAN/maudio/1/pmbypass/yes/upn/th6Ii4TXvBw/sver/3/ip/76.187.106.31/ipbits/8/exp
ire/1343857030/sparams/ip,ipbits,expire,id,itag,source,ratebypass,cmbypass,play
list_type,maudio,pmbypass/signature/49E1FDCA60AD5209A242DAC05872380ADB403124.23
1B9C0764F592164B80A0CA5BA99571CFD691C6/key/ck1/file/index.m3u8" -c copy out.ts
ffmpeg version N-42939-g236ecc3 Copyright (c) 2000-2012 the FFmpeg developers
  built on Jul 26 2012 20:54:56 with gcc 4.7.1 (GCC)
  configuration: --enable-gpl --enable-version3 --disable-w32threads --enable-ru
ntime-cpudetect --enable-avisynth --enable-bzlib --enable-frei0r --enable-libass
 --enable-libcelt --enable-libopencore-amrnb --enable-libopencore-amrwb --enable
-libfreetype --enable-libgsm --enable-libmp3lame --enable-libnut --enable-libope
njpeg --enable-librtmp --enable-libschroedinger --enable-libspeex --enable-libth
eora --enable-libutvideo --enable-libvo-aacenc --enable-libvo-amrwbenc --enable-
libvorbis --enable-libvpx --enable-libx264 --enable-libxavs --enable-libxvid --e
nable-zlib
  libavutil      51. 65.100 / 51. 65.100
  libavcodec    54. 45.100 / 54. 45.100
  libavformat    54. 21.100 / 54. 21.100
  libavdevice    54.  2.100 / 54.  2.100
  libavfilter    3.  3.100 /  3.  3.100
  libswscale      2.  1.100 /  2.  1.100
  libswresample  0. 15.100 /  0. 15.100
  libpostproc    52.  0.100 / 52.  0.100
[mpegts @ 00000000056800a0] Estimating duration from bitrate, this may be inaccu
rate
Input #0, hls,applehttp, from 'http://www.youtube.com/api/manifest/hls_playlist/
id/4a1ca8e76413618e/itag/93/source/yt_live_broadcast/ratebypass/yes/cmbypass/yes
/playlist_type/CLEAN/maudio/1/pmbypass/yes/upn/th6Ii4TXvBw/sver/3/ip/76.187.106.
31/ipbits/8/expire/1343857030/sparams/ip,ipbits,expire,id,itag,source,ratebypass
,cmbypass,playlist_type,maudio,pmbypass/signature/49E1FDCA60AD5209A242DAC0587238
0ADB403124.231B9C0764F592164B80A0CA5BA99571CFD691C6/key/ck1/file/index.m3u8':
  Duration: 02:12:32.00, start: 5270.571356, bitrate: 0 kb/s
    Stream #0:0: Video: h264 (Main) ([27][0][0][0] / 0x001B), yuv420p, 640x360 [
SAR 1:1 DAR 16:9], 25 fps, 25 tbr, 90k tbn, 50 tbc
    Stream #0:1: Audio: aac ([15][0][0][0] / 0x000F), 48000 Hz, stereo, s16, 142
 kb/s
[mpegts @ 00000000059b87c0] muxrate VBR, pcr every 2 pkts, sdt every 200, pat/pm
t every 40 pkts
Output #0, mpegts, to 'out.ts':
  Metadata:
    encoder        : Lavf54.21.100
    Stream #0:0: Video: h264 ([27][0][0][0] / 0x001B), yuv420p, 640x360 [SAR 1:1
 DAR 16:9], q=2-31, 25 fps, 90k tbn, 25 tbc
    Stream #0:1: Audio: aac ([15][0][0][0] / 0x000F), 48000 Hz, stereo, 142 kb/s

Stream mapping:
  Stream #0:0 -> #0:0 (copy)
  Stream #0:1 -> #0:1 (copy)
Press [q] to stop, [?] for help
frame=  156 fps=0.0 q=-1.0 size=    494kB time=00:00:06.18 bitrate= 653.7kbits/
frame=  310 fps=310 q=-1.0 size=    925kB time=00:00:12.39 bitrate= 611.7kbits/
frame=  426 fps=284 q=-1.0 size=    1449kB time=00:00:16.96 bitrate= 700.0kbits/
frame=  592 fps=296 q=-1.0 size=    2441kB time=00:00:23.55 bitrate= 849.0kbits/
frame=  693 fps=276 q=-1.0 size=    3082kB time=00:00:27.62 bitrate= 913.8kbits/
frame=  851 fps=283 q=-1.0 size=    4121kB time=00:00:34.02 bitrate= 992.1kbits/
frame=  991 fps=278 q=-1.0 size=    5037kB time=00:00:39.61 bitrate=1041.7kbits/
frame= 1142 fps=281 q=-1.0 size=    5856kB time=00:00:45.58 bitrate=1052.3kbits/
frame= 1387 fps=298 q=-1.0 size=    6547kB time=00:00:55.44 bitrate= 967.3kbits/
frame= 1525 fps=295 q=-1.0 size=    7274kB time=00:01:00.94 bitrate= 977.6kbits/


bulldog12 08-01-2012 01:03 PM

Re: How to Capture stream of NBCOlympics.com


 
svnpenn thank you so much for doing this. I know i'm going to look really stupid here but I have a question.

I downloaded the latest ffmpeg version and wasn't really sure what to do from there. I went to the bin folder and double clicked on the ffmpeg file but only a command box flashed and went away. Could you help me a little on how to do this? Sorry for being such a newbie.

Also which application did u use to grab that youtube address?

Again thank you for posting this!!

svnpenn 08-01-2012 01:20 PM

Re: How to Capture stream of NBCOlympics.com


 
Quote:

Originally Posted by bulldog12
Also which application did u use to grab that youtube address?

I use Pale Moon but Firefox will also work.

Tools, Web Developer, Web Console

Quote:

Originally Posted by bulldog12
I went to the bin folder and double clicked on the ffmpeg file but only a command box flashed and went away.

You need to open the Command Prompt (Start Menu, Programs, Accessories).

Then change directory to where ffmpeg.exe is located

Code:

cd Downloads
Then run command to download

Code:

ffmpeg.exe -i URL -c copy out.ts
Please let it be very clear that I am not going more in to depth on this. You are asking about the very basics of the command line, something you should have learned long ago.

MrPaul 08-01-2012 08:53 PM

Re: How to Capture stream of NBCOlympics.com


 
Oh my god. This is exactly what I was looking for. Now I just need to figure out how to automate my downloads so I can download a list of stuff overnight. I don't think it'll work because there is an expiration on the URL.

I'll save a link and try it tomorrow.

evol 08-02-2012 02:59 AM

Re: How to Capture stream of NBCOlympics.com


 
Just to add if you want to watch the stream live with ffmpeg you use ffplay........
Code:

ffplay.exe -i URL
;)

bulldog12 08-02-2012 08:24 AM

Re: How to Capture stream of NBCOlympics.com


 
Big Thank You again to svnpenn!

Works beautifully!

jan619 08-02-2012 01:41 PM

Re: How to Capture stream of NBCOlympics.com


 
I download and extracted ffmpeg. When I try to open it with Command it didnt work. I type the "cd download". I am not sure which of the youtube address to select. It sometimes is in .swf format and has many different ping numbers. If someone would kindly give me step by step instructions I would be glad. PM me I am not very computer centric. Thanks.

svnpenn 08-02-2012 03:58 PM

Re: How to Capture stream of NBCOlympics.com


 
Quote:

Originally Posted by jan619
I download and extracted ffmpeg. When I try to open it with Command it didnt work. I type the "cd download". I am not sure which of the youtube address to select. It sometimes is in .swf format and has many different ping numbers. If someone would kindly give me step by step instructions I would be glad.

Quote:

Originally Posted by svnpenn
Please let it be very clear that I am not going more in to depth on this. You are asking about the very basics of the command line, something you should have learned long ago.

​​​​​

stanley0129 08-02-2012 08:17 PM

Re: How to Capture stream of NBCOlympics.com


 
ffmpg seems to work, but it's wicked slow.

not ideal for long videos.

(thanks nevertheless).

synce 08-03-2012 08:06 AM

Re: How to Capture stream of NBCOlympics.com


 
I registered just to say thanks svnpenn. Amazing 1080p quality

BusterAvis 08-04-2012 11:32 PM

Re: How to Capture stream of NBCOlympics.com


 
It's disappointing that there is no program out there that will download these files as just one single big file. Instead, it downloads it as a bunch of fragments of files. Extremely frustrating.

JustPassing 08-05-2012 03:09 AM

Re: How to Capture stream of NBCOlympics.com


 
Hey, thanks for this.

However, I don't live in the US and am having trouble. I've bought a subscription to a VPN so I can access NBCOlympics, but I don't know if it's because I only have a VPN or what, but I am unable to download a full stream in 1080p.

Tried it and it stopped capturing after 1GB.

Do you know if there's a way I can resume the download? If not, if there's a way to capture the stream in parts (like maybe, every 30 minutes or maybe by every 500 MB, etc.) so that there's a lower risk of failure?

If you have a VPN, would you be able to check out european streaming sites (I think it's eurovisionsports.tv) and see if you can find a way for us to download the streams that way? Because the european sites don't use Youtube and I can't find the .m3u8 link when I try to do what your guide needs us to do.

Thanks again. In the meantime, I'll try again and see if I can finish downloading a stream.

streamer 08-05-2012 04:02 AM

Re: How to Capture stream of NBCOlympics.com


 
svnpenn, I'm trying to save a different video off of nbcolympics.com. The video is here.

I opened up the Web Console like you said, and there are tons of youtube URLs so I don't know which one to use for ffmpeg. The URL you used for that other video started with "http://www.youtube.com/api/manifest/hls_playlist/" and ended with "/file/index.m3u8", but I don't see any similar URLs for the video I'm interested in. Any ideas what URL I should use?

sonnypaku 08-05-2012 02:11 PM

Re: How to Capture stream of NBCOlympics.com


 
Thanks for all the help. FFMpeg is working like a charm capturing beach volleyball. Just one question, how do i capture the 1080p or 720p stream? Default seems to be 420p at 640x360.

What is correct setting to capture full 1080p?

Also, can I pause stream on NBC site and will FFMpeg continue to capture?

Thanks for all of your help.

MrPaul 08-06-2012 07:53 AM

Re: How to Capture stream of NBCOlympics.com


 
Quote:

Originally Posted by sonnypaku (Post 50611)
What is correct setting to capture full 1080p?

  • Start Firefox
  • Open web console (CTRL-SHIFT-K)
  • Optional - Unselect CSS, JS, & Logging on the menu bar
  • Type in "m3u8" in the filter on top right
  • Start the video you want to see
  • Click the gear icon on bottom right of video and select the quality you want (typically 1080) and you'll see a new m3u8 file appear
  • Use this URL for the "-i" option of ffmpeg

Quote:

Originally Posted by sonnypaku (Post 50611)
Also, can I pause stream on NBC site and will FFMpeg continue to capture?

Whatever you're doing in Firefox is not associated with what you're streaming in ffmpeg. You can completely close firefox, watch different video, download multiple videos, etc.

KylePhys 08-06-2012 09:44 AM

Re: How to Capture stream of NBCOlympics.com


 
Hello guys, May i ask you where (what folder) does it exactly save the downloaded video file?

Thanks.

JustPassing 08-06-2012 09:58 AM

Re: How to Capture stream of NBCOlympics.com


 
Hi,

My downloads always cut off before the end. I've tried using -ss position (input/output) to start capturing where the download left off but it doesn't seem to be working.

Anybody know how to either resume the incomplete download or to capture the stream starting from a certain time (so all I would need to do is join all the pieces together once I get everything)?

Thanks.

KylePhys 08-06-2012 10:38 AM

Re: How to Capture stream of NBCOlympics.com


 
Quote:

Originally Posted by KylePhys (Post 50668)
Hello guys, May i ask you where (what folder) does it exactly save the downloaded video file?

Thanks.

Guys, I found it, sorry for stupid question. )))

jan619 08-06-2012 10:42 AM

Re: How to Capture stream of NBCOlympics.com


 
Ok I got ffmpeg to work now. I want to know is it possible to download only certain segments of a video ie womens volleyball and not the mens .

KylePhys 08-06-2012 10:59 AM

Re: How to Capture stream of NBCOlympics.com


 
[quote=MrPaul;50658]
  • Start Firefox
  • Open web console (CTRL-SHIFT-K)
  • Optional - Unselect CSS, JS, & Logging on the menu bar
  • Type in "m3u8" in the filter on top right
  • Start the video you want to see
  • Click the gear icon on bottom right of video and select the quality you want (typically 1080) and you'll see a new m3u8 file appear
  • Use this URL for the "-i" option of ffmpeg

MrPaul,

I have this link:

http://www.nbcolympics.com/video/gym...und-final.html

the filter doesn't return anything, is it in different format? I tried to copy a couple of the multitude of links but the ffmpeg returns error. Would appreciate a lot any help.

brideck 08-07-2012 09:34 AM

Re: How to Capture stream of NBCOlympics.com


 
Quote:

Originally Posted by JustPassing (Post 50669)
Hi,

My downloads always cut off before the end. I've tried using -ss position (input/output) to start capturing where the download left off but it doesn't seem to be working.

Anybody know how to either resume the incomplete download or to capture the stream starting from a certain time (so all I would need to do is join all the pieces together once I get everything)?

Thanks.

Anybody have an answer to this? If I try to grab anything longer than an hour, ffmpeg will eventually bomb out with a 404.

KylePhys 08-07-2012 07:16 PM

Re: How to Capture stream of NBCOlympics.com


 
it works now, sorry guys ))

sonnypaku 08-07-2012 08:22 PM

Re: How to Capture stream of NBCOlympics.com


 
Mr. Paul,

Thanks so much for your help. Capturing in 1080p is working wonderfully.

I am also wondering whether or not -ss command will work. When I try to use it to start recording 42 min (-ss 00:42:00), ffmpeg begins downloading but with 0bytes & 0 bitrate with 00:00:00 time. Is this correct. Will it only start downloading once it hits 42 min mark?
Thanks for any assistance with this.

strawberries 08-08-2012 04:31 PM

Re: How to Capture stream of NBCOlympics.com


 
As I'm downloading I had one video throw a 404 and die but the rest have been working. However I'm noticing during busy traffic hours on Comcast I get a lot of drops.

I've tried replaying the video and can't see any quality degradation in video or audio so I'm wondering if these drops get retried until the frames are delivered without quality loss in the end. Is that the case?


synce 08-09-2012 12:13 AM

Re: How to Capture stream of NBCOlympics.com


 
If your download is getting cut off try downloading during low traffic hours. I do all my downloading after midnight

BTW has anyone found such a simple solution to downloading from BBC? I only see a convoluted rtmpdump method. I'm thinking of just recording the audio, since all I really want is the commentary. There's almost none on NBC's videos

quackeroats 08-10-2012 04:58 AM

Re: How to Capture stream of NBCOlympics.com


 
Quote:

Originally Posted by MrPaul (Post 50658)
  • Start Firefox
  • Open web console (CTRL-SHIFT-K)
  • Optional - Unselect CSS, JS, & Logging on the menu bar
  • Type in "m3u8" in the filter on top right
  • Start the video you want to see
  • Click the gear icon on bottom right of video and select the quality you want (typically 1080) and you'll see a new m3u8 file appear
  • Use this URL for the "-i" option of ffmpeg

cheers, mrPaul for reply my other thread about Eurovisionsports.tv
but unfortunately, the web-console don't seem to pick up anything on EVS's site. no m3u8 file. :-(

hers a sample link : http://www.eurovisionsports.tv/londo...?video_id=8503

is there perhaps another way using ffmpeg?

chap 08-10-2012 10:08 AM

Re: How to Capture stream of NBCOlympics.com


 
Quote:

Originally Posted by quackeroats (Post 51163)
cheers, mrPaul for reply my other thread about Eurovisionsports.tv
but unfortunately, the web-console don't seem to pick up anything on EVS's site. no m3u8 file. :-(

hers a sample link : http://www.eurovisionsports.tv/londo...?video_id=8503

is there perhaps another way using ffmpeg?

simple use cache Opera;)

quackeroats 08-11-2012 06:48 AM

Re: How to Capture stream of NBCOlympics.com


 
Code:

C:\Users\...\bin>ffmpeg.exe -i "http://www.youtube.com/api/manifest/hls_playlist/id/4199aa51e673480a/itag/93/so
urce/yt_live_broadcast/ratebypass/yes/cmbypass/yes/playlist_type/CLEAN/maudio/1/pmbypass/yes/upn/l--mX6-O4FQ/sver/3/ip/49.50.124.114/ipbits/8/expire/1344713081/spara
ms/ip,ipbits,expire,id,itag,source,ratebypass,cmbypass,playlist_type,maudio,pmbypass/signature/41CB6961100EE9C9B067C29147421DE44234E69D.4B95CB9AB1694E7B75433A8D404C1
131CD727A80/key/ck1/file/index.m3u8" copy out.ts
ffmpeg version N-43206-gf857465 Copyright (c) 2000-2012 the FFmpeg developers
  built on Aug  4 2012 16:10:39 with gcc 4.7.1 (GCC)
  configuration: --enable-gpl --enable-version3 --disable-w32threads --enable-runtime-cpudetect --enable-avisynth --enable-bzlib --enable-frei0r --enable-libass --en
able-libcelt --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libfreetype --enable-libgsm --enable-libmp3lame --enable-libnut --enable-libopenjpeg --en
able-librtmp --enable-libschroedinger --enable-libspeex --enable-libtheora --enable-libutvideo --enable-libvo-aacenc --enable-libvo-amrwbenc --enable-libvorbis --ena
ble-libvpx --enable-libx264 --enable-libxavs --enable-libxvid --enable-zlib
  libavutil      51. 66.100 / 51. 66.100
  libavcodec    54. 49.100 / 54. 49.100
  libavformat    54. 22.100 / 54. 22.100
  libavdevice    54.  2.100 / 54.  2.100
  libavfilter    3.  5.102 /  3.  5.102
  libswscale      2.  1.100 /  2.  1.100
  libswresample  0. 15.100 /  0. 15.100
  libpostproc    52.  0.100 / 52.  0.100
http://www.youtube.com/api/manifest/hls_playlist/id/4199aa51e673480a/itag/93/source/yt_live_broadcast/ratebypass/yes/cmbypass/yes/playlist_type/CLEAN/maudio/1/pmbypa
ss/yes/upn/l--mX6-O4FQ/sver/3/ip/49.50.124.114/ipbits/8/expire/1344713081/sparams/ip,ipbits,expire,id,itag,source,ratebypass,cmbypass,playlist_type,maudio,pmbypass/s
ignature/41CB6961100EE9C9B067C29147421DE44234E69D.4B95CB9AB1694E7B75433A8D404C1131CD727A80/key/ck1/file/index.m3u8: Input/output error

C:\Users\Joshua\Downloads\ffmpeg-20120804-git-f857465-win32-static\bin>

anyone experience this "Input/Output Error" ??

chap 08-11-2012 10:16 AM

Re: How to Capture stream of NBCOlympics.com


 
try use
-c copy

quackeroats 08-11-2012 05:27 PM

Re: How to Capture stream of NBCOlympics.com


 
Quote:

Originally Posted by chap (Post 51198)
simple use cache Opera;)

yea theres that too, but so far
the DL has been intermittent and unstable. :-(

jan619 08-11-2012 06:58 PM

Re: How to Capture stream of NBCOlympics.com


 
when i enter -t XX:XX:XX ffmpeg still keeps on downloading. i have to stop it myself. how i make it stop itself?

On another video i set up -ss XX:XX:XX but after a while the link timed out. I want to record certain parts of long videos but the link dies before ffmpeg gets to where I want it to start. Any way to make ffmpeg start downloading immediatley at the time I set -ss at?

quackeroats 08-11-2012 10:11 PM

Re: How to Capture stream of NBCOlympics.com


 
Quote:

Originally Posted by chap (Post 51307)
try use
-c copy

unfortunately not, =(
do you happen to know a noob friendly ffmpeg user guide?
or how a noob should navigate round the ffmpeg documentation to
"earn the ropes" ?

cheers


All times are GMT -6. The time now is 07:03 AM.