PDA

View Full Version : RTMPE streams at YouTube - Dr Who


Ed999
02-27-2011, 01:15 AM
YouTube RTMPE files


Use RTMPsrv.exe v2.3 and RTMPdump.exe v2.3 -

http://rtmpdump.mplayerhq.hu/download/


Note: This solution is for Windows XP/Vista/7 only, because it requires the Windows versions of RTMPsrv.exe v2.3 and RTMPdump.exe v2.3. Those versions only work on Windows XP or later.



Step #1 - Run a .bat file (STEP1.BAT) containing the following -


rem *** Safety checks ***

IF EXIST C:\Windows\System32\drivers\etc\NOHOSTS ATTRIB -R -S -H C:\Windows\System32\drivers\etc\*.*
IF EXIST C:\Windows\System32\drivers\etc\NOHOSTS DEL C:\Windows\System32\drivers\etc\HOSTS
IF EXIST C:\Windows\System32\drivers\etc\NOHOSTS REN C:\Windows\System32\drivers\etc\NOHOSTS HOSTS
IF EXIST C:\Windows\System32\drivers\etc\NOHOSTS GOTO END

IF EXIST C:\Windows\System32\drivers\etc\HOSTS_XX ATTRIB -R -S -H C:\Windows\System32\drivers\etc\*.*
IF EXIST C:\Windows\System32\drivers\etc\HOSTS_XX DEL C:\Windows\System32\drivers\etc\HOSTS
IF EXIST C:\Windows\System32\drivers\etc\HOSTS_XX REN C:\Windows\System32\drivers\etc\HOSTS_XX HOSTS
IF EXIST C:\Windows\System32\drivers\etc\HOSTS_XX GOTO END


rem *** Edit the HOSTS file ***

rem Replace line 1 with this:
rem 127.0.0.1 cp59009.edgefcs.net

ATTRIB -R -S -H C:\Windows\System32\drivers\etc\HOSTS
REN C:\Windows\System32\drivers\etc\HOSTS HOSTS_XX
echo 127.0.0.1 cp59009.edgefcs.net> C:\Windows\System32\drivers\etc\HOSTS
ATTRIB +R +S +H C:\Windows\System32\drivers\etc\HOSTS


rem *** Start RTMPSRV ***

rem Start RTMPSRV.EXE and pipe the URLs it displays to a .BAT file
rem to be used with RTMPDUMP.EXE to download the file

rtmpsrv > RTMPdump_run.bat


:END



Step #2 - Start playing the YouTube page in Internet Explorer -


Example URL (including the &fmt=18 option):

http://www.youtube.com/watch?v=4x0f0iuNwBg&fmt=18



Step #3 - Run a .bat file (STEP3.BAT) containing the following -


rem *** Wait 8 Seconds ***
@CHOICE /T 8 /C yn /D y > NUL


rem *** Edit the HOSTS file ***
rem Restore the normal line 1:
rem 127.0.0.1 localhost

ATTRIB -R -S -H C:\Windows\System32\drivers\etc\HOSTS
IF EXIST C:\Windows\System32\drivers\etc\HOSTS_XX DEL C:\Windows\System32\drivers\etc\HOSTS
IF EXIST C:\Windows\System32\drivers\etc\HOSTS_XX REN C:\Windows\System32\drivers\etc\HOSTS_XX HOSTS
ATTRIB +R +H C:\Windows\System32\drivers\etc\HOSTS


rem *** Run RTMPDUMP v2.3 to download the FLV file ***
CALL RTMPdump_run.bat


rem *** Rename the downloaded file ***
IF EXIST 34.* REN 34.* 34.flv



Example of successful command -

A command must be input as a single line

rtmpdump.exe -r "rtmpe://cp59009.edgefcs.net/youtube?auth=daEb.aabUdHc6bUc0cGbrcqdXcPaFb4d8dQ-bnr.Wh-eS-JxDDJnqd&aifp=YT2008121701&slist=c6/id/afafcc0e1fdc39e5/itag/34" -a "youtube?auth=daEb.aabUdHc6bUc0cGbrcqdXcPaFb4d8dQ-bnr.Wh-eS-JxDDJnqd&aifp=YT2008121701&slist=c6/id/afafcc0e1fdc39e5/itag/34" -f "WIN 10,1,53,64" -W "http://s.ytimg.com/yt/swfbin/watch_as3-vflYyTcR7.swf" -p "http://www.youtube.com/watch?v=r6_MDh_cOeU&fmt=18" -y "c6/id/afafcc0e1fdc39e5/itag/34" -o output.flv

A command will lose validity after about 2 hours, because the auth= authentication string has an encoded timelimit in it.

Ed999
03-12-2011, 02:05 PM
Note that my above solution is designed for Windows 7.

You might need to make some changes to the batch files in order to use them with Windows XP, e.g. in the path to the HOSTS file. I don't use XP so I can't tell you what path it uses for its HOSTS file.

Lilarcor
03-12-2011, 02:44 PM
Thank you for your support, unfortunately I have yet tried Replay Media Catcher (http://all-streaming-media.com/record-video-stream/Replay-Media-Catcher-HTTP-RTMP-FLV-MP3-ripper-recorder.htm) which didn't worked correctly and that's why i was looking at rtmpdump (http://all-streaming-media.com/record-video-stream/rtmpdump-freeware-console-RTMP-downloading-application.htm).

@Ed999 I have the last (2.3) release of rtmp dump on window 7 pro 64 bits with Microsoft's .NET framework 4 installed, enough ram and an adequate processor. I though with rtmp dump explorer, it would be easier and unnecessary to run a complicated command. Indeed I understood that rtmpsrv would display directly the command line i needed to run then with rtmpdump.exe.

I'll try your .bat command and keep you informed but i have to specify i would like to record live stream... so how will i be able to start/stop recording whenever i want?
... Moreover is it neccesary to change [127.0.0.1 cp59009.edgefcs.net] by an other address (i don't know how to find) since it's a ustream broadcast?

At the present time i use a try version of Microsoft Expression Encoder 4 Screen Capture, it's quite efficient but i think the video could be more accurate or fluent with a "direct" recording.

Stream Recorder
03-13-2011, 05:04 PM
Thank you for your support, unfortunately I have yet tried Replay Media Catcher (http://all-streaming-media.com/record-video-stream/Replay-Media-Catcher-HTTP-RTMP-FLV-MP3-ripper-recorder.htm) which didn't worked correctly and that's why i was looking at rtmpdump (http://all-streaming-media.com/record-video-stream/rtmpdump-freeware-console-RTMP-downloading-application.htm).
What web-page were you trying to record from? What kind of error did you get?

Stream Recorder
03-13-2011, 05:18 PM
Note that my above solution is designed for Windows 7.

You might need to make some changes to the batch files in order to use them with Windows XP, e.g. in the path to the HOSTS file. I don't use XP so I can't tell you what path it uses for its HOSTS file.
The HOSTS file is in the same folder in Windows XP.

Also it would make sense to use %WINDIR% instead of C:\Windows\

Ed999
03-21-2011, 07:57 AM
@Lilarcor -

Yes, the one piece of information you do need is the server's address, also known as the Host address. But this is usually fairly easy to find, by looking at the HTML source for the internet page which plays the media file that you are interested in.

Alternately, you can usually find it by running 'sniffer' software such as one of the programs URL Snooper (http://all-streaming-media.com/find-stream-URL/Project-URL-Snooper-Find-the-actual-stream-URL-Free-download.htm) (a.k.a. Project URL Snooper) or WinPcap or Wireshark (http://all-streaming-media.com/find-stream-URL/Wireshark-free-network-protocol-analyzer.htm), that capture the packets passing through your internet connection - which you can then examine for the telltale rtmpe:// string.


To tell rtmpdump that a stream is a live stream, you normally have to add the extra
switch -live to the rtmpdump command line.

To stop recording a stream, simply close the Command window (a.k.a. "DOS Box") in which rtmpdump is running! Or simultaneously press the keyboard keys CTRL and BREAK.


But, certainly, if you want an easy life, rtmp streams on many websites can be captured using GUI front-ends for rtmpdump (http://all-streaming-media.com/record-video-stream/rtmpdump-freeware-console-RTMP-downloading-application.htm) -

http://stream-recorder.com/forum/showthread.php?t=3724

I was just trying to demonstrate how to use rtmpdump on websites where the usual GUI front-end programs don't work.

Stream Recorder
03-21-2011, 11:15 AM
Alternately, you can usually find it by running 'sniffer' software such as one of the programs URL Snooper (http://all-streaming-media.com/find-stream-URL/Project-URL-Snooper-Find-the-actual-stream-URL-Free-download.htm) (a.k.a. Project URL Snooper) or WinPcap or Wireshark (http://all-streaming-media.com/find-stream-URL/Wireshark-free-network-protocol-analyzer.htm), that capture the packets passing through your internet connection - which you can then examine for the telltale rtmpe:// string.[/url]
I recommend to use CooJah (http://all-streaming-media.com/record-video-stream/Blader-freeware-RTMP-downloader.htm) instead. Not only it is the easiest way to find RTMPE parameters in Windows, but also it allows to download RTMPE streams with Blader.

But, certainly, if you want an easy life, rtmp streams on many websites can be captured using GUI front-ends for rtmpdump (http://all-streaming-media.com/record-video-stream/rtmpdump-freeware-console-RTMP-downloading-application.htm)
Command line front-ends like get-flash-videos can also help.

IKnowNothing
04-03-2011, 10:43 AM
YouTube RTMPE files


Use RTMPsrv.exe v2.3 and RTMPdump.exe v2.3 -

http://rtmpdump.mplayerhq.hu/download/


Note: This solution is for Windows XP/Vista/7 only, because it requires the Windows versions of RTMPsrv.exe v2.3 and RTMPdump.exe v2.3. Those versions only work on Windows XP or later.



Step #1 - Run a .bat file (STEP1.BAT) containing the following -


rem *** Safety checks ***

IF EXIST C:\Windows\System32\drivers\etc\NOHOSTS ATTRIB -R -S -H C:\Windows\System32\drivers\etc\*.*
IF EXIST C:\Windows\System32\drivers\etc\NOHOSTS DEL C:\Windows\System32\drivers\etc\HOSTS
IF EXIST C:\Windows\System32\drivers\etc\NOHOSTS REN C:\Windows\System32\drivers\etc\NOHOSTS HOSTS
IF EXIST C:\Windows\System32\drivers\etc\NOHOSTS GOTO END

IF EXIST C:\Windows\System32\drivers\etc\HOSTS_XX ATTRIB -R -S -H C:\Windows\System32\drivers\etc\*.*
IF EXIST C:\Windows\System32\drivers\etc\HOSTS_XX DEL C:\Windows\System32\drivers\etc\HOSTS
IF EXIST C:\Windows\System32\drivers\etc\HOSTS_XX REN C:\Windows\System32\drivers\etc\HOSTS_XX HOSTS
IF EXIST C:\Windows\System32\drivers\etc\HOSTS_XX GOTO END


rem *** Edit the HOSTS file ***

rem Replace line 1 with this:
rem 127.0.0.1 cp59009.edgefcs.net

ATTRIB -R -S -H C:\Windows\System32\drivers\etc\HOSTS
REN C:\Windows\System32\drivers\etc\HOSTS HOSTS_XX
echo 127.0.0.1 cp59009.edgefcs.net> C:\Windows\System32\drivers\etc\HOSTS
ATTRIB +R +S +H C:\Windows\System32\drivers\etc\HOSTS


rem *** Start RTMPSRV ***

rem Start RTMPSRV.EXE and pipe the URLs it displays to a .BAT file
rem to be used with RTMPDUMP.EXE to download the file

rtmpsrv > RTMPdump_run.bat


:END



Step #2 - Start playing the YouTube page in Internet Explorer -


Example URL (including the &fmt=18 option):

http://www.youtube.com/watch?v=4x0f0iuNwBg&fmt=18



Step #3 - Run a .bat file (STEP3.BAT) containing the following -


rem *** Wait 8 Seconds ***
@CHOICE /T 8 /C yn /D y > NUL


rem *** Edit the HOSTS file ***
rem Restore the normal line 1:
rem 127.0.0.1 localhost

ATTRIB -R -S -H C:\Windows\System32\drivers\etc\HOSTS
IF EXIST C:\Windows\System32\drivers\etc\HOSTS_XX DEL C:\Windows\System32\drivers\etc\HOSTS
IF EXIST C:\Windows\System32\drivers\etc\HOSTS_XX REN C:\Windows\System32\drivers\etc\HOSTS_XX HOSTS
ATTRIB +R +H C:\Windows\System32\drivers\etc\HOSTS


rem *** Run RTMPDUMP v2.3 to download the FLV file ***
CALL RTMPdump_run.bat


rem *** Rename the downloaded file ***
IF EXIST 34.* REN 34.* 34.flv



Example of successful command -

A command must be input as a single line

rtmpdump.exe -r "rtmpe://cp59009.edgefcs.net/youtube?auth=daEb.aabUdHc6bUc0cGbrcqdXcPaFb4d8dQ-bnr.Wh-eS-JxDDJnqd&aifp=YT2008121701&slist=c6/id/afafcc0e1fdc39e5/itag/34" -a "youtube?auth=daEb.aabUdHc6bUc0cGbrcqdXcPaFb4d8dQ-bnr.Wh-eS-JxDDJnqd&aifp=YT2008121701&slist=c6/id/afafcc0e1fdc39e5/itag/34" -f "WIN 10,1,53,64" -W "http://s.ytimg.com/yt/swfbin/watch_as3-vflYyTcR7.swf" -p "http://www.youtube.com/watch?v=r6_MDh_cOeU&fmt=18" -y "c6/id/afafcc0e1fdc39e5/itag/34" -o output.flv

A command will lose validity after about 2 hours, because the auth= authentication string has an encoded timelimit in it.

I've been playing with these scripts on Windows XP (yes I changed c:\windows to %WinDir%) but put simply

IT DOES NOT WORK

Step 1 fails to populate anything in the RTMPdump_run.bat file even when I manually set up the Hosts file. I know channel 4 is a pig but it even failed with Youtube.

Can someone give an idiot a hand?
I'm using Windows XP and Internet Explorer

So far all I'm doing is running step1.bat in a command window then running IE and playing the video right through. Then when the video finishes I close IE and use Control C to end the step1 batch file.

What am I doing wrong?

placebo
04-03-2011, 11:40 AM
maybe someone can post valid youtube rtmpe url's.
i cant watch any of the suggested url's. ("The uploader has not made this video available in your country.", and other similar error messages)

you can download youtube videos with DownloadHelper (firefox plugin).

IKnowNothing
04-03-2011, 01:36 PM
maybe someone can post valid youtube url's.
i cant watch any of the suggested url's. ("The uploader has not made this video available in your country.", and other similar error messages)

you can download youtube videos with DownloadHelper (firefox plugin).

Me being stupid again - I should have said I'm trying to use rtmpsrv to get the rtmpdump (http://all-streaming-media.com/record-video-stream/rtmpdump-freeware-console-RTMP-downloading-application.htm) command for ripping Channel 4.

I picked a youtube video at random to check I'd set everything up right and it still didn't work.

I know GetFLV (http://all-streaming-media.com/record-video-stream/GetFLV-Download-and-convert-flash-video-streaming.htm) works with Channel 4 (even the demo version) but I think I can't justify the cost when there are free utils that do the job just as well.

Does anyone know of a step by step guide to use rtmpsrv and rtmpdump that actually works?

MickJT
04-04-2011, 03:11 AM
I picked a youtube video at random to check I'd set everything up right and it still didn't work.

Yep. Two reasons.

1) Won't work with 99.99% of YouTube vids. This tutorial is only for those which use RTMPE streaming, which is almost none, but Lionsgate films for example will stream some of their movies via RTMPE.

Hence why the command prompt window doesn't get populated by anything.

2) This method no longer works anyway. Flash 10 handshakes (rtmpe handshake 9) are now required for YouTube.

I'm patiently waiting.

srpenn82
04-05-2011, 01:11 AM
Compile the latest version of rtmpdump (http://all-streaming-media.com/record-video-stream/rtmpdump-freeware-console-RTMP-downloading-application.htm) from SVN.

you really, really need to stop giving people that advice

2011-3-24
hyc
RTMPdump team
The patch in svn only allows rtmpdump to continue to work with Flash servers that still support Flash 9.x clients. There are many servers out there now that require Flash 10.x clients and in that case, rtmpe type 9 is still needed.

MickJT
04-06-2011, 05:13 AM
Agreed. I always use the latest svn revision before I report an issue, and I check the mailing list too.

Ed999
04-07-2011, 01:58 AM
I only advertised this solution as working with RTMPE streams on YouTube, not other streams. I never expected anyone to pick a YouTube page at random - regardless of whether or not it was an RTMPE stream!

If you're looking to download a particular RTMPE stream, this thread might help you. But it isn't intended as a guide to which YouTube streams use RTMPE.

In point of fact, all BBC Worldwide streams on YouTube use RTMPE. I am in the UK, so I wasn't aware that users elsewhere were being blocked. Sorry to hear that. Please use standard IP spoofing techniques, if you wish to overcome this restriction (geolocation masking or 'geo-spoofing').

If you examine my original post, you'll notice that I am using Flash Player 10 (-f "WIN 10,1,53,64"). Thanks for pointing out that this doesn't work with Flash Player 9, which I hadn't realised.

I've made clear, also, that I ran these tests using Windows 7. Sorry if it doesn't work in WinXP. This version of RTMPdump (http://all-streaming-media.com/record-video-stream/rtmpdump-freeware-console-RTMP-downloading-application.htm) [v2.3] will work in WinXP or later, but I've never used XP so I've no idea what changes might be needed in order to use RTMPDUMP with XP. But if you're still using Flash Player 9 in XP, that's probably the cause.

greek33
07-10-2014, 05:21 AM
I can't understand why the hassle. To see anything decent you have to go private. or just watch the bs. To go private you have to have coins. I'm not getting the whole picture. Are you saying that that program will pick up all kind of streams? Even the private ones?

greek33
07-10-2014, 05:29 AM
If you want Getflv I have version 9318 with the crack. Could email it to ya. its only 20mb or so. I think it'll go through yahoo.