theprovince.com: Ripping an RTMP stream with rtmpdump... going nowhere

7ni4UnAsuA · #1 11-17-2009, 10:12 PM

I've used rtmpdump before successfully for example, to rip stream clips from CBC.ca . Right now I'm trying to rip a video from theprovince.ca website, this video here

Code:

http://www.theprovince.com/news/videos/index.html#GH4BFo7oIg2Ly_qFrdAhA2GI4duw6xyt

I've read all the threads in this section to get a run-down on some of the more advanced techniques. From what I gather this is my full version command line:

Code:

rtmpdump -w 583abba3bc1e1a28ca8f8c654dc1b8374d87b5a80007ba07c349cef467cd5
b09 -x 216505 -s "http://www.theprovince.com/multimedia/video/swf/flvPlayer.swf"
 -r "rtmp://cp68812.edgefcs.net/ondemand/?auth=dbEbldZcXaWdfdqdJb8dwcma3cVdHb_dU
bQ-bla2Dl-4q-d9i-2qmFJn6zsIH0R2&amp;aifp=1234&amp;slist=Canwest_The_Province/&lt
;break&gt;Canwest_The_Province/Task0042_-_Video_of_the_arrest_-_071119_-_GODARD_
_697887.flv" -o "Video_of_the_arrest_-_071119_-_GODARD__697887.flv"
RTMPDump v1.6
(c) 2009 Andrej Stepanchuk, license: GPL

DEBUG: Parsing...
DEBUG: Parsed protocol: 0
DEBUG: Parsed host    : cp68812.edgefcs.net
DEBUG: Parsed app     : ondemand/?auth=dbEbldZcXaWdfdqdJb8dwcma3cVdHb_dUbQ-bla2D
l-4q-d9i-2qmFJn6zsIH0R2&amp;aifp=1234&amp;slist=Canwest_The_Province/&lt;break&g
t;Canwest_The_Province/Task0042_-_Video_of_the_arrest_-_071119_-_GODARD__697887.
flv
DEBUG: Parsed playpath: Canwest_The_Province/
DEBUG: Setting buffer time to: 36000000ms
Connecting ...
DEBUG: Protocol : RTMP
DEBUG: Hostname : cp68812.edgefcs.net
DEBUG: Port     : 1935
DEBUG: Playpath : Canwest_The_Province/
DEBUG: tcUrl    : rtmp://cp68812.edgefcs.net:1935/ondemand/?auth=dbEbldZcXaWdfdq
dJb8dwcma3cVdHb_dUbQ-bla2Dl-4q-d9i-2qmFJn6zsIH0R2&amp;aifp=1234&amp;slist=Canwes
t_The_Province/&lt;break&gt;Canwest_The_Province/Task0042_-_Video_of_the_arrest_
-_071119_-_GODARD__697887.flv
DEBUG: swfUrl   : http://www.theprovince.com/multimedia/video/swf/flvPlayer.swf
DEBUG: app      : ondemand/?auth=dbEbldZcXaWdfdqdJb8dwcma3cVdHb_dUbQ-bla2Dl-4q-d
9i-2qmFJn6zsIH0R2&amp;aifp=1234&amp;slist=Canwest_The_Province/&lt;break&gt;Canw
est_The_Province/Task0042_-_Video_of_the_arrest_-_071119_-_GODARD__697887.flv
DEBUG: flashVer : LNX 9,0,124,0
DEBUG: live     : no
DEBUG: timeout  : 300 sec
DEBUG: SWFSHA256:
58 3A BB A3 BC 1E 1A 28 CA 8F 8C 65 4D C1 B8 37 4D 87 B5 A8 00 07 BA 07 C3 49 CE
 F4 67 CD 5B 09
DEBUG: SWFSize  : 216505
DEBUG: Connect, ... connected, handshaking
DEBUG: HandShake: Client type: 03

DEBUG: HandShake: Client digest offset: 620
DEBUG: HandShake: Initial client digest:
3D 74 B5 EB B7 AB C7 16 0A 4C 48 74 35 0F 4B EF A7 BF 45 AC 58 6B E0 4D B5 E2 5B
 36 A1 96 B4 40
DEBUG: HandShake: Type Answer   : 03
DEBUG: HandShake: Server Uptime : 1649759843
DEBUG: HandShake: FMS Version   : 3.0.3.1
WARNING: Trying different position for server digest!

DEBUG: HandShake: Server DH public key offset: 813
DEBUG: HandShake: Client signature digest position: 620
DEBUG: HandShake: Digest key:
43 E6 44 0D D7 25 06 63 66 F7 64 3F 16 9C EA 92 A0 40 86 4A 86 6F 81 29 6B 25 81
 0A D0 F9 14 F9
DEBUG: HandShake: Signature calculated:
88 3F 1D A7 7A C4 C3 88 14 2B 0C 8F 4C D0 9E B0 8A 85 4D 4C 17 E2 F4 69 23 40 9E
 C1 33 5D 8F AC
DEBUG: HandShake: Server sent signature:
88 3F 1D A7 7A C4 C3 88 14 2B 0C 8F 4C D0 9E B0 8A 85 4D 4C 17 E2 F4 69 23 40 9E
 C1 33 5D 8F AC
DEBUG: HandShake: Genuine Adobe Flash Media Server
DEBUG: HandShake: Calculated digest key from secure key and server digest:
91 4B E3 D0 48 3D 3B 4D 88 E7 02 F5 16 4E FB 68 26 F9 E0 C8 00 20 B0 08 BF 5A 43
 29 68 4A 8B 78
DEBUG: HandShake: Client signature calculated:
7D A3 BF 0A 59 31 2B 92 DA C0 C5 CA CB 40 20 D8 BE D2 3E F1 F5 60 14 4D 21 09 8B
 40 D9 8B 55 05
DEBUG: HandShake: Handshaking finished....
DEBUG: Connect, handshaked
Connected...

Starting download at 0.000 KB
DEBUG: GetNextMediaPacket, received: server BW
DEBUG: GetNextMediaPacket, received: client BW
DEBUG: HandlePing, received ping. type: 0, len: 6
DEBUG: GetNextMediaPacket, received: invoke 190 bytes
DEBUG: Property: <Name:                  no-name., STRING:      _result>
DEBUG: Property: <Name:                  no-name., NUMBER:      1.00>
DEBUG: Property: <Name:                  no-name., OBJECT>
DEBUG: Property: <Name:                    fmsVer, STRING:      FMS/3,0,3,333>
DEBUG: Property: <Name:              capabilities, NUMBER:      31.00>
DEBUG: Property: <Name:                  no-name., OBJECT>
DEBUG: Property: <Name:                     level, STRING:      status>
DEBUG: Property: <Name:                      code, STRING:      NetConnection.Co
nnect.Success>
DEBUG: Property: <Name:               description, STRING:      Connection succe
eded.>
DEBUG: Property: <Name:            objectEncoding, NUMBER:      0.00>
DEBUG: HandleInvoke, server invoking <_result>
DEBUG: HandleInvoke, received result for method call <connect>
DEBUG: sending ping. type: 0x0003
DEBUG: GetNextMediaPacket, received: invoke 21 bytes
DEBUG: Property: <Name:                  no-name., STRING:      onBWDone>
DEBUG: Property: <Name:                  no-name., NUMBER:      0.00>
DEBUG: HandleInvoke, server invoking <onBWDone>
DEBUG: GetNextMediaPacket, received: invoke 29 bytes
DEBUG: Property: <Name:                  no-name., STRING:      _result>
DEBUG: Property: <Name:                  no-name., NUMBER:      2.00>
DEBUG: Property: NULL
DEBUG: Property: <Name:                  no-name., NUMBER:      1.00>
DEBUG: HandleInvoke, server invoking <_result>
DEBUG: HandleInvoke, received result for method call <createStream>
DEBUG: SendPlay, sending play: Canwest_The_Province/
DEBUG: sending ping. type: 0x0003
DEBUG: HandlePing, received ping. type: 0, len: 6
DEBUG: GetNextMediaPacket, received: invoke 203 bytes
DEBUG: Property: <Name:                  no-name., STRING:      onStatus>
DEBUG: Property: <Name:                  no-name., NUMBER:      0.00>
DEBUG: Property: NULL
DEBUG: Property: <Name:                  no-name., OBJECT>
DEBUG: Property: <Name:                     level, STRING:      error>
DEBUG: Property: <Name:                      code, STRING:      NetStream.Play.S
treamNotFound>
DEBUG: Property: <Name:               description, STRING:      Failed to play C
anwest_The_Province/; stream not found.>
DEBUG: Property: <Name:                   details, STRING:      Canwest_The_Prov
ince/>
DEBUG: Property: <Name:                  clientid, STRING:      EWlIgEEo>
DEBUG: HandleInvoke, server invoking <onStatus>
DEBUG: HandleInvoke, onStatus: NetStream.Play.StreamNotFound
Closing connection... done!

I think (i'm doing everything right) but nothing works to get the video to start downloading. Error says play stream not found. And I captured the rtmp file using URL Snooper.

#2 11-18-2009, 07:53 AM

I was able to download the video with Replay Media Catcher (RMC), so the RTMP video stream doesn't use SWF verification. This means that you can provide less parameters to rtmpdump. You can also try rtmpdump 1.9.

If you don't want to use commercial software like RMC and Jaksta, you can try freeware Orbit Downloader and Grab Pro, CooJah + Blader, TubeMaster++. The latter program didn't work for me.

7ni4UnAsuA · #3 11-18-2009, 06:39 PM

Quote:

Originally Posted by Stream Recorder

I was able to download the video with Replay Media Catcher (RMC), so the RTMP video stream doesn't use SWF verification. This means that you can provide less parameters to rtmpdump. You can also try rtmpdump 1.9.

If you don't want to use commercial software like RMC and Jaksta, you can try freeware Orbit Downloader and Grab Pro, CooJah + Blader, TubeMaster++. The latter program didn't work for me.

Hi, thanks so much for your reply !

I downloaded rtmpdump 1.9, and gnu make for win32 . During the process I could not get it to work. Ideas ?

Code:

C:\tmp\rtmpdump-1.9>mingw32-make.exe mingw
mingw32-make.exe[1]: Entering directory `C:/tmp/rtmpdump-1.9'
mingw32-mingw32-gcc -Wall   -O2   -c -o bytes.o bytes.c
process_begin: CreateProcess(NULL, mingw32-mingw32-gcc -Wall -O2 -c -o bytes.o b
ytes.c, ...) failed.
make (e=2): The system cannot find the file specified.
mingw32-make.exe[1]: *** [bytes.o] Error 2
mingw32-make.exe[1]: Leaving directory `C:/tmp/rtmpdump-1.9'
mingw32-make.exe: *** [mingw] Error 2

i edited the makefile and replaced gcc and cc with mingw32-gcc and mingw32-cc

ill keep trying to download with rtmpdump 1.6 .

update: well, getting to compile does not matter; i found someone else did it online and so i re-uploaded it to some sites:

Code:

http://www.uploadjockey.com/download/6804932/rtmpdump1.9win32.rar
http://rapidshare.com/files/308999399/rtmpdump1.9win32.rar

update: i tried with this new version, does not work at all. and Replay Media Catcher downloads VERY slowly. can you help to make download work with rtmpdump ?? and show how you did it

#4 11-19-2009, 04:23 AM

Replay Media Catcher works pretty fast for me. I don't know how to help with rtmpdump, but you can try other software mentioned above.

7ni4UnAsuA · #5 11-20-2009, 05:35 PM

Quote:

Originally Posted by Stream Recorder

Replay Media Catcher works pretty fast for me. I don't know how to help with rtmpdump, but you can try other software mentioned above.

hi, i tried Replay Media Catcher, it works. I guess rtmpdump is fail, and no one can figure out how to use it except the developer. Yet another open source failure.

compn · #6 12-02-2009, 08:21 AM

this one seems pretty tough.
heres what Replay Media Catcher reports:

RTMP App: rtmp://cp68812.edgefcs.net:80/ondemand/?auth=dbEd3awdOcMbPaVcEdDd.cncPdXcHaEaSdb-blfNiW-4q-d9i-6nnGAp6xoFIZM4&aifp=1234&slist=Canwest_The_Provinc e/
Media Path: Canwest_The_Province/Task0042_-_Video_of_the_arrest_-_071119_-_GODARD__697887

but i cant get it working in rtmpdump. the ?auth looks like a timestamp.

compn · #7 12-03-2009, 01:38 PM

i asked on rtmpdump mailing list and someone came up with this line that works.

but you have to get an updated auth= part, or it wont work.

Code:

rtmpdump -s "http://www.theprovince.com/multimedia/video/swf/flvPlayer.swf" -r "rtmp://cp68812.edgefcs.net/ondemand/?auth=dbEbmcfblbJapb3dSbTbGaxbDcKb7bPdaag-blf95n-4q-d9i-3pqEBo3wsGG0Q2&aifp=1234&slist=Canwest_The_Province/" -y Canwest_The_Province/Task0042_-_Video_of_the_arrest_-_071119_-_GODARD__697887 -o "Video_of_the_arrest_-_071119_-_GODARD__697887.flv"