rtmpdump problems on CBS.com

japzone · #1 06-17-2010, 02:20 PM

I'm trying to download episodes from cbs.com with rtmpdump but no matter what I try I get an error of one type or another. I Manually sifted through the source code and found a file called "content.select" I downloaded the file and opened with gedit and found a rtmp url in it:

Code:

rtmp://cp21927.edgefcs.net/ondemand/?auth=dbEbqcNdpbAcVdbcicGdac4dTbmaUdIdiaD-bmgK97-bla-d9i-KbFPhVpf&amp;aifp=v001&amp;slist=video/_!/CBS_Production/385/439/CBS_ENTERPRISE_001_CONTENT_CIAN&lt;break&gt;video/_!/CBS_Production/385/439/CBS_ENTERPRISE_001_CONTENT_CIAN.flv

But whenever I try to use it with rtmpdump I get this:

Code:

user@ubuntu:~$ '/home/user/Downloads/rtmpdump-2.2e/rtmpdump' -r "rtmp://cp21927.edgefcs.net/ondemand/?auth=dbEbqcNdpbAcVdbcicGdac4dTbmaUdIdiaD-bmgK97-bla-d9i-KbFPhVpf&amp;aifp=v001&amp;slist=video/_!/CBS_Production/385/439/CBS_ENTERPRISE_001_CONTENT_CIAN" -o CBS_ENTERPRISE_001_CONTENT_CIAN.flv
bash: !/CBS_Production/385/439/CBS_ENTERPRISE_001_CONTENT_CIAN": event not found

I find that this is probably because Terminal misinterprets part of the url for a Terminal command. However trying to modify it gets me nowhere as well:

Code:

user@ubuntu:~$ '/home/user/Downloads/rtmpdump-2.2e/rtmpdump' -r "rtmp://cp21927.edgefcs.net:1935/ondemand?ovpfv=1.1&?auth=dbEbmbFcHa.aTbgaWdwcKaRb9aJaMdibCdd-bmgMEj-bla-d9i-GaxOfUld&slist=video%2F_2FCBS_Production%2F385%2F439%2FCBS_ENTERPRISE_001_CONTENT_CIAN" -o CBS_ENTERPRISE_001_CONTENT_CIAN.flv
RTMPDump v2.2e
(c) 2010 Andrej Stepanchuk, Howard Chu, The Flvstreamer Team; license: GPL
Connecting ...
INFO: Connected...
ERROR: rtmp server sent error
ERROR: rtmp server requested close

I tried using rtmpsrv to catch the needed stuff but I get this error:

Code:

rtmpuser@ubuntu:/home/user$ '/home/user/Downloads/rtmpdump-2.2e/rtmpsrv' 
RTMP Server v2.2e
(c) 2010 Andrej Stepanchuk, Howard Chu; license: GPL

Streaming on rtmp://0.0.0.0:1935
WARNING: Trying different position for client digest!
ERROR: RTMP_ReadPacket, failed to read RTMP packet header
Closing connection... done!

WARNING: Trying different position for client digest!
ERROR: Handshake failed
Closing connection... done!

^CCaught signal: 2, cleaning up, just a second...

Obviously it didn't do squat for me.
Next I used rtmpsuck but...:

Code:

rtmpuser@ubuntu:/home/user$ '/home/user/Downloads/rtmpdump-2.2e/rtmpsuck' 
RTMP Proxy Server v2.2e
(c) 2010 Andrej Stepanchuk, Howard Chu; license: GPL

Streaming on rtmp://0.0.0.0:1935
WARNING: Trying different position for client digest!
Processing connect
app: ondemand?ovpfv=1.1&?auth=dbEbmbFcHa.aTbgaWdwcKaRb9aJaMdibCdd-bmgMEj-bla-d9i-GaxOfUld&amp;aifp=v001&slist=video%2F_!%2FCBS_Production%2F385%2F439%2FCBS_ENTERPRISE_001_CONTENT_CIAN
flashVer: LNX 10,0,45,2
swfUrl: http://www.cbs.com/[[IMPORT]]/vidtech.cbsinteractive.com/player/2_3_1/CBSI_PLAYER.swf
ERROR: RTMP_HashSWF: swfurl http://www.cbs.com/[[IMPORT]]/vidtech.cbsinteractive.com/player/2_3_1/CBSI_PLAYER.swf not found
tcUrl: rtmp://cp21927.edgefcs.net:1935/ondemand?ovpfv=1.1&?auth=dbEbmbFcHa.aTbgaWdwcKaRb9aJaMdibCdd-bmgMEj-bla-d9i-GaxOfUld&amp;aifp=v001&slist=video%2F_!%2FCBS_Production%2F385%2F439%2FCBS_ENTERPRISE_001_CONTENT_CIAN
pageUrl: http://www.cbs.com/classics/star_trek_enterprise/video/?pid=QZi4Rl8ZCZAKn73WZA2XQQ0kA_lSanQ7&vs=Default&play=true
ERROR: RTMP_ReadPacket, failed to read RTMP packet header
Closing connection... done!

^CCaught signal: 2, cleaning up, just a second...

I've been at this for a while and haven't made any progress. Any attepts at using the above Info from rtmpsuck failed as well. Any help would be much appreciated.

The URL for the Video is:
http://www.cbs.com/classics/star_trek_enterprise/video/?pid=QZi4Rl8ZCZAKn73WZA2XQQ0kA_lSanQ7&vs=Default&p lay=false

The "content.select" file from the Video's page is attached below as a Text File. To View it properly you should rename it to the ".xml" extension.

#2 06-18-2010, 02:11 AM

How can I download video streams from cbs.com with freeware rtmpdump?

a_10jqka_2010 · #3 09-19-2010, 12:39 AM

The answer of your problem is that CBS.com will change the authorization code when client would

play ( or get ) the episode. If you manually sift the same episode for serveral times,

the "auth=???" is different in your mentioned the "content.select".

Unfortunately, rtmpDump can't solve the problem so far.

But there is method to help you download episodes from cbs.com with Paw Robot which developed by

a_10jqka_2010.

I can show some episodes which download from cbs.com.

Any question, please contract with: a_10jqka_2010@live.cn

japzone · #4 09-19-2010, 09:04 AM

What exactly does Paw Robot do?

a_10jqka_2010 · #5 11-04-2010, 05:01 AM

Just like what I said, in some websites, the RTMP server will change the code behind the "auth=".

Why the customer can see the same clip for serval times by the Firefox or IE browser, but the rtmpdump can't dump the same clip using the same authorization code ? Because there are some JavaScript in the webpage of the clip, when customer click the play button, the browser will require the authorization code, after that, the RTMP server will reply the new authorization code.

It is emphasis that the authorization code is used only for this time. So if you use the authorization code again, the RTMP server will reject the requirement.

Paw Robot just do the same thing like browser, Paw Robot will require the authorization code actively, so Paw Robot can work.

#6 11-04-2010, 11:51 AM

In case of expiring authorization code one can use software allowing to capture packets from flash player. Such recorders allow to save HTTP and RTMP streams while you watch them. To capture RTMP streams you can use freeware rtmpsuck, CooJah, Orbit Grab Pro, shareware Replay Media Catcher 4.

jcj2002 · #7 01-01-2011, 05:45 AM

Thanks stream-recording for your answers.

I had a similar problem with rtmpsrv and rtmpsuck, and an error saying:

WARNING: Trying different position for client digest!

A question: how rtmpsuck can be used for negotiating the changing and expired authorization codes (auth=???)

Thanks in advance

nullacht · #8 02-19-2011, 08:03 AM

Quote:

Originally Posted by japzone

I'm trying to download episodes from cbs.com with rtmpdump but no matter what I try I get an error of one type or another.

I've used rtmpsrv and got the following result:

Code:

RTMP Server v2.3
(c) 2010 Andrej Stepanchuk, Howard Chu; license: GPL

Streaming on rtmp://0.0.0.0:1935
WARNING: Trying different position for client digest!

rtmpdump -r "rtmp://cp48590.edgefcs.net:1935/ondemand?ovpfv=1.1&?auth=dbEcVd2dccdd6cObAaSaua3cndMaTdkcWc6-bnx7rr-h0-buy-LcAPeWmg&amp;aifp=v001&amp;slist=video%2Ftemp_hd_gallery_video%2FCBS_Production%2F640%2F357%2F" -a "ondemand?ovpfv=1.1&?auth=dbEcVd2dccdd6cObAaSaua3cndMaTdkcWc6-bnx7rr-h0-buy-LcAPeWmg&amp;aifp=v001&amp;slist=video%2Ftemp_hd_gallery_video%2FCBS_Production%2F640%2F357%2F" -f "WIN 10,1,102,64" -W "http://www.cbs.com/[[IMPORT]]/vidtech.cbsinteractive.com/player/2_7_1/CBSI_PLAYER.swf" -p "http://www.cbs.com/primetime/undercover_boss/video/?play=true&pid=qMdNudtOCXsLcrVXTxsiAtYL5vElBq7h" -C Z: -y "mp4:video/temp_hd_gallery_video/CBS_Production/640/357/CBS_BOSS_214_CONTENT_CIAN__940417.mp4" -o CBS_BOSS_214_CONTENT_CIAN__940417.flv

Closing connection... done!

Now, i had to change the swfUrl:

Code:

-W "http://www.cbs.com/[[IMPORT]]/vidtech.cbsinteractive.com/player/2_7_1/CBSI_PLAYER.swf"

Code:

-W "http://vidtech.cbsinteractive.com/player/2_7_1/CBSI_PLAYER.swf"

Modified command line:

Code:

rtmpdump -r "rtmp://cp48590.edgefcs.net:1935/ondemand?ovpfv=1.1&?auth=dbEcVd2dccdd6cObAaSaua3cndMaTdkcWc6-bnx7rr-h0-buy-LcAPeWmg&amp;aifp=v001&amp;slist=video%2Ftemp_hd_gallery_video%2FCBS_Production%2F640%2F357%2F" -a "ondemand?ovpfv=1.1&?auth=dbEcVd2dccdd6cObAaSaua3cndMaTdkcWc6-bnx7rr-h0-buy-LcAPeWmg&amp;aifp=v001&amp;slist=video%2Ftemp_hd_gallery_video%2FCBS_Production%2F640%2F357%2F" -f "WIN 10,1,102,64" -W "http://vidtech.cbsinteractive.com/player/2_7_1/CBSI_PLAYER.swf" -p "http://www.cbs.com/primetime/undercover_boss/video/?play=true&pid=qMdNudtOCXsLcrVXTxsiAtYL5vElBq7h" -C Z: -y "mp4:video/temp_hd_gallery_video/CBS_Production/640/357/CBS_BOSS_214_CONTENT_CIAN__940417.mp4" -o CBS_BOSS_214_CONTENT_CIAN__940417.flv

Code:

RTMPDump v2.3
(c) 2010 Andrej Stepanchuk, Howard Chu, The Flvstreamer Team; license: GPL
Connecting ...
INFO: Connected...
Starting download at: 0.000 kB
INFO: Metadata:
INFO:   duration              2620.98
INFO:   moovPosition          28.00
INFO:   width                 640.00
INFO:   height                360.00
INFO:   videocodecid          avc1
INFO:   audiocodecid          mp4a
INFO:   avcprofile            100.00
INFO:   avclevel              40.00
INFO:   aacaot                2.00
INFO:   videoframerate        29.97
INFO:   audiosamplerate       22050.00
INFO:   audiochannels         2.00
INFO: trackinfo:
INFO:   length                78626548.00
INFO:   timescale             30000.00
INFO:   language              eng
INFO: sampledescription:
INFO:   sampletype            avc1
INFO:   length                57792511.00
INFO:   timescale             22050.00
INFO:   language              eng
INFO: sampledescription:
INFO:   sampletype            mp4a
245961.853 kB / 2620.93 sec (99.9%)
Download complete

Link: http://www.cbs.com/primetime/undercover_boss/video/?play=true&pid=qMdNudtOCXsLcrVXTxsiAtYL5vElBq7h