Audio/video stream recording forums (http://stream-recorder.com/forum/index.php)
-   rtmpdump (http://stream-recorder.com/forum/forumdisplay.php?f=54)
-   -  

City Council Public Video access

 (http://stream-recorder.com/forum/showthread.php?t=16593)

fedex1 08-26-2013 12:00 PM

City Council Public Video access


 
We have public city council videos that we'd like to download.

The direct link to the video is http://councilnyc.pegcentral.com/fla...tartState=play

I apologize for asking but I don't seem to be able to rtmpdump to download.

I know the protocol is RTMPE (encrypted). I've tried to understand via Wireshark, and many attempts at rtmpdump

Can anyone see what is missing? we receive a 0 byte file and a message "ERROR: RTMP_ReadPacket, failed to read RTMP packet header DEBUG: Closing connection."

Here are two attempts:

  • rtmpdump --live --verbose --debug -r "rtmpe://nyc.pegcentral.com/councilnyc/?doConnect=12345&doPublish=54321" -a "councilnyc/?doConnect=12345&doPublish=54321" -f "WIN 11,8,800,94" -W "http://councilnyc.pegcentral.com/flash/media_player_798c.swf?server=nyc-rtmp.pegcentral.com&account=councilnyc&videoFilena me=NYCC-PV-CH-Cha130822-153731.mp4&from=legistar&inTime=&startState=play" -p "http://legistar.council.nyc.gov/Video.aspx?Mode=Auto&URL=aHR0cDovL2NvdW5jaWxueWMuc GVnY2VudHJhbC5jb20vZmxhc2gvbWVkaWFfcGxheWVyXzc5OGM uc3dmP3NlcnZlcj1ueWMtcnRtcC5wZWdjZW50cmFsLmNvbSZhY 2NvdW50PWNvdW5jaWxueWMmdmlkZW9GaWxlbmFtZT1OWUNDLVB WLUNILUNoYTEzMDgyMi0xNTM3MzEubXA0&Mode2=Video" -y "mp4:NYCC-PV-CH-Cha130822-153731.mp4" -o mp4_NYCC-PV-CH-Cha130822-153731.flv
  • (added the swfsize and swfhash parameters) rtmpdump --live --verbose --debug --swfsize 18766 --swfhash 53001033c64d552f762e21ad63d1e01a199f02e42dd0b4cb92 d93869c9aeba27 -r "rtmpe://nyc.pegcentral.com/councilnyc/?doConnect=12345&doPublish=54321" -a "councilnyc/?doConnect=12345&doPublish=54321" -f "WIN 11,8,800,94" -W "http://councilnyc.pegcentral.com/flash/media_player_798c.swf?server=nyc-rtmp.pegcentral.com&account=councilnyc&videoFilena me=NYCC-PV-CH-Cha130822-153731.mp4&from=legistar&inTime=&startState=play" -p "http://legistar.council.nyc.gov/Video.aspx?Mode=Auto&URL=aHR0cDovL2NvdW5jaWxueWMuc GVnY2VudHJhbC5jb20vZmxhc2gvbWVkaWFfcGxheWVyXzc5OGM uc3dmP3NlcnZlcj1ueWMtcnRtcC5wZWdjZW50cmFsLmNvbSZhY 2NvdW50PWNvdW5jaWxueWMmdmlkZW9GaWxlbmFtZT1OWUNDLVB WLUNILUNoYTEzMDgyMi0xNTM3MzEubXA0&Mode2=Video" -y "mp4:NYCC-PV-CH-Cha130822-153731.mp4" -o mp4_NYCC-PV-CH-Cha130822-153731.flv

we post additional information - hitting 10000 character limit

fedex1 08-26-2013 12:02 PM

Re: City Council Public Video access


 
The result is:

Code:
(1st attempt with no hash parameter)


C:\Users\localadmin\Downloads\rtmpexplorer>rtmpdump --live --verbose --debug -r "rtmpe://nyc.pegcentral.com/councilnyc/?doConnect=12345&doPublish=54321" -a "councilnyc/?doConnect=12345&doPublish=54321" -f "WIN 11,8,800,94" -W "http://councilnyc.pegcentral.com/flash/media_player_798c.swf?server=nyc-rtmp.pegcentral.com&account=councilnyc&videoFilename=NYCC-PV-CH-Cha130822-153731.mp4&from=legistar&inTime=&startState=play" -p "http://legistar.council.nyc.gov/Video.aspx?Mode=Auto&URL=aHR0cDovL2NvdW5jaWxueWMucGVnY2VudHJhbC5jb20vZmxhc2gvbWVkaWFfcGxheWVyXzc5OGMuc3dmP3NlcnZlcj1ueWMtcnRtcC5wZWdjZW50cmFsLmNvbSZhY2NvdW50PWNvdW5jaWxueWMmdmlkZW9GaWxlbmFtZT1OWUNDLVBWLUNILUNoYTEzMDgyMi0xNTM3MzEubXA0&Mode2=Video" -y "mp4:NYCC-PV-CH-Cha130822-153731.mp4" -o mp4_NYCC-PV-CH-Cha130822-153731.flv
RTMPDump 2.4 git-6230845 2011-9-25
(c) 2010 Andrej Stepanchuk, Howard Chu, The Flvstreamer Team; license: GPL
DEBUG: Parsing...
DEBUG: Parsed protocol: 2
DEBUG: Parsed host    : nyc.pegcentral.com
DEBUG: Parsed app    : councilnyc
ERROR: RTMP_HashSWF: couldn't contact swfurl http://councilnyc.pegcentral.com/flash/media_player_798c.swf?server=nyc-rtmp.pegcentral.com&account=councilnyc&videoFilename=NYCC-PV-CH-Cha130822-153731.mp4&from=legistar&inTime=&startState=play (HTTP error 406)
DEBUG: Protocol : RTMPE
DEBUG: Hostname : nyc.pegcentral.com
DEBUG: Port    : 1935
DEBUG: Playpath : mp4:NYCC-PV-CH-Cha130822-153731.mp4
DEBUG: tcUrl    : rtmpe://nyc.pegcentral.com:1935/councilnyc/?doConnect=12345&doPublish=54321
DEBUG: swfUrl  : http://councilnyc.pegcentral.com/flash/media_player_798c.swf?server=nyc-rtmp.pegcentral.com&account=councilnyc&videoFilename=NYCC-PV-CH-Cha130822-153731.mp4&from=legistar&inTime=&startState=play
DEBUG: pageUrl  : http://legistar.council.nyc.gov/Video.aspx?Mode=Auto&URL=aHR0cDovL2NvdW5jaWxueWMucGVnY2VudHJhbC5jb20vZmxhc2gvbWVkaWFfcGxheWVyXzc5OGMuc3dmP3NlcnZlcj1ueWMtcnRtcC5wZWdjZW50cmFsLmNvbSZhY2NvdW50PWNvdW5jaWxueWMmdmlkZW9GaWxlbmFtZT1OWUNDLVBWLUNILUNoYTEzMDgyMi0xNTM3MzEubXA0&Mode2=Video
DEBUG: app      : councilnyc/?doConnect=12345&doPublish=54321
DEBUG: flashVer : WIN 11,8,800,94
DEBUG: live    : yes
DEBUG: timeout  : 30 sec
DEBUG: Setting buffer time to: 36000000ms
Connecting ...
DEBUG: RTMP_Connect1, ... connected, handshaking
DEBUG: HandShake: Client type: 06
DEBUG: HandShake: DH pubkey position: 166
DEBUG: HandShake: Client digest offset: 879
DEBUG: HandShake: Initial client digest:
DEBUG: 26 3d 01 cf 53 b2 98 68 7e dd b7 35 d5 cd 08 98
DEBUG: 86 09 52 8f 3e 75 2c 3b 58 6a 78 67 78 92 7e ba
DEBUG: HandShake: Type Answer  : 06
DEBUG: HandShake: Server Uptime : 1001869362
DEBUG: HandShake: FMS Version  : 3.0.2.1
WARNING: Trying different position for server digest!
DEBUG: HandShake: Server DH public key offset: 1164
DEBUG: HandShake: Secret key:
DEBUG: 32 0a ee f9 75 73 4f 3a 7b d7 d3 a2 be 01 b6 12
DEBUG: 0b 3a 82 c9 5d ef c0 b8 b7 bb d6 86 09 7a 79 e9
DEBUG: 1e ad 11 fd e1 f0 c8 0b 10 f4 06 e6 7b db 37 bf
DEBUG: 58 90 06 83 1f 0e ea 62 f6 5e 8c 14 13 62 3a 83
DEBUG: 0f 8c 89 a9 aa 42 46 7f 5d 87 37 fd 74 9a 20 4e
DEBUG: 61 2b 6f cb 0a 72 fe ca 77 12 c3 a5 4f 5c 23 7b
DEBUG: 2c 89 50 67 c0 00 0b 42 57 17 fc f8 75 3f e2 18
DEBUG: f9 ef 54 57 3a 9f 9b 93 42 37 b6 74 6d c6 73 4f
DEBUG: RC4 Out Key:
DEBUG: 54 a3 93 4d 65 1b 1d 04 52 f6 cb 17 fd 3c fd 1f
DEBUG: RC4 In Key:
DEBUG: 94 fc 9a 7c 37 7f 52 40 1e 56 42 a5 5d 30 fa d2
DEBUG: HandShake: Calculated digest key from secure key and server digest:
DEBUG: de f9 b3 aa 28 fc 9f 63 77 c1 04 aa 1b 59 b4 83
DEBUG: c0 58 45 cd a4 12 4a e7 05 c3 bb 4c 4b 02 68 7f
DEBUG: HandShake: Client signature calculated:
DEBUG: 4d 0c 50 87 b3 e9 62 3b 54 cd bc 75 d8 60 20 e5
DEBUG: 84 06 8a cc a1 88 10 f0 9f 59 60 66 a3 4b 66 ea
DEBUG: HandShake: Server sent signature:
DEBUG: b8 8d 1f 48 6d 75 4d 1b ba d2 36 f1 23 03 3f 92
DEBUG: d5 00 53 01 82 69 90 84 2c 32 7d 8b b0 b6 c6 94
DEBUG: HandShake: Digest key:
DEBUG: a8 fc 48 57 c1 bf 45 a2 a9 ce 79 b1 1c 26 87 5c
DEBUG: 3c 82 2a 0b e9 7f 20 9a 75 2b 6f 83 ba 6d 9d ec
DEBUG: HandShake: Signature calculated:
DEBUG: b8 8d 1f 48 6d 75 4d 1b ba d2 36 f1 23 03 3f 92
DEBUG: d5 00 53 01 82 69 90 84 2c 32 7d 8b b0 b6 c6 94
DEBUG: HandShake: Genuine Adobe Flash Media Server
DEBUG: HandShake: Handshaking finished....
DEBUG: RTMP_Connect1, handshaked
DEBUG2: RTMP_SendPacket: fd=404, size=780
DEBUG2:  0000:  03 00 00 00 00 03 0c 14  00 00 00 00              ............     
DEBUG2:  0000:  02 00 07 63 6f 6e 6e 65  63 74 00 3f f0 00 00 00  ...connect.?.... 
DEBUG2:  0010:  00 00 00 03 00 03 61 70  70 02 00 2b 63 6f 75 6e  ......app..+coun 
DEBUG2:  0020:  63 69 6c 6e 79 63 2f 3f  64 6f 43 6f 6e 6e 65 63  cilnyc/?doConnec 
DEBUG2:  0030:  74 3d 31 32 33 34 35 26  64 6f 50 75 62 6c 69 73  t=12345&doPublis 
DEBUG2:  0040:  68 3d 35 34 33 32 31 00  08 66 6c 61 73 68 56 65  h=54321..flashVe 
DEBUG2:  0050:  72 02 00 0f 57 49 4e 20  31 31 2c 38 2c 38 30 30  r...WIN 11,8,800 
DEBUG2:  0060:  2c 39 34 00 06 73 77 66  55 72 6c 02 00 c2 68 74  ,94..swfUrl...ht 
DEBUG2:  0070:  74 70 3a 2f 2f 63 6f 75  6e 63 69 6c 6e 79 63 2e  tp://councilnyc. 
DEBUG2:  0000:  c3                                                .               
DEBUG2:  0000:  70 65 67 63 65 6e 74 72  61 6c 2e 63 6f 6d 2f 66  pegcentral.com/f 
DEBUG2:  0010:  6c 61 73 68 2f 6d 65 64  69 61 5f 70 6c 61 79 65  lash/media_playe 
DEBUG2:  0020:  72 5f 37 39 38 63 2e 73  77 66 3f 73 65 72 76 65  r_798c.swf?serve

fedex1 08-26-2013 12:04 PM

Re: City Council Public Video access


 
Code:
...
...
DEBUG2:  0070:  78 4e 54 4d 33 4d 7a 45  75 62 58 41 30 26 4d 6f  xNTM3MzEubXA0&Mo 
DEBUG2:  0000:  c3                                                .               
DEBUG2:  0000:  64 65 32 3d 56 69 64 65  6f 00 00 09              de2=Video...     
DEBUG: Invoking connect
INFO: Connected...
DEBUG2: RTMP_ReadPacket: fd=404
DEBUG2:  0000:  02 00 00 00 00 00 04 05  00 00 00 00              ............     
DEBUG2:  0000:  00 26 25 a0                                        .&%.             
DEBUG: HandleServerBW: server BW = 2500000
DEBUG2: RTMP_ReadPacket: fd=404
DEBUG2:  0000:  02 00 00 00 00 00 05 06  00 00 00 00              ............     
DEBUG2:  0000:  00 26 25 a0 02                                    .&%..           
DEBUG: HandleClientBW: client BW = 2500000 2
DEBUG2: RTMP_ReadPacket: fd=404
DEBUG2:  0000:  02 00 00 00 00 00 06 04  00 00 00 00              ............     
DEBUG2:  0000:  00 00 00 00 00 00                                  ......           
DEBUG: HandleCtrl, received ctrl. type: 0, len: 6
DEBUG: HandleCtrl, Stream Begin 0
DEBUG2: RTMP_ReadPacket: fd=404
DEBUG2:  0000:  02 00 00 00 00 00 04 01  00 00 00 00              ............     
DEBUG2:  0000:  00 00 10 00                                        ....             
DEBUG: HandleChangeChunkSize, received: chunk size change to 4096
DEBUG2: RTMP_ReadPacket: fd=404
DEBUG2:  0000:  03 00 00 00 00 01 5d 14  00 00 00 00              ......].....     
DEBUG2:  0000:  02 00 07 5f 72 65 73 75  6c 74 00 3f f0 00 00 00  ..._result.?.... 
DEBUG2:  0010:  00 00 00 03 00 06 66 6d  73 56 65 72 02 00 0e 46  ......fmsVer...F 
DEBUG2:  0020:  4d 53 2f 33 2c 35 2c 37  2c 37 30 30 39 00 0c 63  MS/3,5,7,7009..c 
DEBUG2:  0030:  61 70 61 62 69 6c 69 74  69 65 73 00 40 3f 00 00  apabilities.@?.. 
DEBUG2:  0040:  00 00 00 00 00 04 6d 6f  64 65 00 3f f0 00 00 00  ......mode.?.... 
DEBUG2:  0050:  00 00 00 00 00 09 03 00  05 6c 65 76 65 6c 02 00  .........level.. 
DEBUG2:  0060:  06 73 74 61 74 75 73 00  04 63 6f 64 65 02 00 1d  .status..code... 
DEBUG2:  0070:  4e 65 74 43 6f 6e 6e 65  63 74 69 6f 6e 2e 43 6f  NetConnection.Co 
DEBUG2:  0080:  6e 6e 65 63 74 2e 53 75  63 63 65 73 73 00 0b 64  nnect.Success..d 
DEBUG2:  0090:  65 73 63 72 69 70 74 69  6f 6e 02 00 15 43 6f 6e  escription...Con 
DEBUG2:  00a0:  6e 65 63 74 69 6f 6e 20  73 75 63 63 65 65 64 65  nection succeede 
DEBUG2:  00b0:  64 2e 00 04 64 61 74 61  08 00 00 00 00 00 07 76  d...data.......v 
DEBUG2:  00c0:  65 72 73 69 6f 6e 02 00  0a 33 2c 35 2c 37 2c 37  ersion...3,5,7,7 
DEBUG2:  00d0:  30 30 39 00 00 09 00 08  63 6c 69 65 6e 74 69 64  009.....clientid 
DEBUG2:  00e0:  00 41 da dd 7f f5 80 00  00 00 0e 6f 62 6a 65 63  .A.........objec 
DEBUG2:  00f0:  74 45 6e 63 6f 64 69 6e  67 00 00 00 00 00 00 00  tEncoding....... 
DEBUG2:  0100:  00 00 00 0b 73 65 63 75  72 65 54 6f 6b 65 6e 02  ....secureToken. 
DEBUG2:  0110:  00 48 33 35 35 65 34 63  31 35 38 62 65 64 63 39  .H355e4c158bedc9 
DEBUG2:  0120:  61 32 65 34 61 37 32 39  62 61 31 38 65 61 36 65  a2e4a729ba18ea6e 
DEBUG2:  0130:  62 38 37 33 36 64 66 34  65 61 37 38 63 61 37 37  b8736df4ea78ca77 
DEBUG2:  0140:  34 35 37 62 61 38 31 34  30 38 34 62 37 63 64 33  457ba814084b7cd3 
DEBUG2:  0150:  32 66 32 64 61 35 31 37  39 34 00 00 09            2f2da51794...   
DEBUG: RTMP_ClientPacket, received: invoke 349 bytes
DEBUG: (object begin)
DEBUG: Property: <Name:          no-name., STRING:        _result>
DEBUG: Property: <Name:          no-name., NUMBER:        1.00>
DEBUG: Property: <Name:          no-name., OBJECT>
DEBUG: (object begin)
DEBUG: Property: <Name:            fmsVer, STRING:        FMS/3,5,7,7009>
DEBUG: Property: <Name:      capabilities, NUMBER:        31.00>
DEBUG: Property: <Name:              mode, NUMBER:        1.00>
DEBUG: (object end)
DEBUG: Property: <Name:          no-name., OBJECT>
DEBUG: (object begin)
DEBUG: Property: <Name:              level, STRING:        status>
DEBUG: Property: <Name:              code, STRING:        NetConnection.Connect.Success>
DEBUG: Property: <Name:        description, STRING:        Connection succeeded.>
DEBUG: Property: <Name:              data, OBJECT>
DEBUG: (object begin)
DEBUG: Property: <Name:            version, STRING:        3,5,7,7009>
DEBUG: (object end)
DEBUG: Property: <Name:          clientid, NUMBER:        1802895318.00>
DEBUG: Property: <Name:    objectEncoding, NUMBER:        0.00>
DEBUG: Property: <Name:        secureToken, STRING:        355e4c158bedc9a2e4a729ba18ea6eb8736df4ea78ca77457ba814084b7cd32f2da51794>
DEBUG: (object end)
DEBUG: (object end)
DEBUG: HandleInvoke, server invoking <_result>
DEBUG: HandleInvoke, received result for method call <connect>
DEBUG2: RTMP_SendPacket: fd=404, size=4
DEBUG2:  0000:  02 00 00 00 00 00 04 05  00 00 00 00              ............     
DEBUG2:  0000:  00 26 25 a0                                        .&%.             
DEBUG: sending ctrl. type: 0x0003
DEBUG2: RTMP_SendPacket: fd=404, size=10
DEBUG2:  0000:  42 00 00 00 00 00 0a 04                            B.......         
DEBUG2:  0000:  00 03 00 00 00 00 00 00  01 2c                    .........,       
DEBUG2: RTMP_SendPacket: fd=404, size=25
DEBUG2:  0000:  43 00 00 00 00 00 19 14                            C.......         
DEBUG2:  0000:  02 00 0c 63 72 65 61 74  65 53 74 72 65 61 6d 00  ...createStream. 
DEBUG2:  0010:  40 00 00 00 00 00 00 00  05                        @........       
DEBUG: Invoking createStream
DEBUG: FCSubscribe: mp4:NYCC-PV-CH-Cha130822-153731.mp4
DEBUG2: RTMP_SendPacket: fd=404, size=62
DEBUG2:  0000:  43 00 00 00 00 00 3e 14                            C.....>.         
DEBUG2:  0000:  02 00 0b 46 43 53 75 62  73 63 72 69 62 65 00 40  ...FCSubscribe.@ 
DEBUG2:  0010:  08 00 00 00 00 00 00 05  02 00 23 6d 70 34 3a 4e  ..........#mp4:N 
DEBUG2:  0020:  59 43 43 2d 50 56 2d 43  48 2d 43 68 61 31 33 30  YCC-PV-CH-Cha130 
DEBUG2:  0030:  38 32 32 2d 31 35 33 37  33 31 2e 6d 70 34        822-153731.mp4   
DEBUG: Invoking FCSubscribe
DEBUG2: RTMP_ReadPacket: fd=404
DEBUG2:  0000:  03 00 00 00 00 00 1d 14  00 00 00 00              ............     
DEBUG2:  0000:  02 00 07 5f 72 65 73 75  6c 74 00 40 00 00 00 00  ..._result.@.... 
DEBUG2:  0010:  00 00 00 05 00 3f f0 00  00 00 00 00 00            .....?.......   
DEBUG: RTMP_ClientPacket, received: invoke 29 bytes
DEBUG: (object begin)
DEBUG: Property: <Name:          no-name., STRING:        _result>
DEBUG: Property: <Name:          no-name., NUMBER:        2.00>
DEBUG: Property: NULL
DEBUG: Property: <Name:          no-name., NUMBER:        1.00>
DEBUG: (object end)
DEBUG: HandleInvoke, server invoking <_result>
DEBUG: HandleInvoke, received result for method call <createStream>
DEBUG: SendPlay, seekTime=0, stopTime=0, sending play: mp4:NYCC-PV-CH-Cha130822-153731.mp4
DEBUG2: RTMP_SendPacket: fd=404, size=64
DEBUG2:  0000:  08 00 00 00 00 00 40 14  01 00 00 00              ......@.....     
DEBUG2:  0000:  02 00 04 70 6c 61 79 00  40 10 00 00 00 00 00 00  ...play.@....... 
DEBUG2:  0010:  05 02 00 23 6d 70 34 3a  4e 59 43 43 2d 50 56 2d  ...#mp4:NYCC-PV- 
DEBUG2:  0020:  43 48 2d 43 68 61 31 33  30 38 32 32 2d 31 35 33  CH-Cha130822-153 
DEBUG2:  0030:  37 33 31 2e 6d 70 34 00  c0 8f 40 00 00 00 00 00  731.mp4...@..... 
DEBUG: Invoking play
DEBUG: sending ctrl. type: 0x0003
DEBUG2: RTMP_SendPacket: fd=404, size=10
DEBUG2:  0000:  c2                                                .               
DEBUG2:  0000:  00 03 00 00 00 01 02 25  51 00                    .......%Q.       
DEBUG2: RTMP_ReadPacket: fd=404
DEBUG2: RTMP_SendPacket: fd=404, size=34
DEBUG2:  0000:  43 00 00 00 00 00 22 14                            C.....".         
DEBUG2:  0000:  02 00 0c 64 65 6c 65 74  65 53 74 72 65 61 6d 00  ...deleteStream. 
DEBUG2:  0010:  40 14 00 00 00 00 00 00  05 00 3f f0 00 00 00 00  @.........?..... 
DEBUG2:  0020:  00 00                                              ..               
DEBUG: Invoking deleteStream
ERROR: RTMP_ReadPacket, failed to read RTMP packet header
DEBUG: Closing connection.

chap 08-26-2013 03:16 PM

Re: City Council Public Video access


 
Code:
rtmpdump -r "rtmpe://nyc.pegcentral.com/councilnyc/" -a "councilnyc/?doConnect=12345&doPublish=54321" -f "WIN 11,8,800,94" -W "http://councilnyc.pegcentral.com/flash/media_player_798c.swf" -p "http://councilnyc.pegcentral.com/flash/media_player_798c.swf?server=nyc-rtmp.pegcentral.com&account=councilnyc&videoFilename=NYCC-PV-CH-Cha130822-153731.mp4&from=legistar&inTime=&startState=play" -y "mp4:NYCC-PV-CH-Cha130822-153731.mp4" -o "2013-08-26_11-53-22_mp4_NYCC-PV-CH-Cha130822-153731.flv" -T "2JNxehiz"

fedex1 08-26-2013 09:07 PM

Re: City Council Public Video access


 
Thanks very much chap!

I notice that the key for secure token response that you posted works for other videos on that same site. thanks again.

Can you point us to a page where it describes how to derive the key for the secure token response?

I've tried flasm and ffdec.jar etc with no success.


All times are GMT -6. The time now is 10:23 PM.