Download ITV Player using RTMPDump?

Download ITV Player using RTMPDump?

 

Hi, I am wondering if it is possible to use RTMPdump to download videos from itv player? I even have the direct link, but it will not work..

this is the link to the video I wish to download.

I searched the forums, but couldnt find anything on downloading from ITV Player, does no one use it?

Hope its possible, thanks for the help.

KarlAny idea how to stop that smily face appearing in the link? the missing items are ": p" without the space.

Re: RTMPDump and ITV Player?

 

There might be some parameters missing. Have you tried rtmpsuck?

See also http://lists.mplayerhq.hu/pipermail/...er/000097.html for a related issue.

Re: RTMPDump and ITV Player?

 

I may be able to help you (had some experience with rtmpdump), but where did you get the direct link?

I have been looking through the source code of _http://www.itv.com/channels/itv1/default.html but was unable find a direct link


grtz,
crk

Re: RTMPDump and ITV Player?

 

Re: rtmpdump does not start & error: HandShake: Type mismatch: client sent 6, server

 

Tested rtmpdump 2.4, does NOT work with iTV Player, still get the same dreaded message:

WARNING: HandShake: Type mismatch: client sent 6, server answered 9

Re: rtmpdump does not start & error: HandShake: Type mismatch: client sent 6, server

 

it's working as expected.

What to do next? Slightly confused in sequence

 

Dear all

I am a rugby coach and have been following the Rugby World Cup currently going on in New Zealand.
I want to use some sections of the games to use in coaching presentations, to highlight various technical points.
I am attempting to record some of the games that can be accessed by the (UK) ITV catchup facility, ITVplayer

I am using Ubuntu v11 and have installed RTMPdump and Wireshark.

What I do is:
Start Wireshark in privileged mode
Select wlan0 as the device (I am on a wifi broadband in the house) (This seems to be the correct device as a lot of streaming info *is* recorded)
I start the playback of the match I wish to record (eg _http://www.itv.com/itvplayer/video/?Filter=?271631)
I let the playback play for a while (including the compulsory adverts!), even stopping and starting the playback a couple of times as suggested by other forums and sources.
I then look at the Wireshark buffered info.
...and then I get very confused.

Other areas (eg Youtube videos etc) suggest that I filter for the RTMPT package types and then look for strings such as "invoke" or "handshake" but these seem to be either missing or not there at all. And this is even before I attempt to find out what the hidden stream source is and then do the "Follow TCP stream" that I am supposed to do (correct?)

What am I missing in my efforts to record the playback streaming?
I have tried doing a filter on RTMPT *before* starting the payback and also *after* doing so. I have also tried other package types (DNS, RTMPE etc) but am still slightly lost as to the data I am looking at.
Can anyone point out (preferably as an idiot's guide) what series of steps I *should* be doing?
Many thanks

an exasperated and confused newbie

Re: What to do next? Slightly confused in sequence

 

Re: Download ITV Player using RTMPDump?

 

There seems to be a paucity of information on the web (and on this site as well) regarding recording of ITVplayer streams - so perhaps we/(the real experts that I am trying to contact) can start from scratch and set up a definitive series of actions to enable the relevant streams to be saved - both for Windows and Linux? As I have indicated above, I have a technical requirement to use some of the programme images in a presentation shortly! Perhaps this sort of project can be extended to other 'catchup' players/other streaming sources.

First of all, does anyone know what format the ITV iPlayer programmes are streamed in? FLV, asf?
Are they "DRM'd" ?
What is the best/easiest method of obtaining the 'real' URL for a given http url? i.e. what tools would one need to obtain this information and how to go about doing so?

Obviously everyone would prefer the information being sought to be provided by software that is gratis rather than having to pay out for several different programs that may or may not work for them.

Anyone willing to make a start? If necessary, I would be quite willing to author any user guide just so long as the correct information can be supplied

Re: Download ITV Player using RTMPDump?

 

here's the short version. this method also works for non UK users with restrictive vpn's.

1. Run RTMPexplorer and close rtmpsrv by pressing q or closing it's window.
2. open your video url in RtmpExplorer.
3. when channel logo video starts playing quickly start rtmpsrv again.
4. when you see the activity in rtmpsrv window (Duplicate request, skipping) etc. close the RtmpExplorer and rtmpsrv.
5. copy the last command line from Command.bat. it should be like following.
   
   Code:

   ---

   rtmpdump -r "rtmpe://cp72511.edgefcs.net:1935/ondemand" -a "ondemand?ovpfv=1.1&auth=eaEbIcWdPc0csdGdzc9cZaYc1acaLd_dobka.ddbVchdcc1a3dqdxcSclb9aqaRa5dz-boHts0-eV-8zu4DCplDuys&aifp=v002&slist=production/" -f "WIN 10,3,183,10" -W "http://www.itv.com/mercury/Mercury_VideoPlayer.swf" -p "http://www.itv.com/itvplayer/video/?Filter=273823" -C Z: -y "mp4:production/CATCHUP/e98b52c6/13b6/4d00/8397/2846345a1073/1-0694-7695-001_CORONATION-STREET-(SERIES-52)-2011_TX190911_ITV400_16X9.mp4" -o 1-0694-7695-001_CORONATION-STREET-(SERIES-52)-2011_TX190911_ITV400_16X9.flv

   ---

6. change the bitrate in command line to download high quality version. e.g replace ITV400_16X9 with ITV1200_16X9

Re: Download ITV Player using RTMPDump?

 

ITV Player uses RTMPE streams.

Software fore recording RTMPE streams:
RTMPE recorders

Software for finding RTMPE URLs and other parameters of RTMPE streams:
How to find RTMPE stream URLs

Re: Download ITV Player using RTMPDump?

 

KSV

Thanks for this - will give it a try over the weekend

BTW - are the instructions for Windows or Linux or both? I usually used Ubuntu Linux but have a dual boot machine

Many thanks
ADB

Re: Download ITV Player using RTMPDump?

 

KSV

Did what you said - saw the relevant information flying past in rtmpsrv window.
Closed down both rtmpsrv and RTMPexplorer

However - couldn't find "COMMAND.BAT" - is this supposed to be created in the user directory somewhere?

Am getting there, albeit very slowly!

Re: Download ITV Player using RTMPDump?

 

I am running Windows Vista Home Premium SP2

I don't see Command.bat, either. I simply press CTRL-S in the rtmpsrv windows to pause it, and copy from it the command line in it, which is chopped up to short lines of 80 characters per line. So you will have to patch them back manually or using a program. (I am using "recording" feature in the VIM editor.)

Changing the bit rate in the command works most of the time but for some shows/games not all the bit rates are available. And sometimes the file name does not follow their naming convention (e.g. RWC U.S. vs. Russia _http://www.itv.com/itvplayer/video/?Filter=273630 ). Is there a way to find out all the available bit rates and the corresponding file names when they are named following the naming convention? It would be nice to if that info can be had. (GetFLV lists all the bit rates. I guess we either have to pay or labor through it.)

Re: Download ITV Player using RTMPDump?

 

These instructions are windows specific.

I have personally added this feature to rtmpsrv and rtmpsuck to create Command.bat. you can either use my binary or manually copy the command line from rtmpsrv window.
http://stream-recorder.com/forum/sho...1&postcount=23
Normally they provide video in four bitrates 400, 600, 800 and 1200 kbps. however if a particular video doesn't follow their naming convention or doesn't have all available bitartes or have different bitrates then you can use Wireshark to easily get info about all the resolutions and bitrates available for that particular video.

Re: Download ITV Player using RTMPDump?

 

Following on from the sequence that is being described above, I am almost there!

I have downloaded the RTMPexplorer that saves to the COMMAND.BAT file and have found the command that I need - fairly long but it is there.

Set up a terminal command window, ran the command.bat file and watched as the well-known error appeared:
Handshake type mismatch, client sent 6 server answered 9
INFO Connect ...
ERROR RTMP server sent error
ERROR RTMP server requested close

I am using the very latest version of rtmpdump that I could find - 2.4 GIT-6230845 2011-9-25, hence only a few days old.

All the postings and literature that I can find says that the various protocols have been written in but this error is still appearing on people's machines
Any ideas?
I see that the latest build is for Windows 7 and I am using Windows VISTA Basic
Would this make a difference?
Also is there any sort of mismatch between the latest RTMPDUMP and any other versions (eg the 2.4 version produced by KSV that has the COMMAND.BAT creation facility inbuilt)? I have kept the two versions completely separate, using KSV's version to find the command details whilst using the very latest version to actually do the RTMPDUMP

Getting closer to actually recording the rugby that I want to - just one little push will do it! (I hope!)
Many thanks
adb

Re: Download ITV Player using RTMPDump?

 

KSV,

Thanks for showing the Wireshark example. What is your OS?

Wireshark only works for me under Windows XP in finding the "PlaylistService" XML from ITV. But it can't find it on my Windows Vista PC.

Re: Download ITV Player using RTMPDump?

 

if you have got the command line from command.bat then it should work. command.bat file contains one command per line so only copy the last one. the command also contains auth parameter which expires after few minutes so be little quick.
no, rtmpdump works fine on all windows versions (XP, Vista, Win 7).
there isn't any mismatch between those versions.

I am using Win XP SP3. it shouldn't make any difference. make sure you are selecting the correct network adapter to monitor in vista.

Re: Download ITV Player using RTMPDump?

 

KSV,

Thanks again for the reply.

I am redirecting the rtmpsrv.exe output by running in the RTMPexplorer directory (folder) right after the video starts playing:
This way, I can get the Command.bat file like using your version of rtmpsrv so I don't need to concatenate chopped up lines copied from the command windows.

Somehow VPN connections only show up in the "Interface List" of Wireshark on Windows XP PC but not on Windows Vista PC. On a Vista PC, I am seeing in Interface List:

1. 10/100 Network Connection
2. Microsoft
3. MS Tunnel Interface Driver
4. TAP-Win32 Adapter V9

I have to connect through the TAP-Win32 Adapter but not a VPN.

But on a Windows XP PC the first under the list is:

1. Adapter for generic dialup and VPN capture
   ...

The latest release 1.6.2 also crashes when the PlaylistService.XML for the USA-Russia RWC game is loaded. Release 1.4.9 does not crash on the same file.

Re: Download ITV Player using RTMPDump?

 

TAP-Win32 Adapter is installed by OpenVPN. so you need to select that adapter when using VPN.
Wireshark's latest svn version (1.7.0-SVN-39234) works fine on XP SP3.

Re: Download ITV Player using RTMPDump?

 

My current VPN plan supports PPTP but not OpenVPN which was installed previously for a different service provider (free but with limited bandwidth). Wireshark is not working with PPTP on Vista.

Re: Download ITV Player using RTMPDump?

 

Wireshark 1.7.0-SVN-39234 also crashes upon opening the PlaylistService.XML of this video:
http://www.itv.com/itvplayer/video/?Filter=273630

The current stable release 1.6.2 also crashes on it, but the old stable release 1.4.9 does not.

Re: Download ITV Player using RTMPDump?

 

WinPCap driver which is used by Wireshark doesn't support VPN capture on vista and newer systems.

http://www.winpcap.org/misc/faq.htm#Q-6

it works fine on my system.

Re: Download ITV Player using RTMPDump?

 

OK folks - it now is working!

Firstly, many many thanks to everyone who has taken the time and effort to post and help this guy who can write software for 25 years but still not be up to speed with the latest technology - my excuse is that it is not my area of expertise!

What I did was (using previous postings on this thread):

Started ITV player, selecting the match that I wish to download.
The relevant page for the match appeared on the screen but paused waiting for the START command to be selected (*)
Copied the URL for the game from the site address - NB I did not start the player at all at this point
Ran RTMPexplorer, which started RTMPSRV alongwith it
Entered the copied URL into the RTMPEXPLORER address field and selected GO
The match's video site loaded in RTMPEXPLORER, exactly equivalent to the point (*) above
Within the RTMPEXPLORER main screen, started the playback of the game by selecting the START command on the screen within RTMPEXPLORER
Handshake traffic appeared in RTMPSRV box
Waited until audio/visual playback occurred in the RTMPEXPLORER screen - this is important.
Killed the RTMPEXPLORER dialog.
The RTMPSRV box merrily continued to download the file, appearing in the directory.
Waited until the download finished, renamed the file and repeated ad nauseam with the other matches that I wish to download.

Points to note:
KSV's COMMAND.BAT option seems to cause 'problems' - but I *do* like the idea that someone has taken the time and effort to produce a user-friendly output file - many thanks to KSV for this. Using his version of RTMPSRV and RTMPDUMP *does* produce a COMMAND.BAT file that can be edited to extract the relevant download command for the stream. However, running this *as a* command file causes the server 6/9 problem detailed elsewhere in this thread and the command file stops. The steps detailed at the head of this posting do not cause the download to stop so it may need a sequence of "on error, ignore" type statements in the COMMAND.BAT for progress. However, this is a minor point as the download can be done using the methods described above

Secondly, the playback (usually) has connection problems via RTMPEXPLORER, with messages in the RTMPEXPLORER screen indicating playback problems - well, it does on my (supposedly) super-fast broadband. This does not stop or prevent the download from happening but it does cause the whole process to take about 10 times longer than it should. Again, not a real problem, just an annoyance. (As a corollary, if the match playback starts smoothly without this playback problem message, you can still stop the RTMPEXPLORER process and the download takes next to no time and even the display in RTMPSRV looks smoother without terminal overwrites the whole time)

So, all in all, I am now a very happy bunny. Have started to download all the games of the World Cup - yes all 40+ of them. So all I need now is a large external drive for backup, time to edit the games for analysis purposes for my presentations, and many cups of coffee to help me through those processes!

Again, my heartfelt thanks to all involved

Re: Download ITV Player using RTMPDump?

 

You don't need to wait until playback starts in RTMPdump because rtmpsrv disconnects the player after retrieving parameters. player retries several times before giving up on that port (1935) and then switches to rtmpt (port 80) and only then you can see the playback starting in RtmpExplorer.

Command.bat is not intended to be used directly because all detected commands are appended to old file. so you only need to copy the last one and manually start RTMPdump form cmd window. Handshake type 6 or 9 has nothing to do with the commands saved in batch file.

that's why i told you to close RTMPexplorer and rtmpsrv as soon as commands are detected otherwise it will keep sending new requests and rtmpsrv will start multiple instances of RTMPdump to download the same file. starting the rtmpdump manually is recommended.

in short if you stick to the instructions posted in my first post, you shouldn't have any problem in downloading those rugby games. games are available in 400 and 800 kbps bitrate only.

Re: Download ITV Player using RTMPDump?

 

KSV

Thanks for the coments

However - I have done exactly as stated - even started from scratch again.

Downloaded you 'command.bat creating' version.
Copied the RTMPSRV and RTMPdump commands to the RTMPexplorer folder (thus over-writing what was there)
Copied the URL to RTMPEXPLORER and started the player therein
Stopped both RTMPSRV and RTMPEXPLORER as soon as I saw some traffic.
Edited the COMMAND.BAT file to extract the relevant dump command
Opened a Command terminal
Copied the dump command plus parameters (done as soon as possible, as you indicated that there was a time-limited authorisation parameter)
.... and I get the server 6/9 problem that I detailed above, with RTMPDUMP stopping execution without doing the download.

Re: Download ITV Player using RTMPDump?

 

post the screenshot of command you are using.

Re: Download ITV Player using RTMPDump?

 

KSV

Screen dump as requested for the pasted command that was extracted from your COMMAND.BAT file
(Image jpeg file attached)

Command stream is:
rtmpdump -r "rtmpe://cp72511.edgefcs.net:1935/ondemand" -a "ondemand?ovpfv=1.1&auth=eaEdCajceaSafabdpc7bMbha7 a6acbAajcvbadQaBaJa8bVcvbEcrcCdicOcqaXa7aH-boI3Ar-eS-cxv3GArjArxs&aifp=v002&slist=production/" -f "WIN 10,1,102,64" -W "http://www.itv.com/mercury/Mercury_VideoPlayer.swf" -p "http://www.itv.com/itvplayer/video/?Filter=276206" -C Z: -y "mp4:production/stings/IP_ProjectMercury_ITV4sting_600_16-9.mp4" -o IP_ProjectMercury_ITV4sting_600_16-9.flv

Re: Download ITV Player using RTMPDump?

 

The command you posted is of channel logo video instead of actual game video which should not be captured if you follow the first step correctly. rtmpsrv is automatically started when you start RtmpExplorer. you have to close it before pasting url in RtmpExplorer. you need to start it after the channel video logo starts playing but before the actual game video starts.

Re: Download ITV Player using RTMPDump?

 

All - ie CHAP and KSV

All sorted - and I mean it this time!

You were both correct in your postings - I *should* have stopped the RTMPexplorer-induced RTMPSRV before playback - just me being lazy and thinking that whilst it is running, it wold be pointless to stop and restart it.

Again, many, many thanks for helping me out on this - only 30 more games to download and analyse!

Re: Download ITV Player using RTMPDump?

 

Have followed instructions and everything appears to work right up until rtmpdump command. Am getting following error:

ERROR: RTMP_Connect0, failed to connect to socket. 10061 (Unknown error)

rtmp command from bat file is:

rtmpdump -r "rtmpe://cp72511.edgefcs.net:1935/ondemand" -a "ondemand?ovpfv=1.1&auth=eaEdvcNakcCdmaIbhaPd6aWdP d0bvaNaVadaidLacdNa5bBc5dHaKaWaxcRaFbVa.az-bo3JWY-eS-5zv1CCvmxrAq&aifp=v002&slist=production/" -f "WIN 11,1,102,55" -W "http://www.itv.com/mercury/Mercury_VideoPlayer.swf" -p "http://www.itv.com/itvplayer/video/?Filter=293512" -C Z: -y "mp4:production/priority/CATCHUP/a3664a43/c874/41a8/bf2e/e700e8f4bb93/1-9914-0001-001_THE-FIGHT-OF-THEIR-LIVES_TX051211_ITV400_16X9.mp4" -o 1-9914-0001-001_THE-FIGHT-OF-THEIR-LIVES_TX051211_ITV400_16X9.flv

Any ideas?

Re: Download ITV Player using RTMPDump?

 

no problem

Re: Download ITV Player using RTMPDump?

 

Mmmmm something not right then.

D:\Users\Finchy\Downloads\rtmpexplorer>rtmpdump -r "rtmpe://cp72511.edgefcs.net:
1935/ondemand" -a "ondemand?ovpfv=1.1&auth=eaEaCdGaZdiaMcwcsdwaNcydy cMbabmbjblaV
d5aDdhaqcWcHdZb7b3aSdicQdZbKd8-bo3J6z-eS-cAo1DDvjDtyr&aifp=v002&slist=production
/" -f "WIN 11,1,102,55" -W "http://www.itv.com/mercury/Mercury_VideoPlayer.swf"
-p "http://www.itv.com/itvplayer/video/?Filter=293512" -C Z: -y "mp4:production/
priority/CATCHUP/a3664a43/c874/41a8/bf2e/e700e8f4bb93/1-9914-0001-001_THE-FIGHT-
OF-THEIR-LIVES_TX051211_ITV400_16X9.mp4" -o 1-9914-0001-001_THE-FIGHT-OF-THEIR-L
IVES_TX051211_ITV400_16X9.flv
RTMPDump v2.4 GIT-2011-07-22 (Compiled by KSV)
(c) 2010 Andrej Stepanchuk, Howard Chu, The Flvstreamer Team; license: GPL
Connecting ...
ERROR: RTMP_Connect0, failed to connect socket. 10061 (Unknown error)

Re: Download ITV Player using RTMPDump?

 

Are you using VPN? it seems to be blocking connection to 1935 port. try changing the port to 80 and protocol to rtmpte.

if it doesn't work try the following fix.
if it still doesn't work post the debug log after adding --verbose | -V switch to your command line.

Re: Download ITV Player using RTMPDump?

 

I'm not using VPN. Only have Windows Firewall On and unblocked rtmpsrv.exe. Tried creating exception for rtmpdump.exe but still have no connection. Is there something else I need to do with the Firewall? I would have thought since I seem to connect on 1935 through the rtmpsrv.exe that side is ok, no?

Tried your suggestions to no avail. Logs as follows.
Using rtmpe & port 1935.
Using rtmpte & port 80
swfinfo file deleted and -W switch replaced with --swfUrl

Re: Download ITV Player using RTMPDump?

 

I can't download this video too!!

When I use -W parameter:
and when I use --swfUrl parameter, it doesn't say "'couldn't contact swfurl":
and immediately closed!!

Re: Download ITV Player using RTMPDump?

 

Bahman
you forgot the parameters
--swfsize, --swfhash

Re: Download ITV Player using RTMPDump?

 

^ok, but how can I find swfsize and swfhash?
"swfsize" should be decompiled size of swf file?:confused:

Re: Download ITV Player using RTMPDump?

 

1. Decompress SWF player, it gives you SWFSize in bytes
flasm -x "player.swf"

2. Generate the hash, it gives you SWFHash
openssl sha -sha256 -hmac "Genuine Adobe Flash Player 001" "player.swf"
openssl flasm

--swfsize 990750
--swfhash b6c8966da3f49610be7178b01ca33d046bbf915e2908d9dafe 11e4b042d8eeea

Re: Download ITV Player using RTMPDump?

 

Thank you very much, chap!!;) I was so interested in learning how to do it!!

First, I used original swf file for generating hash and got:
6f89a4fac643901ca8dd40c284902ea005e7f92f416fa29be2 5b500a501480c7
then saw your generated hash, used decompressed one and got it as same as you!!

but I still have problem:
and:
Also I have tried replacing port 80 and rtmpte, didn't work!!:confused: