rtmpdump impossible with these links?

[Shinoby92]

Hello everyone,
yes im new registered but i could read the last 4-5 hours about rtmpdump and could successfully get links out of sources...even with sources which were not easy.

2 Links i really don't get it work...i googled and testet so many things out...
here are some skilled people around so i hope someone will and can help me.
I don't want to abuse any of these sources, its for use and of course i want to learn..

First Link ->
http://oklivetv.com/prosieben-pro7-live/

Second Link ->
http://canlitvlive.org/izle/pro-sieben.html


I tried everything out
The First Link somehow creates a /live/random.m3u8 which is also not static and i think cookie based...

The Second Link i think somehow generates a token i don't know how, and i don't know how to get a static link / setting that it generates it tokens itself...


Somehow...He managed to create successfully redirections
http://freetvstream.in/de/tv/pro7hd.php -> successfully uses Link 1
http://freetvstream.in/de/tv/pro72.php -> successfully uses Link 2

How did he managed it??

http://www.next.web.tr/tvizle <- also somehow managed it...

Edit:

What is this?....does it help somehow?https://gist.github.com/auselen/75726ff25400ef4c4944

[peterpan]

Not everything is rtmp lol

Note: I've noticed that in VLC, the stream freezes for a few seconds, then continues...so you may to try to play it in wmp or some other player...It seems to run smoothly in Kodi --I believe there's a command, which helps the streams runs smoothly in VLC, but I forgot what it it was...maybe someone here can help you with that... -Salaam!



try this for 1st link...

c:\livestreamer>livestreamer "hlsvariant://http://46.101.171.43/live/UE5MZkh6MEdKUnNVWFN4S0ZYYjVWS25IdGltcjVjOExKVmJLV25vOXcvYUFmTSswMENCR1Zac0FPbTl3YU5NVDVTOHV3Z2IyRXpOeEh2RG5Vdi9rVS9CcS90bjRnbmlTaFdWOXlEc01JZmM9.m3u8" best
[cli][info] Found matching plugin stream for URL hlsvariant://http://46.101.171.43/live/UE5MZkh6MEdKUnNVWFN4S0ZYYjVWS25IdGltcjVjOExKVmJLV25vOXcvYUFmTSswMENCR1Zac0FPbTl3YU5NVDVTOHV3Z2IyRXpOeEh2RG5Vdi9rVS9CcS90bjRnbmlTaFdWOXlEc01JZmM9.m3u8
[cli][info] Available streams: 272p, 400p, 540p (best), 64k (worst)
[cli][info] Opening stream: 540p (hls)
[cli][info] Starting player: 'C:\Program Files (x86)\VideoLAN\VLC\vlc.exe'

try this...for 2nd link...

livestreamer "hls://http://yayin8.canlitvlive.org/prosieben/live.m3u8?tkn=E20LvemKAABOqw63TQVEpA&tms=1447154528" best
[cli][info] Found matching plugin stream for URL hls://http://yayin8.canlitvlive.org/prosieben/live.m3u8?tkn=E20LvemKAABOqw63TQVEpA&tms=1447154528
[cli][info] Available streams: live (worst, best)
[cli][info] Opening stream: live (hls)
[cli][info] Starting player: 'C:\Program Files (x86)\VideoLAN\VLC\vlc.exe'

[Shinoby92]

Hey Peter!
Thank you for looking for the links, i didnt know that i have to handle it differently... But i could also get these Links you got there out...
The problem is
that in link1 ->
UE5MZkh6MEdKUnNVWFN4S0ZYYjVWS25IdGltcjVjOExKVmJLV2 5vOXcvYUFmTSswMENCR1Zac0FPbTl3YU5NVDVTOHV3Z2IyRXpO eEh2RG5Vdi9rVS9CcS90bjRnbmlTaFdWOXlEc01JZmM9

is getting generated and is not a static link...this link does not work here.
I want a static link, and don't know how to do it..

The same goes for link 2

?tkn=E20LvemKAABOqw63TQVEpA&tms=1447154528

is generated and not static so this link does not work either...

But really thank you for even reading my problem and treeing to help :-))!!!

[peterpan]

EASY FIX... Well somewhat easy...LOL

Install Kodi + LivestreamsPro addon and use the RegEx below...It will automatically update the changing params for you

Link: http://oklivetv.com/prosieben-pro7-live/

<item>
<title>Pro7 RegEx</title>
<link>http://$doregex[getFirstIPNum].$doregex[getSecondIPNum].$doregex[getCleanLast2IPNums]/live/$doregex[getM3U8Code].m3u8</link>
<regex>
<name>getFirstIPNum</name>
<expres>tintColor\|URL\|display\|.*?\|(.*?)\|</expres>
<page>$doregex[getPage]</page>
<referer>http://oklivetv.com/prosieben-pro7-live/</referer>
<cookieJar></cookieJar>
</regex>

<regex>
<name>getSecondIPNum</name>
<expres>tintColor\|URL\|display\|(.*?)\|</expres>
<page>$doregex[getPage]</page>
<referer>http://oklivetv.com/prosieben-pro7-live/</referer>
<cookieJar></cookieJar>
</regex>

<regex>
<name>getCleanLast2IPNums</name>
<expres>$pyFunction:'$doregex[getLast2IPNums]'.replace('|','.')</expres>
<page></page>
</regex>

<regex>
<name>getLast2IPNums</name>
<expres>tintColor\|URL\|display\|.*?\|.*?\|(.*?)\|m3u8</expres>
<page>$doregex[getPage]</page>
<referer>http://oklivetv.com/prosieben-pro7-live/</referer>
<cookieJar></cookieJar>
</regex>

<regex>
<name>getM3U8Code</name>
<expres>m3u8\|(.*?)\|auto</expres>
<page>$doregex[getPage]</page>
<referer>http://oklivetv.com/prosieben-pro7-live/</referer>
<cookieJar></cookieJar>
</regex>
<regex>
<name>getPage</name>
<expres>frameborder='0' src='(.*?)' .*\s.*Austria</expres>
<page>http://oklivetv.com/prosieben-pro7-live/</page>
<cookieJar></cookieJar>
</regex>
</item>

If the ip address remains static, you can use this "simpler" RegEx

<item>
<title>Pro7 STD RegEx "Simpler"</title>
<link>http://46.101.171.43/live/$doregex[getM3U8Code].m3u8</link>
<regex>
<name>getM3U8Code</name>
<expres>m3u8\|(.*?)\|auto</expres>
<page>$doregex[getPage]</page>
<referer>http://oklivetv.com/prosieben-pro7-live/</referer>
<cookieJar></cookieJar>
</regex>
<regex>
<name>getPage</name>
<expres>frameborder='0' src='(.*?)' .*\s.*Austria</expres>
<page>http://oklivetv.com/prosieben-pro7-live/</page>
<cookieJar></cookieJar>
</regex>
</item>

[Shinoby92]

Great :-)
you really are peterpan....wait i mean you should rename yourself to Robin Hood, taking and giving the poor

Thank you for this fast answer, im gonna try it out when im home later

I think the IP is static im not sure, but taking the first one will be better i guess. I will try playing around with the simple regex code and the "referer" so i can maybe start with this regex easy another channel :-P

I really have to study some hours to get behind this regex code, because i want to understand it how to use it myself

Would be no problem to create a regex for the second link right? Or is creating the token somehow else?

[peterpan]

It shouldn't be that hard

Here you go...

Link: http://canlitvlive.org/izle/pro-sieben.html

<item>
<title>Pro7 RegEx "2nd Link"</title>
<link>$doregex[getURL]</link>
<regex>
<name>getURL</name>
<expres>.file:"(.*?)"</expres>
<page>http://canlitvlive.org/izle/pro-sieben.html</page>
</regex>
</item>

Also wrt link1, you can make the RegEx even easier, if the id in the page is static

<item>
<title>Pro7 RegEx "Link 1"</title>
<link>http://46.101.171.43/live/$doregex[getM3U8Code].m3u8</link>
<regex>
<name>getM3U8Code</name>
<expres>m3u8\|(.*?)\|auto</expres>
<page>http://oklivetv.com/xplay/xplay.php?idds=4e7a5931</page>
<referer>http://oklivetv.com/prosieben-pro7-live/</referer>
</regex>
</item>

Enjoy & Salaam

[Shinoby92]

Returned Home, gonna try it out now

Thank youuuuu very much :-))


Hehe...
did you say Salam just for fun?
im persian so salam really means hello in my language or is it somewhere visible :P

[null-zone]

Hi Peterpan and Shinoby92,

I too am very interested in this, being that more and more streamed channels are on sites where they somehow hide or encrypt the links, or each link needs some kind of identifier/cookies or something.

I am a linux user and I prefer to use ffplay for playing of links on PC.
However I've come across some sites lately, they have some good streams, but the links seem to be jumbled or encrypted or need some kind of format to play them in ffplay (or VLC), somehow.

I could be wrong, but after packet sniffing, I get the following:
- This site here: http://www.stream2watch.co/

- And then I select a channel. Lets say I select this one:
http://www.stream2watch.co/live-tv/p...as-live-stream

And after sniffing the stream, I get the following:
rtmp://95.211.148.66/loadbalance?wmsAuthSign=c2VydmVyX3RpbWU9MTEvMTEvMj AxNSA2OjIxOjUxIEFNJmhhc2hfdmFsdWU9UkcxSktrUVRUNGtX NVdsSDI1ZjJTUT09JnZhbGlkbWludXRlcz0xMA==/96832994518847733549

If I input into stream player, say ffplayer (which is the correct format):
# ffplay "rtmp://95.211.148.66/loadbalance?wmsAuthSign=c2VydmVyX3RpbWU9MTEvMTEvMj AxNSA2OjIxOjUxIEFNJmhhc2hfdmFsdWU9UkcxSktrUVRUNGtX NVdsSDI1ZjJTUT09JnZhbGlkbWludXRlcz0xMA==/96832994518847733549"

I get the following output:
ffplay version 2.4.3-1ubuntu1~trusty6 Copyright (c) 2003-2014 the FFmpeg developers
built on Nov 22 2014 17:07:19 with gcc 4.8 (Ubuntu 4.8.2-19ubuntu1)
configuration: --prefix=/usr --extra-version='1ubuntu1~trusty6' --build-suffix=-ffmpeg --toolchain=hardened --extra-cflags= --extra-cxxflags= --libdir=/usr/lib/x86_64-linux-gnu --shlibdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --enable-gpl --enable-shared --disable-stripping --enable-avresample --enable-avisynth --enable-fontconfig --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libflite --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmodplug --enable-libmp3lame --enable-libopenjpeg --enable-libopus --enable-libpulse --enable-librtmp --enable-libschroedinger --enable-libshine --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-opengl --enable-x11grab --enable-libxvid --enable-libx265 --enable-libdc1394 --enable-libiec61883 --enable-libzvbi --enable-libzmq --enable-frei0r --enable-libx264 --enable-libsoxr --enable-openal --enable-libopencv
libavutil 54. 7.100 / 54. 7.100
libavcodec 56. 1.100 / 56. 1.100
libavformat 56. 4.101 / 56. 4.101
libavdevice 56. 0.100 / 56. 0.100
libavfilter 5. 1.100 / 5. 1.100
libavresample 2. 1. 0 / 2. 1. 0
libswscale 3. 0.100 / 3. 0.100
libswresample 1. 1.100 / 1. 1.100
libpostproc 53. 0.100 / 53. 0.100
rtmp server sent error= 0 aq= 0KB vq= 0KB sq= 0B f=0/0

and after some seconds, ffplayer stops trying to play it.
I can get any other type of rtmp stream play, just not these.

I've tried this on VLC (just for the heck of it) and get the same outcome.

After reading your post, the structure of the link I am able to sniff, seems very similar to what you've posted in your last post, and thus it seems I may be missing something, I'm not familiar with RegEx (I plan to be soon though), and I think that it might be a matter of just forming the structure of the link in a particular way.

Any ideas on how to generate a working link from this?

Any help would be greatly appreciated.

Cheers
Null-Zone

[peterpan]

Sorry, I'm not familiar with Linux

Here's VLC's code...

rtmpdump -r "rtmp://178.162.205.101/loadbalance" -a "loadbalance?wmsAuthSign=c2VydmVyX3RpbWU9MTEvMTEvMjAxNSA2OjUzOjQ1IEFNJmhhc2hfdmFsdWU9aEY2bXpxOXB0a1o2Rkd4VHJmOWl4dz09JnZhbGlkbWludXRlcz0xMA==" -f "WIN 19,0,0,226" -W "http://pxstream.tv/player510.swf" -p "http://pxstream.tv/embedrouter.php?file=sicnoti4&width=700&height=480&jwplayer=flash" -y "96832994518847733549" | "C:\Program Files (x86)\VideoLAN\VLC\vlc.exe" -

So yes, technically "rtmp://178.162.205.101/loadbalance?wmsAuthSign=c2VydmVyX3RpbWU9MTEvMTEvMj AxNSA2OjUzOjQ1IEFNJmhhc2hfdmFsdWU9aEY2bXpxOXB0a1o2 Rkd4VHJmOWl4dz09JnZhbGlkbWludXRlcz0xMA==/96832994518847733549" should have worked in ffplay! Maybe you're missing a param or something!

Edit: I think there's a LNX version of Kodi, so if you're interested you could run this RegEx on Kodi+LivestreamsPro (addon) and enjoy non-stop streaming of SIC (as the regex will auto-update the entire rtmp link for you )...Note that this is the simplest "working version" of the RegEx. If they change the playpath and/or the file name, you can regex those params as well

<item>
<title>SCI -- PXSTREAM</title>
<link>$doregex[getRTMP]/96832994518847733549 flashver=WWIN\2011,8,800,133 swfUrl=http://pxstream.tv/player510.swf pageUrl=http://pxstream.tv/embedrouter.php</link>
<regex>
<name>getRTMP</name>
<expres>(rtmp.*?)'<expres>
<page>http://pxstream.tv/embedrouter.php?file=sicnoti4&amp;width=700&amp;height=480&amp;jwplayer=flash</page>
<referer>http://www.meocanaltv.com/embed/SICNOTICIAS.php?width=700&amp;height=480</referer>
<agent>Mozilla/5.0 (Windows NT 6.3; WOW64; Trident/7.0; rv:11.0) like Gecko</agent>
<cookieJar></cookieJar>
</regex>
</item>

[null-zone]

Hi Peterpan,

Thanks a whole lot for that example, it is very interesting... infact I'm really getting an interest in RegEx and would like to understand more, how you derived the actual strings you've used, from the rtmp link I gave.

Is there somewhere you can suggest online, that I can quickly learn regex?

Additionally, the rtmpdump string you provided:

[html]

rtmpdump -r "rtmp://178.162.205.101/loadbalance" -a "loadbalance?wmsAuthSign=c2VydmVyX3RpbWU9MTEvMTEvMjAxNSA2OjUzOjQ1IEFNJmhhc2hfdmFsdWU9aEY2bXpxOXB0a1o2Rkd4VHJmOWl4dz09JnZhbGlkbWludXRlcz0xMA==" -f "WIN 19,0,0,226" -W "http://pxstream.tv/player510.swf" -p "http://pxstream.tv/embedrouter.php?file=sicnoti4&width=700&height=480&jwplayer=flash" -y "96832994518847733549" | "C:\Program Files (x86)\VideoLAN\VLC\vlc.exe" -

Is quite similar to the format of ffplay, when adding flags etc... however in linux, there are no .exe files as such so the pipe would be something different, such as just 'vlc'.
But it also seems that they are temporary keys, as this link is no longer playing... for me anyway... and so how would I overcome that ?

Then, I also have a question about how you derived this code:

<item>
<title>SCI -- PXSTREAM</title>
<link>$doregex[getRTMP]/96832994518847733549 flashver=WWIN\2011,8,800,133 swfUrl=http://pxstream.tv/player510.swf pageUrl=http://pxstream.tv/embedrouter.php</link>
<regex>
<name>getRTMP</name>
<expres>(rtmp.*?)'<expres>
<page>http://pxstream.tv/embedrouter.php?file=sicnoti4&amp;width=700&amp;height=480&amp;jwplayer=flash</page>
<referer>http://www.meocanaltv.com/embed/SICNOTICIAS.php?width=700&amp;height=480</referer>
<agent>Mozilla/5.0 (Windows NT 6.3; WOW64; Trident/7.0; rv:11.0) like Gecko</agent>
<cookieJar></cookieJar>
</regex>
</item>

I can get a similar output whilst I am sniffing the streams, but they are not set out in such manner (ie. RegEx code).
Maybe there is some kind of online tool that I can use where I can dump the initial string (sniffed link) and then it will output the above code? Or did you do it by hand, if so how?
Sorry for all the questions, I'm really eager however, to learn how to do this.


I've found a link:

http://stream-recorder.com/forum/use-rtmpdump-rtmpsrv-linux-t7661.html?

which provided some information on use of rtmpdump with linux, which when following the examples given in that page, its not a problem. However the pxstream.tv link is another type of link, unless I'm missing/not understanding something?

As far as ffplay is concerned, thats pretty easy to use

For example:
A stream link

rtmp://$OPT:rtmp-raw=rtmp://5.153.233.106:443/share/ playpath=live1-rbi6c swfUrl=http://sharecast.to/player/player20.swf live=1 timeout=13 pageUrl=http://sharecast.to/rtmp://5.153.233.106:443/share/ playpath=live2-bipmr swfUrl=http://sharecast.to/player/player20.swf live=1 timeout=13 pageUrl=http://sharecast.to/

is easily played by removing the initial part of the string to:

ffplay "rtmp://5.153.233.106:443/share/ playpath=live1-rbi6c swfUrl=http://sharecast.to/player/player20.swf live=1 timeout=13 pageUrl=http://sharecast.to/rtmp://5.153.233.106:443/share/ playpath=live2-bipmr swfUrl=http://sharecast.to/player/player20.swf live=1 timeout=13 pageUrl=http://sharecast.to/"

Then it plays without problem, (if the link was live).

So seeing the format is similar, any ideas on how I would resolve the initial stream, in ffplay?
It also seems that the pxstream may require updated keys/cookies etc... ??? Or is it just a matter of arranging the code in a particular way?

Any ideas/assistance would be greatly appreciated, because with some examples, I'll be able to learn from them quickly.