Customized rtmpdump binaries with patch file

Customized rtmpdump binaries with patch file

 

Anonymous recently shared some good patches with me so i thought of reviving the release thread again. apart from all my patches till date this release includes following new enhancements.

Anonymous's Contribution:

1. Better resume support:
rtmpdump can now resume from corrupted files by automatically searching the file for valid audio video frames.

2. Invalidate "Play2" command:
rtmpsuck now invalidates this transition command so flash player isn't able to adaptively switch the stream to another quality during capture.

3. Generate unique filenames:
if detected filename is longer than 128 characters it generates short unique name instead.

4. fixed a bug in AMF3 decoding

5. few other minor fixes

My Fixes:

1. add timestamp to detected filename (rtmpsrv and rtmpsuck) to avoid overwriting the streams

2. replace invalid characters in filename with underscore

3. fixed a crash in rtmpsuck when closed using 'q' command

4. fixed generation of invalid flv file in some rare cases

5. few other minor fixes

Update 17/04/2013:

1. fixed rtmpsrv command generation in some specific cases + other minor fixes

Update 22/04/2013:

1. enhanced keyframe search for much better resume functionality
2. fixed a bug in RTMP_FindPrefixProperty and RTMP_FindFirstMatchingProperty function

Update 25/04/2013:

1. added onFCSubscribe response to rtmpsrv to detect more streams
2. show complete debug info in rtmpsuck when connection is closed
3. fixed a small bug in redirect handling (allocating 1 byte less than required)

Update 07/05/2013:

1. fixed timestamp generation on some platforms

Update 15/05/2013:

1. added support for featve.com changes

Update 19/05/2013:

1. added support for wfctv.com

Update 11/06/2013:

1. updated support for webvideocore.net servers

Update 14/09/2013:

1. added support for yycast.com changes

Update 18/10/2013:

1. added support for yukons.net, axcast.com changes

Update 14/03/2014:

1. also check client signature to detect if server wanna use old rtmp handshake

(fixes handshake problems with some lousy servers)

2. added support for ddoss.me, streampiraten.ws changes
3. handle NetConnection.Connect.Rejected for onStatus response along with _error

Update 21/03/2014:

1. updated support for streampiraten.ws and clones
2. fixed a small bug

Update 11/09/2014:

1. updates for some site changes

Update 28/10/2014:

1. cleaned-up and merged --ccommand | -K switch patch (provided by @denobis)
2. rewrote the support for 3dbuzz.com authentication

Update 19/01/2015:

1. some minor fixes

Update 09/02/2015:

1. updated support for mips.tv and clones

Update 01/05/2015:

1. save and resume support for more than 4 GB files
2. add null encoding support in AMF object ( -C NZ:name: )
3. other minor fixes

Update 05/05/2015:

1. added basic support for AMF_REFERENCE type
2. added support for tvb.com streams

Update 11/12/2015:

1. fixed some AMF3 decoding issues (videostream.dn.ua)
2. fixed a crash in rtmpsuck
3. other minor fixes

Update 15/12/2015:

1. sync with rtmpdump upstream

==========
This release supersedes all previous releases.
==========


assuming you have all tools (gcc, binutils etc.) and dependencies (OpenSSL, Zlib) installed correctly for your distribution.

1. clone the repository
2. copy patch from package to rtmpdump directory and apply it
3. then just compile and install normally
Mac users should add SYS=darwin while compiling. you can also add XLDFLAGS="-s -static" to statically link and strip the resulting binary.

Re: Customized rtmpdump binaries with patch file

 

KSV
Thanks for your work and time:cool:

Re: Customized rtmpdump binaries with patch file

 

unsurpassable

Re: Customized rtmpdump binaries with patch file

 

SO Greatly appreciated!!!

Re: Customized rtmpdump binaries with patch file

 

GREAT stuff as always, KSV :-)

Re: Customized rtmpdump binaries with patch file

 

Thanks for the great work.

Re: Customized rtmpdump binaries with patch file

 

Thanks KSV for your time. ;)
But I already have a question. When I watch this stream in browser, it works fine but with rtmpdump it fails many times before good start.

Re: Customized rtmpdump binaries with patch file

 

Thank you very much KSV

Re: Customized rtmpdump binaries with patch file

 

Thanks again KSV for all of your work :)

Re: Customized rtmpdump binaries with patch file

 

i have tried it few times and it works every time. maybe your localized server having issues. try with IP 124.**.**.***.

Re: Customized rtmpdump binaries with patch file

 

i have seen some people claiming that certain url's working with old builds but not new one's. this is due to the changed behavior of url parsing in official git repository. for example if you have passed following url to rtmpdump it will behave differently after this commit.

old app will parse the app as first/second and playpath as third/fourth while after this commit app will be parsed as first/second/third and playpath as fourth invalidating the previously working command.

you can overcome this problem in two ways:
1. specify app and playpath using separate commands (-a|--app) and (-y|--playpath) respectively.
2. in my builds you can also use // as app and playpath separator.

Re: Customized rtmpdump binaries with patch file

 

With your server it doesn't work at all.

Re: Customized rtmpdump binaries with patch file

 

use following command to access it directly with IP.

Your second stream is also working fine for me.

Re: Customized rtmpdump binaries with patch file

 

It's working great with -t parameter added even with original server.
Thanks very much KSV. ;)

Re: Customized rtmpdump binaries with patch file

 

'-t' switch doesn't do anything magical. probably it was a temporary glitch on your side.

Re: Customized rtmpdump binaries with patch file

 

How about BUFX - realtime download on some servers...
Isn't possible to download with real speed on servers based on Flash Media Server 3?

Majority of sites runnin FMS is needed to use -v mode and sometimes videos are downloaded with lag between Video/Sound.

Re: Customized rtmpdump binaries with patch file

 

i don't quite understand what you wanna say but it has been resolved long ago.

Re: Customized rtmpdump binaries with patch file

 

I have some trouble with a stream. The capturing seems to start but it captures only 0.01sec and then the process hangs / doesn't captures anything more ... :(

Re: Customized rtmpdump binaries with patch file

 

Try adding -v (--live) switch.

Re: Customized rtmpdump binaries with patch file

 

Thank you KSV for your effort and for adding those patches, one of which has fixed my previous problem. It is definitely appreciated. If only I had a tenth of the understanding that you have!

a69

Re: Customized rtmpdump binaries with patch file

 

OMG, stupid me ... big thx :)

Re: Customized rtmpdump binaries with patch file

 

I have compiled this release into librtmp's for various systems (iOS (Apple TV, iPhone, iPod Touch), RasPi, Linux 32&64) for anyone wanting this release in their XBMC.

I can easily put exectuables up also if anyone needs but I don't know of any practical reasons off the top of my head for devices like RasPi and iOS.

http://www.mediafire.com/?x4cvp5hl4m9xr

Re: Customized rtmpdump binaries with patch file

 

Thank you Redpenguin.

I have a problem with your xbmc apk for android.

(Sorry for my english because I´m Spanish). I installed your xbmc apk and when I click to run it crash.

Say: La aplicación XBMC (proceso org.xbmc.xbmc) se ha interrumpido inesperadamente. Inténtelo de nuevo

RTMPDUMP returns wrong AMF calculation

 

very weird problem: I'm using unofficial KSV version. on one of my boxes it doesnt work properly: I investigated and found that the server asks for an answer which on other boxes is calculated well, but on this box no... checked python, and there it calculates well
so, on this thing:
enc = AMF_EncodeNumber(enc, pend, exp(atan(sqrt(VerificationNumber))) + 1)

the "bad" box returns ((VerificationNumber) + 1)

any idea? I'm totally cluless:confused:

btw, it's a linux box

Re: Customized rtmpdump binaries with patch file

 

At first I had a mix up with signing the modified APK but I fixed it and most folks report it's working great.

http://forum.xbmc.org/showthread.php?tid=162307 is the support thread I maintain for my librtmp files and the APK if you wanna check it out.

Re: RTMPDUMP returns wrong AMF calculation

 

Post the full debug log (-V) on pastebin. if it works on everything else then it can't be code's problem.

Re: Customized rtmpdump binaries with patch file

 

Also KSV or somebody else not sure if you have a cable TV subscription or not to test:

http://www.cnn.com/video and test their "Live TV" section.

But I have noticed that the rtmpdump code must have changed sometime after 2011-07-11 because like I said before if I use KSV or normal versions since then it constantly results in "Invalid AMF Data" with rtmpsrv from RTMPDumpHelper.

From what I can tell, they (edgecfs) are simply changing the connection data on every play request and using weird characters like the Spanish upside down exclamation point.

Not sure why but the older rtmpdumps can simply flow with these odd connection data but the newer cannot and just error out, so I was wondering if this could be fixed via a patch.

Here is a sample of what I mean:

rtmpdump -r "rtmpe://cp99921.live.edgefcs.net:1935/live" -a "live?auth=daEdabcbS
bfdrdlcNa.dudNbld5cebQaKan-brBoEc-hca-lxy_GFs&aifp=v001&slist=tvehln104_1_low@s8
9305" -f "WIN 11,7,700,169" -W "http://z.cdn.turner.com/xslo/cvp/plugins/akamai/
streaming/osmf1.6/2.11.3/AkamaiAdvancedStreamingPlugin.swf" -p "http://www.cnn.c
om/video/#/video/cvptve/cvpstream2" --live -C Θ: -y "tvehln104_1_low@s89305?auth
=daEdabcbSbfdrdlcNa.dudNbld5cebQaKan-brBoEc-hca-lxy_GFs&aifp=v001&slist=tvehln10
4_1_low@s89305" -o "tvehln104_1_low@s89305.flv"

ERROR: Invalid AMF parameter: Θ:

It's as if the command would easily work with zero issues if it was not for the strange ASCII characters.

Though not sure if this would be something the actual RTMPDump would need to code.

Re: Customized rtmpdump binaries with patch file

 

here is the log:

the "bad" box-
the number given back in response is 97.73 (should be 5.35)
here is the "good" box-
it's a mediadirect.ro server, so the number is a random number given by server to get the response
rest of the log is the same for both boxes (until hang up)

Re: Customized rtmpdump binaries with patch file

 

@bentzi

your problem seems like a bug in math library (libm.so). try upgrading glibc to newer version. it's also possible that your compiler optimization is breaking it. try compiling static binary with no optimizations.
@RedPenguin

does this happens also with rtmpsuck? also post the verbose log of successful and failed attempt.

Re: Customized rtmpdump binaries with patch file

 

For some reason rtmpsuck has never worked with these streams (rtmpsuck claims it fails and video continues in browser) this is what it always does with 2011-07-11 and identical error with your latest compile.

http://pastebin.com/VkbqL0vQ

Re: Customized rtmpdump binaries with patch file

 

i mean the latest rtmpsrv log not older rtmpsuck one.

Re: Customized rtmpdump binaries with patch file

 

It looks like newer rtmpsrv is giving a very similar error to older rtmpsuck.

http://pastebin.com/tWJEYA28

Re: Customized rtmpdump binaries with patch file

 

i seem to have pinpointed the issue. the main issue was that countAMF and dumpAMF functions in rtmpsrv were not taking new array types into consideration hence generating wrong command line in case there was any extra parameters to connect object.

change following in rtmpsrv.c and try:
countAMF:
dumpAMF:

Re: Customized rtmpdump binaries with patch file

 

That's completely gets rid of the invalid AMF data, but for some reason it still errors out on RTMPDump:

https://dl.dropboxusercontent.com/u/...tmpsrv-log.txt

The thing I always noticed between the older and newer RTMPSrvs I had was when 2011-07-11 was recording it always claimed the AMF Data was "-C 0:0 -C 0:1" such as I seen from your fix, but the original ones from this thread claim they got the strange chars I mentioned before.

Re: Customized rtmpdump binaries with patch file

 

That's not the problem with rtmpdump. rtmpdump tries to connect with their sever on detected port (1935) and server disconnects the connection. it's also the reason why rtmpsuck doesn't work on this site. after disconnection their flash client switches to another port (probably 80 or 443) which is not redirected to rtmpsrv or rtmpsuck by default (check RTMPDumpHelper options). try after changing the port from 1935 to 80 or 443. it's better to use wireshark in this case to know which protocol (RTMPT ?) and port is being used.

Re: Customized rtmpdump binaries with patch file

 

A wireshark analysis just seems to show normal HTTP/HTTPS traffic then the minute the stream plays a flow of "RTMP" traffic with a ton of "Unknowns (0x0)" which I always seem to see with RTMPE on port 1935, which is confirmed after reading an XML that was sent before hand.


http://www.cnn.com/video/data/3.0/vi...eam1/index.xml

You can tell it seems to mention rtmpe first and that's the protocol uses in the older version but I do see an rtmpte URL also in that XML but Wireshark claims rtmpte is not in use by default.

Re: Customized rtmpdump binaries with patch file

 

then the only reason possible is that their server is rejecting old clients (handshake 9 and earlier). try with something newer :rolleyes:

Re: Customized rtmpdump binaries with patch file

 

First post updated with new fixes.

Re: Customized rtmpdump binaries with patch file

 

TY.

Only thing that confuses me then after you looked at this issue is how the older rtmpdump involked by rtmpsrv is actually able to download from the stream.

What would the older one have the newer one doesn't, is the question.

Re: Customized rtmpdump binaries with patch file

 

First rtmpsrv doesn't download anything. it's only job is to detect parameters and generate proper command line for a given stream and then launch rtmdump (which should be either in same folder or system path).

are you suggesting that older version of rtmpdump is able to download while newer one isn't. there is one more thing we can try. post the debug log of older and newer rtmpdump. rtmpsrv doesn't matter because after the above fix both generates proper command line. introduction of those array types have caused many regressions.