be-at.tv changed their internal urls - how to download?

be-at.tv changed their internal urls - how to download?

 

Hi guys,

be-at.tv changed their internal urls. To be honest I don't have to clue how to download now. :-)

Could you have a look at this example?

Cheers
Sebastian

Re: be-at.tv changed their internal urls - how to download?

 

Here's the example. ;-)

http://www.be-at.tv/brands/q-nightcl...work/ben-klock

Re: be-at.tv changed their internal urls - how to download?

 

Seems to be a hard one!

Re: be-at.tv changed their internal urls - how to download?

 

I'd like to +1 that, tried fiddling around a bit but couldn't find a way to get anything other then garbage data.

Re: be-at.tv changed their internal urls - how to download?

 

Anyone with some idea? YouTube also had some change for their videoformats, maybe the same problem?

Re: be-at.tv changed their internal urls - how to download?

 

The old method still seems to work. But the audio and video still has to be downloaded separately, as far as I know.

For the link that you've provided above;

Audio (using rtmpdump):
Video; segments - one minute each:
Assemble all the video pieces and mux with the audio track.

Re: be-at.tv changed their internal urls - how to download?

 

@Blimey: Thanks a lot for your help.
How did you find the audio and video urls?

Re: be-at.tv changed their internal urls - how to download?

 

My memory has faded, but i believe it shows within the source or by monitoring of traffic.

Various utilities will show download attempts like this, for example:
003311 is the session
004001-0128 is the audio and bit rate
005376-1000 is the video and bit rate

For any other video, just plug the respective values into the urls provided in previous post.

Re: be-at.tv changed their internal urls - how to download?

 

Ok, understood, thanks!!

Re: be-at.tv changed their internal urls - how to download?

 

Unfortunately rtmpdump with the audio file doesn't work anymore. I don't know why.

Anyone knows what changed?

Re: be-at.tv changed their internal urls - how to download?

 

Re: be-at.tv changed their internal urls - how to download?

 

Thanks - I used a too old version of RTMPDump. :-)

Re: be-at.tv changed their internal urls - how to download?

 

Aaahw, they once again changed their urls.

Check this out:

http://www.be-at.tv/brands/maimarkth.../chris-liebing

That leads to files, that I can't make any use of:
http://cdn.be-at.tv/001460/128/1250/0000.beat

Maybe someone know a way to use the *.beat-files?

Re: be-at.tv changed their internal urls - how to download?

 

You must still be using too old version of RTMPDump. it still works;

Audio (using rtmpdump):
Video; segments - one minute each:
Btw, you ignored my reply in the other thread requesting a link to a session with "??missing frames??".

Re: be-at.tv changed their internal urls - how to download?

 

blimey, thanks but how did you compile the Session-, Video- and Audio-Numbers?

Last time I compiled it from the *.beat-URL, but I couldn't find these numbers with the new given url (hxxp://cdn.be-at.tv/001460/128/1250/0000.beat) now.

For your other question: I wanted to try it myself first with your instruction. This one ran out of sync by trying with Avidemux: http://www.be-at.tv/brands/flughafen...-koletzki-fran

Btw, I can't thank you enough for all the help you did yet. :-)

Re: be-at.tv changed their internal urls - how to download?

 

In time I will reverse the *.beat format. The Player4.swf flash player that plays them is not encrypted, so it will not be too hard to figure out the format.

Re: be-at.tv changed their internal urls - how to download?

 

Well i was fiddling with their new .beat format. they are now encrypting their content using their own solution and using custom format for storing encrypted tags. i have written a basic script describing how to decode this format. it's not a full fledged downloader nor i intended to create one. it only converts individual .beat files to flv files. i will post it later with some minor improvements.

Re: be-at.tv changed their internal urls - how to download?

 

thanks!!:cool:

Re: be-at.tv changed their internal urls - how to download?

 

That sounds fantastic KSV. Do their .beat-Files als contain the audio track?

Re: be-at.tv changed their internal urls - how to download?

 

I have added BeatConvert.php file to my repository.

above command will create 0000.flv in the same directory.

Yeah it also contains audio.

Re: be-at.tv changed their internal urls - how to download?

 

really nice work, ksv! quite impressed.
and the decoded .beat files have h.264 video, unlike the vp6 that is present in even the newest additions to the old system.

however, it seems that somehow each .beat format session is somehow keyed differently, or is otherwise somehow differently formatted.

for example, Session003311, mentioned earlier in this thread;

is not properly decoded by the script (although the attempt is completed), while the most recent session mentioned in this thread - Session002646 (aka Recording id# 001460);

is properly decoded. I haven't checked any others yet.

Thanks again very much for your effort on this script.

Re: be-at.tv changed their internal urls - how to download?

 

I have pushed new update to the repo with added support of version 1 of .beat file format.

Re: be-at.tv changed their internal urls - how to download?

 

Thank you so much.
As I don't have PHP experience - by googling I found XAMPP could be my program of choice, is that right?

Re: be-at.tv changed their internal urls - how to download?

 

sebastian, ksv has "Installing PHP for dummies (Windows only)" on his wiki. see at the very bottom of this page.

Re: be-at.tv changed their internal urls - how to download?

 

sweet... i have checked compatibly across a dozen or so files across the past few years, all ok.

Re: be-at.tv changed their internal urls - how to download?

 

Thanks, I can't wait for trying this this weekend at my home computer as this looks like a solution for something I was looking for so long. :-)

Re: be-at.tv changed their internal urls - how to download?

 

Anyone can recommend me a handy mass downloader für the .beat-Files? JDownloader totally fails with this.
Just something that downloads it from a text file with all the urls.

Re: be-at.tv changed their internal urls - how to download?

 

I tried KSVs script and it worked, thanks a lot for that!!!

Only downside: When combining the files either with ffmpeg or Avidemux the audio is missing for a few ms after every combined segment. :-(

Re: be-at.tv changed their internal urls - how to download?

 

Batch mode in IDM is a good choice.

In IDM; Tasks, Add batch download.

Enter URL with asterisk for variable, for example;

h..p://cdn.be-at.tv/001460/128/1250/*.beat

And set wildcard size to 4. For "From" enter 0, for "To" enter number of last file, like 200, 500, 1000, or whatever it is.

No "missing audio for a few ms" (or any missing audio whatsoever) when using ffmpeg here. And I've done several sets now.
But, we've been down that road already...

Re: be-at.tv changed their internal urls - how to download?

 

Strange, I did all according to your ffmpeg-instruction on be-at.tv (http://stream-recorder.com/forum/mux...es-t16816.html) and still got the audio gaps between each merged segment. I'll try it with your IDM suggestion later, but I don't think that JDownloader altered the files itself. I'll report later.

Again, thanks for all your help! :-)

Re: be-at.tv changed their internal urls - how to download?

 

Maybe I just can't hear the few ms of audio gaps.

Below is a link to a small snippet (the first 6 min, or 30 .beat files) of time-warp-2013/chris-liebing (Session 002646/Recording 001460) that was concatenated with ffmpeg. Please tell me if you detect any audio gaps;

But you're right that it is unlikely that the downloader or download method has any effect, so long as the downloaded .beat files were able to be converted with BeatConvert.php.

Re: be-at.tv changed their internal urls - how to download?

 

@blimey: No gaps at your file. And no gaps if I'm converting the same session too at home.

So it's a session based problem. :-)

Here's the one that always does gaps between each file:
hxxp://www.be-at.tv/brands/jaarbeurs-utrecht/timewarp-2012/marcel-fengler

Maybe KSV could have a look at it? :-)

Re: be-at.tv changed their internal urls - how to download?

 

Does that one play without any gaps whatsoever when playing it on the website in their flash player? How common are these "gapped" sessions?

It is possible that the beat people just did some bad encodes, or made some other sort of mistake. Unless it is very common, or if the "gapped" sessions play entirely gap-free on the website.

Re: be-at.tv changed their internal urls - how to download?

 

It plays entire gap-free on their website.
Didn't try many other sessions yet though.

Re: be-at.tv changed their internal urls - how to download?

 

I did the first 30 .beat files of timewarp-2012/marcel-fengler (Recording 001196) with ffmpeg and it seems ok to me. I'd have to do the whole thing to be 100% sure of sync, but it seems right so far. Check it -- if it is "gapped", point out where;

Re: be-at.tv changed their internal urls - how to download?

 

Very strange. Your recording is ok, no problems.
What version of ffmpeg are you using? I tried several static builds from http://ffmpeg.zeranoe.com/builds/

Re: be-at.tv changed their internal urls - how to download?

 

Actually, there is a sync problem. I'm looking into it now and will report back later.

If you follow the music in the web player, or in the individual converted beat file, you can see that the music is in a different place compared to my joined file just before they go to the guy at the panel for the very first time around 2:20-2:30.

Checking it further now.

Re: be-at.tv changed their internal urls - how to download?

 

Any news? I also wonder why ffmpeg behaves differently at you and me while joining the files.

Re: be-at.tv changed their internal urls - how to download?

 

Yes, I was able to get that session (timewarp-2012/marcel-fengler, recording 001196) in sync.

This session has 463 beat files (0000-0462). After processing them all with the BeatConvert.php script, you may notice that if you play any one individual flv file, the ending time of each individual file tracks along respective to the whole session time.

For example 0462.flv has an ending time of 132:27 (the end time of the whole session).
0461.flv has an ending time of 132:24 (where it ends relative to the whole).
And so on, for all the earlier files.

The flv containers for all of these pieces are encoded in such a way that the collection "appears" as one big individually encoded flv file to the flash player. This is due to the way they split up the original flv file. I'll spare the details about that.

Anyway, you can simply reconstruct the original flv file from all the pieces using simple binary file operations.

To put it as simply as possible, you leave 0000.flv as-is, then cut the first 32 bytes from each of the remaining files (0001.flv through 0462.flv), and then join them all together (in order) and you have the original flv in one file.

When I say join them, I mean in terms of binary file operations, not video operations.

I used "replace pioneer 2.73" to quickly do these binary file operations in a GUI, but a script could easily be constructed.

Once you have the original flv file in one piece, you can copy it to another container like mkv using ffmpeg (the best way).

Flvextract won't work on the original flv because of some anomalies in the 264 bitstream they used. And if using mp4box, some special commands are needed for the same reason. But if you just stream copy the original flv to mp4 or mkv container using ffmpeg it will work straight away. Or you can just leave the original flv alone if you can use it that way.

Re: be-at.tv changed their internal urls - how to download?

 

Thank you so much for your investigation on this problem.
I'll try it this weekend and keep you posted. :-)

If anyone also knows a command line based app to strip the bytes, please let me know, so I could do the whole process via a batch file. :-)