[sebastian]

Hi guys,

be-at.tv changed their internal urls. To be honest I don't have to clue how to download now. :-)

Could you have a look at this example?

Cheers
Sebastian

[sebastian]

Here's the example. ;-)

http://www.be-at.tv/brands/q-nightclub/like-klockwork/ben-klock

[sebastian]

Seems to be a hard one!

[drbmn]

I'd like to +1 that, tried fiddling around a bit but couldn't find a way to get anything other then garbage data.

[sebastian]

Anyone with some idea? YouTube also had some change for their videoformats, maybe the same problem?

[blimey]

Here's the example. ;-)

http://www.be-at.tv/brands/q-nightclub/like-klockwork/ben-klock

The old method still seems to work. But the audio and video still has to be downloaded separately, as far as I know.

For the link that you've provided above;

Audio (using rtmpdump):

rtmpdump.exe -r "rtmp://media.cdn.be-at.tv:80/cfx/st/" -a "cfx/st/" -y "Session003311/Audio004001/128" -o "Audio004001.flv"


Video; segments - one minute each:

http://video.cdn.be-at.tv/Session003311/Video005376/1000.000.flv
http://video.cdn.be-at.tv/Session003311/Video005376/1000.001.flv
http://video.cdn.be-at.tv/Session003311/Video005376/1000.002.flv

all the way up until the last minute.


Assemble all the video pieces and mux with the audio track.

[sebastian]

@Blimey: Thanks a lot for your help.
How did you find the audio and video urls?

[blimey]

My memory has faded, but i believe it shows within the source or by monitoring of traffic.

Various utilities will show download attempts like this, for example:

h..p://cdn.be-at.tv/003311/004001-0128/005376-1000/0000.beat


003311 is the session
004001-0128 is the audio and bit rate
005376-1000 is the video and bit rate

For any other video, just plug the respective values into the urls provided in previous post.

[sebastian]

Ok, understood, thanks!!

[sebastian]

Unfortunately rtmpdump with the audio file doesn't work anymore. I don't know why.

Starting download at 0.000 KB
ERROR: ReadN, RTMP recv error 10060
ERROR: ReadPacket, failed to read RTMP packet header
Closing connection... done!

Anyone knows what changed?

[chap]

>rtmpdump.exe -r "rtmp://media.cdn.be-at.tv:80/cfx/st/" -a "cfx/st/" -y "Session
003311/Audio004001/128" -o "Audio004001.flv"
RTMPDump v2.4 GIT-2013-10-07 (Compiled by KSV)
(c) 2010 Andrej Stepanchuk, Howard Chu, The Flvstreamer Team; license: GPL
Connecting ...
INFO: Connected...
Starting download at: 0.000 kB
INFO: Metadata:
INFO: audiochannels 2.00
INFO: audiocodecid .mp3
INFO: audiodatarate 128.00
INFO: audiodevice Spotbox LIVE Stream
INFO: audioinputvolume 75.00
INFO: audiosamplerate 44100.00
INFO: author B@ TV
INFO: copyright BEAT TV MEDIA LTD
INFO: creationdate Thu Sep 26 09:56:21 2013
INFO: duration 12802.66
INFO: lastkeyframetimestamp 0.00
INFO: lasttimestamp 12802664.00
INFO: presetname Custom
31183.619 kB / 1926.37 sec (15.0%)

[sebastian]

Thanks - I used a too old version of RTMPDump. :-)

[sebastian]

Aaahw, they once again changed their urls.

Check this out:

http://www.be-at.tv/brands/maimarkthall/time-warp-2013/chris-liebing

That leads to files, that I can't make any use of:
http://cdn.be-at.tv/001460/128/1250/0000.beat

Maybe someone know a way to use the *.beat-files?

[blimey]

You must still be using too old version of RTMPDump. it still works;


h..p://www.be-at.tv/brands/maimarkthall/time-warp-2013/chris-liebing


Audio (using rtmpdump):

rtmpdump.exe -r "rtmp://media.cdn.be-at.tv:80/cfx/st/" -a "cfx/st/" -y "Session002646/Audio003186/128" -o "Audio003186-0128.flv"


Video; segments - one minute each:

h..p://video.cdn.be-at.tv/Session002646/Video004575/1000.000.flv
.
.
.
etc


Btw, you ignored my reply in the other thread requesting a link to a session with "??missing frames??".

[sebastian]

blimey, thanks but how did you compile the Session-, Video- and Audio-Numbers?

Last time I compiled it from the *.beat-URL, but I couldn't find these numbers with the new given url (hxxp://cdn.be-at.tv/001460/128/1250/0000.beat) now.

For your other question: I wanted to try it myself first with your instruction. This one ran out of sync by trying with Avidemux: http://www.be-at.tv/brands/flughafen-tempelhof/fly-bermuda-festival/oliver-koletzki-fran

Btw, I can't thank you enough for all the help you did yet. :-)

[blimey]

In time I will reverse the *.beat format. The Player4.swf flash player that plays them is not encrypted, so it will not be too hard to figure out the format.

[KSV]

Well i was fiddling with their new .beat format. they are now encrypting their content using their own solution and using custom format for storing encrypted tags. i have written a basic script describing how to decode this format. it's not a full fledged downloader nor i intended to create one. it only converts individual .beat files to flv files. i will post it later with some minor improvements.

[chap]

i will post it later with some minor improvements.
thanks!!:cool:

[sebastian]

That sounds fantastic KSV. Do their .beat-Files als contain the audio track?

[KSV]

I have added BeatConvert.php (https://github.com/K-S-V/Scripts/blob/master/BeatConvert.php) file to my repository.


KSV Beat Converter

You can use script with following switches:

--help displays this help
--debug show debug output
--infile [param] input beat file to convert
--outfile [param] filename to use for output file

php BeatConvert.php 0000.beat
above command will create 0000.flv in the same directory.

Do their .beat-Files also contain the audio track?

Yeah it also contains audio.

[blimey]

I have added BeatConvert.php (https://github.com/K-S-V/Scripts/blob/master/BeatConvert.php) file to my repository.

really nice work, ksv! quite impressed.
and the decoded .beat files have h.264 video, unlike the vp6 that is present in even the newest additions to the old system.

however, it seems that somehow each .beat format session is somehow keyed differently, or is otherwise somehow differently formatted.

for example, Session003311, mentioned earlier in this thread;


h..p://cdn.be-at.tv/003311/004001-0128/005376-1000/0000.beat
.
.
and so on


is not properly decoded by the script (although the attempt is completed), while the most recent session mentioned in this thread - Session002646 (aka Recording id# 001460);


hxxp://cdn.be-at.tv/001460/128/1250/0000.beat
.
.
and so on


is properly decoded. I haven't checked any others yet.

Thanks again very much for your effort on this script.

[KSV]

I have pushed new update to the repo with added support of version 1 of .beat file format.

[sebastian]

Thank you so much.
As I don't have PHP experience - by googling I found XAMPP could be my program of choice, is that right?

[blimey]

sebastian, ksv has "Installing PHP for dummies (Windows only)" on his wiki. see at the very bottom of this page (https://github.com/K-S-V/Scripts/wiki).

[blimey]

I have pushed new update to the repo with added support of version 1 of .beat file format.
sweet... i have checked compatibly across a dozen or so files across the past few years, all ok.

[sebastian]

Thanks, I can't wait for trying this this weekend at my home computer as this looks like a solution for something I was looking for so long. :-)

[sebastian]

Anyone can recommend me a handy mass downloader für the .beat-Files? JDownloader totally fails with this.
Just something that downloads it from a text file with all the urls.

[sebastian]

I tried KSVs script and it worked, thanks a lot for that!!!

Only downside: When combining the files either with ffmpeg or Avidemux the audio is missing for a few ms after every combined segment. :-(

[blimey]

Batch mode in IDM is a good choice.

In IDM; Tasks, Add batch download.

Enter URL with asterisk for variable, for example;

h..p://cdn.be-at.tv/001460/128/1250/*.beat

And set wildcard size to 4. For "From" enter 0, for "To" enter number of last file, like 200, 500, 1000, or whatever it is.

No "missing audio for a few ms" (or any missing audio whatsoever) when using ffmpeg here. And I've done several sets now.
But, we've been down that road already...

[sebastian]

...No "missing audio for a few ms" (or any missing audio whatsoever) when using ffmpeg here. And I've done several sets now.
But, we've been down that road already...

Strange, I did all according to your ffmpeg-instruction on be-at.tv (http://stream-recorder.com/forum/muxing-several-files-yamb-incl-chapter-files-t16816.html) and still got the audio gaps between each merged segment. I'll try it with your IDM suggestion later, but I don't think that JDownloader altered the files itself. I'll report later.

Again, thanks for all your help! :-)

[blimey]

Maybe I just can't hear the few ms of audio gaps.

Below is a link to a small snippet (the first 6 min, or 30 .beat files) of time-warp-2013/chris-liebing (Session 002646/Recording 001460) that was concatenated with ffmpeg. Please tell me if you detect any audio gaps;


001460_FHF.mp4 (http://www.datafilehost.com/d/4601d784)

(uncheck the box before "Use our download manager and get recommended downloads" in order to get the file without the garbage install wrapper)


But you're right that it is unlikely that the downloader or download method has any effect, so long as the downloaded .beat files were able to be converted with BeatConvert.php.

[sebastian]

@blimey: No gaps at your file. And no gaps if I'm converting the same session too at home.

So it's a session based problem. :-)

Here's the one that always does gaps between each file:
hxxp://www.be-at.tv/brands/jaarbeurs-utrecht/timewarp-2012/marcel-fengler

Maybe KSV could have a look at it? :-)

[blimey]

So it's a session based problem. :-)

Here's the one that always does gaps between each file:
hxxp://www.be-at.tv/brands/jaarbeurs-utrecht/timewarp-2012/marcel-fengler

Does that one play without any gaps whatsoever when playing it on the website in their flash player? How common are these "gapped" sessions?

It is possible that the beat people just did some bad encodes, or made some other sort of mistake. Unless it is very common, or if the "gapped" sessions play entirely gap-free on the website.

[sebastian]

It plays entire gap-free on their website.
Didn't try many other sessions yet though.

[blimey]

Here's the one that always does gaps between each file:
hxxp://www.be-at.tv/brands/jaarbeurs-utrecht/timewarp-2012/marcel-fengler

I did the first 30 .beat files of timewarp-2012/marcel-fengler (Recording 001196) with ffmpeg and it seems ok to me. I'd have to do the whole thing to be 100% sure of sync, but it seems right so far. Check it -- if it is "gapped", point out where;


001196_FHF.mp4 (http://www.datafilehost.com/d/16fb36e1)

(uncheck the box before "Use our download manager and get recommended downloads" in order to get the file without the garbage install wrapper)

[sebastian]

Very strange. Your recording is ok, no problems.
What version of ffmpeg are you using? I tried several static builds from http://ffmpeg.zeranoe.com/builds/

[blimey]

Actually, there is a sync problem. I'm looking into it now and will report back later.

If you follow the music in the web player, or in the individual converted beat file, you can see that the music is in a different place compared to my joined file just before they go to the guy at the panel for the very first time around 2:20-2:30.

Checking it further now.

[sebastian]

Any news? I also wonder why ffmpeg behaves differently at you and me while joining the files.

[blimey]

Yes, I was able to get that session (timewarp-2012/marcel-fengler, recording 001196) in sync.

This session has 463 beat files (0000-0462). After processing them all with the BeatConvert.php script, you may notice that if you play any one individual flv file, the ending time of each individual file tracks along respective to the whole session time.

For example 0462.flv has an ending time of 132:27 (the end time of the whole session).
0461.flv has an ending time of 132:24 (where it ends relative to the whole).
And so on, for all the earlier files.

The flv containers for all of these pieces are encoded in such a way that the collection "appears" as one big individually encoded flv file to the flash player. This is due to the way they split up the original flv file. I'll spare the details about that.

Anyway, you can simply reconstruct the original flv file from all the pieces using simple binary file operations.

To put it as simply as possible, you leave 0000.flv as-is, then cut the first 32 bytes from each of the remaining files (0001.flv through 0462.flv), and then join them all together (in order) and you have the original flv in one file.

When I say join them, I mean in terms of binary file operations, not video operations.

I used "replace pioneer 2.73" to quickly do these binary file operations in a GUI, but a script could easily be constructed.

Once you have the original flv file in one piece, you can copy it to another container like mkv using ffmpeg (the best way).

Flvextract won't work on the original flv because of some anomalies in the 264 bitstream they used. And if using mp4box, some special commands are needed for the same reason. But if you just stream copy the original flv to mp4 or mkv container using ffmpeg it will work straight away. Or you can just leave the original flv alone if you can use it that way.

[sebastian]

Thank you so much for your investigation on this problem.
I'll try it this weekend and keep you posted. :-)

If anyone also knows a command line based app to strip the bytes, please let me know, so I could do the whole process via a batch file. :-)

[blimey]

If anyone also knows a command line based app to strip the bytes, please let me know, so I could do the whole process via a batch file. :-)

Swiss File Knife is an ideal choice.

Download sfk169.exe from sourceforge (http://sourceforge.net/projects/swissfileknife/files/1-swissfileknife/1.6.9/).

Description (http://stahlworks.com/dev/index.php?tool=partcopy) of the feature that would do the job.

Very crude example of batch file (has little error checking) that uses sfk169.exe to strip the bytes and copy them with the first file to joined.flv.

joinflv.bat:


rem @echo off
if "%1" gtr "9998" goto :END
if not "%1"=="" goto copy
echo Usage is "%0 lastfilenumber" to join 0001.flv through lastfilenumber.flv
echo and append them with 0000.flv to joined.flv
goto :END
:COPY
copy 0000.flv joined.flv
set /a first=1
set last=%1
set /a last=10000%last% %% 10000
set last=10000%last%
set last=%last:~-4%
:LOOP
set first=10000%first%
sfk169 partcopy %first:~-4%.flv -allfrom 32 joined.flv -append -yes
set /a first+=1
set first=%first:~-4%
if %first% gtr %last% goto :END
goto LOOP
:END


The batch file is hard coded to start with 0001.flv, so you need only to pass the last file number (without the file extension) as a command line parameter;


joinflv.bat usage:

ex: joinflv lastfilenumber

joinflv 462


-----
Edit:

Check your source files carefully before using this batch file on any non-AVC encoded session, or any session other than:


h..p://www.be-at.tv/brands/jaarbeurs-utrecht/timewarp-2012/marcel-fengler


as the session may be encoded with vp6, or have a different offset for the start of the 'AVC sequence header', as mentioned by KSV in the post below.

In all cases, this binary file copy method will work, but for some (possibly many) sessions, the offset may need to be changed from 32, to quite often 13, but possibly other values as well..

However, ffmpeg with work with many sessions. All my attempts to maintain sync, with this session in particular, failed with the concatenate feature of ffmpeg, although this is probably not a problem with ffmpeg itself. Note that due to the source material in these files, it can be difficult to check sync. I checked it by comparison of the waveform segment of the audio and the corresponding video frame, as well as the overall time length of the video.

[KSV]

Stripping first 32 bytes isn't gonna work reliably with different files. you are assuming that first flv packet is 'AVC sequence header' and it's of same length for different files which isn't true. a better way to join those files is explained below:

1. create a new folder (BeatConvert) and copy BeatConvert.php (https://github.com/K-S-V/Scripts/blob/master/BeatConvert.php), FlvFixer.php (https://github.com/K-S-V/Scripts/blob/master/FlvFixer.php), FFMpeg.exe (http://ffmpeg.zeranoe.com/builds/win32/static/ffmpeg-latest-win32-static.7z) to this folder.

2. now create a new bat file (BeatConvert.bat) with following content:
if exist "List.txt" del "List.txt"
for %%a in (*.beat) do php BeatConvert.php %%a && echo file '%%~na.flv' >> List.txt
FFMpeg.exe -y -f concat -i List.txt -c copy Final.flv
php FlvFixer.php --in Final.flv --out Final_fixed.flv --nometa
FFMpeg.exe -y -i Final_fixed.flv -c copy Final.mkv

3. now copy your beat files (0000.beat....nnnn.beat) to the same folder and run the bat file.

if everything goes as expected a new file (Final.mkv) will be created which should be in sync.

[blimey]

Stripping first 32 bytes isn't gonna work reliably with different files. you are assuming that first flv packet is 'AVC sequence header' and it's of same length for different files which isn't true.

Yes, I know. For the v1 .beat files, or some others encoded in vp6, it is 13 bytes. But whatever it has been, it has always been consistent within a session for all .beat files 0001+ through the end of the session. In any case, this parameter is easily edited as needed.


a better way to join those files is explained below:


I don't know what to tell you, except, as I mentioned earlier in this thread, and in the other thread, my favored method was the concatenate feature of ffmpeg. But it bombed. And of course I tried FlvFixer.php, both on the segmented .flv files, or the joined, or both, and everything it between. I also just tried direct stream copy (individually) of the segmented .flv files with ffmpeg prior to concatenation in order to "fix" the .flv from the way in which it is time coded and yet still maintain sync.


1. create a new folder (BeatConvert) and copy BeatConvert.php (https://github.com/K-S-V/Scripts/blob/master/BeatConvert.php), FlvFixer.php (https://github.com/K-S-V/Scripts/blob/master/FlvFixer.php), FFMpeg.exe (http://ffmpeg.zeranoe.com/builds/win32/static/ffmpeg-latest-win32-static.7z) to this folder.

2. now create a new bat file (BeatConvert.bat) with following content:
if exist "List.txt" del "List.txt"
for %%a in (*.beat) do php BeatConvert.php %%a && echo file '%%~na.flv' >> List.txt
FFMpeg.exe -y -f concat -i List.txt -c copy Final.flv
php FlvFixer.php --in Final.flv --out Final_fixed.flv --nometa
FFMpeg.exe -y -i Final_fixed.flv -c copy Final.mkv

3. now copy your beat files (0000.beat....nnnn.beat) to the same folder and run the bat file.

if everything goes as expected a new file (Final.mkv) will be created which should be in sync.

Now, for the session that has most recently been in discussion in this thread;


h..p://www.be-at.tv/brands/jaarbeurs-utrecht/timewarp-2012/marcel-fengler


Which has corresponding .beat files at;


h..p://cdn.be-at.tv/001196/128/1250/0000.beat
.
.
h..p://cdn.be-at.tv/001196/128/1250/0462.beat


I just tried your batch file using the raw source .beat files.
The resulting files it produced:

Final_fixed.flv Time length: 01:35:34
Final.mkv Time length: 01:35:34

Time length of video when played in flashplayer: 01:32:28

Time length of video when joined by binary file copy method I mentioned in my previous post: 01:32:28 (it could show up as 01:32:27 on some players)

If you have any ideas, I'm all ears.

But I do agree to caution anyone before using the batch file that I just posted to check the source .flv files after processing with BeatConvert.php.

[KSV]

can you post the debug log of FlvFixer.php?

php FlvFixer.php --in Final.flv --out Final_fixed.flv --nometa --debug 2> Debug.txt

[blimey]

Sure, thanks. The log seems oddly formatted? But here is what spit out from the command line you specified.

Debug1a.zip (http://www1.zippyshare.com/v/76274029/file.html)

Edit: There was an error in the first copy of the above log.
Updated Debug.zip w/ Debug1a.zip.

It could be that something is off with their encode of just this particular session.
For comparison, here is the debug log from FlvFixer.php for the .flv file joined by binary file copy rather than ffmpeg.


Debug2.zip (http://www61.zippyshare.com/v/57957617/file.html)

[KSV]

i have analyzed your logs. strangely the file concatenated by ffmpeg is missing most of audio video data contained in 0000.flv but when i try it on my side everything seems ok. are you sure you are using the latest version of ffmpeg?

[blimey]

hmm. that's kinda odd. I'm at a loss.

I had tried several versions of ffmpeg along the way while working with this particular set of files from this session.

I just used the newest version:
ffmpeg version N-60240-ge1cb6dc
built on Jan 29 2014 22:01:42 with gcc 4.8.2. (GCC)

Are you using the same version of ffmpeg referenced above? And it produced a ffmpeg concatenated file with a length of 01:32:28 (or 01:32:27 on some players)?

For anyone else following this thread, use the ffmpeg method shown in ksv's example. If the time length of the produced file matches the web player (or is -1 second off), it is very likely synced properly. In all cases, this binary file copy method will work, but for some (possibly many) sessions, the offset may need to be changed from 32, to quite often 13, but possibly other values as well.

[sebastian]

Final_fixed.flv Time length: 01:35:34
Final.mkv Time length: 01:35:34

same here with using KSVs batch. :-(

[blimey]

Final_fixed.flv Time length: 01:35:34
Final.mkv Time length: 01:35:34

same here with using KSVs batch. :-(

Well, could you test my batch too? It only takes a few seconds. Just copy the batch file and sfk169.exe into a folder with 0000.flv - 0462.flv (the .flv files processed already with BeatConvert.php, not the .beat files) from the timewarp-2012/marcel-fengler session.

Ffmpeg will quite often work with many sessions, but I have found about a dozen sessions that it has problems with, although this is probably not a problem with ffmpeg itself. In all cases, the binary file copy method will work, but for some (possibly many) sessions, the offset may need to be changed from 32, to quite often 13, but possibly other values as well. When you do the binary file copy method, you have a copy of the server file as they muxed it - as there is no remuxing involved.

[sebastian]

@blimey: joined.flv is 01:32:27, thanks! :-)

Anyone knows (if we can't find a solution that works for all types), how I can easily see if I should use your batch, KSVs batch, or even have to alter your batch to a different size of byte to strip?

[sebastian]

Guys, we're so close! Just need to know how I can find out if and how much bytes I'd have to strip! :-)

[KSV]

@blimey
i didn't noticed your corrected debug log you posted in your previous post. you should have mentioned it in new post. anyway i have analyzed your new log and it's obvious why total time of joined file is increased. it's due to wrong interleaving of audio video packets at the point of separation.

End of first flv:
VIDEO 11976 11936 5228 1966536
AUDIO 11981 11958 360 1971779
VIDEO 12016 11976 3091 1972154
VIDEO 12056 12016 5407 1975260
VIDEO 12096 12056 3229 1980682
VIDEO 12136 12096 6156 1983926
VIDEO 12176 12136 3393 1990097
VIDEO 12216 12176 6204 1993505
VIDEO 12256 12216 3546 1999724
VIDEO 12296 12256 4681 2003285
VIDEO 12336 12296 6716 2007981
VIDEO 12376 12336 3715 2014712


Start of second flv:
AUDIO 12004 -1 4 13
AUDIO 12004 12004 389 32
AUDIO 12027 12004 395 436
AUDIO 12051 12027 346 846
AUDIO 12074 12051 395 1207
AUDIO 12097 12074 376 1617
AUDIO 12120 12097 396 2008
AUDIO 12144 12120 383 2419
AUDIO 12167 12144 376 2817
AUDIO 12190 12167 372 3208
AUDIO 12213 12190 356 3595
AUDIO 12236 12213 388 3966
AUDIO 12260 12236 374 4369
AUDIO 12283 12260 389 4758
AUDIO 12306 12283 354 5162
AUDIO 12329 12306 380 5531
AUDIO 12353 12329 353 5926
AUDIO 12376 12353 357 6294
AUDIO 12399 12376 383 6666
VIDEO 12416 -1 44 7064
VIDEO 12416 12416 64234 7123
AUDIO 12422 12399 383 71372


due to non monotonically increasing timestamps ffmpeg's concat filter rebases second file's timestamp starting from 12376. this results in increased total length of file.

Solution:
i have modified my BeatConvert script to generate single flv file instead of one file per fragment so we don't have to use concat filter at all avoiding this whole mess. use the updated script with following batch file and report. it should create flv file with proper sync and length.

BeatConvert.bat:
if exist "Final.flv" del "Final.flv"
for %%a in (*.beat) do php BeatConvert.php %%a
php FlvFixer.php --in Final.flv --out Final_fixed.flv --nometa
FFMpeg.exe -y -i Final_fixed.flv -c copy Final.mkv

[hasomaso]

thanks KSV

i would be glad if you option your PM again switch on

[blimey]

That's great KSV, thanks! That point in the log did stand out to me, but I wasn't sure what it meant.

Anyway, thanks for the updated script. This project is finally finished, for now at least.

[blimey]

I tested the updated script on two AVC sessions, and all is correct.

Final.flv
Final_fixed.flv
Final.mkv

each have the correct duration and are in sync. I will test it on a vp6 session later, but it looks like all is good with the updated script!

[sebastian]

I will test it this weekend, but I think this will be the final solution.

KSV: I can't thank you enough for coding this. I have been waiting so long for a solution for my favourite video site.

blimey: Also thanks for your expertise and energy in this.

You both are my heroes! I will give you an info when I tested this. :-)

[chap]

KSV,blimey
respect:cool:

[sebastian]

I tested a few sessions, and all are in sync! Again: Thank you so much!! :-)

[tribalmixes]

i must also say: thank you very much, all of you, guys, for this. it's a very big help for me and my friends, we like to record and share be-at.tv, and had to do it while streaming it lately.. i really appreciate this, cause it's already saving me tons of time.. =)

i am really after the audio though, video - yes, some of the sessions, maybe every 5th, no matter, and audio was kinda left out of your discussion...

i do want to ask something though... i feel kinda stoopid and cannot figure it out, where do we find all 3 of the IDs - the Recording ID (all djs/mixes as one club night), Session ID (one dj/mix), and Stream ID (actual 128/192/1000/2500/etc).. there's also 4th ID, its irrelevant now, i think..

as was discussed, there are currently 2 ways they serve their streams (and i am using 2 most recent sessions):

1. as in here ..be-at.tv/brands/klokgebouw/awakenings-eindhoven-2014-area-y/makcim-b2b-el-p this one yields pieces like this cdn.be-at.tv/003789/004433-0128/005808-1000/0003.beat that satisfy the original example where it allows one to download the audio stream with dtmpdump, and i do that, substitute my own session id and stream id, and i get 128kbps version (in this case) of the audio stream.

2. as in here ..be-at.tv/brands/klokgebouw/awakenings-eindhoven-2014-area-x/ - this one produces different pieces, that are accessed like this ..cdn.be-at.tv/002288/192/1250/0097.beat - and in this case, whatever i do, the most i can find is the session ID - something like 3801 if i remember right, but i cannot find stream ID. i am trying all possible ways. i employed like 6 different url sniffers, nothing.. i did look into .program file they served, and it had the Session ID in there, but not the stream ID. and so i am rendered helpless facing this task: finding the 2 ids to download the stream smoothly.

i did though download all the video and audio in some other case, where i didn't want video, btw, ..cdn.be-at.tv/002288/192/0097.beat - produces just the audio, converted from flv to mp3 and was happy, still saved tons of time.

i just wanna know, how did you guys find those streams and their IDs up above in the posts?

thanks, will be eagerly checking back here... =)

[sebastian]

@tribalmixes: Sorry, but sharing their content is a violation of copyright. This community is only for our personal purposes.

Be-At.tv is streaming so much great content, and they are deserving every click!!

[blimey]

btw, cdn.be-at.--/002288/192/0097.beat - produces just the audio

That seems like a good solution for just the audio, 002288/192/ ranges from 0095-1074 (.beat), and seems to include the audio (and only the audio) in acc format (flv) for half of the four sessions of Awakenings Eindhoven 2014 Area X. The other half is in 2290.

I'm not sure if they are currently actively using the non-beat format sources, although for some reason they are still present. I don't remember where the Audio00xxxx and Video00xxxx addresses are located, I'd have to check again. I think I uncovered them when experimenting with different user agent settings for the browser.

[tribalmixes]

@tribalmixes: Sorry, but sharing their content is a violation of copyright. This community is only for our personal purposes.

Be-At.tv is streaming so much great content, and they are deserving every click!!

you wanna be a dick about it - go ahead, my pleasure. but please, make sure erase this thread, cause it does allow assholes like me to find out how to get their music and share it. you wanna be the only one who knows how to rip be-at.tv? well i must surprise you, there are a few more people now, including me.

you wanna talk copyright? their TOS perfectly state that copying, recording, and whatsoever, is as prohibited as sharing their content. standard TOS, i must note. they know how to deal with their stuff being copied and shared and do it sometimes. who are you? do i see there some kinda cape? you like professor hindsight? the superhero? congratulations! you are the winner.

[tribalmixes]

That seems like a good solution for just the audio, 002288/192/ ranges from 0095-1074 (.beat), and seems to include the audio (and only the audio) in acc format (flv) for half of the four sessions of Awakenings Eindhoven 2014 Area X. The other half is in 2290.

well yeah, i noticed when video screen is minimized in that setting they stop doing video, thus it's the audio only in there, but to be honest, rtmpdump works way more impressive. in my opinion..

I'm not sure if they are currently actively using the non-beat format sources, although for some reason they are still present. I don't remember where the Audio00xxxx and Video00xxxx addresses are located, I'd have to check again. I think I uncovered them when experimenting with different user agent settings for the browser.

i'll try to play with those myself, thanks alot!! for the help and info and all.

[blimey]

There are no old style links to any of the four sessions in the Awakenings Eindhoven 2014 Area X event.

All of the last dozen or so events in the "Recently Recorded' list have old style links, with the exception of the Awakenings Eindhoven 2014 Area X event. I have no idea why that is the only event that lacks them. Perhaps because it was just recorded four days ago?

It is the only event/session I've found that doesn't have old style links in addition to the new format. If there is another one, provide the details.

[sebastian]

I got a new problem:

When decoding the following session:

hxxp://www.be-at.tv/brands/dc10/paradise-closing-2013/jamie-jones

the parts in the middle aren't decoded properly, resulting in "green screen". However, the audio is ok.

Anyone knows what could cause the problem?

[blimey]

I got a new problem:

When decoding the following session:

hxxp://www.be-at.tv/brands/dc10/paradise-closing-2013/jamie-jones

the parts in the middle aren't decoded properly, resulting in "green screen". However, the audio is ok.

Anyone knows what could cause the problem?

I took a quick look. Something goes wrong at all of the joints. However, the fragments are joined properly by the script.

Each of any of the fragments play ok individually with any player.

As for the joined files;

Final.flv (the decoded/joined file prior to processing with FlvFixer.php) will play without issue with the flv player that comes with getflv. But playback fails at the joints with most other players.

Final_fixed.flv (post FlvFixer.php processing) will no longer play with the getflv player.

ffmpeg throws numerous errors when copying the contents into the mkv container;

Non-monotonous DTS
missing picture in access unit with size 40
reference count overflow
illegal memory management control operation

I'm not sure what is the problem. The easiest solution is to transcode the individual frgaments and join them as you transcode. I tested that and it worked ok.

You could download the video from the old system (Video00xxxx links), that joins ok, but since it is vp6 you would probably want to transcode it anyway.

[lesor]

the parts in the middle aren't decoded properly, resulting in "green screen"My video plays without distortions, but Final_fixed.flv = 1KB (Final.flv > 2GB) :(

[blimey]

My video plays without distortions,

We have different source files from each other. The source I was speaking about is the 960x540 resolution at /1250. Yours is the 1024x576 resolution at the /2500. So, I suppose, be sure to download the higher resolution source files for this session.

Final_fixed.flv did have the full size for the lower resolution source since the input file size is only 1.86 GB. But for the higher resolution source, the input file size, as you say, is > 2 GB, and this seems to be beyond the limit for the FlvFixer.php script.

[KSV]

This particular session (http://www.be-at.tv/brands/dc10/paradise-closing-2013/jamie-jones) have 0000.beat file which contains different AVC sequence header than rest of other beat files. it seems they restarted video encoding with different parameters after first few seconds. this causes problems with most players because they expect only one decoder configuration packet per stream. you can leave out 0000.beat and try to join the rest. it should work properly though i have tested it only on first few fragments.

for the 2 GB problem it's a limitation of php which uses signed 32 bit file pointers limiting the file size to 2 GB. if you are using a 64 bit operating system (greater than xp) you can download 64 bit php (http://windows.php.net/downloads/releases/php-5.5.9-Win32-VC11-x64.zip) and try with that.

[sebastian]

Alright, thanks again!

[sebastian]

We have different source files from each other. The source I was speaking about is the 960x540 resolution at /1250. Yours is the 1024x576 resolution at the /2500. So, I suppose, be sure to download the higher resolution source files for this session.

Final_fixed.flv did have the full size for the lower resolution source since the input file size is only 1.86 GB. But for the higher resolution source, the input file size, as you say, is > 2 GB, and this seems to be beyond the limit for the FlvFixer.php script.

The /2500 was never shown here. Is there a button to switch to "hd" which I can't find?

[sebastian]

Found it. It seems like switching to fullscreen will load the next beat-file with the better quality. :-)

[bozboy]

kvs or/and Blimey could you please help me with this:

http://i59.tinypic.com/2myqaz7.jpg

?

It is saying one flv file is broken.. but how do i find out wich one?

[bozboy]

Found it! Total file size is more than 2 gb.. I'm gonna do this in 2 parts and find a program to join the mkv's :-)

[stwalln]

have you guys managed to find a way to grab the audio successfully yet? i cant for the life of me do it - im trying to get the mp3 of this link http://www.be-at.tv/FcwFAA can anyone help me? thanks !

[blimey]

have you guys managed to find a way to grab the audio successfully yet? i cant for the life of me do it - im trying to get the mp3 of this link http://www.be-at.tv/FcwFAA can anyone help me? thanks !
The old system has been entirely disabled. So, the old rtmp server that had mp3 audio is gone.

Audio-only can still be downloaded in beat format, which is 192k aac. For the content you specify, you can get audio-only (no video) by downloading these 1904 beat fragments;

http://cdn.be-at.tv/003153/192/0000.beat
.
.
http://cdn.be-at.tv/003153/192/1903.beat


After downloading, process them with the BeatConvert.php script.

[stwalln]

thanks for the reply dude , im pretty newbie with scripts etc - i downloaded the two files you linked but not sure what to do with them next, could you help? thanks man

[stwalln]

Hmm :( Seems noone can help... Thanks anyway

[dancruz31]

Hello, new here and to how video stream recordings work in general honestly :p

I was wondering if anyone can help download this video to my macbook please: http://www.be-at.tv/brands/dalt-vila/ims-2014-grand-finale/anabel-englund-live


Thank you very much in advance!!!

[Sunwatcher]

hi, anyone can this thread translate in german ?

how can i find the .beat files ?

how can in convert the .beat files in mp4 etc. ?



http://www.be-at.tv/brands/nature-one/nature-one-20131/open-air-floor-saturday/dj-dag

[blimey]

hi, anyone can this thread translate in german ?

how can i find the .beat files ?

how can in convert the .beat files in mp4 etc. ?



http://www.be-at.tv/brands/nature-one/nature-one-20131/open-air-floor-saturday/dj-dagThe livestreamer (http://livestreamer.readthedocs.org/en/latest/plugin_matrix.html) utility claims to support be-at.tv now, which may automate the entire process. I haven't tried it.

[Sunwatcher]

thx but i dont understand this tool, its to difficult for me :(

i search a one click tool :D

[nullacht]

http://github.com/chrippa/livestreamer/releases

livestreamer "http://www.be-at.tv/brands/nature-one/nature-one-20131/open-air-floor-saturday/dj-dag" best -o 01.flv


[cli][info] Found matching plugin beattv for URL http://www.be-at.tv/brands/nature-one/nature-one-20131/open-air-floor-saturday/dj-dag
[cli][info] Available streams: audio_mono, audio_stereo (worst), mobile_low, mobile_medium, web_hd (best), web_high, web_medium
[cli][info] Opening stream: web_hd (beat)

[sebastian]

I can't suggest to use livestreamer from the current point of view. It procuced asynchronous videos for me.

I can only suggest to use KSVs scripts! :-)

[nullacht]

I can't confirm that. The file seems to be ok. I have no playback issues.

[Space767]

I would love to record some off these set off last ADE edition.
http://www.be-at.tv/brands/gashouder/ade-2014-awakenings-presents-electric-deluxe/dvs1
just an example would love len faki and Speedy J and many more :-D
But i really don't understand the post can't figure out yet how to record :-D

[103Alex1]

Hi.

Been feeling (fumbling ?) my way through this trying to work out how to access an audio stream which I have tried to capture off be-at.tv for private playback. They only had it up for a day and unfortunately I couldn't take time out to listen to it at the time.

I obviously didn't capture everything as the session timed out, but am hoping someone can help me retrieve and listen to what I got (if anything). I tried to use livestreamer for the first time. This is as far as I got :

http://i1300.photobucket.com/albums/ag89/103Alex1/Livestream/screenshot_Tue_Jan_13_233046_zpsfdcff755.png (http://s1300.photobucket.com/user/103Alex1/media/Livestream/screenshot_Tue_Jan_13_233046_zpsfdcff755.png.html)

Have I managed to save anything I can playback (and preferably save) ? If so, can anyone help explain exactly what I have to do to next to access the downloaded content ? In particular, is this saved on my hard drive anywhere ?

Sorry for such basic questions - have no prior experience trying to do this but really wanted to hear the set. :)

[blimey]

Have I managed to save anything I can playback (and preferably save) ? If so, can anyone help explain exactly what I have to do to next to access the downloaded content ? In particular, is this saved on my hard drive anywhere ?
It looks the output filename of "01.flv" was passed to livestreamer, so that file should be present in the C:\Users\Kim folder, even if only a partial download was completed. You can play .flv files with any player that supports them, such as vlc.

btw, you downloaded the HD video and the audio. If you had just downloaded the audio, the filesize would be much smaller. The data is still present on the server so you can try again to get the whole thing - and just do the audio this time if that is all you want.

[103Alex1]

It looks the output filename of "01.flv" was passed to livestreamer, so that file should be present in the C:\Users\Kim folder, even if only a partial download was completed. You can play .flv files with any player that supports them, such as vlc.

btw, you downloaded the HD video and the audio. If you had just downloaded the audio, the filesize would be much smaller. The data is still present on the server so you can try again to get the whole thing - and just do the audio this time if that is all you want.

Thanks so much - I found it and listened via the video. The original was nearly 5hrs long and I got about 2 hours of it. Fantastic forum this - it took a bit of hunting around and trying to work things out from complete zero experience, but so glad it all worked ... would never have worked out how to do that in a month of Sundays ! :D .

I tried to get the audio stream but it just came back with an error: Unable to validate JSON message - does that mean the data is no longer present on the server ?

Is it possible to split the audio from the .flv file in any way to play back as .mp3 ?

[nullacht]

I tried to get the audio stream but it just came back with an error: Unable to validate JSON message - does that mean the data is no longer present on the server ?

The audio stream is still available:

livestreamer "https://www.be-at.tv/brands/mamita-s/bpm-2015-all-day-i-dream/lee-burridge-b2b-matthew-dekay" worst -o 01.flv

[cli][info] Found matching plugin beattv for URL https://www.be-at.tv/brands/mamita-s/bpm-2015-all-day-i-dream/lee-burridge-b2b-matthew-dekay
[cli][info] Available streams: audio_mono, audio_stereo (worst), mobile_low, mobile_medium, web_hd (best), web_high, web_medium
[cli][info] Opening stream: audio_stereo (beat)


Is it possible to split the audio from the .flv file in any way to play back as .mp3 ?

FLV Extract:

Extracts video and audio from FLV files without decompressing or recompressing.

http://www.moitah.net/download/latest/FLV_Extract.zip

01.flv -> 01.aac

AAC:

Advanced Audio Coding (AAC) is an audio coding standard for lossy digital audio compression.

[103Alex1]

Not tried in ages but can't seem to get anywhere with this approach now. Tried and failed with this one :

>livestreamer be-at.tv/brands/cova-santa-ibiza/woomoon-closing-party-2016/rampue worst -o 01.flv

Does livestreamer still work with streams from this source ?

[Kris1982]

Hello guys

I read all the 10 pages but I'm still confused about how this works.

I want just the audio (.mp3) from:

http://www.be-at.tv/brands/space-ibiza/music-is-revolution-closing-party-2016-discoteca

It's a 9h liveset from Carl Cox closing the Music Is Revolution in Space Ibiza.

Is there someone who can assist me?

[Moonspell]

check your pm mate :)

[noaliasmike]

Hello guys

I read all the 10 pages but I'm still confused about how this works.

I want just the audio (.mp3) from:

http://www.be-at.tv/brands/space-ibiza/music-is-revolution-closing-party-2016-discoteca

It's a 9h liveset from Carl Cox closing the Music Is Revolution in Space Ibiza.

Is there someone who can assist me?

Hello mate. I am after the exact same thing, did you manage to get this in the end? And if so how if you don't mind?

[duonganvien25]

Chuyá»?n nh?* th?*nh h?°ng (http://dichvuchuyennhatrongoi.org.vn/chuyen-nha-thanh-hung/Chuyen-nha-Thanh-Hung-Taxi-tai-Thanh-Hung.html) Chuyá»?n nh?* trá»?n g??i (http://dichvuchuyennhatrongoi.org.vn/) Chuyá»?n nh?* th?*nh h?°ng (http://chuyennhathanhhunghanoi.com/)Danh h?*i Ho?*i Linh Ä‘?°á»?c biá??t Ä‘á??n l?* má»™t nghệ sÄ© giá??n dị, c?? t??m v?* y??u nghá»?. Anh Ä‘?°á»?c kh??n giá?? cá?? n?°á»›c y??u má??n má»™t phá?§n c?©ng v?¬ Ä‘iá»?u Ä‘??. Ch?*nh gia cá?? Ä‘?´ng anh em, cuá»™c sống tuổi th?? thiá??u thốn vá??t vá?? Ä‘?? tá??o n??n má»™t Ho?*i Linh c?? nh??n c??ch Ä‘á??p nh?° ng?*y h?´m nay.

Ä?á»? c?? nhá»?ng vai diá»…n ch??n chá??t v?* Ä‘á?*m m?*u sá??c cuá»™c sống, chá??c chá??n Ho?*i Linh Ä‘?? từng trá??i qua cuá»™c sống khốn kh??. Danh h?*i n?*y quá?? thá?*t Ä‘?? c?? má»™t cuá»™c sống "thiá??u tr?°á»›c há»?t sau" nh?° thá??. Ng?*y 15/8, qua bức á??nh Ä‘á»™c v?* hiá??m của ca sÄ© D?°??ng Triệu V?©, ng?°á»?i h??m má»™ má»›i c?? thá»? t?°á»?ng t?°á»?ng Ä‘?°á»?c cuá»™c sống tr?°á»›c khi nổi tiá??ng của anh ra sao?

Ho?*i Linh, D?°??ng Triệu V?©
Cuá»™c sống Ä‘?´ng con vá??t vá?? v?* nhiá»?u ??p lá»±c nh?°ng má?? danh h?*i Ho?*i Linh lu?´n lá??c quan v?*o cuá»™c sống.
Ho?*i Linh, D?°??ng Triệu V?©
D?? Ä‘i diá»…n há??i ngoá??i xa x?´i nh?°ng cá?? D?°??ng Triệu V?© lá?«n Ho?*i Linh Ä‘á»?u th?°á»?ng xuy??n vá»? thÄ?m bố má??.
Khi Ä‘Ä?ng bức h?¬nh ng?°á»?i má?? vui c?°á»?i b??n Ä‘?*n lá»?n, D?°??ng Triệu V?© Ä‘?? viá??t: "My mom! Tá??m h?¬nh chá»?p tá??i Dá?§u Gi??y, l??c n?*y gia Ä‘?¬nh c??n thiá??u há»?t đủ kiá»?u nh?°ng vá?«n há??nh ph??c v?¬ c?? bố má??. Nh?¬n Ä‘??ng y??u qu??".

D?? Ä‘i diá»…n há??i ngoá??i xa x?´i nh?°ng cá?? D?°??ng Triệu V?© lá?«n Ho?*i Linh Ä‘á»?u th?°á»?ng xuy??n vá»? thÄ?m bố má??.Ä??°á»?c biá??t, bố má?? Ho?*i Linh – D?°??ng Triệu V?© c?? c??ng qu?? Quá??ng Nam. V?¬ kinh tá?? kh?? khÄ?n, n??n cá?? gia Ä‘?¬nh phá??i chuyá»?n Ä‘i n??i kh??c định c?°. Ng?°á»?i má?? â€?quyá»?n lá»±câ€? của hai anh em Ä‘?? phá??i l?*m đủ má»?i việc từ há»™ sinh, y t??,… Ä‘á»? c??ng chồng nu?´i dá??y con c??i n??n ng?°á»?i. Hiện tá??i, cứ tá»›i th??ng 12 h?*ng nÄ?m, Ho?*i Linh v?* D?°??ng Triệu V?© lá??i Ä‘??n bố má?? vá»? Việt Nam Ä‘á»? thÄ?m qu?? h?°??ng v?* b?* con á»? qu?? nh?*.

V?¬ ho?*n cá??nh kh?? khÄ?n nh?* lá??i Ä‘?´ng con n??n c?©ng nh?° bao ng?°á»?i phá»? ná»? kh??c, má?? của danh h?*i phá??i chá??y Ä‘?´n chá??y Ä‘??o đủ má»?i việc, tá??o tá?§n c??ng chồng nu?´i con. Tuy cuá»™c sống v?´ c??ng kh?? khÄ?n nh?°ng b?* vá?«n duy tr?¬ Ä‘?°á»?c tinh thá?§n lá??c quan c??ng "m??u vÄ?n nghệ" n??n Ä‘á»?i sống b?* v?´ c??ng vui vá?» b?¬nh y??n.
Ho?*i Linh, D?°??ng Triệu V?©
Cuá»™c sống kh?? giá??, Ä‘á?§y đủ nh?°ng chỉ khi n?*o Ä‘i sá»± kiện c??ng con trai th?¬ b?* má»›i diện đồ Ä‘á??p. B?¬nh th?°á»?ng l??c á»? nh?*, má?? Ho?*i Linh th?*ch Ä?n má?·c giá??n dị cho thoá??i m??i.
Hiện nay, d?? Ä‘?? Ä‘i qua nhá»?ng kh?? khÄ?n của cuá»™c sống, con c??i kh?´n lá»›n tr?°á»?ng th?*nh nh?°ng b?* vá?«n giá»? lối sống giá??n dị Ä‘iá»?m Ä‘á??m chỉ khi n?*o phá??i Ä‘i sá»± kiện c??ng con c??i b?* má»›i Ä?n má?·c Ä‘á??p c??n á»? nh?* b?* vá?«n muốn b?¬nh dị nh?° x?°a. Hiện nay, má?? Ho?*i Linh Ä‘?? gá?§n 80 tuổi, tuy Ä‘?? luống tuổi nh?°ng má?? danh h?*i vá?«n c??n khá»?e má??nh v?* trá?» so vá»›i tuổi. B?* quyá??t Ä‘á»? b?* Ä‘?°á»?c nh?° vá?*y, Ä‘?? ch?*nh l?* b?* lu?´n Ä‘á»? t??m hồn vui vá?» v?* suy nghÄ© lá??c quan

[Kris1982]

Hello mate. I am after the exact same thing, did you manage to get this in the end? And if so how if you don't mind?

See PM

[toif]

I'm also trying to find how to get audio from be-at.tv and couldn't be able to manage so far.. Tried many things but no result. Anyone can help?

thanks

[london2016]

c:\BeatConvert>FFMpeg.exe -y -i Final_fixed.flv -c copy Final.mkv
.
.
.
Final_fixed.flv: No such file or directory


I'm stuck. :mad: Can anyone help?

[bostjan]

I'm also trying to find how to get audio from be-at.tv and couldn't be able to manage so far.. Tried many things but no result. Anyone can help?

thanks

Hi,

try this new site: http://getmusic.online/

BR
Bostjan

[bostjan]

Hello guys

I read all the 10 pages but I'm still confused about how this works.

I want just the audio (.mp3) from:

http://www.be-at.tv/brands/space-ibiza/music-is-revolution-closing-party-2016-discoteca

It's a 9h liveset from Carl Cox closing the Music Is Revolution in Space Ibiza.

Is there someone who can assist me?

I think you are using an invalid URL.
Click on the session icon, and you should be redirected to this URL:
https://be-at.tv/brands/space-ibiza/music-is-revolution-closing-party-2016-discoteca/carl-cox

So I believe, this livestreamer command shell work:
livestreamer -o cox.flv "https://be-at.tv/brands/space-ibiza/music-is-revolution-closing-party-2016-discoteca/carl-cox" audio_stereo

Or just go to the http://getmusic.online :)


cheers
B.