be-at.tv changed their internal urls - how to download?

[sebastian]

Guys, we're so close! Just need to know how I can find out if and how much bytes I'd have to strip! :-)

[KSV]

@blimey
i didn't noticed your corrected debug log you posted in your previous post. you should have mentioned it in new post. anyway i have analyzed your new log and it's obvious why total time of joined file is increased. it's due to wrong interleaving of audio video packets at the point of separation.

End of first flv:

 VIDEO   11976           11936           5228    1966536         
 AUDIO   11981           11958           360     1971779         
 VIDEO   12016           11976           3091    1972154         
 VIDEO   12056           12016           5407    1975260         
 VIDEO   12096           12056           3229    1980682         
 VIDEO   12136           12096           6156    1983926         
 VIDEO   12176           12136           3393    1990097         
 VIDEO   12216           12176           6204    1993505         
 VIDEO   12256           12216           3546    1999724         
 VIDEO   12296           12256           4681    2003285         
 VIDEO   12336           12296           6716    2007981         
 VIDEO   12376           12336           3715    2014712 

Start of second flv:

 AUDIO   12004           -1              4       13              
 AUDIO   12004           12004           389     32              
 AUDIO   12027           12004           395     436             
 AUDIO   12051           12027           346     846             
 AUDIO   12074           12051           395     1207            
 AUDIO   12097           12074           376     1617            
 AUDIO   12120           12097           396     2008            
 AUDIO   12144           12120           383     2419            
 AUDIO   12167           12144           376     2817            
 AUDIO   12190           12167           372     3208            
 AUDIO   12213           12190           356     3595            
 AUDIO   12236           12213           388     3966            
 AUDIO   12260           12236           374     4369            
 AUDIO   12283           12260           389     4758            
 AUDIO   12306           12283           354     5162            
 AUDIO   12329           12306           380     5531            
 AUDIO   12353           12329           353     5926            
 AUDIO   12376           12353           357     6294            
 AUDIO   12399           12376           383     6666            
 VIDEO   12416           -1              44      7064            
 VIDEO   12416           12416           64234   7123            
 AUDIO   12422           12399           383     71372

due to non monotonically increasing timestamps ffmpeg's concat filter rebases second file's timestamp starting from 12376. this results in increased total length of file.

Solution:
i have modified my BeatConvert script to generate single flv file instead of one file per fragment so we don't have to use concat filter at all avoiding this whole mess. use the updated script with following batch file and report. it should create flv file with proper sync and length.

BeatConvert.bat:

if exist "Final.flv" del "Final.flv"
for %%a in (*.beat) do php BeatConvert.php %%a
php FlvFixer.php --in Final.flv --out Final_fixed.flv --nometa
FFMpeg.exe -y -i Final_fixed.flv -c copy Final.mkv

[hasomaso]

thanks KSV

i would be glad if you option your PM again switch on

[blimey]

That's great KSV, thanks! That point in the log did stand out to me, but I wasn't sure what it meant.

Anyway, thanks for the updated script. This project is finally finished, for now at least.

[blimey]

I tested the updated script on two AVC sessions, and all is correct.

Final.flv
Final_fixed.flv
Final.mkv

each have the correct duration and are in sync. I will test it on a vp6 session later, but it looks like all is good with the updated script!

[sebastian]

I will test it this weekend, but I think this will be the final solution.

KSV: I can't thank you enough for coding this. I have been waiting so long for a solution for my favourite video site.

blimey: Also thanks for your expertise and energy in this.

You both are my heroes! I will give you an info when I tested this. :-)

[chap]

KSV,blimey
respect

[sebastian]

I tested a few sessions, and all are in sync! Again: Thank you so much!! :-)

[tribalmixes]

i must also say: thank you very much, all of you, guys, for this. it's a very big help for me and my friends, we like to record and share be-at.tv, and had to do it while streaming it lately.. i really appreciate this, cause it's already saving me tons of time.. =)

i am really after the audio though, video - yes, some of the sessions, maybe every 5th, no matter, and audio was kinda left out of your discussion...

i do want to ask something though... i feel kinda stoopid and cannot figure it out, where do we find all 3 of the IDs - the Recording ID (all djs/mixes as one club night), Session ID (one dj/mix), and Stream ID (actual 128/192/1000/2500/etc).. there's also 4th ID, its irrelevant now, i think..

as was discussed, there are currently 2 ways they serve their streams (and i am using 2 most recent sessions):

1. as in here ..be-at.tv/brands/klokgebouw/awakenings-eindhoven-2014-area-y/makcim-b2b-el-p this one yields pieces like this cdn.be-at.tv/003789/004433-0128/005808-1000/0003.beat that satisfy the original example where it allows one to download the audio stream with dtmpdump, and i do that, substitute my own session id and stream id, and i get 128kbps version (in this case) of the audio stream.

2. as in here ..be-at.tv/brands/klokgebouw/awakenings-eindhoven-2014-area-x/ - this one produces different pieces, that are accessed like this ..cdn.be-at.tv/002288/192/1250/0097.beat - and in this case, whatever i do, the most i can find is the session ID - something like 3801 if i remember right, but i cannot find stream ID. i am trying all possible ways. i employed like 6 different url sniffers, nothing.. i did look into .program file they served, and it had the Session ID in there, but not the stream ID. and so i am rendered helpless facing this task: finding the 2 ids to download the stream smoothly.

i did though download all the video and audio in some other case, where i didn't want video, btw, ..cdn.be-at.tv/002288/192/0097.beat - produces just the audio, converted from flv to mp3 and was happy, still saved tons of time.

i just wanna know, how did you guys find those streams and their IDs up above in the posts?

thanks, will be eagerly checking back here... =)

[sebastian]

@tribalmixes: Sorry, but sharing their content is a violation of copyright. This community is only for our personal purposes.

Be-At.tv is streaming so much great content, and they are deserving every click!!