Adobe HDS Downloader

Re: Adobe HDS Downloader

 

Hi, I tried Adobe HDS Downloader on an embedded video. I caught the manifest thanks to the Link Detector but when I launch the script, it says:
Here's the script I first used:
I tried with -manifest "http://www.wat.tv/images/v70/PlayerLite.swf" (with and without the VideoId from the original link) but still can't download.

The original link of the video is no longer available since the website is now closed. You can check it here: http://www.wat.tv/video/jt-21-decemb...df_2eyuf_.html

The embedded link which still works actually:
http://www.wat.tv/images/v70/PlayerL...?videoId=6qpdf

Can you help me please?

Re: Adobe HDS Downloader

 

Dear KSV,
thank you a lot for writing and maintaining this behemoth of a script!

My use case is watching sports matches of my favorite volleyball team from a subscription-based service, which I do pay for, but whose Flash player sucks.

Basically it does zero buffering, so my connection remains idle for 90% of the time, while the current segment is playing; then at the last possible moment the SWF wakes up and tries to download the next segment, freezing the video because it cannot get it in time; then it plays the segment, goes down in resolution, connection idle again... rinse and repeat, over and over, making the match impossible to enjoy. Whoever wrote this piece of shit Kaltura player needs to be tarred and feathered and sent back to flipping burgers. Even Real Player had better buffering!

Anyways, as I was squeezing Google for information about this crazy segmented media format I had never seen before, I found your script mentioned in some other forum. I was able to apply it straightaway to my website, at least for the recorded matches (I have to wait for the next live match to see if it works live too)

I have never seen a media protocol as complicated as this. I've been browsing the source code of your script and I have to say I'm stunned at the complexity and ingenuity it displays.

Bravo! If there is any way for me to buy you a beer, PM me the details :-)

Re: Adobe HDS Downloader

 

I'm trying to download video from http://livestream.com/boisestate/eve...deos/114615595 but I'm failing. HDS Link Detector isn't building this for me as it has in past for videos on this site so I'm going old school via wireshark.

I've found the SMIL "http://api.new.livestream.com/accounts/14596003/events/4800203/videos/114615595.smil" but I'm unable to get AdobeHDS.php to parse it.

Re: Adobe HDS Downloader

 

Try this:

Re: Adobe HDS Downloader

 

Looks like they changed something on the site. When I open it now HDS link detector does grab that command below. However, some of the URLs from before still exist.

The XML containing the higher speed/resolution video is at http://nlds119.neulion.com:443/play?url=%2Fnldsu_vod%2Fjtvs%2Fvod%2F2016%2F03%2F0 4%2Fcdwrzlbidrdbuze.20160305042511%2Fcdwrzlbidrdbu ze.20160305042511_1_pc.mp4' which links specifically to the HD stream at 'http://nlds119.neulion.com:443/play?url=%2Fnldsu_vod%2Fjtvs%2Fvod%2F2016%2F03%2F0 4%2Fcdwrzlbidrdbuze.20160305042511%2Fcdwrzlbidrdbu ze.20160305042511_1_3000.mp4'

I'm hoping I can find a link to that HD stream. Doesn't seem like they change any keys.

Re: Adobe HDS Downloader

 

Hi, I am not able to use HDS Link Detector with Firefox on the following link...

http://www.sonyliv.com/details/episo...ress-from-Past

How do I get the manifest url? Pls help.

Re: Adobe HDS Downloader

 

Hello,
I need help!
I started a thread named "http://ici.radio-canada.ca/tele/"
I received only 1 answer which redirected me here and now I'm stuck with no more replies to my 2nd question:

When I paste the link from HDS link Detector, I get this message: "could not open input file: AdobeHDS.php"


p.s. I read all sticky post from Video stream recording, and it did not help me. I tried numerous free and registered programs without any success.

I'm not a programmer and I don't understand PHP. I need a self explanatory method for Dummies. I read and tried following the WIKI
https://github.com/K-S-V/Scripts/wiki

I had some trouble with the whole process of installing PHP, but I finally made it work : when I type php -v I get the right msg.

All I want is to be able to download videos from this site:
http://ici.radio-canada.ca/tele/toc-...e?isAutoPlay=1

Video Downloader Ultimate was able to download all video fragments to a folder. I read the method to stitch them together, but I can't figure how to make it work.
Please, I already spent 5 days from 10 am to 10 pm trying to make this work. I'm going insane and I need help.


EDIT: I finally made it work and I got the video! This youtube video helped :
https://www.youtube.com/watch?v=Ahq_Azppvj8
I would like to say what made it difficult is that the steps in wiki are incomplete. Here are steps you could add to it to help others like me:

After installing PHP, download AdobeHDS.php script here: https://raw.githubusercontent.com/K-...r/AdobeHDS.php
Save page as: AdobeHDS.php (remove .txt)
Place file in C:\PHP
Open Command Prompt and type: cd c:\php
To see if everything is working (you should see help menu appear) type: php adboeHDS.php --help
Go to your video in Firefox, copy link with HDS link detector
paste link in Command Prompt
It should start download!!

I'm so happy!!! :)

Re: Adobe HDS Downloader

 

I need some serious help here.
I'm a bit new to all of this, but I've been using two programs for a while now. PHP (V5.3) and FFMPEG/ISMDownloader.

But, my computer crashed, had to turn it back to the day I got it. Voila, everything was gone. Opened up my old laptops, 5 of them, found the old folders in one of them. Hallelujah.
I remembered this happened once before. So I did the same as now.
- Copy the v5.3 folder (php, from C where it was located),
- Paste in my extended harddrive and then just paste into C on my new laptop. And it worked, twice.
But now this time.

First I got a message saying the cURL extension needed to be downloaded.
Fooled around, fucked up and deleted everything and then changed it back, copied and pasted and 7 hours later; I now just get this message;


I've tried to copy and paste - didn't work, but it worked for FFMPEG
I've tried downloading different versions - didn't work
I've tried to use this one; https://www.microsoft.com/web/platfo...onwindows.aspx
Put it in just C. Then program files (x86) and copy and make a copy on to just "C", and tried "C:/PHP" as well. Deleted and did it all over again.

I followed this guide, twice; https://github.com/K-S-V/Scripts/wiki
The "installing for dummies" - didn't work.

Can't find a single "tutorial" on how to install it on windows 10.

What is going on?!

The only difference is; first laptop has Windows 7. The second laptop has Windows 7, upgraded to windows 10 - PHP worked fine on those.
This laptop had windows 8 - worked.
Then I upgraded it to windows 10 - worked.
Then my laptop died; I had to reset it to factory (back to win 8) and upgraded it to 10. Did the same copy and paste method but now PHP wont work! FFMPEG works, even tho I forgot to copy the ismn folder, why or how it works, I have no freaking clue.

Yes, I might use wrong names here. But I'm not smart, I'm actually a bit dumb. I killed my laptop, 4 times. Because I dropped them on the floor, kicked it and threw one out of the window, yes, anger issues.
PHP is Adobe php.

I only use it to download videos, or stream or record.
I use sniffer, find the manifest and done.
Or firefox - HDS link detector, done.
That's what I need it for, to download videos where I can capture the manifest.

This is the bat file I use;
php.exe adobehds.php --manifest "INSERT LINK HERE" --delete

pause

Sometimes I just copy the whole thing captured by HDS link detector.
No complicated stuff is being done. I don't use this program for anything else.
Help! why wont it work on my laptop? What I'm doing wrong in downloading it?

I tried it on my old laptop, and it worked fine. The V5.3 folder that I use is working fine, but on this laptop it wont work.

Re: Adobe HDS Downloader

 

hello sir..

one request sir.. when capturing with adobe hds tere are 4 types of fragments but adobe hds automatically choose the highest ones HD, how to select lower one's?

any idea..



how to choose between quality selection

i will be highly oblighed sir

Re: Adobe HDS Downloader

 

Read: https://github.com/K-S-V/Scripts/wiki

--quality low/medium/high

Re: Adobe HDS Downloader

 

Or he can choose the exact bitrate. According to his screen cap, the choices appear to be: 4057, 2105, 1298, 765, 460 or 257.

Re: Adobe HDS Downloader

 

thanks alot for the help guys.. one more thing.. does adobe hds works on windows 2012R2 ? i shifted to this window today and i m not able to make it workout on adobe hds here.. plz help

Re: Adobe HDS Downloader

 

Hi guys,
is it possible to increase the "updating bootstrap info:...." attempts?

Seems to me that after the second one, HDS stop to record.

Re: Adobe HDS Downloader

 

I can't download the videos on this page, any suggestion?

I downloaded using the IDM, but wanted to understand how to solve this problem.

Re: Adobe HDS Downloader

 

HDS Link Detector add-on for Firefox does not work on Palemoon 64 26.2.2, anyway to fix it? Even if I force install, it never shows in add-on bar

edit
Had to use Portable Firefox, worked a treat

Enable the curl extension in the php.ini file (by removing the preceding semi-colon which commented that line out)
I discovered that PHP was looking for php_curl.dll in the root of PHP, so I had to move it there from the 'ext' directory.

Re: Adobe HDS Downloader

 

Each flv downloaded with AHDS Downloader while processed with ffmpeg to mpg gives the following errors (but in the end converts OK)

Anybody has any idea why?

Same error is mentioned ie here

And still applies to latest available FFmpeg git-9591ca7 64-bit Static (2016-05-25)

sebus

Re: Adobe HDS Downloader

 

Hi,

I'm using Adobe HDS script to get live stream from ISP to VLC but sometimes I get something strange like loops or repeated stuff on the player...

One thing that I did was to limit parallel connections to 1 only, this reduced the problem a lot but is not mitigated yet.

As I understand the server dont like to much connections to it like dont respect an interval and for instance when the bootstrapp needs to update and something is donwloading I get a loop or freeze.

I can't provide the link I'm using here but I can do it on PM if someone can help.

Best Regards,
Nuno

Re: Adobe HDS Downloader

 

hey guys,

the script was working well, but now not getting any results, saying is unable to do FlashAccess DRM. Any ideas to help?

http://i.imgur.com/6KFgtyP.png

Re: Adobe HDS Downloader

 

Yes, same for me, fixed it by adding retries to the script, something like this, search for "$status = $cc->get($bootstrapUrl)", around line 1111? in my abused script

Also added Loginfo text plus beeps (only php-sound easily available is the Bell character for an old console, with delay inbetween)

That is, inserted 2 retries with beeps and delays, straight inline-code without any counter counting the retries.
$cc->get() is the one doing the download.
$status as 200 hex means OK, alll others different kind of problems.

First and last lines unchanged, add, insert the rest.
php.exe complains at reading the script if obvious splelling,etc errors.

$bootstrapPos = 0;
LogInfo("\n STARTSTART Updating bootstrap info, Available fragments: " . $this->fragCount);
$status = $cc->get($bootstrapUrl);
LogInfo("GOT Status: " . $status );
if ($status != 200) {
LogInfo("\n 1111Failed to refresh bootstrap info, Status: " . $status . $bootstrapUrl);
echo chr(7); usleep(10000);
echo chr(7);

$status = $cc->get($bootstrapUrl);
if ($status != 200) {
LogInfo("\n 22222Failed to refresh bootstrap info, Status: " . $status . $bootstrapUrl, true);
$status = $cc->get($bootstrapUrl);
echo chr(7); usleep(10000);
echo chr(7); usleep(10000);
echo chr(7); usleep(10000);

}
}
$bootstrapInfo = $cc->response;
ReadBoxHeader($bootstrapInfo, $bootstrapPos, $boxType, $boxSize);


Gunnar

PS Watch out with the LogError code, changed most of them as they print the error and exits, no retries.
Change them to Loginfo

PPS This helped a lot on capturing live streams, especially when also running torrents or "Cptr doing too much"
Now runs for days without this error-exit, When problems getting fragments just a matter of 6-12s of stream missing

PPPS I have also added beep-info-alerts to missed fragments, TimeStamps getting fixed or negative.
Next will be "warning-beep" when script has launched close to the default 8 simultaneus, parallel "get-fragments", a sign the connection is too slow (Need to slow down other downloads or similar).
2-3 parallel downloads means evrthng is OK for my live streams, some live streams seem to buffer only 7-8 fragments, others more.
(for archived streams I use two parallels going, enough to get full speed with no pauses inbetween)

Re: Adobe HDS Downloader

 

From my Finland YLE (BBC) experience the script and detector (together) can do some encrypted streams.

That is, when it "works" there is a lot of --author, etc and cookie, etc arguments added (by HDS detector plugin frm web page) needed for the script to get the (one) encryption syst recently added.
(for garbage US action series so have not bothered checking in detail)

The (humongous) link also needs to be used within some 30-60seconds or "cant access Key"

Gunnar

PS That is, your command line didnt include any of the "humongous stuff"

Re: Adobe HDS Downloader

 

I have added Loginfo() info-text "here and there" to figure out simialr problems.
Most important to see how the script starts new fragment-downloads and when they are "done and used" (and then update bootstrap to get the new ones)
eight parallell downloads seem to run into the problem that the new next ones are not checked for until all old 8 have "arrived safely".
Some servers dont even keep 8 fragments buffered?

But getting the fragments "one-by-one" with check for new ones inbetween for every fragment wastes a lot of bandwith.

Missed fragments trigger "TImeSTamp fix" when decoding the fragments (or earlier), same for "negative timestamps"

Picking two added info-beeps as example, because I have butchered the script too much to post proper patches
As an example, LogDebug to LogInfo and ring the bell when happens (might be only every fifth hour)

if ($timeShift > $this->fixWindow)
{
echo chr(7); // ring bell
LogInfo("Timestamp gap detected: PacketTS=" . $packetTS . " LastTS=" . $lastTS . " Timeshift=" . $timeShift, $debug);
usleep(100000);
echo chr(7); // and anoher bell
if ($this->baseTS < $packetTS)
$this->baseTS += $timeShift - FRAMEFIX_STEP;
else
$this->baseTS = $timeShift - FRAMEFIX_STEP;
$packetTS = $fixedTS;
}

//--- missed fragment, decoder will have missed 2-6-12 seconds
// note, the audio stream is the "master" for timing

else
{
$this->lastFrag += 1; // bitch and scream
LogInfo("*************** Skipping failed fragment **********" . $this->lastFrag);
echo chr(7); usleep(10000);
LogInfo("*************** XXXXXXXXXXXXXXXXXXXXXXXX **********" . $this->lastFrag);
echo chr(7); usleep(10000);

Gunnar

PS should be some simple argument for debugging, giving info on just

- manifest, bootstrap missed
- how many parallell fragments it tries to download
- BITCH and SCREAM when missing fragments, timestamps,etc

hmm, a test for how many fragments the server actually keeps buffered (something Im halfdone with, but no need to attack it again)

If server only keeps 4-6, using 8 parallell downloads kills the whole thing because script doesnt check for new ones in time,.

Re: Adobe HDS Downloader

 

Thanks Gunnar, I was using detector and after the change sit did not find the "humongous link" anymore. Should I attempt manually based on what I see listed under developer->network view?

Re: Adobe HDS Downloader

 

Thanks! It's not possible to dont allow VLC to play the repeated fragment?

Re: Adobe HDS Downloader

 

Does anyone know if it's possible to decrypt Adobe HDS with provided key file and how?

Re: Adobe HDS Downloader

 

hi I need a way to compress a 1080p mp4 video file to store. but at same I need a way to decompress it to get orignal video quality and size (Just like a paper we fold a paper to take smaller size.and unfold it to make it original in size) same I need to do with a video hope you understand plzz reply

Re: Adobe HDS Downloader

 

This is impossible. If you want to compress a video, you will lose quality and can not "decompress" back to original quality.

Re: Adobe HDS Downloader

 

ok...can I reduce video resolution without loosing quality (eg: 1080p to 360)

Re: Adobe HDS Downloader

 

No, of course not. Think about it. If that was possible, why would there ever be a need for higher resolutions in the first place?

Re: Adobe HDS Downloader

 

Hello!

Is it possible with HDS format to get the final movie file size when starting the download.

AFAIU, it should be in the moov box in the bootstrap. I have checked several videos on moonwalk.cc and apollocdn.cc like sites and there's no moov box in their bootstraps. Only abst, asrt and afrt boxes.

here's sample bootstrap and metadata tags from the manifest
http://pastebin.com/0f9zVL25

May be they remove it for some reason? Or am I missing something? Or may be the file size could be read by some other means

It may be useful to add the AdobeHDS.php script ability to stream the video being downloaded to the DLNA renderer device, however it is not possible without knowing the final file size - cause it should be specified in Content-Length header of HTTP response serving the file for DLNA. Of course we could wait till the download is finished before starting DLNA - but it is not a solution, just a compromise.

Re: Adobe HDS Downloader

 

@Liphtier

You won't find 'moov' box in client side fragments. it's not possible to accurately know the filesize before all fragments are downloaded and decoded. some websites do inject the same in metadata stored in bootstrap file but it's not necessary that the final filesize generated after decoding will match that. why don't you just try sending an arbitrary large size like some major CDN's do. for example Akamai HD streaming (over plain http) sends 2 GB as content-length header although the actual video data is normally larger or smaller than that.

Re: Adobe HDS Downloader

 

Solved with:

"-loglevel 16" is used to suppress warnings about wrong timestamps

Re: Adobe HDS Downloader

 

@KSV, Thank you for explanation.

Now, at least, I know it's not there and will continue to try to work it around.

Setting fake content length header may require special handling for Range requests. Not sure if it's possible at all

Re: Adobe HDS Downloader

 

Would like a feature request. Some sites have started having separate audio & video streams. Can you please allow the specification of more than one "quality" number.

2nd part is the ability to auto-join these but that's completely optional.

Re: Adobe HDS Downloader

 

I am trying to download this file (US IP address required)
http://now.telemundo.com/se%C3%B1ora...o/736864835850

but during download I get a ton of errors, but at the end the video muxes into a large FLV file, individual chunks are deleted, but the end video file is unplayable, ffmpeg detects a lot of codec errors when analyzing that file, and gives me a huge number of streams (over 100) within that file (e.g. Stream#1, Stream#2, etc. which is illogical).

During download, I get error for every fragment downloaded:

when analyzing the file with ffprobe, I get a a looong 2-minute error pullout, before the streams list. Errors are like this:

all in all, it's like almost 2 minutes of errors before ffprobe comes to an end.

Any help would be appreciated.

Re: Adobe HDS Downloader

 

@rubiohiguey

it seems you are using very old version of php. AdobeHDS.php script requires atleast 5.4 version.

Re: Adobe HDS Downloader

 

Thank you, I got this working fine on a different machine with newer PHP version. It works wonders. Great job, thank you again for this wonderful ability to work with encrypted streams.

Re: Adobe HDS Downloader

 

Hi KSV, any way to get AdobePHP working with Ooyala?
Uses the same FlashAccess. It also runs through Akamai network.

E.g. http://canalnuestratele.com/video/al...itulo-132-9441

Re: Adobe HDS Downloader

 

the source i have, theres 3 different quality of video, how can i select the highest?

i was using a bat file which i select max but i dont know how to use it here

Re: Adobe HDS Downloader

 

deleted post: no longer relevant

Re: Adobe HDS Downloader