Audio/video stream recording forums (http://stream-recorder.com/forum/index.php)
-   rtmpdump (http://stream-recorder.com/forum/forumdisplay.php?f=54)
-   -  

Adobe HDS Downloader

(http://stream-recorder.com/forum/showthread.php?t=14823)

palm1234 05-10-2013 03:05 AM

Re: Adobe HDS Downloader


 
By the way I forked AdobeHDS.php and created a python version (with the major features) on
https://github.com/k3c/Scripts

This AdobeHDS.py is basically for retrieving the m6replay.fr files, but can be easily adapted.

Velcro 05-11-2013 10:42 AM

Re: Adobe HDS Downloader


 
Quote:

Originally Posted by KSV (Post 61646)
Apple HLS is totally different than Adobe HDS. ask it on ffmpeg or some other relevant forum.

Sure, I do know that :)

Actually I thought that there would have been similarities between both implementations of this kind of DRM.

adammw 06-14-2013 02:08 AM

Re: Adobe HDS Downloader


 
KSV, I'm new to HDS but you seem to be the go to guy about it. ABC iView recently switched to using an akamai-based HDS for unmetered streaming, I was wondering if you had worked out the algorithm for generating pvtoken?

Vadmium 06-15-2013 04:04 AM

Re: Adobe HDS Downloader


 
I was also looking into the AkamaiHDUnmetered stuff. There’s a very englightening post by KSV about the “pvtoken” algorithm in this thread about a Pluzz French service:

http://stream-recorder.com/forum/rec...html#post43761

PluzzDL.py implementation: http://code.google.com/p/tvdownloade...src/PluzzDL.py

Unfortunately I now understand the PV stands for “player verification”. KSV says it requires both a hash of the player SWF and another key hidden inside the player. It looks like someone would have to get very intimate with the ABC’s flash player to find out the key.

CristianoA 06-15-2013 08:12 AM

Re: Adobe HDS Downloader


 
sorry for interrupting

i think newest version of GetFLV can download akamai drm streams (abc ivew etc) just use Ipad mode for downloading

KSV 06-15-2013 09:30 AM

Re: Adobe HDS Downloader


 
Quote:

Originally Posted by adammw (Post 62522)
KSV, I'm new to HDS but you seem to be the go to guy about it. ABC iView recently switched to using an akamai-based HDS for unmetered streaming, I was wondering if you had worked out the algorithm for generating pvtoken?

yeah, see this thread for explanation of same. you can also use my firefox add-on to retrieve such videos if they are not encrypted.

Quote:

Originally Posted by CristianoA (Post 62538)
i think newest version of GetFLV can download akamai drm streams (abc ivew etc) just use Ipad mode for downloading

Nope, downloading the alternate HLS (.m3u8 / not HDS) stream by using the User-Agent of mobile device isn't anything new. it's a well known method around here. but not all providers provide alternative unprotected streams. it has nothing to do with Akamai DRM or FlashAccess DRM.

GtbpyQgB 07-13-2013 05:47 PM

Re: Adobe HDS Downloader


 
It seems that "HDS Link Detector 0.5" is no longer compatible with firefox 22.0 !!!!

WHOOKIDSON 07-15-2013 09:54 AM

Re: Adobe HDS Downloader


 
and thats the reason I downgraded my Firefox RIGHT AFTER I upgraded it !!

s/n: a lot of times when i'm downloading with through AdobeHDS/cmd prompt it gets "stuck" on the last frag download..

for instance..if its "875" frags to be downloaded..it will get to 875 and just "hang"..any way around that?

GtbpyQgB 07-15-2013 11:27 AM

Re: Adobe HDS Downloader


 
It was just a notice from my side "WHOOKIDSON".
You can always use sniffers like "URL snooper" and many others mentioned on this site to find the samme correct link as with the Firefox addins!, but I think your problems is more with your Internet network provider or there could be som virus or other things on your computer, causing it to hang. You can also try to delete your cache(clean your computer) with CCleaner before your try a few times more.
http://www.piriform.com/ccleaner/download

WHOOKIDSON 07-15-2013 06:17 PM

Re: Adobe HDS Downloader


 
thanks for the reply :)

I cleaned the cache/history etc etc and I'm 100% sure there are no viruses or any other malicious programs on my pc..I've even tried it using a RDP and it still hangs but this time it "hangs" @ frag# 801..dunno whats causing the problem..but it seems its more on the site side from which I'm downloading from..I will try more things..thanks dude..

KSV 07-15-2013 11:29 PM

Re: Adobe HDS Downloader


 
i have repackaged the add-on (no code changes) with new SDK to make it compatible with Firefox 22 and above. it will be available on Mozilla website and through auto update after it's fully reviewed by Mozilla which may take a day or two. till then you can use this link to download new version (0.6).

WHOOKIDSON 07-16-2013 12:22 AM

Re: Adobe HDS Downloader


 
Quote:

Originally Posted by KSV (Post 62842)
i have repackaged the add-on (no code changes) with new SDK to make it compatible with Firefox 22 and above. it will be available on Mozilla website and through auto update after it's full reviewed by Mozilla which may take a day or two. till then you can use this link to download new version (0.6).

Super thanks for the update, bro! Even tho I downgraded my FF..I have good reason to upgrade now! :D

do you know why or can address why sometimes frags freeze on the VERY last frag when its downloading? like it gets "stuck" or just "hangs" in cmd...thanks man

KSV 07-16-2013 11:39 AM

Re: Adobe HDS Downloader


 
Quote:

Originally Posted by WHOOKIDSON (Post 62843)
do you know why or can address why sometimes frags freeze on the VERY last frag when its downloading? like it gets "stuck" or just "hangs" in cmd...thanks man

What do you mean by stuck? does it never complete or it just takes some time to complete?

This script downloads several fragments in parallel (default 8, use --parallel switch to change it to any number) so when it displays the last fragment number it is actually downloading last 8 (or other specified number) fragments in parallel so it may seem stuck for a little while.

GtbpyQgB 07-17-2013 07:19 AM

Re: Adobe HDS Downloader


 
KSV@

Thanks for "HDS Link Detector 0.6" update :D. Much appreciated.

chap 08-04-2013 03:38 PM

Re: Adobe HDS Downloader


 
KSV
Adobe HDS Downloader
does not work on the site http://v.kiwi.kz/v2/skshwta45su7/
they came up with a clever trick?:confused:
Thanks

theclansmen 08-04-2013 06:25 PM

Re: Adobe HDS Downloader


 
please i need help
i try to download this vid : http://www.ndr.de/unterhaltung/event...acken2843.html

i used the KSV tutorial and firefox add-on, everything went fine
but when i press enter i got a big list of stuff like this :
<span class="p">;</span></div><div class='line' id='LC1940'> etc etc

and then this message : "something went wrong with that request. please try again"

i don't know what to do, please help me

chap 08-04-2013 11:11 PM

Re: Adobe HDS Downloader


 
Quote:

Originally Posted by theclansmen (Post 63060)
please i need help
i try to download this vid : http://www.ndr.de/unterhaltung/event...acken2843.html

no problem
works fine
Code:

php AdobeHDS.php --manifest "http://hds.ndr.de/z/2013/
0804/TV-20130804-0233-2542.,hi,hq,.mp4.csmil/manifest.f4m?hdcore=2.8.2&g=OEDTFVR
OIKOL" --delete --auth "als=0,1,0,1,0,NaN,0,0,0,8,f,0,4604.35,f,s,OEDTFVROIKOL,2
.8.2,8&hdcore=2.8.2" --useragent "Mozilla/5.0 (Windows NT 5.1; rv:22.0) Gecko/20
100101 Firefox/22.0"

                            KSV Adobe HDS Downloader

Processing manifest info....
Quality Selection:
 Available: 1788 892
 Selected : 1788
Downloading 767/767 fragments
Found 767 fragments
Finished

try use latest Adobe HDS Downloader
Code:

php AdobeHDS.php --update

KSV 08-05-2013 07:19 AM

Re: Adobe HDS Downloader


 
Quote:

Originally Posted by theclansmen (Post 63060)
i used the KSV tutorial and firefox add-on, everything went fine
but when i press enter i got a big list of stuff like this :
<span class="p">;</span></div><div class='line' id='LC1940'> etc etc

and then this message : "something went wrong with that request. please try again"

You have saved the html of script page instead of actual script. use the raw link to save it again or download the zip file.

KSV 08-05-2013 07:34 AM

Re: Adobe HDS Downloader


 
Quote:

Originally Posted by chap (Post 63057)
Adobe HDS Downloader
does not work on the site http://v.kiwi.kz/v2/skshwta45su7/
they came up with a clever trick?:confused:

Yep they tried by obfuscating the mdat box but it's lame one and easy to bypass. following is the code to unobfuscate the fragment before processing. but the way the unobfuscation works, it makes the fragment processing extremely slow. each fragment requires about 10 seconds to unobfuscate. i wouldn't add this to my official repo because it's a site specific trick which they can change whenever they please.

Code:

          // Unobfuscate fragments used by kiwi.kz website
          $encByteIndex = 0;
          $encSum      = 0;
          $encData      = substr($frag, $fragPos, $fragLen);
          $encDataLen  = strlen($encData);
          $timeStart    = microtime(true);
          for ($i = 0; $i < $encDataLen; $i++)
            {
              $x                  = ord($encData[$i]);
              $frag[$fragPos + $i] = chr($x ^ $encSum ^ $encByteIndex++);
              $encSum              = $x;
            }
          $timeEnd = microtime(true);
          LogDebug(sprintf("Fragment %d decrypted in %.2f seconds.", $fragNum, $timeEnd - $timeStart), $debug);

Code:

http://pastebin.com/67TfREWZ
Also firefox add-on doesn't work here due to a minor (probably intentional) glitch (.f4m/). you have to use the manual method instead.

chap 08-05-2013 09:38 AM

Re: Adobe HDS Downloader


 
KSV
thanks and great respect for your work:cool:

jsparrow 08-06-2013 06:10 AM

Re: Adobe HDS Downloader


 
hey, can you please help to download videos from startv.in
because using script i cant download it.
it says "access denied"
please help
thanks in advance

ohmediafire 08-15-2013 07:55 PM

Adobe HDS Downloader For OSX


 
Hi KSV,

How can i running this script on Mac OSX?

Velcro 08-25-2013 02:46 AM

Re: Adobe HDS Downloader


 
Are there any useful information about AkamaiDRM here? http://code.google.com/p/mp-onlinevi...ryption_Akamai

bolaoito 10-20-2013 10:27 PM

Re: Adobe HDS Downloader


 
someone tried on Hulu or Hulu. jp (Japan) with subtitles ? :cool:

hallucinogen 11-14-2013 07:48 AM

Re: Adobe HDS Downloader


 
i don't have firefox because i only use a netbook which crashes all the time when i use firefox. do u have an extension for chrome that can detect those streams?

StreamRecorder 12-12-2013 12:54 AM

Re: Adobe HDS Downloader


 
Any chance to support dynamic HTTP streaming from Ustream? I have tried every Adobe HDS Downloader I have found to no avail. Is there any working solution for UStream.TV?

wanderingmon 12-15-2013 12:56 PM

Re: Adobe HDS Downloader


 
iam a complete new-bie infact a doctor with no knowledge on coding etc. , so go easy on me.

i installed php and like the wiki says also tested it with the 'php -v' in command prompt and i got it as said in the wiki.

i downloaded the script .its 77kb i believe , i saved the page after pressing raw

i do not know exactly what my next step should be.

is that to open command-prompt and give that code with the manifest?

i even installed the link-checker addon and when i paste that in command prompt.it says : could not open input file AdobeHDS.php

i just tried to type php AdobeHDS.php and enter to test , it just gave out there was no input file or some thing like that.

i was fascinated by this video on youtube :http://www.youtube.com/watch?v=WfkWxsY6BGQ

where he shows good easy to use customized thing.but when i download the link provided by him it does not have the files he showed in the video.

is there a customized easy to use thing ,i like the way it prompts for all that is required and in an easy to enter manner
please help me

RedPenguin 12-30-2013 08:10 PM

Re: Adobe HDS Downloader


 
I know this is a little old but just wanted to say this totally works with the X-Forwarded-To in case anybody has any question.

Now if only I could get XBMC to do the same, LoL.

Quote:

Originally Posted by KSV (Post 58492)
unfortunately that particular stream server doesn't updates it's bootstrap info in timely manner so stream is few seconds behind than actual live stream.



provide actual link to the stream with more details.



i have only tested it with Firefox 17 and above.



may be in some future update. for the time being you can just modify the script yourself.

Code:

      function headers()
        {
          $headers[] = 'Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8';
          $headers[] = 'Connection: Keep-Alive';
          $headers[] = 'X-Forwarded-For: 1.2.3.4';
          return $headers;
        }



adi10289 01-05-2014 06:21 AM

Re: Adobe HDS Downloader


 
Any luck with Akamai DRM KSV?

Bizzo 01-10-2014 01:44 PM

Re: Adobe HDS Downloader


 
How can I set up a default path to the AdobeHDS.php script for php.exe? I find it annoying always having to write like:
php.exe "C:\My Documents\Videos\PHP\Scripts-master\AdobeHDS.php"

chap 01-10-2014 03:27 PM

Re: Adobe HDS Downloader


 
Quote:

Originally Posted by Bizzo (Post 64247)
How can I set up a default path to the AdobeHDS.php script for php.exe? I find it annoying always having to write like:
php.exe "C:\My Documents\Videos\PHP\Scripts-master\AdobeHDS.php"

try use
Code:

https://github.com/K-S-V/Scripts/wiki#installing-php-for-dummies-windows-only

Bizzo 01-10-2014 05:07 PM

Re: Adobe HDS Downloader


 
Quote:

Originally Posted by chap (Post 64248)
try use
Code:

https://github.com/K-S-V/Scripts/wiki#installing-php-for-dummies-windows-only

The default path to the php.exe is easily defined in windows, but I was looking for an option to set the default path to the scripts folder, because Php.exe doesn't recognize it if I add the scripts folder to the windows user paths. I looked into the php.ini file for some possible feature, but I got lost there.

Bizzo 01-10-2014 05:41 PM

Re: Adobe HDS Downloader


 
When doing offline processing the AdobeHDS.php script only accepts fragments starting from the number 1.
What about having a couple of extra parameters like --startfragment# and --stopfragment#, -both optional when doing offline processing?

I tried to use the --duration parameter when doing offline processing, but that did not work. So is it only for online use???
Would it be possible to set a start time and stop time when doing offline processing? Or is that far beyond the range of such a script?

Bizzo 01-20-2014 03:54 PM

Re: Adobe HDS Downloader


 
OK, at least there is some --start parameter I see...

ycyaron 01-23-2014 01:10 PM

Re: Adobe HDS Downloader


 
antil a few days ago, i could download chapters from www.mako.co.il.
now when i try, it starts download and stops after a few seconds.
can you help me?
here is a link of a chapter for example: http://www.mako.co.il/mako-vod?partn...Id=95 7463908
the link detector seems to give now a different kind of link from what it gave antil a few days ago. maybe they changed something...

chap 01-23-2014 01:54 PM

Re: Adobe HDS Downloader


 
Quote:

Originally Posted by ycyaron (Post 64363)
antil a few days ago, i could download chapters from www.mako.co.il.
now when i try, it starts download and stops after a few seconds.
can you help me?
here is a link of a chapter for example: http://www.mako.co.il/mako-vod?partn...Id=95 7463908
the link detector seems to give now a different kind of link from what it gave antil a few days ago. maybe they changed something...

DRM:(

ycyaron 01-23-2014 02:23 PM

Re: Adobe HDS Downloader


 
CHAP, what is DRM?
is there no solution?

karlo2105 01-23-2014 04:15 PM

Re: Adobe HDS Downloader


 
DRM means encrypted files, you wan't watch it without decryption keys and so far AdobeHDS can't decode those files.

hasomaso 01-24-2014 08:25 AM

Re: Adobe HDS Downloader


 
hello KSV,

i have a manifest.f4m url and that i have tested with AdobeHDS.php and hdsdump.exe

but something is wrong here? both of scripte bring me error messages and will not be downloaded i dont know why?

I add a couple of pictures so you can see what is the cause



1. first tested with hdsdump.exe and bring me this message on the screen

and that is the hdsdump.exe parameter on "cmd"

Code:

hdsdump.exe --showtime --manifest "http://ccr.cim-jitp.top.comcast.net/cimomg04/OPUS/83/162/119271491507/1389989008837/119271491507_1389986611184_1850000_4.f4m?ckm_guid=ff746ed1-07b7-4f12-8566-152974f22bb9&amp;pid=FbRQ10WrsArR&amp;t=1390564970&amp;sig=2b9fe72a95f61ca26662e19ebea195d4c569d950" --outfile "12345.flv"





2. and that is the AdobeHDS.php

at AdobeHDS i get no error message but the download procedure does not work and stops by 8 fragments of 674

Code:

AdobeHDS.php --quality high --delete --manifest "http://ccr.cim-jitp.top.comcast.net/cimomg04/OPUS/83/162/119271491507/1389989008837/119271491507_1389986611184_1850000_4.f4m?ckm_guid=ff746ed1-07b7-4f12-8566-152974f22bb9&pid=FbRQ10WrsArR&t=1390564970&sig=2b9fe72a95f61ca26662e19ebea195d4c569d950"




I would be very happy if you could help






thanks
hasomaso

Totem 02-08-2014 04:00 AM

Re: Adobe HDS Downloader


 
Hello! I have problem to download from stream.1tv.ru/live

For example trying this stream.1tv.ru/live?startTime=1391843700

then i found .f4m i do this:
Code:

php AdobeHDS.php --manifest "http://cdn3.1internet.tv/hds-live11/livepkgr/_definst_/1tv-hd.f4m?e=1391855140" --parallel 2 --delete
and have this:


Whats going wrong?


All times are GMT -6. The time now is 02:34 PM.