Adobe HDS Downloader

[maniac8828]

Can anyone help me get the link for this video from HDS link detector?

http://colors.in.com/in/biggboss/vid...171-2.html#nav

For some strange reason HDS link detector is not popping up the link for the video...

[eclaires]

Are there any efforts to get around the restrictions of flashaccess and the annoying akamai drm?
Couldn't find any research on that problem so far.

[jsparrow]

Originally Posted by denobis

Hey could you please give me the adownloader link,
I am not able to find the link to download it.
thanks in advance

[eclaires]

Downloading 135/361 fragments
Fatal error: Allowed memory size of 536870912 bytes exhausted (tried to allocate
5163817 bytes) in C:\PHP_Leecher\AdobeHDS.php on line 1014

i have 8GB RAM and 120GB diskspace free, how can i avoid that exhaustion?

[joe5]

Greetings fellow video download enthusiasts. I have been using HDSdump.exe recently and have created a few batch files to automate things a bit. Just thought I would share these to see if they might be of any use to anyone and see if any actual programmers might be able to improve on them.

I am in Canada and have only tested them on a couple of sites such as cbc.ca and thecomedynetwork.ca, but they should work on any site that uses unencrypted .f4m manifest files.

CBC uses an unencrypted stream spliced into .f4v files referenced by an .f4m manifest file which is easily revealed by the HDS.Link.Detector Firefox Plugin.

However, with Thecomedynetwork site, The link detector doesn't work since it only captures the first .f4m link out of a possible 9. The first link does not contain the proper information, but the next 8 links will work fine with HDSdump and each link represents a resolution/quality setting. To find the links, I just use the firefox console (press f12) and enter .f4m in the filter box on the right.

Once I see the list of links, I further filter it down to one link according to the desired quality. For example, to get the best quality link, I would type "8.mp4.f4m". Each video is further spliced into multiple segments corresponding to the commercial breaks. To get the full list of .f4m url's, I just drag the video seek button onto each segment briefly until the .f4m link appears, then pause the video on the last segment.

Now you can "select all" and select "copy url" (right-click context). The url's need to each be on a separate line and sometimes windows or firefox copies them all to one line, so paste into a text editor to verify. You can also use URLsnooper to get the links as well.

In order to make things easy and universal, my batch file just takes the list of url's or single url directly from the clipboard and puts them into a temp file which is processed and deleted. I use a modified version of the HDS.Link.Detector that only captures the url to get the single .f4m file links on CBC.ca. Then the links are processed in the batch file using HDSdump.exe, but it should be trivial to modify it to use the Adobe.HDS.php script.

To make it all work, you need HDSdump.exe, ffmpeg, and a tiny exe file called paste.exe which is needed to paste the clipboard contents into a temp file.

https://github.com/WendyH/hdsdump/releases
http://www.c3scripts.com/tutorials/msdos/paste.html
http://ffmpeg.zeranoe.com/builds/

ffmpeg is used to stitch or join the flv segments from multi-segment sites like thecomedynetwork.ca and also remux the files to MP4. Remuxing is much quicker than re-encoding and the result should be playable on most devices that can handle mp4 h.264 video.

The batch file tries to capture a unique filename from the url using some "delimited FOR loops" but it may not be perfect for every site. You will likely have to edit the filename once the download is done.

So here is the batch file for handling the multi-part videos which also works for single part videos as well:

Download.HDS.Video.bat

@echo off

setlocal enableextensions enabledelayedexpansion

SET TEMPFILE=%DATE:~-4%%DATE:~4,2%%DATE:~7,2%_%TIME:~0,2%%TIME:~3,2%%TIME:~6,2%

paste > %TEMPFILE%.tmp

set /p firstline=<%TEMPFILE%.tmp

for /f "tokens=1 delims=? " %%a in ("!firstline!") do (set TITLE=%%a)

for /f "tokens=1 delims=, " %%a in ("!TITLE!") do (SET TITLE=%%~nxa)

for /f "tokens=1-4 delims=- " %%b in ("!TITLE!") do (SET MP4TITLE=%%b_%%c_%%d_%%e)

rem echo %MP4TITLE%

SET /A COUNT=0

for /f "tokens=*" %%a in (%TEMPFILE%.tmp) do (SET /A COUNT+=1

hdsdump -m "%%a" -o %MP4TITLE%!COUNT!.flv
echo file %MP4TITLE%!COUNT!.flv>>Filelist.%TEMPFILE%.tmp)

del %TEMPFILE%.tmp

echo "Download Complete. Files will now be joined"
Pause

ffmpeg -f concat -i Filelist.%TEMPFILE%.tmp -c copy -copyts %MP4TITLE%.mp4

del Filelist.%TEMPFILE%.tmp

echo "All finished. Temp FLV files will now be deleted"

pause

del %MP4TITLE%*.flv

timeout /T 3

I will also post an earlier version that works for a singlle url, and one that works for .M3U8 playlist files.

[joe5]

Here's a simpler batch file I created to download a single segment .f4m file and convert to MP4:

Get.F4M.Video.bat

@echo off

SET TEMPFILE=%DATE:~-4%%DATE:~4,2%%DATE:~7,2%_%TIME:~0,2%%TIME:~3,2%%TIME:~6,2%

paste > %TEMPFILE%.txt

set /p URL1=<%TEMPFILE%.txt

del %TEMPFILE%.txt

hdsdump -m "%URL1%" -o %TEMPFILE%.flv

Choice /M "Download complete. Do you want to convert to MP4"

If Errorlevel 2 Goto No

If Errorlevel 1 Goto Yes

Goto End

:No

Goto End

:Yes

ffmpeg -i %TEMPFILE%.flv -c copy -copyts Video%TEMPFILE%.mp4

echo "Deleting TEMP FLV file"

timeout /T 3

del %TEMPFILE%.flv

:End

[joe5]

This is for downloading .M3U8 playlist files. It only uses ffmpeg.

Get.M3U8.Video.bat

@echo off

SET TEMPFILE=%DATE:~-4%%DATE:~4,2%%DATE:~7,2%_%TIME:~0,2%%TIME:~3,2%%TIME:~6,2%

paste > %TEMPFILE%.txt

set /p URL1=<%TEMPFILE%.txt

del %TEMPFILE%.txt

ffmpeg -user-agent "Mozilla/5.0 (Windows NT 6.1)" -i %URL1% -c copy Video%TEMPFILE%.ts

Choice /M "Download complete. Do you want to convert to MP4"

If Errorlevel 2 Goto No

If Errorlevel 1 Goto Yes

Goto End

:No

Goto End

:Yes

ffmpeg -i %TEMPFILE%.ts -c copy -copyts Video%TEMPFILE%.mp4

echo "Deleting TEMP FLV file"

timeout /T 2

del %TEMPFILE%.ts

:End

[joe5]

Whoops. Already discovered a major bug with my script. The timestamp code at the top generates a name with a space if the time is single digits, which messes up the whole script.

So I replace with the following to make it more reliable:

set d=%date:~-4,4%%date:~-7,2%
set d=%d: =_%
set t=%time:~0,2%%time:~3,2%%time:~6,2%
set t=%t: =0%

SET TEMPFILE=%d%_%t%

I am not a programmer, so I'm sure there may be much better ways to do this, but this seems to work for now. I have also tested it on Discovery.ca and it is working well. The only issue I seem to run into is copying the links from Firefox seems inconsistent. Sometimes I have to select "copy" instead of "copy url" to get anything, but then I have to edit out the GET commands and trailing gobbledegook. UrlSnooper might be a better way to go.

[joe5]

Somewhat improved script. Does a better job of getting the MP4 filename correctly.

@echo off

setlocal enableextensions enabledelayedexpansion

set d=%date:~-4,4%%date:~-7,2%
set d=%d: =_%
set t=%time:~0,2%%time:~3,2%%time:~6,2%
set t=%t: =0%

SET TEMPFILE=%d%_%t%

paste>%TEMPFILE%.tmp

set /p firstline=<%TEMPFILE%.tmp

for /f "tokens=1 delims=?;&~ " %%a in ("!firstline!") do (set TITLE=%%a)

   :: To delete everything after the string '.mp4'  
   :: first get '.mp4' and everything before it
   SET _endbit=%TITLE:*.mp4=%
   :: Echo We dont want: [%_endbit%]

   ::Now remove this from the original string
   CALL SET _result=%%TITLE:%_endbit%=%%
   
:: echo %_result%

SET TITLE=%_result%

for /f "tokens=1 delims=" %%a in ("!TITLE!") do (SET TITLE=%%~nxa)

for /f "tokens=1-5 delims=-_" %%b in ("!TITLE!") do (SET MP4TITLE=%%b_%%c_%%d_%%e_%%f)

SET /A COUNT=0

for /f "tokens=*" %%a in (%TEMPFILE%.tmp) do (SET /A COUNT+=1

hdsdump -m "%%a" -o %MP4TITLE%.!COUNT!.flv
echo file %MP4TITLE%.!COUNT!.flv>>Filelist.%TEMPFILE%.tmp
)

del %TEMPFILE%.tmp

echo "%MP4TITLE%"

echo "Download Complete. Files will now be joined"

Pause

ffmpeg -f concat -i Filelist.%TEMPFILE%.tmp -c copy -copyts %MP4TITLE%.mp4

del Filelist.%TEMPFILE%.tmp

echo "All finished. Temp FLV files will now be deleted"

pause

del %MP4TITLE%*.flv

timeout /T 3

[hyperactive]

Hello there.
I'm having difficulty downloading a story from ABC Iview.
I managed to get the Url for the manifest using URL snooper, but when I try to use php and adobe HDS to download the file, I get access denied, unable to download fragments
Here is the URL where you can start the story playing
I hope someone can help.
http://iview.abc.net.au/programs/fou...044S00#playing
btw: those of you who live outside of Australia will need to use an aussie proxy so you are not blocked from playing the story
when I get the URL to the manifest, it's different every time.
could this have anything to do with the fragments being unavailable, or is it another encrypted DRM scheme?