PDA

View Full Version : Capture from watch.diynetworks.com


ehurdler
10-13-2017, 11:37 AM
Trying to capture from watch.diynetworks website a full video without commercials/ads. Is this possible? I can get a video, but has ads.
If anyone knows how to do this, please let me know. What I have tried in detail so far:

Example episode does not need provider login:
http://watch.diynetwork.com/show/DFTF/First-Time-Flippers/3539816/Flue-Season/

Once the video loads, I have HLS link detector running and 3 master.m3u8 files are present.

First one, if you use it with livestreamer gives the full episode with commercials.
http://dcs-vod.apis.anvato.net/vod/p/session/master.m3u8?i=i177602562-n14b90f71-b76e-4523-a9cb-2acd3008f328
So not what I am looking for.

Second master.m3u8 file is long and does not work in live streamer.
http://dcs-vod.apis.anvato.net/vod/CN0VadLru0ZXI9J1XEfqrvh1TlleFCuruGBEhpK3jH1WHyYeQo GqUaU8XMFZDUGB1DiR1Q19qXxjXY-F48AibPkwmSJvJWllK8Qza2zlUgIH-fnxXjS8QJt5KnJKBTJE/q_zTSZfhTK8Icy5K6vLcAGYkfToyAo9G8imID6O8N2WNjW9u_E P2dBgsODaKy8z9lZ5fUNjs2ViCKr6PC5W1b4O0juMjhLx8oMji 4dyK68ooga2WCV_xZK1UsnWHQsiJ/F18ktC6md0GNa7Z8NiHXgR-6y9i-odJNNNkPazgLI0JfWsDNgsvT-gKlf0p8I9GYh9ioBbJOYXYUR2eE-UvFXd6Wbh23032B0JRZFs24Ggz_f2xjQ6Fq9n9u-sg05Ib4/MfELtRam26MOXEFVjlcFVlvtMLMBNXHRxDsddm4ZB-CufY6CxVAFNu4zJRKQGtra_qdJ76krYif3frzY_On5E_E521jT GYC_IvTdqMublHrQbgDqk6JcCZTIL5SUKkO7/master.m3u8?fields=full&anvauth=tb=0~te=XXXXXXXXX~sgn=******************** ***bunchofrandomnumbers**************&t=XXXXXXXX&_vpng=0

Gives "error: Failed to parse playlist: Missing #EXTM3U header" message.
If you load it in the browser however, gives the following:

session_id "i177602562-ncd0a5313-d246-49db-b8ea-9af0cee077a0"
master_m3u8 "http://dcs-vod.apis.anvato.net/vod/p/session/master.m3u8?i=i177602562-ncd0a5313-d246-49db-b8ea-9af0cee077a0"
interstitials {…}
breaks […]

The master.m3u8 shown above, if you load in livestreamer, gives a video which is basically just the commercial itself.
Same with the last master.m3u8 file hls link detector finds from the start of the video loading in browser.

http://dcs-vod.apis.anvato.net/vod/p/session/master.m3u8?i=i177602562-n6d11bc0f-cc22-45bd-bfb6-dc783bd473ea

Anybody have an ideas? HGTV and DIYNETWORKS seemed to have just changed their sites within the past 2 weeks.

Thank you!

Yelloworanges
10-13-2017, 02:29 PM
Use theplatform links instead of the anvato ones. They are still there but might be going away.

If you really want to use the anvato links, note that the first "m3u8" url called is not really in m3u8 format. Download it as a text file and find the real hls source (for the content) within.

ehurdler
10-13-2017, 04:32 PM
Use theplatform links instead of the anvato ones. They are still there but might be going away.

If you really want to use the anvato links, note that the first "m3u8" url called is not really in m3u8 format. Download it as a text file and find the real hls source (for the content) within.

From what I am seeing the "theplatform" links that used to be present a week or two ago are gone. I looked with AdBlock Plus, also with Tools->Web Developer->Web Console....Just not there anymore. Do you see them? If you do, how? What are you using?

As for the anvato links. I found that long m3u8 file I referenced in the original post I pasted it into the browser and looked at the raw data. Copied that and pasted into TextEdit and I couldnt find any hls or m3u8 links that work.

Were you able to get a full episode from my original post with no ads?

Yelloworanges
10-13-2017, 06:51 PM
From what I am seeing the "theplatform" links that used to be present a week or two ago are gone. ... Do you see them?

It should look something like this;
http://link.theplatform.com


As for the anvato links. I found that long m3u8 file I referenced in the original post I pasted it into the browser and looked at the raw data.

The steps for anvato is a lot of stuff to type. I'll organize all the steps later if I have the energy and you can't get theplatform working. The youtube-dl nerds should be working on anvato. If you wait for them to add it to youtube-dl, you'll save yourself the trouble.

Note that for a few days after broadcast while a new video is in "on demand" mode, it has the broadcast version including the original commercials. It is all one continuous video. Then some days later they make a clean version. You can tell the difference when a new video is posted as being 30 minutes or 60 minutes (has original commercials) versus 20-22 minutes or 40-44 minutes (clean version).

ehurdler
10-14-2017, 06:42 AM
Can you please tell me how and where you found the http://link.theplatform.com link? I for the life of me have no idea where. I have tried everything I have known and done in the past.

Any info you can pass along in the future too on the anvato links as well would be greatly appreciated.

Thanks.

Yelloworanges
10-14-2017, 01:09 PM
The extractor was fixed today in youtube-dl. See here (https://github.com/rg3/youtube-dl/commit/b21ab85088345323d1e6d988b2cdce8e02fe6bdf) and here (https://github.com/rg3/youtube-dl/issues/14389).

Download the updated version.

ehurdler
10-14-2017, 05:22 PM
Thank you!! I appreciate it.