Capture from watch.diynetworks.com

ehurdler · #1 10-13-2017, 12:37 PM

Trying to capture from watch.diynetworks website a full video without commercials/ads. Is this possible? I can get a video, but has ads.
If anyone knows how to do this, please let me know. What I have tried in detail so far:

Example episode does not need provider login:

Code:

http://watch.diynetwork.com/show/DFTF/First-Time-Flippers/3539816/Flue-Season/

Once the video loads, I have HLS link detector running and 3 master.m3u8 files are present.

First one, if you use it with livestreamer gives the full episode with commercials.

Code:

http://dcs-vod.apis.anvato.net/vod/p/session/master.m3u8?i=i177602562-n14b90f71-b76e-4523-a9cb-2acd3008f328

So not what I am looking for.

Second master.m3u8 file is long and does not work in live streamer.

Code:

http://dcs-vod.apis.anvato.net/vod/CN0VadLru0ZXI9J1XEfqrvh1TlleFCuruGBEhpK3jH1WHyYeQoGqUaU8XMFZDUGB1DiR1Q19qXxjXY-F48AibPkwmSJvJWllK8Qza2zlUgIH-fnxXjS8QJt5KnJKBTJE/q_zTSZfhTK8Icy5K6vLcAGYkfToyAo9G8imID6O8N2WNjW9u_EP2dBgsODaKy8z9lZ5fUNjs2ViCKr6PC5W1b4O0juMjhLx8oMji4dyK68ooga2WCV_xZK1UsnWHQsiJ/F18ktC6md0GNa7Z8NiHXgR-6y9i-odJNNNkPazgLI0JfWsDNgsvT-gKlf0p8I9GYh9ioBbJOYXYUR2eE-UvFXd6Wbh23032B0JRZFs24Ggz_f2xjQ6Fq9n9u-sg05Ib4/MfELtRam26MOXEFVjlcFVlvtMLMBNXHRxDsddm4ZB-CufY6CxVAFNu4zJRKQGtra_qdJ76krYif3frzY_On5E_E521jTGYC_IvTdqMublHrQbgDqk6JcCZTIL5SUKkO7/master.m3u8?fields=full&anvauth=tb=0~te=XXXXXXXXX~sgn=***********************bunchofrandomnumbers**************&t=XXXXXXXX&_vpng=0

Gives "error: Failed to parse playlist: Missing #EXTM3U header" message.
If you load it in the browser however, gives the following:

Code:

session_id	"i177602562-ncd0a5313-d246-49db-b8ea-9af0cee077a0"
master_m3u8	"http://dcs-vod.apis.anvato.net/vod/p/session/master.m3u8?i=i177602562-ncd0a5313-d246-49db-b8ea-9af0cee077a0"
interstitials	{…}
breaks	[…]

The master.m3u8 shown above, if you load in livestreamer, gives a video which is basically just the commercial itself.
Same with the last master.m3u8 file hls link detector finds from the start of the video loading in browser.

Code:

http://dcs-vod.apis.anvato.net/vod/p/session/master.m3u8?i=i177602562-n6d11bc0f-cc22-45bd-bfb6-dc783bd473ea

Anybody have an ideas? HGTV and DIYNETWORKS seemed to have just changed their sites within the past 2 weeks.

Thank you!

Yelloworanges · #2 10-13-2017, 03:29 PM

Use theplatform links instead of the anvato ones. They are still there but might be going away.

If you really want to use the anvato links, note that the first "m3u8" url called is not really in m3u8 format. Download it as a text file and find the real hls source (for the content) within.

ehurdler · #3 10-13-2017, 05:32 PM

Quote:

Originally Posted by Yelloworanges

Use theplatform links instead of the anvato ones. They are still there but might be going away.

If you really want to use the anvato links, note that the first "m3u8" url called is not really in m3u8 format. Download it as a text file and find the real hls source (for the content) within.

From what I am seeing the "theplatform" links that used to be present a week or two ago are gone. I looked with AdBlock Plus, also with Tools->Web Developer->Web Console....Just not there anymore. Do you see them? If you do, how? What are you using?

As for the anvato links. I found that long m3u8 file I referenced in the original post I pasted it into the browser and looked at the raw data. Copied that and pasted into TextEdit and I couldnt find any hls or m3u8 links that work.

Were you able to get a full episode from my original post with no ads?

Yelloworanges · #4 10-13-2017, 07:51 PM

Quote:

Originally Posted by ehurdler

From what I am seeing the "theplatform" links that used to be present a week or two ago are gone. ... Do you see them?

It should look something like this;

Code:

http://link.theplatform.com

Quote:

Originally Posted by ehurdler

As for the anvato links. I found that long m3u8 file I referenced in the original post I pasted it into the browser and looked at the raw data.

The steps for anvato is a lot of stuff to type. I'll organize all the steps later if I have the energy and you can't get theplatform working. The youtube-dl nerds should be working on anvato. If you wait for them to add it to youtube-dl, you'll save yourself the trouble.

Note that for a few days after broadcast while a new video is in "on demand" mode, it has the broadcast version including the original commercials. It is all one continuous video. Then some days later they make a clean version. You can tell the difference when a new video is posted as being 30 minutes or 60 minutes (has original commercials) versus 20-22 minutes or 40-44 minutes (clean version).

ehurdler · #5 10-14-2017, 07:42 AM

Can you please tell me how and where you found the

Code:

http://link.theplatform.com

link? I for the life of me have no idea where. I have tried everything I have known and done in the past.

Any info you can pass along in the future too on the anvato links as well would be greatly appreciated.

Thanks.