Help capturing from Fox.com.

Help capturing from Fox.com.

 

Let me say, I have found a way to capture videos from fox.com since they made changes to their website. The process is rather long, but again, it does work. I was wondering if someone, anyone may be able to help to make the process easier and or faster.

Let me state, youtube-dl does work....but it also grabs the commercials and adds to final download.

Ok so here is my process.

This is for Fox's new show The Orville - s01e02 - https://www.fox.com/watch/3cecd74bcf...84a67c2bb1648/

Load video in question.
Got to Tools->Web Developer->Network
Use All Tab
Filter URLs - Search for link.

You will find for example:
Take the number string after /media/ in the url, in this case “rTAuVMt2lj_p” add between /media/ and ?

Paste in browser. Hit enter. Will download a file “rTAuVMt2lj_p”.
Open this file in a text editor.
Now look for Change User Agent to iPhone 3, also Disable Flash. Now Paste url into browser, start playing the video.

Once starts streaming you can either save video of choice with “Video DownloadHelper”
Or you can copy the string from the video you would download with Video Download Helper into ffmpeg
Examples below:

This works, I guess since it is reaching back to the "crypto server"/"key file" this is why the process is so slow? The process if you strictly use "Video DownloadHelper" takes maybe 10 minutes. The full process above takes 20-30 minutes. I wish i knew how Video DownloadHelper did the process so much faster.

Example of what ffmpeg spits out every few seconds:
If anyone can help, point to a different way, or anything please respond or even PM me. Thank you!

Re: Help capturing from Fox.com.

 

1080p Video Check If Any Issues
http://www84.zippyshare.com/v/5tCZcVgy/file.html
http://www84.zippyshare.com/v/LPtIKAl0/file.html
http://www84.zippyshare.com/v/sBnwfnUd/file.html
http://www84.zippyshare.com/v/IQNool1L/file.html
http://www84.zippyshare.com/v/zUczCOCt/file.html
http://www84.zippyshare.com/v/SOsUtWuJ/file.html
http://www84.zippyshare.com/v/89XIWFtK/file.html
http://www84.zippyshare.com/v/9q16ynqm/file.html
http://www84.zippyshare.com/v/MwDWAtw4/file.html

Re: Help capturing from Fox.com.

 

lottery IcTv thanks. This process which I thought I had tried before, and didnt work, well did this time. Unfortunately This no longer works. Youtube-dl or my long process i listed above. For example, the new episode of Brooklyn Nine-Nine https://www.fox.com/watch/5f5afb41c6...189e08c56e912/ When you simply use youtube-dl and one of the quality m3u8 files, it downloads everything but adds an advertisement in the beginning of the downloaded video. The advertisement also cuts off the beginning 15 seconds of the episode.

I will say, I am using a mac and when I use youtube-dl on certain sites I have to use the " --prefer-ffmpeg" option or it will error out. So what I tried is I do get the video downloaded, but as I stated gets advertisement stuck to the beginning. Is there any way around this?

Re: Help capturing from Fox.com.

 

The youtube-dl contributors are probably working on it.

The steps described in the next to last post here:
https://github.com/rg3/youtube-dl/issues/14147

Seem to work.

1. Download/view theplatform request.
2. Look for the PlayURL in the request.
3. Edit the PlayURL and download with streamlink/livestreamer.

Re: Help capturing from Fox.com.

 

Can you explain further? I tried the process described in the github link you sent. I parsed the url, as what I thought was right. I was able to use livestreamer but I still get the commercials. Can you give detailed instructions if you got this working? Thank you.

Re: Help capturing from Fox.com.

 

I just checked the above video using the github method. No ad at the beginning or anywhere else.

I really don't know how to make it any clearer. It is 3 steps.

Use the very long theplatform request made by the browser (no editing this or using an alternatively formed request).

Once you have this data, at the very top there is a very long uplink preplay json. Load that (again, no edits).

Once you have that, the PlayURL is at the very bottom of the preplay json. The PlayURL is the only item that needs to be edited. The pbs value at this particular location is important in determining what is sent in the m3u8. The m3u8 here is a parent m3u8 and not a quality m3u8.

If you are following these steps without doing any shortcuts or kludges, then I don't know what else to suggest.

Re: Help capturing from Fox.com.

 

ffmpeg -ss 5 -i inputfile outputfile

discards the first five seconds of input.

If your input file was 60 seconds long, the output file will be 55 seconds long.

https://superuser.com/questions/5380...fset-in-ffmpeg

https://trac.ffmpeg.org/wiki/Seeking

Re: Help capturing from Fox.com.

 

OK, Yelloworanges. I got it working now. I swear I did what that github post said and I got the file with commercials. I tried it again this morning and I got the file without commercials. To be fair, I just didn't fully understand your instructions. At first I was trying to find "theplatform" thru Tools-Web Developer-Network. This does get what you search for, but it is missing I guess some of the header data. But using the Web Console, now I see how to get what is needed. I can also find it thru AdBlock Plus. Just have to toggle that on and off from blocking on fox.com or it won't load the videos for me initially.

I did try in a test also if to take and parse the link that hls stream detector finds in firefox. That didn't work last night when I tried it, but it did work this morning. So, Thank you for the instructions. I guess I needed a bit more detail. I appreciate the help!

Re: Help capturing from Fox.com.

 

Now that you can do it, how would you have explained it better? This might help others so they don't have to deal with my lousy unclear instructions.

Re: Help capturing from Fox.com.

 

Solution that cannot be more straightforward, simply cut the commercial off the saved video with ffmpeg.

Re: Help capturing from Fox.com.

 

That wouldn't do it. There are commercials through-out, not just at beginning. Yelloworanges solution works perfectly.

Re: Help capturing from Fox.com.

 

OK, Deal. Yelloworanges, I did a test and wrote up this little set of instructions for myself, so as you suggested I will post them here.

Open Browser (I’m using Firefox) Load up Tools->Web Developer->Web Console.
Put “theplatform” (without quotes) in the search box.
Open Fox video in question. I am using The Orville s01e04:
Now the web console will give a result, in my example:
Expand this and you need to copy the full long “Location” url, the .json url.

Paste into Browser. Will load JSON Data in Firefox’s window. Copy the “playURL” url.

Parse it to remove “/preplay2” as well as everything before .m3u8 but not as far as the first section of numbers. So original link edited down will look like:

Take this url and run it with Livestreamer, and you will get the full Video, no Commercials at the beginning or through-out the video at all.


If my process is too long, or other plugins, or anything can be used to simplify the process.....Please let me know.

Thanks Again!

Re: Help capturing from Fox.com.

 

C�M QUAY TAY D??ỚI M�I H??NH THỨC ^^

----------------------------------

Re: Help capturing from Fox.com.

 

Re: Help capturing from Fox.com.

 

Interesting. It seems that the legacy sources "feed.theplatform.com/f/fox.com" and "link.theplatform.com/s/fox-mobile" are still active, at least for the mobile platform(s).

While the desktop platform has transisitioned to "link.theplatform.com/s/fox-dcg".

The legacy system might be easier to download than the new uplink system, although the old system doesn't have 1080p. The question is whether the legacy system will be ongoing for the mobile platform(s).

Re: Help capturing from Fox.com.

 

Thank you. This is awesome! But it seems that the videos you would have to login to a cable company login with do not work. Only works for older, or free access videos. Is this kind of feed setup available for other networks? NBC, ABC, CBS for example by chance?

Re: Help capturing from Fox.com.

 

the auth ones will work if the signature is included with the request.