Re: How to use iView (ABC Australia) downloaders

sos · #**971** 03-11-2014, 03:57 AM

Is it just me or has the latest makeover foiled iViewNapper again? It exits after failing to get the index.

davey52 · #**972** 03-11-2014, 04:39 AM

Quote:

Originally Posted by sos

Is it just me or has the latest makeover foiled iViewNapper again? It exits after failing to get the index.

Same for me, although it worked OK last night.

blood.eaglz · #**973** 03-11-2014, 05:42 AM

Ah crap,

From what I can tell (with the help of Urlsnooper2 and wireshark), it appears the json is now being hosted at http://project.abc.net.au (on loading a gzip file identified as containing json is transferred from there) I got a 403 error trying to follow the url.

However the site itself seems to contain a lot of the directory within the source code of the channel, categories and programs A-Z pages, allowing you to branch off to each episode. Whether that would be usable for our purposes I'll leave to the coders to determine.

Hope this helps in some way.

fredsmith · #**974** 03-11-2014, 07:55 AM

Quote:

Originally Posted by blood.eaglz

From what I can tell (with the help of Urlsnooper2 and wireshark), it appears the json is now being hosted at http://project.abc.net.au (on loading a gzip file identified as containing json is transferred from there) I got a 403 error trying to follow the url.

That seems to just be the watchlists for individual users.

Quote:

However the site itself seems to contain a lot of the directory within the source code of the channel, categories and programs A-Z pages, allowing you to branch off to each episode. Whether that would be usable for our purposes I'll leave to the coders to determine.

In the worst case, it looks like it is possible to scrape the details from the HTML, but that's WAY more of a hassle to parse (and problematic in terms of it breaking) than getting the JSON.

Probably the best thing would be to put wireshark into promiscuous mode and capture traffic from non-browser app, like a TV or Xbox.

blood.eaglz · #**975** 03-11-2014, 09:52 AM

Quote:

Originally Posted by fredsmith

That seems to just be the watchlists for individual users.

I hope not, as that is the only JSON file I got during the entire trace, along with a bunch of javascript files from the same http://project.abc.net.au

Code:

/assets/js/iview-watchlist.js
/assets/js/iview-filter.js
/assets/js/webtrends.load.iview.js
/assets/js/iview-main.js
and a couple of javascript gzips
potentially missed some

Also tried promiscuous mode while using the android app, either I don't have wireshark setup properly or there is no json sent to the android app (possibly just uses the html).

Unfortunately this is not going to be as easy as when the v2 api came out, I only needed URLsnooper2 for that

fredsmith · #**976** 03-11-2014, 10:57 AM

Quote:

Originally Posted by blood.eaglz

I hope not, as that is the only JSON file I got during the entire trace, along with a bunch of javascript files from the same http://project.abc.net.au

Right, but I think that's all it is. The program list is contained within the HTML. That makes some sense, since they're no longer using flash for the rendering.

Quote:

Also tried promiscuous mode while using the android app, either I don't have wireshark setup properly or there is no json sent to the android app (possibly just uses the html).

I'd imagine the JSON data is still available somehow for apps that don't spin up a whole browser. Whether Android is an example, I couldn't say.

mce · #**977** 03-12-2014, 12:03 AM

Hi guys.

I'm in the same boat as you guys.

Been looking at wireshark captures and .js files and I cannot see any type of index like before.

The config.xml has changes with two new lines but nothing else there.

I haven't been over the iview site thoroughly but before they had a big window of shows, where now I don't think they do.

They maybe using this api: http://developer.tmsapi.com/docs/data_v1/ but customised.

eegee · #**978** 03-13-2014, 03:17 AM

Anything of use in the feeds? They were full of broken links a couple of days ago. Now some are populated & others completely empty.

Been using FF webconsole...
List of titles. Title search. Related programs. Buggered if I can find anything by category.

I've been able to save a manifest & also download using AdobeHDS (via HDS Link Detector). Not sure if config.xml is being used. Seems like you need html+auth+manifest to get to the nitty gritty. Still experimenting. Haven't tried hdsdump yet tho'

Also not seeing expiry dates & times. Webpage is vague about this (which is annoying many users on the messageboard, who are also missing the Last Chance category!).