How to use iView (ABC Australia) downloaders

Re: How to use iView (ABC Australia) downloaders

 

For Apple Mac users looking to download iView shows, I have written a basic AppleScript applet. As with other apps, it uses youtube-dl and FFmpeg and so works on any site youtube-dl handles. It's called MacYTDL.

To use, download the dmg file, open it, read the Help file and save the applet in a favourite place (eg. Applications). It will download and install youtube-dl, FFmpeg and FFprobe as needed. Those components can be updated from within the applet (except MacYTDL at present). It can uninstall itself. Works basically the same way as other apps => just paste a URL into the box and click on "Download".

Has options for downloading subtitles (always in SRT format at present - embedded if desired), file description, file format, download location, overwriting downloads and verbose feedback from youtube-dl.

The AppleScript code is not hidden. So, any keen scripters out there are welcome to improve, change and beautify MacYTDL. Just make sure to send me all the details.

Currently at version 1.2 and requires macOS 10.10. Download from here:

Download here


Cheers.

Re: How to use iView (ABC Australia) downloaders

 

Resurrected eh? Lucky I still had the forum bookmarked.

Re: How to use iView (ABC Australia) downloaders

 

Re: How to use iView (ABC Australia) downloaders

 

The spammers are back already ..

Re: How to use iView (ABC Australia) downloaders

 

MacYTDL v1.4 is available

MacYTDL is a youtube-dl GUI front end for Apple Macs running macOS 10.10 or later. Written in AppleScript the code is not protected and can be opened in Script Editor.

More info: MacYTDL v1.4 @ VideoHelp

V1.4 changes:

• New option to check for youtube-dl updates on startup.
• New option to remux every download file and keep/discard original.
• Can download audio file only with remux format choices: arc, flac, mp3, m4a, opus, vorbis, wav.

Please, any feedback or suggestions, especially on missing options, would be a great help. Make a post on the thread or send a private message at VideoHelp or here at Stream-Recorder.

Re: How to use iView (ABC Australia) downloaders

 

Version 1.5 of MacYTDL is now available.

Has new options and functions.

Details are available at: MacYTDL @ VideoHelp Forums

Re: How to use iView (ABC Australia) downloaders

 

ah, well, everything was going well til yesterday, when they changed the site completely & broke not just the downloader i was using, but the site is a horrible mess to navigate too
any ideas what can be done? i noticed video downloadhelper grabbed it, but the video came out all black & distorted (i assume deliberately)

Re: How to use iView (ABC Australia) downloaders

 

The files are encrypted look at the very last line from media info youtube cannot deal with this new setup !!!
General
Complete name : Back In Time For Dinner.mp4
Format : MPEG-4
Format profile : Base Media
Codec ID : isom (isom/iso2/avc1/mp41/iso5/iso6)
File size : 581 MiB
Duration : 58 min 48 s
Overall bit rate : 1 382 kb/s

Video
ID : 1
Format : AVC
Format/Info : Advanced Video Codec
Format profile : High@L4
Format settings : CABAC / 4 Ref Frames
Format settings, CABAC : Yes
Format settings, ReFrames : 4 frames
Codec ID : encv / avc1
Codec ID/Info : Advanced Video Coding
Duration : 58 min 48 s
Bit rate : 1 372 kb/s
Width : 1 024 pixels
Height : 576 pixels
Display aspect ratio : 16:9
Frame rate mode : Constant
Frame rate : 25.000 FPS
Color space : YUV
Chroma subsampling : 4:2:0
Bit depth : 8 bits
Scan type : Progressive
Bits/(Pixel*Frame) : 0.093
Stream size : 577 MiB (99%)
Writing library : x264 core 148 r2643 5c65704
Encoding settings : cabac=1 / ref=3 / deblock=1:0:0 / analyse=0x3:0x113 / me=hex / subme=7 / psy=1 / psy_rd=1.00:0.00 / mixed_ref=1 / me_range=16 / chroma_me=1 / trellis=1 / 8x8dct=1 / cqm=0 / deadzone=21,11 / fast_pskip=1 / chroma_qp_offset=-2 / threads=6 / lookahead_threads=1 / sliced_threads=0 / nr=0 / decimate=1 / interlaced=0 / bluray_compat=0 / constrained_intra=0 / bframes=3 / b_pyramid=2 / b_adapt=1 / b_bias=0 / direct=1 / weightb=1 / open_gop=0 / weightp=2 / keyint=250 / keyint_min=25 / scenecut=40 / intra_refresh=0 / rc_lookahead=40 / rc=crf / mbtree=1 / crf=22.0 / qcomp=0.60 / qpmin=0 / qpmax=69 / qpstep=4 / vbv_maxrate=1404 / vbv_bufsize=3000 / crf_max=0.0 / nal_hrd=none / filler=0 / ip_ratio=1.40 / aq=1:1.00
Language : English
Encryption : Encrypted

Re: How to use iView (ABC Australia) downloaders

 

Looks like ytdl gurus might have a fix for the iView problem:

https://github.com/rg3/youtube-dl/co...06.11...master

Code change done by the developer "remitamine". They also have a change for metadata.

That was quick !

Re: How to use iView (ABC Australia) downloaders

 

Hey all..

So, from what I can see ABC iView has finally dumped any and all requirement for flash, which is great, and are now using HTML5, they rolled out a new website and iOS apps, but the video is now encrypted!
I grabbed the latest build from ytdl and though I noticed a comment from @GBDesk about a recent commit done by one of the devs, has anyone been able to decrypt the video - I can use a couple of other downloading tools to grab the mp4 files, but if it's encrypted, its useless. Any suggestions please or are we in waiting mode for ytdl to release a new build? Thanks in advance.

Re: How to use iView (ABC Australia) downloaders

 

There seem to be two issues at the moment .. getting a usable url or program ID that yt-dl could work with and then the DRM encryption on everything.

Re: How to use iView (ABC Australia) downloaders

 

The github link given by GBDesk says they are aware of the problem and working on it. But the fix has not yet reached the current release.

That still leaves the workable url/program ID issue.

Re: How to use iView (ABC Australia) downloaders

 

On the right hand side of the program picture there is a share arrow click and then copy link this will give the usable url links with the id number and episode name copy to clipboard

Re: How to use iView (ABC Australia) downloaders

 

Try this. Released 4 hours ago.
https://yt-dl.org/downloads/2018.06.14/youtube-dl.exe


Cheers
:rolleyes:

Re: How to use iView (ABC Australia) downloaders

 

Version 2018.06.14 has been released. I've just DL'd last night's 4Corners with no problems. Ditto Episode 4 of City&TheCity.

The trick for getting URLs of individual videos is to click on the down arrow beside an episode then click on "Share". That will copy the link which can then be pasted into youtube-dl.

But, the new site makes a mess of apps which try to pull the URL from the page address. That no longer works as each page is just a holder for all the episodes.

You can track what youtube-dl fixes will be in the next release here: https://github.com/rg3/youtube-dl/releases. A link to future commits becomes visible when the first commit is finished for the next release.

Be kind to the YTDL people – they have responded very quickly and precisely to the iView change [maybe they saw how many Oz users love their ABC iView !].

Cheers.

Re: How to use iView (ABC Australia) downloaders

 

To programmatically get the URL might mean parsing the html for the links. With some work (or a lot) that would result in a list of episodes and URLs from each show page. For example, this web page: "https://iview.abc.net.au/show/city-and-the-city" has six "shareUrl" references: one for the page, one for latest episode and one for each of the four available episodes.

Re: How to use iView (ABC Australia) downloaders

 

Woo Hoo - the latest release works a treat for me - I just grabbed a few different things - all worked, no encryption. Hats off to the ytdl guys! :D

Yes, discovered this from playing around with the new page - but thanks for the heads up - if you are grabbing a weekly program, I grab the first url, and you'll notice that only two numbers of the url change to identify the episode number from week to week - I wont mention too much since big brother is watching, but anyone with 5 minutes and half a brain can grab a few links from the same show and they will quickly see what I'm talking about.

Of course, these guys are my heroes - since they have given me a way of grabbing iView stuff to keep - and even though 1024x576 is still not the best possible resolution, it's a lot better than what we had previously which was around 360p.

Using a rather long command string I found on another site, I am able to get the show's metadata, a thumbnail and the .vtt subtitles (which alas don't convert into proper .srt using the "--convert-subs srt" but its relatively easy to find a converter which will number each line to make it .srt compliant. I also convert the .mp4 into a .mkv for ease of use in the future. Though it definitely needs a remux to make into a proper .mkv because the source video is downloaded in individual chunks - but that's another issue entirely, one that I already understand, and not specifically relevant to this current discussion.

I get that driving ytdl from a command prompt might be a little complicated for some people, but until someone creates a Windows front end with the ability to turn on/off each option, enabling the various options on the command line is a reliable way to get consistent results week to week - of course, if you don't want subtitles, metadata, thumbnails and conversion to mkv, the command line gets much simplier ;-P

Thanks to GBDesk, pcspeak and yagasill for responding so quickly - and for all the others contributing to this thread.

Cheers, dman

Re: How to use iView (ABC Australia) downloaders

 

may be I am dumb about this I got the url ok copy and pasted them into URLDown Dropper v4.1 updated utube-dl to the latest version but still can not get any downloads is this a cmd line operation if not where am I going wrong does the program need recording ?

Re: How to use iView (ABC Australia) downloaders

 

If the URL is correct, it works in MacYTDL (which uses fairly vanilla youtube-dl calls). The URLs look like this:

iview.abc.net.au/show/mystery-road/series/1/video/DR1631W001S00

But, note that this formulation also works with youtube-dl: https://iview.abc.net.au/video/ZW1506A001S00 ... but, neither work in a web browser.

Perhaps there is an issue with URLDown Dropper – but, development has ceased. There are many alternative Windows apps which use youtube-dl. There are also some cross-platform efforts which are functional and free (eg. youtube-dl-gui).

Cheers.

Re: How to use iView (ABC Australia) downloaders

 

In your browser perhaps change to:
https://iview.abc.net.au/programs/ZW1506A001S00


Does that work for you?

Re: How to use iView (ABC Australia) downloaders

 

Thanks .. silly me tried right-click to copy the link and nothing happened.

Re: How to use iView (ABC Australia) downloaders

 

I just tried the SBSDL -V4.2 updated to the latest utube-dl and I can download the ABC programs back-in-time-for-dinner copy and paste the link into getvideo in the program and it starts up ok DECRYPTED 650MB and the srt file present

Re: How to use iView (ABC Australia) downloaders

 

I was thinking I might get a frame with the JW player showing that video but instead I get just the show's main page. Not a big issue. It does work with youtube-dl which, in part, reports:

[generic] ZW1506A001S00: Requesting header
[redirect] Following redirect to https://iview.abc.net.au/show/city-a.../ZW1506A001S00
[debug] Using fake IP 1.131.162.50 (AU) as X-Forwarded-For.
[abc.net.au:iview] ZW1506A001S00: Downloading JSON metadata
[abc.net.au:iview] ZW1506A001S00: Downloading webpage
[abc.net.au:iview] ZW1506A001S00: Downloading m3u8 information

So, DL'ing is not a problem.

Re: How to use iView (ABC Australia) downloaders

 

Someone asked.
Package an ABC download in an MKV container, with subtitles added.
My batch file, 'ff MP4+subs-MKV v01.cmd'
Needs 'ffmpeg.exe' in the same directory - or modify the paths.

Cheers.:)

Re: How to use iView (ABC Australia) downloaders

 

Away for 6 days

Re: How to use iView (ABC Australia) downloaders

 

Hi all, Just checking in as it has been a while.

Re: How to use iView (ABC Australia) downloaders

 

Hi and welcome back.]

Re: How to use iView (ABC Australia) downloaders

 

Been a while too, anything new happenin'?

Re: How to use iView (ABC Australia) downloaders

 

Has anyone else noticed that iview has stopped working with yt-dl (and dependent applications) in the past few days? It was working Monday but not today. I tried several shows .. and they all give the same "is not a valid url" error.

Pcspeak's latest script to "get list" is only getting eps up until the end of last week. Nothing newer is showing, but they are up on the website. Url's for eps this week taken from the website give the not valid error. Have the latest version of yt-dl.

Re: How to use iView (ABC Australia) downloaders

 

Continued ...

I notice there's a moderator-deleted post on the SBS forum on monday, which is probably someone asking the same thing there.

Using pcspeak's latest ABC script, selecting an old ep from a previous week and changing the episode number in the program ID works (making an educated guess as to what it is). Messy tho' and it does rename the file to the older episode (I didn't try changing that .. one variable at a time). No idea why this workaround works when yt-dl itself does not work, but then I know zilch of coding so no idea what the abc script is doing differently that allows it to work.

Update: I'm now having mixed success throwing guessed url's for this week at naked yt-dl. But it's very slow. School holidays?

Re: How to use iView (ABC Australia) downloaders

 

A new release of MacYTDL is available. It's version 1.7 - a bug fix release with no new functions. MacYTDL is a GUI front end for youtube-dl. Requires an Apple Mac with macOS 10.10 or newer.

Available here:

https://forum.videohelp.com/threads/...for-Apple-Macs

Please post any feedback here or on the Video Help forum.

Cheers.

Re: How to use iView (ABC Australia) downloaders

 

A new release of MacYTDL is available. It's version 1.14.1 - which has many new features and bug fixes since my last post.

MacYTDL is a GUI front end for youtube-dl. Requires an Apple Mac with macOS 10.10 or newer.

Available here:

https://github.com/section83/MacYTDL

Please post any feedback here or on GitHub.

Cheers.

Re: How to use iView (ABC Australia) downloaders

 

Since this forum is back up again and seems fairly stable, I suppose it's time to post an update on how to use downloaders with iview.

First a legal disclaimer - using downloaders on streaming sites is a legal grey area, so this primer should not be taken as a licence. :) However in some jurisdictions it is deemed the equivalent of using a VCR/DVR, so not prosecuted. Also, some businesses have licences which legally allow employees to record or download broadcast media for, ahem, work or research purposes. Hence downloaders themselves are not illegal. End disclaimer.

Apart from some commercial downloaders, today pretty much all downloaders are based on youtube-dl. If you are happy using the command prompt, go to "https://youtube-dl.org/", d/l the version for your os and off you go.

For those who prefer a GUI, see the previous post for a GUI for apple computers. For windows there were several GUIs, but they have now been abandoned and for the most part removed from the web. A series of scripts is still available for SBS from mega.nz, here's a tiny url: "https://tinyurl.com/y8h582e2". The download script works for many streaming sites including iview. You will however need to update youtube-dl. Once you've uncompressed the zip file, go to the created folder and in the sub-folder "bin" run the script "youtube-dl_update" - the copy of youtube-dl packaged with the script is out of date. Whilst these scripts operate in a dos/command shell, you run them from the windows folder, so they are easier to use.

Whether you use native youtube-dl or a front end, you need one additional item and that's the url of the video itself (not the url of the iview webpage describing the show, the two are different). Go to the iview website, then to the page of the show you would like and click on the "share" button and then "copy link". Paste this in when prompted with the frontend or use it as the command line argument with youtube-dl, then sit back and wait. Downloaded files will need to be renamed since they will not include the name of the show, just the series & episode numbers.

The above means of getting a url will work for series, but does not work for one-off programs. There is a workaround, but it is a bit more complicated. Go to the iview web page for the show, right click on the screenshot and select "save image as" and you'll get something like "ZW1435A001S00_598aa96ecff76_1280.jpg" in the "save as" popup. The part before the "_" is the program id code. Paste this into: "<iview web page url>/series/0/video/<id code>". The "web page url" here is the url for the iview page describing the show (not the video link url). Use notepad to assemble the video link and copy & paste that into the frontend or youtube-dl, as above. You should get something like: "https://iview.abc.net.au/show/royal-edinburgh-military-tattoo-2017/series/0/video/ZW1435A001S00".

Re: How to use iView (ABC Australia) downloaders

 

I use the SBS downloader V9 for all my ABC Iview downloads works well no problems I make a new folder copy the txt description for the programs and the downloaded files usually a video and srt to the folders to keep it all tidy

Re: How to use iView (ABC Australia) downloaders

 

And pcspeak's latest SBS script is here:
https://mega.nz/file/Z3og0QKB#dlzvIe...-5zOLxnSfsDve8

Re: How to use iView (ABC Australia) downloaders

 

Has any body worked out how to copy the text on the new abc redesigned iplayer site I worked out how to download a file start the video then copy the link from the address bar but the txt appears to be a pdf ? I want to keep the doctor who series 5

Re: How to use iView (ABC Australia) downloaders

 

Just go to the page of the show you want, select the desired series and you will get a row of the available episodes with a screenshot and a brief description below. < & > just above the right-most episode on the screen navigates to other episodes.

Right click on the screenshot for the ep you want & copy the link. For Dr Who 5.1, that's:
https://iview.abc.net.au/video/ZX0929A001S00

Then toss that at pcspeak's downloader script, youtube-dl or whatever other method you prefer. I just tried the above url and it worked.

One-off specials & movies are more difficult. The instructions I gave in this forum back in December still mostly work apart from the first step in getting the program ID. Now you need to right click on the background and select "view page source", "view page info" (for firefox) or whatever options your browser gives. Hunt through the resulting tab and look for the url of the background image, snip out the ID which is part of the background image filename and follow the rest of the instructions I posted back in Dec last year a few posts above.

Re: How to use iView (ABC Australia) downloaders

 

Not an iview question, but since this forum is not moderated & I have nowhere else to ask, here will have to do.

Has anyone else noticed that 10Play has broken youtube-dl again in the past week or so? Not just newly posted eps are failing but even older ones that previously worked are now failing to download. If you can get anything, it's a blank 3s video file. Videodownload helper also falls over.

I've tried with the latest yt-dl and on both win7 & win10 machines have the same result.

Re: How to use iView (ABC Australia) downloaders

 

A bug has been filed on github.