You use old version of Replay AV. Please download the latest one and try again.

But NetTransport shows timeout after trying to connect. So there must be some problem with rtsp or ports.

Real Player can automatically change ports and protocols. You can try to change ports and protocols manually. But it is easier to find the stream URL that Real Player uses with the URL Finder of Replay AV or with freeware URL Snooper.

After finding stream URL, try to record from it. You shouldn't have any problem.