MFC, how to see who is online?

[forlan38]

still no other way of MFChecker?

[James Halpert]

Originally Posted by forlan38

still no other way of MFChecker?

what i did earlier this week was wrote a little script that curls mfc's top online models and their offline models page.

It just runs on an endless loop with a random length temporary sleep time between each bulk cURL run.

From this I parse out all the model names and store them in a temporary swap file.

With all the model names rounded up from both pages I cURL I then cURL each model's profile pageto locate their model ID.

Then I pass the information off to a MySQL database I created with the following columns:

recordNum(incremental INT - PK) | modelName | modelID

I query this database to figure out which model's I have in my various rtmpsuck.exe's saved streams folder (as rtmpsuck only saves the modelID in the file name).

Also, since some MFC models love to change their names regularly I specifically query mysql for the modelID and sort it so that it responds with only the most recent modelName for that modelID.

Is this the best solution? Hell no, but it is good enough for my needs, for now. It doesn't get every model and it has a lot of redundant processes (ie: re-scraping model profiles already discovered and haven't changed)

I really need to learn how to mimic a javascript enabled web browser from a terminal script (using anything like lynx, w3m or bottle.py). I'd be curious if anyone has any tips or insight as to what the best general path I should explore to accomplish this hurdle...

[Quazar]

I have begun fiddling around with casperjs but it'll take some time for me to get some progress done. Whenever I try accessing any element other than the outer most frame, casperjs acts as if they are not there (selectors are not being found) but the website is being captured fine.

A little example:

casper.start('http://myfreecams.com/', function() {
    this.echo(this.getTitle());
    casper.capture('step1.png');  // works fine, shows the website with the "I am over 18" button on top.
});

casper.click('#enter_desktop', function() {   // Fails because the selector cannot be found, even though it was clearly shown in step1.png
    this.echo('Passed age gate.');
    casper.capture('step2.png');
}

[James Halpert]

Originally Posted by Quazar

I have begun fiddling around with casperjs but it'll take some time for me to get some progress done. Whenever I try accessing any element other than the outer most frame, casperjs acts as if they are not there (selectors are not being found) but the website is being captured fine.

A little example:

casper.start('http://myfreecams.com/', function() {
    this.echo(this.getTitle());
    casper.capture('step1.png');  // works fine, shows the website with the "I am over 18" button on top.
});

casper.click('#enter_desktop', function() {   // Fails because the selector cannot be found, even though it was clearly shown in step1.png
    this.echo('Passed age gate.');
    casper.capture('step2.png');
}

Cool find!

To install this on Ubuntu 14.04:

apt -get install phantomjs git -y; git clone git://github.com/n1k0/casperjs.git; cd casperjs; ln -sf `pwd`/bin/casperjs /usr/local/bin/casperjs;

Confirm installation with:

phantomjs --version; casperjs | head -n1 | awk {'print $9'}

Output should appear as such:

1.9.0
1.9.0

I'm playing around with this myself now, I'm analyzing MFC via Wireshark in a VM to try and figure out how to bust through the age prompt.

Will update this thread in a little bit with my findings...

[James Halpert]

Sorry I got distracted with other things but I managed to get you one step a little further.

To get around the #enter_desktop button you can simply invoke a reload (try it a browser incognito mode, first the button appears, refresh and you do not get prompted with anything).

Being that I literally only heard of CasperJS from your post I am a total noob at this. But I was able to take your code and add a couple tweaks:

1. Declares the User_Agent so that you look like an average user in their webserver access log files.
2. Circumvents the #enter_desktop challenge.

Here is what I got so far:

var casper = require('casper').create();

// User Agent for "Google Chrome Generic Running on Windows 8.1 64-bit"
casper.userAgent('Mozilla/5.0 (Windows NT 6.3; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36');

casper.start('http://myfreecams.com/#Homepage', function() {
  this.echo(this.getTitle());
  casper.capture('step1.png');
  this.reload(function() {
    this.wait(2000, function() {
      casper.capture('step2.png');
    });
  });
});
casper.run();

Unfortunately I'm going to be AFK for about 18 hours or so, but when I get back I'm totally going to see about going further with CasperJS.

I think this is going to be the smoking gun that I've been looking for to be able to do this efficiently, so thanks for bringing this to my attention!

[basa666]

Because mfc add more servers (about 50 new servers) where now stored models live capture my old script posted earlier in this thread stopped working for mostly models. I decided made update in my script generally im working now in two scripts - lite version where you need only know model name and extended version where you must know model name and model ID , extended version will be based on my old script you can see model avatar but live screen capture will be works only if screenshot stored in old mfc server and only in popup.

But both scripts will be now easier to use need only perpare txt file with model names (lite version) or model names and id (extended version), special exectuable file (instaled NET Framework needed) will made html page based on your models list from txt file.

Lite version will be looks probably like my alpha testing page :


Extended version :


Now my mfc checker will be more detailed , will be available live statuses : Online , Online: Away, Online: Webcam Off, Online: Private, Online: Group Show and of course Offline.

Im still testing but now looks like all works fine , i think about how add live caps for all models but probably its not possible for now live caps stored totally random and checking every 50 servers by script can be laggy if you have added more models.

[Quazar]

This is as far as I will get today. Another 30min spent without making any headway...

var casper = require('casper').create({
	verbose: true,
	logLevel: 'error',
	pageSettings: {
		userAgent: 'Mozilla/5.0 (Windows NT 6.2; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/29.0.1547.2 Safari/537.36'
	}
});

var x = require('casper').selectXPath

casper.start('http://myfreecams.com/', function() {
	this.echo(this.getTitle());
	this.page.switchToChildFrame(0);
});

casper.then(function() {
	casper.echo("Waiting for age gate...");
	casper.waitForSelector('#enter_desktop');
	casper.click('#enter_desktop');
	casper.echo("Entered.");
});

casper.then(function() {
	casper.echo("Selecting model container...");
	this.page.switchToChildFrame(0);
	
	// foreach modelRow in online_broadcasters_list
	//     if !modelRow.isLoaded
	//         scroll down
	//     
	//     foreach model in modelRow
        //         fetch data

});

casper.run();

There "switchToChildFrame" are necessary because the model list is situated within an iframe, which itself sits in another iframe.

[James Halpert]

Originally Posted by Quazar

This is as far as I will get today. Another 30min spent without making any headway...

var casper = require('casper').create({
	verbose: true,
	logLevel: 'error',
	pageSettings: {
		userAgent: 'Mozilla/5.0 (Windows NT 6.2; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/29.0.1547.2 Safari/537.36'
	}
});

var x = require('casper').selectXPath

casper.start('http://myfreecams.com/', function() {
	this.echo(this.getTitle());
	this.page.switchToChildFrame(0);
});

casper.then(function() {
	casper.echo("Waiting for age gate...");
	casper.waitForSelector('#enter_desktop');
	casper.click('#enter_desktop');
	casper.echo("Entered.");
});

casper.then(function() {
	casper.echo("Selecting model container...");
	this.page.switchToChildFrame(0);
	
	// foreach modelRow in online_broadcasters_list
	//     if !modelRow.isLoaded
	//         scroll down
	//     
	//     foreach model in modelRow
        //         fetch data

});

casper.run();

There "switchToChildFrame" are necessary because the model list is situated within an iframe, which itself sits in another iframe.

Looks cool, I'm going to be AFK for a few hours but later tonight I'm going to try and pick up where you left off.

One thing though, you can specify the verbosity of the script when executing it as opposed to making the script itself verbose by executing casperjs as such:

casperjs --log-level=debug --verbose mfc.js

No big deal though, but I personally would rather keep CasperJS quiet when the script is complete and have it only verbose for development...

Good work on figuring out how to switch to the frame. Last night I did try waitForSelector for a bit and now I know that it wasn't working because I wasn't drilling down into the frames.

[basa666]

Anyone have idea how check actuall model name in mfc if i allready have only her model id ? (old name dont works but id still active)

[yetanotherday]

Originally Posted by basa666

Anyone have idea how check actuall model name in mfc if i allready have only her model id ? (old name dont works but id still active)

post her old name we might be able to help u via search.