Python resource question

[phppete]

I'm making a link checker for a client, this link checker basically spiders several hundred sites looking for a reciprocal link, although it does check the original location first and moves to the next site if found. The number of links could be several hundred, so that x {number of pages} per link could take upto 30 mins to complete (current time on my local machine during testing).

I don't actually plan to deploy this on FQ because I have decided to create an .exe and it can run on my clients PC and eat his b/w, however I just wanted to know if such scripts had a max execution time on FQ. I know cgi/php scripts do but what about non web scripts... just curious, thanks.

[georgeek]

I'm making a link checker for a client, this link checker basically spiders several hundred sites looking for a reciprocal link....You may want to check the reciprocal links are genuine. Look for rel="nofollow", noindex and nofollow meta, javascript redirects, exclusion by robots.txt etc., etc.

Good idea having it run on the client's machine. Perhaps you should build in a message that pops up every 15 minutes that says "Reciprocal linking is a good way to tell Google that no one wants to link to your website voluntarily". :smile:

- George

[phppete]

Perhaps you should build in a message that pops up every 15 minutes that says "Reciprocal linking is a good way to tell Google that no one wants to link to your website voluntarily". :smile:
- George
Perhaps the reciprocal links are 3 way eg site A links to site C and site B links to site A so there are no direct link swaps. So I might add a message every 15 minutes to say "Sneaky 3 way random linking is a good way to increase your page ranking and George at FQ must think I am a dummy!" :smile:

[georgeek]

N-way linking strategies stick out like a sore thumb on a link graph, so yes George does think he is a dummy but don't tell him! I bet your client has a links page as well :wah:

- George