html into perl

telecsan · 05-11-2000, 02:24 PM

I've read plenty of stuff on how to create html content with a perl script, but is there a way to pull in a remote html page into a perl script?

*jokesplus* · 05-11-2000, 03:24 PM

Try

use LWP::Simple;
$content = get($URL);

If it gets more complex you'll probably want to explore the LWP documentation @ http://www.linpro.no/lwp/

Jarrod

------------------
From blonde jokes to yo mamma
http://www.jokesplus.com

telecsan · 05-12-2000, 07:27 AM

That actually worked pretty well. But is it possible with that to send a user name and password as well? (Local server requires user name and passwd to get out to the internet...)

*jokesplus* · 05-12-2000, 11:44 AM

Yes LWP can send a user name and password details. However, haven't personally used it. If you visit the LWP web-site they have some sample scripts...you might be able to find one to copy. Sorry can't be of more help.

Jarrod

Justin · 05-12-2000, 04:04 PM

A simply (and *NOT* very secure) way to authenticate is this:

http://username:password@www.domain....h/to/file.html

This will cause you to be logged in, but keep in mind that you would have to add the auth info for each URL you visit within the protected area (eg, images etc).

Hope this helps.

------------------
Justin Nelson
FutureQuest Support

sumengen · 05-12-2000, 10:47 PM

using LWP::UserAgent you can access protected directories. Here is an example from LWP-cookbook
http://theoryx5.uwinnipeg.ca/CPAN/da...l/lwpcook.html

Code Sample:

 

  use LWP::UserAgent;

  $ua = LWP::UserAgent->new;

  $req = HTTP::Request->new(GET => 'http://www.linpro.no/secret/');

  $req->authorization_basic('aas', 'mypassword');

  print $ua->request($req)->as_string;

------------------
*****************
Baris Sumengen
*****************