FQuest Reminder: April Log Rotations on **SIX**

[Terra]

Please download and archive your logs from the logs_web/last_month directory...

I will be performing Log Rotations on April 3rd, and all archived logs in the last_month will be deleted and replaced with the 'access.199903??.gz' logfiles...

The logs_web/error log will be compressed and rotated as well...

I will also be deleting the logs_cgi/script logs... There is no rotation done on this debugging log...

Thank You...

--
Andrew Gillespie
Systems Administrator
FutureQuest.net

[Charles Capps]

Hm, are you sure we should be looking in logs_web/last_month? It's empty. http://www.aota.net/ubb/smile.gif

------------------
"Okay, so I'm not "SANE" so to speak, but uh... I'm the lovable kind of psycho"
http://solareclipse.net/

[Boksoft]

Same here

[Deb]

It depends which server you are on and when you got on it. For those on the TAZ server this does not apply.

For those on the SIX server this does apply but if you have not been on the server long enough to generate a last month, then it will be empty http://www.aota.net/ubb/smile.gif

Deb

[Terra]

For some of you, as Deb has stated above - this won't apply...

I'm currently writing the programs to do the rotations and will begin testing them tonight... Expect full rotation to happen tomorrow night after all preliminary testing is done...

Another sidenote that I forgot to mention... All domains on **SIX** will go offline (Apache web servers ONLY) for 2-5 minutes around 3:00am EST as this is required to rotate the error log properly... Open error log file handles need to be closed and re-opened...

I am beginning to start coding the next generation of logging techniques entitled 'Stage3', this will greatly reduce the number of running processes and consolidate all logging being fed through 8 concurrent multi-staged dedicated daemons, instead of the (per domain) daemons being used now...

I have been building this in my head for long time now, and have chosen Perl for the first 'Stage3' daemon design - later I will recode this in either C or C++ as speed and minimal resources used is paramount...

Stage3 will also be built with the RARP (Reverse Resolve) hooks needed to cope with the sheer bulk of logfiles generated in a day... A dedicated server will be built for this duty with 3-6 internal DNS engines exclusive for this purpose...

Estimated time for completion on Stage3 will be 1 to 2 months, but will be asking for volunteers within a month...

Below is the proposed server architecture coming soon and is preliminary:
TAZ:Stage1 and Stage2
SIX:Stage2 and (Stage3 (minimal))
NINE: (Stage2 (minimal)) and Stage3
ELEVEN:Stage3 only
SEVEN:dedicated core Raid 2/5 100+Gig SCSI feeder... (ummm $$$$$$$$$$$$$$$$$) http://www.aota.net/ubb/wink.gif
??HITME??:dedicated RARP and DNS for Stats

Once Stage3 is rock-solid, then all Stage1 and Stage2 domains will be upgraded as well...

--
Terra
--Statistical counter of being hit--
FutureQuest

[This message has been edited by ccTech (edited 04-02-99).]

[Aaron]

Well, I took a look at my log files, and I am wondering if it is necessary to backup the log files. It's like 14 MB worth for the last month! I don't have a Broadband connection or anything...just a dialup. That would take all night! http://www.aota.net/ubb/smile.gif Are you going to delete them or something?

Aaron

[Terra]

all archived logs in the last_month will be deleted and replaced with the 'access.199903??.gz' logfiles...

--
Terra
--RTFM==Read The First Message-- http://www.aota.net/ubb/wink.gif
FutureQuest

[Terra]

Don't stress the deletions for another day or two... I'm still writing the Stage2 rotation code, and is delayed due to higher priority issues taking precedence at the moment...

--Terra

[Terra]

Oh yeah, you think 14Mb in gzip -9 compressed files is bad, you outta see them uncompressed... http://www.aota.net/ubb/wink.gif

All my programs sure do... http://www.aota.net/ubb/biggrin.gif

Hence the vicious Beast I call STATS

--Terra

[Deb]

Ummmm TeRRa, I think your starting to babble... that's my job:P

[Boksoft]

----
SEVEN:dedicated core Raid 2/5 100+Gig SCSI feeder... (ummm $$$$$$$$$$$$$$$$$)
----

Sounds cool.....<grin>

[frankc]

Well HERE'S the dumb, stupid newbie question of the day: Whut is a .gz file and whut do you do with it (CAREFUL!)? Sorry, I don't know UNIX-ese much (yet) and didn't find any mention of this in the online FQ User Manual. I do have FastStats for offline log analysis.

Along that line, is there any way, from the FTP command line, to compress all the individual files into one for more efficient download?

Thanks, as always!

------------------
Frank

Pacesetter Signs www.pace-setter.com (http://www.pace-setter.com)
Specialists in electronic "moving message" signs since 1984!

[Justin]

I usually download the file and use WinZip or Windows Commander to unzip it - both do it with no problems (provided Commander has the plugins for it).

As for zipping them up into one file, I know you can tar them on the command line (like a zip file) but I honestly don't know how yet (something I need to learn soon http://www.aota.net/ubb/smile.gif) Try typing tar --help on the command line (Telnet) for a list of options http://www.aota.net/ubb/smile.gif

PS:

http://www.aota.net/ubb/Forum3/HTML/000176.html

http://www.aota.net/ubb/Forum10/HTML/000023.html

These might help too http://www.aota.net/ubb/biggrin.gif

------------------
Justin Nelson
FutureQuest Support

[This message has been edited by Justin (edited 04-05-99).]

[Deb]

Along that line, is there any way, from the FTP command line, to compress all the individual files into one for more efficient download?

Don't know about via FTP but via telnet you could do this with the zip command.

Via any telnet program, which may even be accesable from your browser by pointing it to telnet://yourdomain.com and typing in your username and password when promted, you could do as follows.

Type ls to see where you are and what's in there...
type cd wherever to go into the directory you want to zip up.
Once in the directory you want to zip the contents of just type zip stuff * This will copy all of the files within that directory into a file titled stuff.zip.

Because of the way the shell does filename substitution, files starting with "." are not included. To include these as well: zip stuff .* *

To zip all files in a directory to use with PKUNZIP on a PC, type zip -k stuff * This will convert UNIX names and paths to conform to MSDOS rules. You can then use PKUNZIP.EXE on a PC to unzip the files.

Type man zip to see quite a few more options http://www.aota.net/ubb/smile.gif

Deb