FutureQuest Domains -- High Load

[Terra]

For the last 1 hour, FutureQuest has been experiencing HIGH system load, due to some new log rotation methods being implemented...

The new rotation program is still in Beta testing and a full rollout is expected in 2 weeks...

If you would like to help us Beta test this, please contact Beta@FutureQuest.net... It will *not* affect your current domain logs...

The problem has now been isolated and repaired... Our apologizes if this affected your domain...

Terra
System Administrator

--sometimes things that are to make ones life easier, only make them more difficult--

[Terra]

Update: Project Stage2

This new method of 'log rotation' was an effort to minimize the nightly processing of stats, and to allow our customers a more efficient method of downloading their raw log files...

All domains logfiles are contained in the "logs_web" directory... They are now split/rotated at midnight and timestamped, the previous months logs are moved into a folder stamped e.g. "199810", and compressed... This has increased our stats processing efficiency by over 800%, as we do not have to 'reverse resolve' the entire current months logs...

We have begun rollout to over 90% of the domains and should have the rest implemented within the week... The rollout has been happening between (3:30am - 5:00am) EST every morning... We do these manually, as there is no best automated way to do the rollout properly... The Apache server has been going through frequent 'rehash' as well, which resets and implements the new configuration for each individual domain...

FutureQuest has been growing tremendously, and this is one of the many steps we are doing to accomodate this growth...

Respectfully,
Andrew Gillespie
Systems Administrator
FutureQuest.net