Pregenerate pages: serverload & bandwidth...
I'm currently working on a site on which each and every page is generated through datebase-access, ranging from simple selects to extensive searches, also changing over time (counters, ratings etc.).
On some part in time, it might become handy to pregenerate the pages, to reduce server-load and speed up page-access (no waiting time for query-executing).
Using mod_rewrite, wget, cron etc. it is easily to grab these pages each XX minutes/hours or so (depending upon which page), and redirect normal browsers to the fixed pages.
However, a few questions are left for me:
a) Is bandwidth from local accesses calculated in the monthly plan ? As it will go through apache, the accesses will probably appear in the logfiles (correct me if I'm wrong), but no bytes will ever leave the NOC, I hope. In worst case, every byte gets double-counted, as being outbound AND inbound traffic.
b) On which time-frame it is 'allowed' to fire of cron-jobs ? I have some pages that still will be entirely dynamic, while other might need to be updated once every 15 minutes. I can tell wget to be very relaxing (one page every x seconds).