Web Log Filter is a helper utility for people who have huge (Apache) web log files, over a gigabyte in size, and want to be able to analyze these logs in standard web log analysis tools. Web Log Filter runs simple scripts that will rip through a log file at blazing speed and extract just the lines you care about (discarding the rest) and create one or more new log files, which are smaller and more manageable. If you've ever tried loading a 5gb log file into a standard desktop web log analysis program you know it can be an extremely painful process. Many web log analysis programs will simply crash if you try to load such a large web log file. Other will simply churn away for 60 minutes and use up your entire system memory and hard drive space, and then run so slowly as to make you want to slit your wrists.
Comments