I consider myself to be a bit of a statistics junkie. Something about looking through logs, traffic reports, graphs, trends, etc. gets my blood pumping. For the longest time I've always been a fan of Awstats as my web analytics package of choice and before that was Webalizer. A while back I took Mint for a spin, and I loved it.
Finally, I've succumbed to the notion that letting google track my web statistics wasn't that bad of an idea, so I've added Google Analytics to my cache of analysis tools. While I've only been using Google Analytics for a few days, the system looks pretty neat, but I don't yet have enough data so see trends and fully leverage all of it's options.
Lastly, for the hardcore data nerds like myself, there is Splunk. Now while splunk isn't an analysis tool in and of itself, it does have some really neat searching and reporting features that you can customize into your own tools. I LOVE Splunk! It is like putting the power of a massive search engine into the palms of your hands, and letting your log data trickle through leaving all of the pretty shineys for you to pick out.
Here is how I would classify the above applications:
For basic website reporting, if you just want to get a rough idea of what the key components of your website are, and if your website is stored on a single server... then Awstats and Webalizer are what you want. Awstats is the more powerful of the two, and will give you a better idea of the who, what, where...
For more in-depth reporting where you need or want to know more than just how many people are visiting your site, that is where Mint and Google Analytics shine. Both Mint and Google Analytics are javascript based trackers; they execute a snippet of code to gather data about your users. This is very important because it allows them to figure out where your visitors came from, where they are going, how long they stayed on your site, and several other metrics. Thus both of these applications are able to provide some in-depth analysis of your traffic patterns, and be able to provide you with purposeful information about your users, rather than just numbers.
Now the part that makes Mint and Google Analytics so powerful (the whole javascript tracking thing), also is a weakness. Awstats and Webalizer analyze the actual webserver logs, and capture data about file accesses, byte usage, error reports; things which cannot be easily tracked via javascript. This is why I personally use a combination of programs to analyze my traffic.
But where does Splunk come into the picture with all of this? Well, Splunk is a search engine for log files, and has powerful data extraction and reporting capabilities. While you can target splunk to index and absorb all of your web data, and you can pull reports like Awstats and Webalizer based on those server logs... it really shines as an investigation tool.
I use splunk as my "secret weapon" when trying to track down issues and solve mysteries. By going through the various reporting tools, I can spot an issue with a certain user (IP). Then I go to Splunk, and I can rapidly find all instances of that IP in the logs, and scale down my reports to just that user. This leads me to another clue about a particular file, which I then use splunk to switch to reports for that single file. Through simple logic and a few select queries, I can rapidly track down the problem and solve it.
I guess my point is, there isn't one be-all super analytics package out there. Just a bunch of tools, each with a similar purpose. The key is to use all of the tools in the way they were meant to be used, and to use them all together.
Finally, I've succumbed to the notion that letting google track my web statistics wasn't that bad of an idea, so I've added Google Analytics to my cache of analysis tools. While I've only been using Google Analytics for a few days, the system looks pretty neat, but I don't yet have enough data so see trends and fully leverage all of it's options.
Lastly, for the hardcore data nerds like myself, there is Splunk. Now while splunk isn't an analysis tool in and of itself, it does have some really neat searching and reporting features that you can customize into your own tools. I LOVE Splunk! It is like putting the power of a massive search engine into the palms of your hands, and letting your log data trickle through leaving all of the pretty shineys for you to pick out.
Here is how I would classify the above applications:
For basic website reporting, if you just want to get a rough idea of what the key components of your website are, and if your website is stored on a single server... then Awstats and Webalizer are what you want. Awstats is the more powerful of the two, and will give you a better idea of the who, what, where...
For more in-depth reporting where you need or want to know more than just how many people are visiting your site, that is where Mint and Google Analytics shine. Both Mint and Google Analytics are javascript based trackers; they execute a snippet of code to gather data about your users. This is very important because it allows them to figure out where your visitors came from, where they are going, how long they stayed on your site, and several other metrics. Thus both of these applications are able to provide some in-depth analysis of your traffic patterns, and be able to provide you with purposeful information about your users, rather than just numbers.
Now the part that makes Mint and Google Analytics so powerful (the whole javascript tracking thing), also is a weakness. Awstats and Webalizer analyze the actual webserver logs, and capture data about file accesses, byte usage, error reports; things which cannot be easily tracked via javascript. This is why I personally use a combination of programs to analyze my traffic.
But where does Splunk come into the picture with all of this? Well, Splunk is a search engine for log files, and has powerful data extraction and reporting capabilities. While you can target splunk to index and absorb all of your web data, and you can pull reports like Awstats and Webalizer based on those server logs... it really shines as an investigation tool.
I use splunk as my "secret weapon" when trying to track down issues and solve mysteries. By going through the various reporting tools, I can spot an issue with a certain user (IP). Then I go to Splunk, and I can rapidly find all instances of that IP in the logs, and scale down my reports to just that user. This leads me to another clue about a particular file, which I then use splunk to switch to reports for that single file. Through simple logic and a few select queries, I can rapidly track down the problem and solve it.
I guess my point is, there isn't one be-all super analytics package out there. Just a bunch of tools, each with a similar purpose. The key is to use all of the tools in the way they were meant to be used, and to use them all together.
Leave a comment