User Tools

Site Tools


apache:logs:extract_all_user_agents_from_apache_logs

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Next revision
Previous revision
apache:logs:extract_all_user_agents_from_apache_logs [2023/07/17 12:10] – created peterapache:logs:extract_all_user_agents_from_apache_logs [2023/07/17 12:12] (current) peter
Line 5: Line 5:
 </code> </code>
  
-(where “test.log” is the access logfile you want to analyse).+  * where “test.log” is the access logfile to analyze.
  
 Returns Returns
Line 19: Line 19:
 </code> </code>
  
-The first number (bolded) is the amount of times this spider/crawler/user agent/ has accessed your site. Beware, these are not all crawlers, as the data is intermixed with actual human user traffic and other useful traffic. 
  
 <WRAP info> <WRAP info>
-In my example above, you see that the “Facebookexternalhit” user agent accessed the site 390,477 times per month. That is roughly 541x per hour. Excessive. On the kill list, you go!+**NOTE:**  The first number is the amount of times this spider/crawler/user agent/ has accessed the site. 
 + 
 +  * Beware, these are not all crawlers, as the data is intermixed with actual human user traffic and other useful traffic. 
 + 
 + 
 +In the example above, notice that the “Facebookexternalhit” user agent accessed the site 390,477 times per month. 
 + 
 +  * That is roughly 541x per hour. Excessive!!!. 
 +  * On the kill list, you go!
 </WRAP> </WRAP>
apache/logs/extract_all_user_agents_from_apache_logs.1689595848.txt.gz · Last modified: 2023/07/17 12:10 by peter

Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki