Feature #14846

Understand the user agent issue in the logs of our website

Added by sajolida 2017-10-13 18:05:55 . Updated 2017-10-20 17:12:24 .

Status:
Resolved
Priority:
Normal
Assignee:
sajolida
Category:
Target version:
Start date:
2017-10-13
Due date:
% Done:

0%

Feature Branch:
Type of work:
Website
Blueprint:

Starter:
Affected tool:
Deliverable for:


Subtasks


Related issues

Related to Tails - Feature #14872: Use Matomo to analyze the 2017 donation campaign Resolved 2017-10-20
Related to Tails - Feature #14601: Know which ressources we would need to run Matomo on our infrastructure Rejected 2017-09-04

History

#1 Updated by sajolida 2017-10-13 18:06:48

I’ll start by hitting our website on an easily recognizable URL and search for it in our logs.

#3 Updated by sajolida 2017-10-20 17:07:15

  • related to Feature #14872: Use Matomo to analyze the 2017 donation campaign added

#4 Updated by sajolida 2017-10-20 17:12:24

  • Status changed from Confirmed to Resolved

Doing:

zgrep 'GET /home/?14846+' access.log-2017-10-14.gz

I get:

Oct 13 20:12:02 web amnesia.boum.org: 0.0.0.0 - - [13/Oct/2017:20:12:02 +0200] "GET /home/?14846+tor-browser HTTP/1.1" 200 16102 "-" "Mozilla/5.0 (Windows NT 6.1; rv:52.0) Gecko/20100101 Firefox/52.0" 0 tails.boum.org
Oct 13 20:12:15 web amnesia.boum.org: 0.0.0.0 - - [13/Oct/2017:20:12:15 +0200] "GET /home/?14846+wget HTTP/1.1" 200 58982 "-" "Wget/1.18 (linux-gnu)" 0 tails.boum.org
Oct 13 20:13:33 web amnesia.boum.org: 0.0.0.0 - - [13/Oct/2017:20:13:33 +0200] "GET /home/?14846+firefox HTTP/1.1" 200 16102 "-" "Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Firefox/52.0" 0 tails.boum.org
Oct 13 20:15:31 web amnesia.boum.org: 0.0.0.0 - - [13/Oct/2017:20:15:31 +0200] "GET /home/?14846+chromium HTTP/1.1" 200 16102 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/61.0.3163.100 Safari/537.36" 0 tails.boum.org

Reading https://en.wikipedia.org/wiki/User_agent#Format_for_human-operated_web_browsers, I understand that:

  • Mozilla/5.0 doesn’t mean that Mozilla is the browser vendor but is some compatibility thingie dating from the 90’s.
  • Both Chrome and Safari use AppleWebKit later on in the string.

Quick conclusions:

  • Making sense from the user-agent string requires complexe parsing that we shouldn’t try to do manually.
  • There is no bug in our logs.

Next steps:

  • If we want to do this manually in the future again, look for a library to parse user-agent strings. Maybe there’s something like this in Piwik.
  • Use Piwik to analyze the next donation campaign → Feature #14872.

#5 Updated by sajolida 2017-10-26 15:45:20

  • related to Feature #14601: Know which ressources we would need to run Matomo on our infrastructure added