Implement stats accumulation from GALILEO Search

Daily Download

Download raw stats files from galftp for

• 1. Login
• 2. Links
• 3. Search

Daily Accumulation

Read raw stats files from database and accumulate stats for

• 1. Login
• 2. Links
• 3. Search (?)

In addition, add daily rows for every active institution for every active resource they have access to.

Monthly Accumulation

Read Daily stats files from database and accumulate stats for

• 1. Login
• 2. Links
• 3. Search (?)

Reports

Simple csv exports where you can choose

• 1. Institution (one)
• 2. Month (one)

This will allow us to compare the monthly (and daily?) accumulated data with the snapshots, e.g.,

https://stats.galileo.usg.edu/snapshots/2022/08/uga1/report.html

Trial run

Changed my development system to read production galftp files.

• 202008 (first full month for galileo_search) link and login (and probably search) counted twice
• 202009 correct
• 202010
• 202011
• 202012
• 202101
• 202102
• 202103
• 202104
• 202105
• 202106
• 202107
• 202108 (more stats in admin than in prod--missing files restored maybe)
• 202109
• 202110
• 202111 (more stats in admin than in prod--missing files restored maybe)
• 202112 (a little more stats in admin than in prod--missing files restored maybe)
• 202201
• 202202
• 202203 (more stats in admin than in prod--missing files restored maybe)
• 202204
• 202205 (more stats in admin than in prod--missing files restored maybe)
• 202206 (more stats in admin than in prod--missing files restored maybe)
• 202207
• 202208 (a little more stats in admin than in prod--missing files restored maybe)
• 202209 (present month)

Pre 202008 stats

• Raw Stats? (probably not)
• Daily Stats? (worth the effort?--not sure)
• Monthly Stats (definitely)