goaccess: Duplicated request entries on "Requested Files" panel
Hello! I’m currently trying to automate the report generation for a project which contains several deployed nodes, these nodes write to different logs, and I’m generating the report for those logs. Each of these logs relates to a day of accesses and they are rotated daily around 3AM.
# Concatenate log files into a single file
zcat -f $LOGS | sort -k $SORT > $PARSED_LOG
# Process log variations
bash $BASEDIR/process-log-variations.sh $PARSED_LOG
# Import log data into BTREE databases
goaccess --process-and-exit -p $conf $PARSED_LOG
# Generate HTML from BTREE databases
goaccess -p $conf -o $REPDIR/report.html
My script receives several log files and concatenates them together, sorts them by the date field, and then using SED removes variation fields, such as IDs, Hashes, and others from the requests URL replacing them with the word “$var”. A single log file is generated from this process which I then feed to GoAcess, first persisting the data and then updating the report HTML with data from the last log file.
The problem is that, after loading 4/5 days of logs, in the “Requested Files” panel, the behavior in the following image happens:
As you can see, there are several “GET /api/auth/token” when only one should be appearing. Does anyone know why this happen? Is it a bug or am I doing something wrong?
About this issue
- Original URL
- State: closed
- Created 4 years ago
- Comments: 56 (38 by maintainers)
Thank you @0bi-w6n-K3nobi I cannot do it right now, but I’ll test it out tomorrow and I’ll comment the results here!
@rtista, please, try to get last version from Github. I had similar problem that was reported in issue #1933. I believe the patch a6e1825 solved all.