Skip to content

Conversation

@cdrini
Copy link
Collaborator

@cdrini cdrini commented Sep 11, 2025

Closes #

Technical

Testing

Screenshot

Stakeholders

@cdrini cdrini force-pushed the fix/nginx-bot-logger branch from a0685fd to 66bfa0e Compare September 11, 2025 17:59
@cdrini cdrini changed the title Fix bot moitoring 'other' category Fix bot monitoring 'other' category Sep 11, 2025
@cdrini cdrini added the Patch Deployed This PR has been deployed to production independently, outside of the regular deploy cycle. label Sep 11, 2025
@mekarpeles mekarpeles marked this pull request as ready for review September 11, 2025 19:25
@Copilot Copilot AI review requested due to automatic review settings September 11, 2025 19:25
@mekarpeles mekarpeles merged commit 8ce458a into internetarchive:master Sep 11, 2025
4 checks passed
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR fixes the bot monitoring system's categorization of 'other' bot traffic by correcting the filtering logic used to count different types of bot traffic.

  • Replaces obfi_top_bots -v with obfi_grep_bots -v in the OTHER_BOTS_COUNT calculation
  • Adds obfi_grep_bots -v filtering to the NON_BOT_TRAFFIC_COUNT calculation
  • Updates test expectations to reflect the corrected counting logic

Reviewed Changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated 1 comment.

File Description
scripts/monitoring/utils.sh Updates bot traffic filtering logic to use consistent grep function
scripts/monitoring/tests/test_utils_sh.py Updates test expectations and adds FIXME comment about double counting

Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.

@mekarpeles
Copy link
Member

Confirmed the graphs now show the correct values on grafana.

@cdrini cdrini deleted the fix/nginx-bot-logger branch September 11, 2025 21:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Patch Deployed This PR has been deployed to production independently, outside of the regular deploy cycle.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants