Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create static and easier links to internet.nl reports #531

Open
stitch opened this issue Jul 31, 2024 · 0 comments
Open

Create static and easier links to internet.nl reports #531

stitch opened this issue Jul 31, 2024 · 0 comments

Comments

@stitch
Copy link
Collaborator

stitch commented Jul 31, 2024

This would save about 12% (and growing) of metric records in the dashboard and simplifies referring to reports by end users.

What happens

The dashboard stores data when there are changes. So when the report link changes, a new record is created. This happens every scan and this link is stored in the score + all categories. Which is 5 for web and 4 for mail. So 9 + 2 = 11.

This adds up. When comparing a normal metric with a category, there is a difference of about 400.000 records.

select count(id) from scanners_endpointgenericscan where type='internet_nl_mail_dashboard_tls'; = 642606
select count(id) from scanners_endpointgenericscan where type='internet_nl_mail_starttls_cert_domain'; = 231438

This overhead now takes up about 12% of record storage in the database and could be reduced to only changes in score. That would save the 12% and all other records in the future. This 12% is derived by the excess records divided by the total number of records in the database. That is: 4.400.000 / 37.386.598.

Proposed change

Being able to access internet.nl reports by date would eliminate this need for storage. It's pretty easy to retrieve the last report for a domain based on the date of the report. That way the links will just use the date of the scan or report, instead of a specific link each time.

For example, the next link will yield the newest report before July 7th 2024 on 13:37:42:

https://internet.nl/site/www.example.nl/2024-07-31@13:37:42/ 

As a bonus, its just as easy to have an alias for the latest report:

https://internet.nl/site/www.example.nl/latest/ 
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

No branches or pull requests

1 participant