Data Queries - Platform Archiving

Owned by Jonathan Bellard
Jul 18, 2024
2 min read

Data Archiving for Enhanced Performance

Overview

In response to the growing datasets of our long-term clients and the observed impact on system performance, we have introduced a new data archiving feature. This functionality allows users to manage the accumulation of data from MVS projects and other areas by archiving scan data over configurable periods, improving data retrieval speed and overall platform performance.

Please note that any data within archived projects, phases, or scans will be excluded from the platform's metrics (e.g., dashboard metrics). However, this data will not be removed from the platform and can be accessed using the Archived filter available throughout the platform and on the Archived page.

Key Enhancements

  1. Configurable Archiving Settings:

  • Users can now set archiving timelines specific to each service offering within their tenant.

  • Helps manage data more effectively and maintain optimal platform performance.

  1. Improved Query Performance:

  • Limit data queries to a user-defined period (e.g., last 6 months, 12 months).

  • Reduces the time taken to calculate compliance and view affected hosts, enhancing system efficiency.

  1. Service-Specific Default Settings:

  • MVS: Archive data older than 12 months.

  • Penetration Testing, Ransomware, Red Team Assessment: Archive data older than 2 years.

image-20240712-115139.png
Data Queries Page

User Story

Users requiring daily import of scans will benefit from this feature, as it ensures that regular importing activities do not compromise the platform’s performance, maintaining speed and efficiency.

How to Use

  1. Navigate to the Settings Menu:

    • Go to the settings menu in your tenant.

  2. Select Data Queries Option:

    • Choose the Data Queries option to configure archiving settings.

  3. Adjust Archiving Timeline:

    • Set the archiving timeline according to your specific needs.

    • Choose from several predefined intervals or specify a particular number of scans.

  4. Project-Based Archiving:

    • Use the project-based option to set data to archive, allowing for greater control over individual project data management.

Manually Archive Projects/Phases and Scans

Users can manually archive projects (excluding vulnerability scanning types), phases, and scans by selecting the '...' menu option on the Projects overview page and within a project's phases and scans view.

image-20240712-120607.png
Projects Action Options

Enhancing System Efficiency

With the introduction of data archiving, we provide a scalable solution that accommodates the growing needs of our users without sacrificing performance. This feature helps maintain high system responsiveness and efficiency, even as data volumes increase.

Start using the data archiving feature today to keep your system running smoothly and efficiently!