Data Analytics
Panther's Data Analytics allow for freely searching collected and normalized log data using SQL via AWS Athena and Snowflake.
This is necessary for investigations, baselining behaviors, writing rules, and generating analytics on logs in the context of days, weeks, or months of data.
Panther performs data normalization and processing to store the log data in a standard and efficient way in S3.
Additionally, other applications that can read data from S3 can access this data for search, business intelligence, redundancy, or anything else.
The following databases are available:
Database | Description |
| All data sent via Log Analysis, organized by log type |
| Events for all triggered alerts, organized by log type |
| Events for all errors from rules (e.g., Python tracebacks) |
| Standardized fields across all logs and rule matches |
| Panther cloud security scanning data |
| Panther data loader self-monitoring (Snowflake Only) |
This is the main Panther database, holding parsed records of all the onboarded log types. The number and size of the tables here will vary depending on the sources you onboard. See a few sample queries here​
For every onboarded source that appears in a rule match, Panther creates a row in the corresponding table in the rule matches database. This allows for an easy historical view over what rules are firing and why.
Sometimes, due to either incorrect code or permissions issues, a rule returns an error, and does not complete its run successfully. The rule errors tables keep track of any such events, for easy debugging.
The Panther team has worked hard to bring together common data fields that enable users to do searches across multiple data sources at once. These are exposed here as virtual tables or views.
The following views are available:
View | Description |
| Search all data (logs, rule matches and errors) |
| Search all log data |
| Search all cloud security data |
| Search all events matching rules |
| Search all events causing rule errors |
The Panther Cloud Security Database stores AWS configuration information and changes detected from the scans on the monitored environments.
Panther Monitor contains information about the data load process into Panther's Snowflake database itself. See the Snowflake Backend section for more details on this.
Panther Data Analytics is still in its early phases! For upcoming releases, we have planned:
Scheduled searches
Search optimization
Pre-canned searches
