Resolved -
After confirming the fix internally, it has been deployed globally and there should no longer be any issues.
Please note that if you onboarded a new log source after 18:30 UTC on April 25, logs will be missing from the time of onboarding until now.
We will continue to monitor to ensure there are no further problems.
Apr 25, 19:27 PDT
Update -
We have identified the root cause of the issue and have begun deploying a fix internally to verify that it resolves the problem.
In the meantime, please refrain from onboarding new log sources until we deploy the fix and resolve this incident.
We will provide an update again once we confirm the fix and deploy it globally.
Apr 25, 14:35 PDT
Identified -
Panther has identified an issue resulting in failures in the following areas: - Lookup table updates - Log source onboarding - Scheduled query runs - Cloud security monitoring
You may receive alerts related to this issue.
We will update this incident as our investigation and remediation process continues.
Apr 25, 13:43 PDT
Resolved -
We have deployed a fix, and the previously configured raw event filters should be working again. (This issue did not affect normalized event filters.) We will continue to monitor the issue to ensure there are no further problems. Once again, you will not be charged for the additional ingest caused by this incident.
If you are still experiencing issues, please submit a ticket to the support team for assistance.
Apr 19, 12:25 PDT
Update -
We are verifying a fix that will automatically reapply filters you previously configured, which were removed due to this incident. Once the fix has been applied, we will update the status page.
Apr 19, 08:51 PDT
Identified -
Panther has identified an issue affecting data ingestion filters. If you have configured log filtering within Panther, you may be impacted. We are currently working on a fix for the issue. There will not be any costs associated with any additional ingest from the log filter failure.
We will update this incident as our investigation and remediation process continues.
Apr 19, 07:48 PDT