FogBugz: Cases are not visible in the filters. "There was a problem with your search string!"

Incident Report for IgniteTech

Resolved

As of 08:30 UTC, we implemented a potential solution for the remaining few customers who were impacted by the FogBugz searching issue. We have completed the re-indexing process, and we can no longer reproduce the issue identified.

We apologize for any inconvenience or difficulty you may have experienced as a result of this issue.
Posted Apr 12, 2023 - 08:36 UTC

Update

Reindexing is completed and operations are back to normal for the majority of the customers.

We're aware that some users are still experiencing issues with custom filters after reindexing, and our development team is currently working to address those as soon as possible.

We'll keep you updated on any further developments, and we apologize for any inconvenience or difficulty you may have experienced as a result of this issue.
Posted Mar 20, 2023 - 10:27 UTC

Update

We have received positive feedback from customers after the index rebuild and backfill operation has been completed for their specific environments. We're aware that some users are experiencing issues with custom filters after reindexing, and our development team is currently working to address those as soon as possible.

Please note that the reindexing is still ongoing; we appreciate your patience as we work to complete this process. We'll keep you updated on any further developments, and we apologize for any inconvenience this may cause in the meantime.
Posted Mar 17, 2023 - 12:49 UTC

Update

The ElasticSearch index rebuild and the backfill of historical case data are still ongoing, as the previous ETA was rather underestimated.

We deeply regret and apologize for the inconvenience. We will provide new updates as they become available.
Posted Mar 17, 2023 - 08:30 UTC

Update

We are now working on rebuilding the Elasticsearch indices along with a complete backfill operation to cover historical data with the assistance of our Infrastructure and Development Teams. Considering the magnitude of the data, this operation is expected to last a few hours.

We deeply regret and apologize for the inconvenience. We will provide new updates as they become available.
Posted Mar 16, 2023 - 12:36 UTC

Identified

As of 10AM UTC, we identified an issue with the ElasticSearch backend component that causes the current search/case visibility issues.

We are investigating the issue and will provide further updates as they become available.
Posted Mar 16, 2023 - 10:23 UTC

Update

We are continuing to investigate this issue.
Posted Mar 16, 2023 - 07:57 UTC

Investigating

We are currently investigating the issue of cases not being visible and are working to identify the source of the issue reported.

We will provide further updates as they become available.
Posted Mar 16, 2023 - 07:53 UTC
This incident affected: FogBugz (Cases/Case History).