Cases1 case

1 to 1 of 1

1. IL-0346 Render's routing service returned intermittent 404s for web services and static sites in Oregon

   Render2025

   Symptoms

   On 5 November 2025, some web services and static sites hosted on Render in the Oregon region answered part of their requests with 404 responses. Every newly created service in the affected clusters got 404 responses, and updates to existing services were slow to take effect.

   High error rate

   Trigger

   On 5 November 2025 Render cleaned up feature flags that no longer appeared in code, including a flag that the metadata service still read, so the metadata service went back to its older, less memory-efficient way of sending data to the routing service.

   Root cause

   Configuration change

   Component

   Cloud load balancerService discovery

   Contributing factor

   Partial rolloutNo health probesAutomation amplification

   Remediation

   • Increased the memory available to the metadata service, a change later reverted
   • Re-enabled the feature flag for the more efficient data transfer between the routing and metadata services for a time; the flag was later removed
   • Deployed the metadata service so that it no longer relied on the feature flag

   Action items

   • Enhanced monitoring of the metadata service so that this failure mode raises an alert
   • Change feature flag practice so that a flag cannot be removed while it is still being evaluated
   • Keep a routing service instance out of traffic if it never loaded state from the metadata service

   View case

By root cause1