Internet Archive limited automated access to Wayback Machine

Internet Archive has updated its access policies for the Wayback Machine service, introducing strict restrictions on high-intensity automated traffic. The measure is aimed at protecting the infrastructure from excessive loads that led to degradation of the service's performance for regular users.

The administration of the resource acknowledged the presence of errors in the work of new filters, due to which legitimate requests are blocked. Users who have encountered false triggers of protection systems can send a request for unblocking to the address [email protected]. In the letter, it is necessary to specify the IP address or the nature of the tasks being performed, so that the support team can adjust the access rules.

The restrictions primarily affect parsers and scripts that perform thousands of requests per second. Such activity is often used to collect training datasets for AI models, which creates a critical load on the archive's servers. In the current conditions, the company is forced to prioritize access for manual users, preserving the integrity of the historical data archive.

The situation has caused active discussion in the Hacker News community, where users note the complexity of balancing data openness for researchers and the technical resilience of the platform. The changes take effect immediately and will be adjusted as feedback is received from developers and researchers using the archive's API for legitimate purposes.