Your resource for web content, online publishing
and the distribution of digital products.
S M T W T F S
 
 
 
 
 
1
 
2
 
3
 
4
 
5
 
6
 
7
 
8
 
9
 
 
 
 
 
 
 
 
 
 
 
20
 
21
 
22
 
23
 
24
 
25
 
26
 
27
 
28
 
29
 
30
 

AI crawlers are hammering sites and nearly taking them offline

Tags: web
DATE POSTED:October 2, 2024
Kyle Wiens recognized something was wrong in July when his staff at iFixit began receiving alerts about high traffic on their cellphones. They also were able to identify what had caused the issue: It turned out to be a web crawler sent out into the world by Anthropic, makers of the Claude chatbot, to try and gather training data. Source: AI crawlers are hammering sites and nearly taking them offline
Tags: web