2. Checks Google/SO and no answer
3. Figures it out themselves
4. Blogs about that
5. AIs that search pick it up first but eventually it ends up in training.
As well as AI teams paying for content for training.
Some studies show that the number of sites with AI blockers at their robots.txt has dramatically increased!
Right now, some companies are trying to ignore robots.txt, but after regulations...
2. Checks Google/SO and no answer
3. Figures it out themselves
4. Blogs about that
5. AIs that search pick it up first but eventually it ends up in training.
As well as AI teams paying for content for training.