I don't get why the AI scrapers need to scrape the same sites and pages over and... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		DanOpcode 5 days ago \| parent \| context \| favorite \| on: We can't have nice things because of AI scrapers I don't get why the AI scrapers need to scrape the same sites and pages over and over again.

kermatt 5 days ago [–]

Because the scrapers are poorly written. Efficiency is not a concern for them.

DanOpcode 5 days ago | [–]

Feels like parasites who are killing their hosts by DDOSing them to death

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact