Ask HN: Non-Malicious Bots
When I ask an AI to load a link, sometimes it can load it, and sometimes it can't (and I have to copy paste the text myself). Sometimes it can load it even when it has the "checking if you're a malicious bot". I'm wondering how that works. Isn't AI scraper traffic literally the thing that page is designed to stop? Do they let Google, OpenAI etc. user agents through? Or do those companies just have a bunch of guys in a warehouse somewhere with Chrome open, forwarding the AI's HTTP reque
阅读原始来源
来源记录
指标快照
points · 1 votes
2026-11-07 13:45:32.660Z
cumulative since publication
研究分析
用户报告的问题
来源描述：When I ask an AI to load a link, sometimes it can load it, and sometimes it can't (and I have to copy paste the text myself). Sometimes it can load it even when it has the "checking if you're a malicious bot". I'm wondering how that works. Isn't AI scraper traffic literally the thing that page is designed to stop? Do they let Google, OpenAI etc. user agents through? Or do those companies just have a bunch of guys in a warehouse somewhere with Chrome open, forwarding the AI's HTTP reque
频次与替代方案
记录作者：andai。 来源票数: 1 votes (2026年11月7日 UTC; cumulative since publication) 可供比较的近期同类记录：“Ask HN: Is anyone running multi/always-on agents that don't cost a fortune?” (Hacker News, 2026年11月6日)；“Ask HN: Engineers Focus Using AI” (Hacker News, 2026年11月6日)。主题相近仅用于导航，未核验其是否属于同一需求或独立证据。
需求判断
将报告的任务或障碍作为访谈线索。功能请求、抱怨或替代方案搜索本身并不能确定预算负责人或付费意愿。
商业证据缺口
待补证据：受影响的独立用户、重复发生场景、当前绕行方案、实际时间或金钱成本、采购权限，以及对具体报价的响应。
需求验证动作
按相同任务整理原始问题，去重作者和转载；核对今天如何处理、实际成本多少，再测试明确报价后判断付费需求。