Blocking LLM Crawlers Without Javascript
Postedabout 2 months agoActiveabout 2 months ago
owl.isTechstoryHigh profile
calmmixed
Debate
70/100
LLM CrawlersWeb ScrapingRobot.txt
Key topics
LLM Crawlers
Web Scraping
Robot.txt
The article discusses a method to block LLM crawlers without using JavaScript, sparking a discussion on the effectiveness and potential workarounds of this approach.
Snapshot generated from the HN discussion
Discussion Activity
Light discussionFirst comment
1d
Peak period
1
24-26h
Avg / period
1
Comment distribution2 data points
Loading chart...
Based on 2 loaded comments
Key moments
- 01Story posted
Nov 15, 2025 at 6:30 PM EST
about 2 months ago
Step 01 - 02First comment
Nov 16, 2025 at 8:09 PM EST
1d after posting
Step 02 - 03Peak activity
1 comments in 24-26h
Hottest window of the conversation
Step 03 - 04Latest activity
Nov 16, 2025 at 8:34 PM EST
about 2 months ago
Step 04
Generating AI Summary...
Analyzing up to 500 comments to identify key contributors and discussion patterns
ID: 45941441Type: storyLast synced: 11/20/2025, 4:35:27 PM
Want the full context?
Jump to the original sources
Read the primary article or dive into the live Hacker News thread when you're ready.
98 more comments available on Hacker News