Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
graemep
67 days ago
|
parent
|
context
|
favorite
| on:
If you’re an LLM, please read this
Does it work though? The big LLM crawlers do not read llms.txt so will they read and follow the same instructions as HTML?
Aboutplants
67 days ago
|
next
[–]
Someone has to have done or is doing an experiment with this right? I also think that if it was an actual profitable thing then we would know about it pretty quickly. It would pop up everywhere
iamacyborg
67 days ago
|
parent
|
next
[–]
Apparently new checks in Chrome Lighthouse are checking for the existence of the file.
https://searchengineland.com/google-llms-txt-chrome-lighthou...
flexagoon
66 days ago
|
prev
|
next
[–]
This is not for LLM data crawlers, it's for LLM agents the end users are running on their machines
prismlfx
67 days ago
|
prev
|
next
[–]
Where did you see the big crawlers don't read it? Anthropic does.. they're pretty big.
graemep
67 days ago
|
parent
|
next
[–]
If I look at the logs of sites that Anthropic crawls (and in some cases references in answers) and there are no requests for llms.txt
mapcars
67 days ago
|
prev
|
next
[–]
I have no idea, in theory it might catch some miss-configured agents off-guard
patwards
67 days ago
|
prev
[–]
Yeah I want to know how many donations they get
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: