In 2025 bots (we used to call them spiders) from LLM companies are not just visiting your web-site, they are reading absolutely everything, they are exploiting every possible field with every possible argument, constantly. Their IP-adresses use more traffic than all human visitors if not to ban them. They are totally ignoring robots.txt and mimicring under human activity.
Go and take some legal action against them. Go and damage their reputation. Of course you are able to do these measures.
the thieves already steal with impunity, they have no need for a license and have no concern for reputational harm. the politicians will protect them as they were paid to do.
Ask HN: Could we create a license to make AI companies pay for your content?
1 points by lilerjee 12 hours ago | 3 comments
Comments
In 2025 bots (we used to call them spiders) from LLM companies are not just visiting your web-site, they are reading absolutely everything, they are exploiting every possible field with every possible argument, constantly. Their IP-adresses use more traffic than all human visitors if not to ban them. They are totally ignoring robots.txt and mimicring under human activity.
Go and take some legal action against them. Go and damage their reputation. Of course you are able to do these measures.