★ Liked https://werd.io/2023/licensing-site-content-using-a-text-file
Ben Werdmuller
post from Licensing site content using a text file
Dare Obasanjo, over on Mastodon:Robots.txt needs an update for the 2020s. Instead of just saying what content can be indexed, it should also grant rights.Like crawl my site only to provide search results not train your LLM.Call it license.txt.The robots.txt standard allows a …
🔗 • by