A training crawler is a customer with a budget. Put the offer where a program will find it: robots.txt, a 402 with an x402 offer, a sales page at /crawl. @profullstack/x402-gateway does that in one middleware, it is on 38 sites, and tonight the first dollar cleared.
Read the original (By Anthony Ettinger, via Chovy's Blog): https://dev.profullstack.com/~anthony/blog/043-post.html
