User:Leemartie/sandbox

arXiv has over 2 million papers that you can download in bulk with AWS Requester Pays Buckets, but this makes it hard for web crawlers to index these papers. This article lists indexes, updated periodically by timestamp, of URLs to each paper, where the URLs are constructed from the papers found in the AWS Requester Pays Bucket.

arXiv index 3/2/2023: https://raw.githubusercontent.com/133martie/arXiv_Index/main/index.txt