aeo.press tracks a variety of bots to help users monitor and manage automated activity on their websites. The specific bots tracked are documented in the official ai-robots-txt/ai.robots.txt project repository.
Key Details
- Tracked Bots: The list of bots monitored by aeo.press is maintained in a public JSON file, which is regularly updated by the project maintainers.
- Transparency: Users can review the current and historical list of tracked bots at any time by visiting the official repository.
- Community Contributions: The bot list is open-source, allowing contributions and updates from the community to ensure comprehensive and up-to-date tracking.
Accessing the List of Tracked Bots
To view which bots are currently tracked by aeo.press:
- Visit the ai-robots-txt/ai.robots.txt GitHub repository.
- Open the
robots.json
file. - Browse the file to see the full list of tracked bots and related details.
robots.json
Example Entry from json
{
"name": "Googlebot",
"category": "Search engine",
"description": "Google's search crawler"
}
For the most accurate and up-to-date information about which bots are tracked, always refer to the official robots.json
file in the ai-robots-txt/ai.robots.txt repository.