This API fetches the robots.txt file and sitemaps of a given domain.

Robots and Sitemaps Fetcher API

Retrieves the robots.txt rule and list of sitemap and content for a specified Domain.

The domain to fetch the robots.txt and sitemap information from. It must use https:// schema

Successful response with robots.txt and sitemaps data

Bad Request - The request was invalid, details in the error message.

Unauthorized - Authentication credentials were missing or incorrect.

Internal Server Error - We had a problem with our server. Try again later.