Find the mistakes that make crawlers ignore or misread a robots.txt file: typos, rules in the wrong place, unsupported fields, server errors and more. Each problem comes with its line number and a fix.
Or paste a robots.txt to check it before uploading