Free tool · Technical SEO
Test your robots.txt rules
See which paths are allowed or blocked for each crawler.
Fix this with Rankavia. Rankavia has a safe robots.txt editor.
Frequently asked questions
Does robots.txt stop indexing?
No. It stops crawling. Use a noindex tag to keep a page out of search.
Updated on

