A Chrome extension to view the robots.txt file of the current website.
This extension allows you to quickly and easily view the robots.txt file of any website you're visiting. The robots.txt file provides instructions to web robots, such as search engine crawlers, about which parts of the site should not be processed or crawled.
The extension displays the contents of the robots.txt file in a clean, code editor-like interface with line numbers for easy readability.
- One-click access: View the
robots.txtfile with a single click from the Chrome toolbar. - Code editor-like interface: Presents the content in a readable format with line numbers.
can directly install from here: https://chromewebstore.google.com/detail/odccpphhdfbkimiobfmjifeomhbejjbd/
Or
- Download the extension files from this repository.
- Open Chrome and navigate to
chrome://extensions/. - Enable "Developer mode" in the top right corner.
- Click "Load unpacked" and select the directory where you extracted the extension files.
- Install the extension in Chrome.
- Navigate to any website.
- Click the extension icon in the Chrome toolbar.
- The popup will display the
robots.txtcontent for the current domain.
Contributions are welcome! If you have any suggestions or find any issues, please create a pull request or open an issue.
If you find this extension helpful, please consider supporting the developer through the links provided in the extension's footer.