To block all bots from accessing your website, create a robots.txt file with the following content:
User-agent: *
Disallow: /
To block all bots from accessing a specific folder, apply the code as follows:
User-agent: *
Disallow: /folder/
Replace folder with the actual name of your folder.
Comments
Please sign in to leave a comment.