On Open Source Technologies
Your answer is to create a robots.txt file in the root of your web directory and to have the code setting given below in the file.
You can read more about Robots exclusion protocol, here
robots, robots exclusion protocol, robots.txt
Your email address will not be published. Required fields are marked *
Git: How to add an untracked file back to the repository?
Git: How to make a file not to be tracked in future commits?
How to run multiple node versions in a computer?
How to move the atom editor installable file to a different location?
How to open a file in Atom editor from a Mac terminal?