We are in the process of migrating this forum. A new space will be available soon. We are sorry for the inconvenience.

What is robots.txt used for?


danielnash
15/03/2016, 06h48
I learnt here about sitemap.xml file. Now I'm little bit confused for what is robots.txt used for?

Please guys clear it.