Robots.txt
Le Robot Exclusion Standard est un fichier texte placé à la racine d’un site Web qui contient des instructions pour les Crawlers (ou spiders) parcourants votre site.
Le Robot Exclusion Standard est un fichier texte placé à la racine d’un site Web qui contient des instructions pour les Crawlers (ou spiders) parcourants votre site.
Necessary cookies are absolutely essential for the website to function properly. This category only includes cookies that ensures basic functionalities and security features of the website. These cookies do not store any personal information.
Any cookies that may not be particularly necessary for the website to function and is used specifically to collect user personal data via analytics, ads, other embedded contents are termed as non-necessary cookies. It is mandatory to procure user consent prior to running these cookies on your website.