When a search engine crawler comes to Wyandotte, it will look for a special file on the Website. That file is called robots.txt and it tells the search engine spider, which Webpages of Wyandotte should be indexed and which Webpages should be ignored.
The robots.txt file is a simple text file (no HTML), that must be placed in your root directory, for example:
Use the following content for your robots.txt file if you want to allow all search engine spiders to index all files of your Web site:
If you don't want search engines to index any file of your Web site, use the following:
Do not know what to do? Copy and paste this code in a txt archive called "robots.txt" and upload it to Wyandotte root directory:
- Quick Links
- Website screenshot Website name and weight Bounce Percentage Website IP Website worth Domain Age Google Pagerank™ Alexa Traffic Rank™ Google™ indexed pages Page Speed Bing™ indexed pages Site Advisor Linkgraph DMOZ directory listing Yahoo™ directory listing Friendly URL Title tag longitude Meta tags Robots.txt archive Google Analytics™ Semantic tags Image atributes Visitors come from Website HeatMap W3C Standard SEO Tunning Rating