Frequently Asked Questions - SEO services Thailand, search engine optimization Thailand
SEO Services Thailand
Premier SEO Services Company in Thailand
Proven Results, Affordable Pricing
Internet Marketing Experts
Frequently Asked Questions
What is a robots.txt file?
This is a small text file that grants, prevents or both, search engine robots from indexing web pages on your website. Alternatively you can use the Meta Tag "robots" to do the same thing but using the text based file is simpler.
Open a simple text file, on the first line type
User-agent: *
The * signifies all robots. You can if you wish by changing the * into a proper name prevent a specific search engine robot from indexing your website.
On the next line, type
Disallow: /anything you want/
This little file tells all search engines to index the entire site except folder "anything you want"
You can also use the robots.txt file to show the search engines the location of your sitemap simply by adding the line
Sitemap: http://www.yourwebsite.com/sitemap.xml