Robots.txt Generator

Default - All Robots are

Crawl-Delay

Sitemap (leave blank if you don't have)

Search Robots

Google

Google Image

Google Mobile

MSN Search

Yahoo

Yahoo MM

Yahoo Blogs

Ask/Teoma

GigaBlast

DMOZ Checker

Nutch

Alexa/Wayback

Baidu

Naver

MSN PicSearch

Restricted Directories