# robots.txt for http://www.board.gen.tr User-agent: * #Crawl-delay: 100 Disallow: /?ref= Disallow: /*ref=