User-agent: * Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: *.pdf Disallow: *?attachment* User-agent: SeekportBot Crawl-delay: 5