# robots.txt for http://www.newsweb.no/ User-agent: * Disallow: /newspoint/ Disallow: /css/ Disallow: /newsweb/css/ Disallow: /script/ Disallow: /newsweb/script/ Disallow: /images/ Disallow: /newsweb/images/ Disallow: /newsweb/attachment? Disallow: /newsweb/attachment.do Disallow: /newsweb/attachment.do? Crawl-delay: 10 Visit-time: 0030-0500