# obp crawler User-agent: Nutch User-agent: NutchCVS User-agent: ParkSpider Disallow: /kml/ Disallow: /xml/ Disallow: /extensions/