User-agent: Wget Disallow: /cdlisearch/ Disallow: /cdli/cdlisearch/ Disallow: /wiki/ Disallow: /cdli/wiki/ Disallow: /*.php$ User-agent: * Disallow: /dl/ Disallow: /ltd/ Disallow: /js/ Disallow: /workshop/ Disallow: /staff/englund/