User-agent: * Disallow: /calendar/ Disallow: /papers/ Disallow: /docs/*.pdf Disallow: /docs/apps/*.pdf Allow: /docs/berk_*.pdf