User-Agent: *
Disallow: /download/
Disallow: *.csv
Disallow: *.pdf