User-agent: *
Disallow: *.pdf  

User-agent: *
Disallow: /*/*/robo/

User-agent: AhrefsBot 
Disallow: /