User-agent: *
Disallow: /docs/
Request-rate: 1/60 # maximum rate is one page every 60 seconds