Skip to content

About our crawler

OpportunityHubBot/1.0 is the crawler that collects public opportunity announcements for OpportunityHub.

How it behaves

  • It obeys robots.txt, checked at most once a day, under the user agent OpportunityHubBot or *.
  • It makes at most one request every 2 seconds to any one site, and runs twice a day.
  • It reads only listing pages, feeds and public APIs that we have added by hand.
  • It stops for 7 days when a site answers with HTTP 403 or 429.

What we publish

We show the title, the key facts and deadline, our own summary of 60 words or fewer, and a prominent link to your page. We never republish your full text.

Opting out

Add this to your robots.txt:

User-agent: OpportunityHubBot
Disallow: /

Or write to info@opportunityhub.ng and we will remove your site from our sources.