RelaceHorizon
RelaceHorizon is the regulatory horizon scanner of Relace, a compliance platform for financial services firms. It reads the publications of financial regulators and government bodies, so that compliance teams learn of new rules, consultations and guidance that apply to them.
What it fetches
- RSS and Atom feeds, and news or publication listings, of official sources only.
- The publication pages those feeds and listings link to. It does not follow other links, and it does not fetch PDFs or other documents.
- It runs once a week, plus occasional runs started by hand. A page it read in the last 36 hours is not fetched again.
- The pages of one feed or listing are fetched one after another, so a site sees at most one request at a time for each of its feeds we read.
robots.txt
It reads each site's /robots.txt before fetching from it and obeys it (RFC 9309). It follows a group for the product token RelaceHorizon, or else the group for all agents. A path that robots.txt disallows is not fetched. If robots.txt cannot be read because of a server or network error, nothing on that site is fetched.
How to recognise it
- User-Agent: RelaceHorizon/1.0 (+https://app.withrelace.com/bots/relace-horizon)
- Every request is signed with Web Bot Auth (HTTP Message Signatures, RFC 9421). The Signature-Agent header names https://app.withrelace.com, and the public key is at https://app.withrelace.com/.well-known/http-message-signatures-directory.
- It runs on Google Cloud in europe-west4 and has no fixed IP address.
Contact
To ask us to stop or slow down, or about anything else, write to yiming@withrelace.com. You can also disallow RelaceHorizon in your robots.txt.