Skip to main content

Domain Policies

A Domain Policy determines how many requests the crul query processor can make to a domain per second, per ten seconds and per minute.

Policy Contents​

A policy is composed of a perSecond, perTenSeconds, and perMinute value. Adjusting these values will determine how many requests can be sent to a domain. For example the following policy will allow for a request per second, until the perTenSeconds limit is hit (5), then wait until 10 seconds have passed before continue making requests once per second, and be throttled at the minute level once 15 requests have been made in a minute span.

{
  "perSecond": 1,
  "perTenSeconds": 5,
  "perMinute": "15"
}

The policy will be applied according to the least permissive rule, for example, if your policy is as follows, the strictest rule is the perMinute rule of 1 request, and this will override the more lenient perSecond and perTenSeconds rules.

{
  "perSecond": 100,
  "perTenSeconds": 1000,
  "perMinute": "1"
}

Throttling Domain Wait​

A query that cannot complete due to the domain policy will continue to check if the domain is available to request until the query times out.

Defaults​

The default domain policy allows for one request to a domain per second.

{
  "perSecond": 1,
  "perTenSeconds": 10,
  "perMinute": "60"
}