Download
Get bulk download URLs for a UTC date.
GET
Download
Use
GET /download to request a daily bulk manifest with source, market, and date and get all snapshot download URLs for that UTC date in one response.
Open datasets do not require an Authorization header. Bearer auth or machine payment is only required when the dataset access policy for the requested data requires it.
Endpoint
GET /download
Preferred workflow
- Use Catalog to confirm the exact
sourceandmarket. - Request
GET /download?source=...&market=...&date=.... - Read the manifest and download the returned snapshot URLs.
- Decompress each
.jsonl.zstfile locally and treat it as the canonical normalized event source.
Parameters
Required query params:source, market, date
string
Source ID for the bulk manifest request.
string
Exact Polaris market ID for the bulk manifest request.
string
UTC date for the bulk manifest request, in strict
YYYY-MM-DD format.Bulk manifest behavior
When you requestsource, market, and date, Polaris returns a JSON manifest for that UTC date.
- The endpoint uses canonical query params only. Use
sourceandmarket, not legacy aliases such asexchangeorasset. - The date must be
YYYY-MM-DD. - The endpoint returns JSON. It does not redirect to a single file.
- Polaris groups available files by timestamp and returns one manifest entry per snapshot timestamp.
- If a timestamp already has one standardized object, the returned URL points to that object directly.
- If a timestamp has multiple standardized shards, Polaris assembles them into one temporary file before returning the URL.
- If no standardized object exists for a timestamp, Polaris builds a standardized snapshot from the available source files and returns a URL for that assembled output.
standard/{source}/{market}/{date}/. If none exist for the day, it falls back to the available raw source objects for that date.
Bulk manifest response fields
string
required
Source you queried.
string
required
Market you queried.
string
required
UTC date you queried, in
YYYY-MM-DD format.number
required
Number of snapshot entries returned for that date.
number
required
Total size in bytes across the returned snapshot files.
object[]
required
Snapshot download entries for the requested date.
string
required
UTC date covered by the snapshot, in
YYYY-MM-DD format.string
required
UTC timestamp within the date, formatted as
HHMMSS.string
required
Opaque snapshot identifier for that timestamp.
string
required
Pre-signed download URL for the standardized snapshot file.
number
required
Lifetime of the pre-signed download URL, typically
86400 (24 hours).Bulk manifest example
Access behavior
- Open datasets do not require bearer auth.
- Preview or restricted datasets may require bearer auth or a machine payment challenge, depending on dataset policy.
- Bulk manifest access is evaluated against the requested dataset and date.
Error behavior
400for missing required params or an invaliddate401when bearer auth is required by dataset policy402when the dataset requires payment and no auth or payment is provided404when no matching snapshot data is found
Next steps
Download