Skip to content
Cascading Labs QScrape VoidCrawl Yosoi

Download Policy

download controls whether a scrape run may download files.

download:
allow: false
allowed_types: []
directory: null
max_bytes: null
keep: true

Downloads are disabled by default. Enabling downloads should be explicit in durable policy.

Fields

FieldTypeDefaultDescription
allowbooleanfalseAllows downloads for the run. Required for any file download.
allowed_typeslist[string][]Run-level allowlist such as pdf, csv, or json.
directorystring or nullnullDownload output directory.
max_bytesinteger or nullnullRun-level file size cap.
keepbooleantrueKeep downloaded files after extraction.

Example

download:
allow: true
allowed_types: [csv, pdf]
directory: .yosoi/downloads
max_bytes: 25000000
keep: true

The contract field still needs its own ys.File(...) configuration. The run policy and field policy must both allow the download.