Lead Generation

Crunchbase Organization Inventory

Every Crunchbase organization profile, with the date each one last changed.

crunchbase-organizationscrunchbaselead-generationcompanies

0 rows in the dataset

Download the dataset

Get every row this scraper has collected as one CSV or JSONL file. If the data is older than maxAgeHours, the scraper is re-run with its configured settings first. The key needs the datasets:export scope.

DOWNLOAD_ID=$(curl -s -X POST "https://api.pandorlabs.com/v1/datasets/crunchbase-organizations/downloads" \  -H "Authorization: Bearer $PANDORLABS_KEY" \  -H "Content-Type: application/json" \  -d '{"maxAgeHours":24,"format":"csv"}' | jq -r '.id')while true; do  STATUS=$(curl -s "https://api.pandorlabs.com/v1/downloads/$DOWNLOAD_ID" \    -H "Authorization: Bearer $PANDORLABS_KEY" | jq -r '.status')  [ "$STATUS" != "refreshing" ] && break  sleep 5donecurl -s "https://api.pandorlabs.com/v1/downloads/$DOWNLOAD_ID/file" \  -H "Authorization: Bearer $PANDORLABS_KEY" \  -o dataset.csv

The rate is 1 credit per 100 rows cached and 2 credits live, charged on the rows in the dataset when the download becomes ready. A failed refresh is not charged. The file stays downloadable for 24 hours. See pricing.

Start a run

To choose the targets yourself, send the parameters below as input. The call returns 202 with the run; the key needs the scrapers:run scope and the account a positive credit balance.

curl -X POST "https://api.pandorlabs.com/v1/scrapers/crunchbase-organizations/runs" \  -H "Authorization: Bearer $PANDORLABS_KEY" \  -H "Content-Type: application/json" \  -d '{    "input": {      "maxSitemaps": 2,      "maxOrganizations": 50000,      "modifiedSince": "2026-01-01",      "slugContains": "labs"    }  }'

A run is billed at the live rate once it finishes: 2 credits per 100 rows it collected. A run that collects nothing costs nothing.

Parameters

Every parameter is optional. Anything you leave out uses the default shown here; an unknown name or an invalid value is rejected with a 400 that lists each problem.

Scope

maxSitemaps
number
Organization sitemaps per run
Each file holds up to 50,000 organizations. The default is deliberately small — rows persist and re-runs upsert, so the inventory accumulates across runs rather than being rebuilt by one.
Default
2
Range
1 to 500
maxOrganizations
number
Max organizations per run
A ceiling on one run, not on the dataset. Anything left uncollected is counted and warned about.
Default
50000
Range
1 to 5000000
modifiedSince
string
Modified since
Keeps only entries whose sitemap <lastmod> is on or after this date. This is what makes a scheduled re-run cheap. Entries with no date are kept — undated is not evidence of unchanged.
Default
none
Example
2026-01-01
slugContains
string
Permalink contains
Case-insensitive substring filter on the organization slug.
Default
none
Example
labs

Advanced

useRobotsTxt
boolean
Discover the sitemap index from robots.txt
Reads the Sitemap: directive rather than assuming a path. Falls back to https://www.crunchbase.com/www-sitemaps/sitemap-index.xml when robots.txt is unreachable or declares nothing.
Default
true
sitemapIndexUrl
string
Sitemap index URL override
Set to bypass discovery entirely and walk a specific index.
Default
none
Example
https://www.crunchbase.com/www-sitemaps/sitemap-index.xml
impersonation
enum
Browser profile
Which browser the TLS fingerprint imitates. Worth changing first if a run comes back blocked.
Default
firefox
Allowed values
chrome
firefox
requestDelayMs
number
Delay between requests (ms)
Default
1000
Range
0 to 60000

Input as JSON Schema

The same schema the API validates against. Use it as a tool input schema or to generate a typed client.

inputSchema

{  "type": "object",  "additionalProperties": false,  "properties": {    "maxSitemaps": {      "type": "number",      "minimum": 1,      "maximum": 500,      "title": "Organization sitemaps per run",      "description": "Each file holds up to 50,000 organizations. The default is deliberately small — rows persist and re-runs upsert, so the inventory accumulates across runs rather than being rebuilt by one.",      "default": 2    },    "maxOrganizations": {      "type": "number",      "minimum": 1,      "maximum": 5000000,      "title": "Max organizations per run",      "description": "A ceiling on one run, not on the dataset. Anything left uncollected is counted and warned about.",      "default": 50000    },    "modifiedSince": {      "type": "string",      "maxLength": 2000,      "title": "Modified since",      "description": "Keeps only entries whose sitemap <lastmod> is on or after this date. This is what makes a scheduled re-run cheap. Entries with no date are kept — undated is not evidence of unchanged.",      "examples": [        "2026-01-01"      ]    },    "slugContains": {      "type": "string",      "maxLength": 2000,      "title": "Permalink contains",      "description": "Case-insensitive substring filter on the organization slug.",      "examples": [        "labs"      ]    },    "useRobotsTxt": {      "type": "boolean",      "title": "Discover the sitemap index from robots.txt",      "description": "Reads the Sitemap: directive rather than assuming a path. Falls back to https://www.crunchbase.com/www-sitemaps/sitemap-index.xml when robots.txt is unreachable or declares nothing.",      "default": true    },    "sitemapIndexUrl": {      "type": "string",      "maxLength": 2000,      "title": "Sitemap index URL override",      "description": "Set to bypass discovery entirely and walk a specific index.",      "examples": [        "https://www.crunchbase.com/www-sitemaps/sitemap-index.xml"      ]    },    "impersonation": {      "type": "string",      "enum": [        "chrome",        "firefox"      ],      "title": "Browser profile",      "description": "Which browser the TLS fingerprint imitates. Worth changing first if a run comes back blocked.",      "default": "firefox"    },    "requestDelayMs": {      "type": "number",      "minimum": 0,      "maximum": 60000,      "title": "Delay between requests (ms)",      "default": 1000    }  }}

Run, poll, read rows

The run is asynchronous. Poll it until it reaches a terminal status and its billing is paid, then page through its rows. Until then the rows endpoint answers 409 (still queued or running) or 402 (payment required).

RUN_ID=$(curl -s -X POST "https://api.pandorlabs.com/v1/scrapers/crunchbase-organizations/runs" \  -H "Authorization: Bearer $PANDORLABS_KEY" \  -H "Content-Type: application/json" \  -d '{    "input": {      "maxSitemaps": 2,      "maxOrganizations": 50000,      "modifiedSince": "2026-01-01",      "slugContains": "labs"    }  }' | jq -r '.id')while true; do  RUN=$(curl -s "https://api.pandorlabs.com/v1/runs/$RUN_ID" \    -H "Authorization: Bearer $PANDORLABS_KEY")  STATUS=$(echo "$RUN" | jq -r '.status')  BILLING=$(echo "$RUN" | jq -r '.billing.status')  case "$STATUS" in queued|running) ;; *) [ "$BILLING" != "pending" ] && break ;; esac  sleep 5doneecho "$RUN" | jq '{status, rowCount, billing}'curl -s "https://api.pandorlabs.com/v1/runs/$RUN_ID/rows?page=1&limit=100" \  -H "Authorization: Bearer $PANDORLABS_KEY"

See the API reference for pagination, cancelling and listing runs.

Output fields

Rows have no fixed schema; these are the fields observed in the rows collected so far. Coverage is the share of rows where the field is present.

No rows collected yet, so no fields have been observed. Run the scraper once and they will appear here.