Dubai Unified Property Listings
One row per real-world Dubai unit for sale or rent, deduplicated across Property Finder, Dubizzle and Bayut: every portal listing id and url, how many agents and agencies advertise it, min/max/median asking price, owner-direct flag, first and last seen, days on market, price history and price-drop events from daily snapshots, delisting, and DLD comps for the same building or area (12-month sales count and median price per sqm, Ejari median annual rent per sqm for the same room count, asking-vs-DLD gap).
0 rows in the dataset
Download the dataset
Get every row this scraper has collected as one CSV or JSONL file. If the data is older than maxAgeHours, the scraper is re-run with its configured settings first. The key needs the datasets:export scope.
DOWNLOAD_ID=$(curl -s -X POST "https://api.pandorlabs.com/v1/datasets/dubai-listings-unified/downloads" \ -H "Authorization: Bearer $PANDORLABS_KEY" \ -H "Content-Type: application/json" \ -d '{"maxAgeHours":24,"format":"csv"}' | jq -r '.id')while true; do STATUS=$(curl -s "https://api.pandorlabs.com/v1/downloads/$DOWNLOAD_ID" \ -H "Authorization: Bearer $PANDORLABS_KEY" | jq -r '.status') [ "$STATUS" != "refreshing" ] && break sleep 5donecurl -s "https://api.pandorlabs.com/v1/downloads/$DOWNLOAD_ID/file" \ -H "Authorization: Bearer $PANDORLABS_KEY" \ -o dataset.csvThe rate is 1 credit per 100 rows cached and 2 credits live, charged on the rows in the dataset when the download becomes ready. A failed refresh is not charged. The file stays downloadable for 24 hours. See pricing.
Start a run
To choose the targets yourself, send the parameters below as input. The call returns 202 with the run; the key needs the scrapers:run scope and the account a positive credit balance.
curl -X POST "https://api.pandorlabs.com/v1/scrapers/dubai-listings-unified/runs" \ -H "Authorization: Bearer $PANDORLABS_KEY" \ -H "Content-Type: application/json" \ -d '{ "input": { "sourceSnapshots": 30, "compsMonths": 12 } }'A run is billed at the live rate once it finishes: 2 credits per 100 rows it collected. A run that collects nothing costs nothing.
Parameters
Every parameter is optional. Anything you leave out uses the default shown here; an unknown name or an invalid value is rejected with a 400 that lists each problem.
maxItemsnumber
Max rows
Stop after this many output rows (for a quick sample).
- Default
- none
- Range
- 1 to 5000000
sourceSnapshotsnumber
Source snapshots
How many of the newest listing snapshots to read for history and delisting.
- Default
30- Range
- 1 to 60
compsMonthsnumber
DLD comps window (months)
- Default
12- Range
- 1 to 36
Input as JSON Schema
The same schema the API validates against. Use it as a tool input schema or to generate a typed client.
{ "type": "object", "additionalProperties": false, "properties": { "maxItems": { "type": "number", "minimum": 1, "maximum": 5000000, "title": "Max rows", "description": "Stop after this many output rows (for a quick sample)." }, "sourceSnapshots": { "type": "number", "minimum": 1, "maximum": 60, "title": "Source snapshots", "description": "How many of the newest listing snapshots to read for history and delisting.", "default": 30 }, "compsMonths": { "type": "number", "minimum": 1, "maximum": 36, "title": "DLD comps window (months)", "default": 12 } }}Run, poll, read rows
The run is asynchronous. Poll it until it reaches a terminal status and its billing is paid, then page through its rows. Until then the rows endpoint answers 409 (still queued or running) or 402 (payment required).
RUN_ID=$(curl -s -X POST "https://api.pandorlabs.com/v1/scrapers/dubai-listings-unified/runs" \ -H "Authorization: Bearer $PANDORLABS_KEY" \ -H "Content-Type: application/json" \ -d '{ "input": { "sourceSnapshots": 30, "compsMonths": 12 } }' | jq -r '.id')while true; do RUN=$(curl -s "https://api.pandorlabs.com/v1/runs/$RUN_ID" \ -H "Authorization: Bearer $PANDORLABS_KEY") STATUS=$(echo "$RUN" | jq -r '.status') BILLING=$(echo "$RUN" | jq -r '.billing.status') case "$STATUS" in queued|running) ;; *) [ "$BILLING" != "pending" ] && break ;; esac sleep 5doneecho "$RUN" | jq '{status, rowCount, billing}'curl -s "https://api.pandorlabs.com/v1/runs/$RUN_ID/rows?page=1&limit=100" \ -H "Authorization: Bearer $PANDORLABS_KEY"See the API reference for pagination, cancelling and listing runs.
Output fields
Rows have no fixed schema; these are the fields observed in the rows collected so far. Coverage is the share of rows where the field is present.
No rows collected yet, so no fields have been observed. Run the scraper once and they will appear here.
