Social Media

X (Twitter) Posts

Public posts from X (Twitter) account timelines.

x-postsxtwittersocial-mediapostsguest

0 rows in the dataset

Download the dataset

Get every row this scraper has collected as one CSV or JSONL file. If the data is older than maxAgeHours, the scraper is re-run with its configured settings first. The key needs the datasets:export scope.

DOWNLOAD_ID=$(curl -s -X POST "https://api.pandorlabs.com/v1/datasets/x-posts/downloads" \  -H "Authorization: Bearer $PANDORLABS_KEY" \  -H "Content-Type: application/json" \  -d '{"maxAgeHours":24,"format":"csv"}' | jq -r '.id')while true; do  STATUS=$(curl -s "https://api.pandorlabs.com/v1/downloads/$DOWNLOAD_ID" \    -H "Authorization: Bearer $PANDORLABS_KEY" | jq -r '.status')  [ "$STATUS" != "refreshing" ] && break  sleep 5donecurl -s "https://api.pandorlabs.com/v1/downloads/$DOWNLOAD_ID/file" \  -H "Authorization: Bearer $PANDORLABS_KEY" \  -o dataset.csv

The rate is 1 credit per 100 rows cached and 2 credits live, charged on the rows in the dataset when the download becomes ready. A failed refresh is not charged. The file stays downloadable for 24 hours. See pricing.

Start a run

To choose the targets yourself, send the parameters below as input. The call returns 202 with the run; the key needs the scrapers:run scope and the account a positive credit balance.

curl -X POST "https://api.pandorlabs.com/v1/scrapers/x-posts/runs" \  -H "Authorization: Bearer $PANDORLABS_KEY" \  -H "Content-Type: application/json" \  -d '{    "input": {      "handles": [        "elonmusk",        "nasa",        "github"      ],      "maxPostsPerAccount": 100,      "maxAgeDays": 0,      "minFavorites": 0    }  }'

A run is billed at the live rate once it finishes: 2 credits per 100 rows it collected. A run that collects nothing costs nothing.

Parameters

Every parameter is optional. Anything you leave out uses the default shown here; an unknown name or an invalid value is rejected with a 400 that lists each problem.

Targeting

handles
string[]
Accounts
Handles only — @ prefixes and pasted URLs are cleaned up.
Default
["elonmusk","nasa","github"]
Example
elonmusk, nasa
maxPostsPerAccount
number
Max posts per account
20 posts per request, so this is also the request budget per account.
Default
100
Range
1 to 2000
maxAgeDays
number
Max age (days)
Stop paging an account once posts get older than this. 0 keeps everything.
Default
0
Range
0 to 3650

Matching

minFavorites
number
Minimum likes
Default
0
Range
at least 0
includeReplies
boolean
Include replies
The timeline mixes an account’s replies in with its own posts.
Default
false
includeRetweets
boolean
Include reposts
A repost carries the original author’s text, not this account’s.
Default
false

Endpoint

userQueryId
string
UserByScreenName query id
X rotates these hashes. Read the current one from a /graphql/ request in a browser network tab.
Default
qW5u-DAuXpMEG0zA1F7UGQ
tweetsQueryId
string
UserTweets query id
As above. A 404 from the API almost always means this needs updating.
Default
V7H0Ap3_Hh2FyS75OCDO3Q

Collection

concurrency
number
Concurrent accounts
The guest token is shared by the whole run, so parallel accounts share one rate limit.
Default
2
Range
1 to 8
requestDelayMs
number
Delay between requests (ms)
Default
1500
Range
0 to 30000

Input as JSON Schema

The same schema the API validates against. Use it as a tool input schema or to generate a typed client.

inputSchema

{  "type": "object",  "additionalProperties": false,  "properties": {    "handles": {      "type": "array",      "items": {        "type": "string"      },      "maxItems": 1000,      "title": "Accounts",      "description": "Handles only — @ prefixes and pasted URLs are cleaned up.",      "default": [        "elonmusk",        "nasa",        "github"      ],      "examples": [        "elonmusk, nasa"      ]    },    "maxPostsPerAccount": {      "type": "number",      "minimum": 1,      "maximum": 2000,      "title": "Max posts per account",      "description": "20 posts per request, so this is also the request budget per account.",      "default": 100    },    "maxAgeDays": {      "type": "number",      "minimum": 0,      "maximum": 3650,      "title": "Max age (days)",      "description": "Stop paging an account once posts get older than this. 0 keeps everything.",      "default": 0    },    "minFavorites": {      "type": "number",      "minimum": 0,      "title": "Minimum likes",      "default": 0    },    "includeReplies": {      "type": "boolean",      "title": "Include replies",      "description": "The timeline mixes an account’s replies in with its own posts.",      "default": false    },    "includeRetweets": {      "type": "boolean",      "title": "Include reposts",      "description": "A repost carries the original author’s text, not this account’s.",      "default": false    },    "userQueryId": {      "type": "string",      "maxLength": 2000,      "title": "UserByScreenName query id",      "description": "X rotates these hashes. Read the current one from a /graphql/ request in a browser network tab.",      "default": "qW5u-DAuXpMEG0zA1F7UGQ"    },    "tweetsQueryId": {      "type": "string",      "maxLength": 2000,      "title": "UserTweets query id",      "description": "As above. A 404 from the API almost always means this needs updating.",      "default": "V7H0Ap3_Hh2FyS75OCDO3Q"    },    "concurrency": {      "type": "number",      "minimum": 1,      "maximum": 8,      "title": "Concurrent accounts",      "description": "The guest token is shared by the whole run, so parallel accounts share one rate limit.",      "default": 2    },    "requestDelayMs": {      "type": "number",      "minimum": 0,      "maximum": 30000,      "title": "Delay between requests (ms)",      "default": 1500    }  }}

Run, poll, read rows

The run is asynchronous. Poll it until it reaches a terminal status and its billing is paid, then page through its rows. Until then the rows endpoint answers 409 (still queued or running) or 402 (payment required).

RUN_ID=$(curl -s -X POST "https://api.pandorlabs.com/v1/scrapers/x-posts/runs" \  -H "Authorization: Bearer $PANDORLABS_KEY" \  -H "Content-Type: application/json" \  -d '{    "input": {      "handles": [        "elonmusk",        "nasa",        "github"      ],      "maxPostsPerAccount": 100,      "maxAgeDays": 0,      "minFavorites": 0    }  }' | jq -r '.id')while true; do  RUN=$(curl -s "https://api.pandorlabs.com/v1/runs/$RUN_ID" \    -H "Authorization: Bearer $PANDORLABS_KEY")  STATUS=$(echo "$RUN" | jq -r '.status')  BILLING=$(echo "$RUN" | jq -r '.billing.status')  case "$STATUS" in queued|running) ;; *) [ "$BILLING" != "pending" ] && break ;; esac  sleep 5doneecho "$RUN" | jq '{status, rowCount, billing}'curl -s "https://api.pandorlabs.com/v1/runs/$RUN_ID/rows?page=1&limit=100" \  -H "Authorization: Bearer $PANDORLABS_KEY"

See the API reference for pagination, cancelling and listing runs.

Output fields

Rows have no fixed schema; these are the fields observed in the rows collected so far. Coverage is the share of rows where the field is present.

No rows collected yet, so no fields have been observed. Run the scraper once and they will appear here.