Firecrawl

These example posts were automatically generated by PersonaBox from GitHub pull requests.

Want posts like this?

Turn your GitHub PRs into polished product updates.

Powered by PersonaBox

Choose spark-1-pro or spark-1-mini for your agent jobs#

Choose spark-1-pro or spark-1-mini for your agent jobs

You can now specify which model powers your agent jobs by passing model="spark-1-pro" or model="spark-1-mini" in your request. Use spark-1-mini for bulk, cost-efficient runs and spark-1-pro when output quality matters most. Available in Python and TypeScript SDKs.

Webhook support for agent jobs in Node.js and Python SDKs#

Webhook support for agent jobs in Node.js and Python SDKs

The Node.js and Python SDKs now support webhooks for agent jobs. Receive HTTP callbacks for started, action, completed, failed, and cancelled events instead of polling. Configure webhook URLs, custom headers, metadata, and event filtering directly in your start_agent or agent calls.

Sitemap-only mode for precise, targeted crawling#

Sitemap-only mode for precise, targeted crawling

You can now set sitemap: "only" to crawl exclusively the URLs listed in a site's sitemap.xml. The crawler skips HTML link discovery, giving you precise control over which pages are ingested. Ideal for docs-only RAG pipelines, targeted monitoring, or avoiding infinite crawls from faceted navigation.

Rust SDK v2 namespace with agent support#

Rust SDK v2 namespace with agent support

The Rust SDK now includes a v2 namespace with access to all v2 API endpoints: scrape, search, map, crawl, batch_scrape, and the new agent endpoint for prompt-driven web workflows. Use scrape_with_schema() or agent_with_schema() for typed extraction, and manage async jobs with start, status, errors, and cancel methods. Fully backwards-compatible with v1.