Feature Enhancements and Performance Improvements
Feature Enhancements: Geolocation and mobile scraping support, 4x faster parsing, improved webhooks, credit packs, auto-recharges, batch scraping support, iframe support, query parameter differentiation for URLs, similar URL deduplication, enhanced map ranking, and improved sitemap fetching.
Performance Improvements: Faster crawl status filtering, improved map ranking algorithm, optimized Kubernetes setup, simplified build processes, enhanced sitemap discoverability.
Bug Fixes: Resolved JSON formatting, scrolling actions, encoding errors, crawl limits, relative URLs, error handling, self-hosted crawling inconsistencies, and schema errors.
SDK Updates: Added dynamic WebSocket imports with fallback, optional API keys for self-hosted instances, improved error handling.
Documentation Updates: Improved API docs and examples, updated self-hosting URLs, added Kubernetes optimizations, new articles on /scrape and /crawl.
Fetched April 11, 2026