Apify

3.17.0 (2026-06-04)

Bug Fixes

• add network timeouts to discoverValidSitemaps to prevent indefinite hangs (#3429) (ee90835)
• bind Browser.pages() correctly in PuppeteerPlugin (#3439) (c3a4b3b)
• browser-pool: allow unsetting launch context proxy URL (#3621) (d5ab219)
• browser-pool: preserve caller's AbortContext across p-limit queue (#3673) (c4d58d9), closes #3670
• BrowserCrawler closes ctx.page before errorHandler runs on navig… (#3655) (ab34886)
• change sequential approach to parallel for Iterator first page (#3402) (adf3dae), closes #3395
• core: apply object searchParams in HTTP request options (#3622) (d32946e)
• core: release storage open queue slot on failure (#3662) (18ebc61), closes #3661
• correct failed requests delta count in periodic log message (#3482) (a098f42)
• Correctly track the number of requests handled by a crawler (#3410) (b2296ce), closes #3083 #3330
• e2e: resolve flaky Camoufox tests due to GitHub rate limits (#3527) (08c98cf), closes #3524
• honor custom respectRobotsTxtFile userAgent in enqueueLinks (#3578) (1d2528b)
• log warning when Sitemap.load returns empty sitemap due to loading error (#3462) (2cf9c1c)
• parse proxy URLs correctly when using useIncognitoPages (#3433) (db2bb68)
• Prevent accidental request dropping with maxRequestsPerCrawl (#3531) (b23319b)
• prevent iframe expansion failure on pages with Trusted Types CSP (#3590) (c0b9b50), closes #3588
• prevent v3 sitemap discovery init hangs in discoverValidSitemaps (#3434) (6c04f92), closes #3412
• unref BrowserController.close() fallback timer to avoid keeping Node alive longer than needed (#3671) (eef94d4)
• using GET for candidate checks - sitemaps (#3464) (f82eb04), closes #3463

Features

• adaptive-crawler: add shouldPropagateError callback to prevent browser fallback (#3635) (d3a29d9)
• add ignoreProxyCertificate option for the internal proxy-chain instance (#3418) (02eec66), closes #3369
• add abortDownload context helper to FileDownload (#3528) (3b3d8f6)
• Dynamic memory snapshots (#3471) (87c67dc), closes #3408
• expose Download objects on PlaywrightCrawlingContext (#3596) (5dc1627), closes #3583
• Modularize SystemStatus to allow custom backpressure mechanisms (#3529) (7159a13)
• templates: use ImpitHttpClient and install optional deps in Docker (#3603) (113dca6), closes #3601
• utils: add sitemapFilter option to parseSitemap (#3557) (1d4f6b9)

Performance Improvements

• add lazyIterablePromise to kvs iterators (#3413) (2658610)

3.4.1 (2026-05-29)

🐛 Bug Fixes

• Forward missing run kwargs in Actor.start/call/call_task (#906) (7a13809) by @vdusek
• Update push_data annotation with JsonSerializable instead of Any (#899) (b4f5485) by @Mantisus

3.4.0 (2026-05-05)

🚀 Features

• Add subdivision code to proxy configuration (#878) (b2e4006) by @daniil-poletaev

3.3.3 (2026-04-21)

🐛 Bug Fixes

• Cap _list_head request limit at _MAX_HEAD_ITEMS (#869) (1716a2a) by @vdusek
• Preserve max_total_charge_usd=0 instead of treating it as unlimited (#870) (714334c) by @vdusek
• Avoid InvalidStateError on mid-stream platform websocket disconnect (#867) (4dbbd3f) by @vdusek
• Tolerate non-UTF-8 bodies in ApifyRequestList remote sources (#871) (737b0dd) by @vdusek
• Use load sentinel and injected config in AliasResolver (#874) (2d129ad) by @vdusek
• Honor event_listeners_timeout in Actor.reboot (#872) (03e73d3) by @vdusek

3.3.2 (2026-03-27)

🐛 Bug Fixes

• scrapy: Resolve Crawlee's request data round-trip failure in request conversion (#832) (3b9d588) by @vdusek
• Treat default alias as default storage when in schema (#827) (1610d0d) by @Pijukatel
• Guard ReentrantLock against None task context (#841) (193de10) by @vdusek
• Isolate cleanup steps in Actor __aexit__ to prevent cascading failures (#842) (68c2acf) by @vdusek
• Handle exceptions in pre-reboot event listeners via return_exceptions (#843) (ed13597) by @vdusek

3.3.1 (2026-03-11)

🐛 Bug Fixes

• Fix f-string bugs in charging log message (#817) (bcb4050) by @vdusek
• Fix BeforeValidator treating 0 as falsy in configuration fields (#819) (72efe88) by @vdusek
• Clamp negative timedelta in _get_remaining_time() (#818) (69b8af9) by @vdusek
• scrapy: Close AsyncThread on scheduler open() failure (#820) (7dfaf1a) by @vdusek
• Keep track of synthetic apify-default-dataset-item events (#814) (50c4b6c) by @Mantisus

3.3.0 (2026-02-25)

🚀 Features

• Support Actor schema storages with Alias mechanism (#797) (10986ac) by @Pijukatel
• Migrate to Scrapy's native AsyncCrawlerRunner (#793) (01ad9da) by @vdusek

🐛 Bug Fixes

• Resolve LogRecord attribute conflict in event manager logging (#802) (e1bdbc9) by @vdusek
• Update models.py to align with the current API behavior (#782) (b06355d) by @vdusek
• Handle ServiceConflictError when reusing Actor across sequential context (#804) (9e5078f) by @Mantisus

3.2.1 (2026-02-17)

🐛 Bug Fixes

• Fix crawler deadlock when API fails during marking request as handled (#768) (66ed5ea) by @Pijukatel
• Use hashed request_id as cache key in shared RQ client reclaim_request (#795) (bd7572f) by @vdusek
• Correct inverted return value in Scrapy scheduler enqueue_request (#794) (405cf5d) by @vdusek
• Eliminate race condition in _fetch_requests_from_url (#796) (c0a74b9) by @vdusek

3.2.0 (2026-02-11)

🚀 Features

• Add Actor method use_state (#738) (8a78b6f) by @Mantisus

🐛 Bug Fixes

• Stop silently swallowing exceptions in request queue (#777) (6358d66) by @vdusek
• Handle TimeoutError in Actor aexit to prevent resource leaks (#776) (fb13765) by @vdusek
• Pass name instead of id for name param in SmartApifyStorageClient (#775) (56cfc38) by @vdusek

3.16.0 (2026-02-06)

Bug Fixes

• adaptive-crawler: Fix persistence of rendering type detection results (#3368) (4abca8b)
• certain redirect responses change request methods (#3296) (efac644), closes #2586
• clean turbo cache and tsbuildinfo files in yarn clean (#3348) (6cd9456)
• core: ensure maxCrawlDepth warning is logged only once (#3337) (9d01334), closes #3336
• handle multiple BasicCrawler.stop() calls correctly (#3324) (9c0580b), closes #3257
• impit-client: pause fromWeb stream to prevent early consumption (#3347) (72aacb4), closes #555
• more permissive accept (#3373) (d03af1b), closes #3242
• remove deprecation from RequestQueueV1 (#3341) (89309bc)
• suppress info message for undefined maxRequestsPerCrawl (#3237) (f3d9a79)

Features

• add @crawlee/stagehand package for AI-powered browser automation (#3331) (a89cb5a), closes #3064
• Add a counter of in-flight rendering type detections (#3355) (565fc34)
• implements async iterators (#3352) (7f7a4ab), closes #3338
• make handleCloudflareChallenge more configurable (#3247) (629daf8), closes #3127
• utils: add discoverValidSitemaps utility (#3339) (29f52ed)

Performance Improvements

• drop tsbuildinfo from published packages (#3243) (3450f27), closes #3239

3.1.0 (2025-12-08)

🚀 Features

• Add support for Python 3.14 (#680) (b81e86a) by @Mantisus
• Add ACTOR_PERMISSION_LEVEL to the configuration (#689) (68012c7) by @stepskop

🐛 Bug Fixes

• Make ApifyFileSystemStorageClient compatible with the apify cli (#677) (a32274f) by @Pijukatel
• Synchronize charge operations to prevent race conditions (#684) (1c7a9e6) by @vdusek

3.0.5 (2025-11-18)

🐛 Bug Fixes

• Fix crash in Actor.push_data with PPE and a strict charging limit (#664) (8f2e4b2) by @janbuchar
• Avoid charge calls with count=0 (#665) (a0f894e) by @janbuchar
• Fix Actor.charge behavior when the budget is overdrawn (#668) (88e6ba3) by @janbuchar
• Fix detection of whether any instance is initialized (#675) (b2355cf) by @vdusek
• Update apify client to fix rare JSONDecodeError (#679) (17c13d1) by @Pijukatel

3.15.3 (2025-11-10)

Bug Fixes

• await retries inside _timeoutAndRetry (#3206) (9c1cf6d), closes /github.com/apify/crawlee/pull/3188#discussion_r2410256271
• cli: support creating projects with names that start with a number (#3219) (3f37845), closes #3213
• use shared enqueue links wrapper in AdaptivePlaywrightCrawler (#3188) (9569d19)

Features

• support custom userAgent with respectRobotsTxtFile (#3226) (354252d), closes #3222

3.0.4 (2025-11-03)

🐛 Bug Fixes

• Fix type of cloud_storage_client in SmartApifyStorageClient (#642) (3bf285d) by @vdusek
• Fix local charging log dataset name (#649) (fdb1276) by @vdusek

⚡ Performance

• Use Apify-provided environment variables to obtain PPE pricing information (#644) (0c32f29) by @Mantisus

3.15.2 (2025-10-23)

Bug Fixes

• correctly apply launchOptions with useIncognitoPages (#3181) (84a4b70), closes #3173 #3173
• enable systemInfoV2 by default (#3208) (617a343)
• Re-export MemoryStorage from the crawlee package (#3200) (e183ea9)

Features

• export cheerio types in all crawler packages (#3204) (f05790b)

Performance Improvements

• don't await crawler.setStatusMessage (#3207) (1a67ffb)

3.0.3 (2025-10-21)

🐛 Bug Fixes

• Cache requests in RQ implementations by id (#633) (76886ce) by @Pijukatel

3.0.2 (2025-10-17)

🐛 Bug Fixes

• Handle None result in single consumer request queue client (#623) (451284a) by @janbuchar
• Unify Actor context manager with init & exit methods (#600) (6b0d084) by @vdusek
• Handle truncated unique_key in list_head by fetching full request data (#631) (4238086) by @vdusek

3.0.1 (2025-10-08)

🐛 Bug Fixes

• Also load input from a file with a .json extension in file system storage (#617) (b62804c) by @janbuchar

3.0.0 (2025-09-29)

• Check out the Upgrading guide to ensure a smooth update.

🚀 Features

• Add deduplication to add_batch_of_requests (#534) (dd03c4d) by @Pijukatel
• Add new methods to ChargingManager (#580) (54f7f8b) by @vdusek
• Add support for NDU storages (#594) (8721ef5) by @vdusek
• Add stats to ApifyRequestQueueClient (#574) (21f6782) by @Pijukatel
• Add specialized ApifyRequestQueue clients (#573) (f830ab0) by @Pijukatel

🐛 Bug Fixes

• Restrict apify-shared and apify-client versions (#523) (b3ae5a9) by @vdusek
• Expose APIFY_USER_IS_PAYING env var to the configuration (#507) (0801e54) by @stepskop
• Resolve DeprecationWarning in ApifyEventManager (#555) (0c5111d) by @vdusek
• Use same client_key for Actor created request_queue and improve its metadata estimation (#552) (7e4e5da) by @Pijukatel
• Properly process pre-existing Actor input file (#591) (cc5075f) by @Pijukatel

Chore

• [breaking] Update apify-client and apify-shared to v2.0 (#548) (8ba084d) by @vdusek

Refactor

• [breaking] Adapt to the Crawlee v1.0 (#470) (f7e3320) by @vdusek
• [breaking] Replace httpx with impit (#560) (cca3869) by @Mantisus
• [breaking] Remove Request.id field (#553) (445ab5d) by @Pijukatel
• [breaking] Make Actor initialization stricter and more predictable (#576) (912222a) by @Pijukatel
• [breaking] Make default Apify storages use alias mechanism (#606) (dbea7d9) by @Pijukatel

3.15.1 (2025-09-26)

Bug Fixes

• use correct config for storage classes to avoid memory leaks (#3144) (911a2eb)

Performance Improvements

• Improve glob performance by reusing minimatch objects (#3168) (e5632e2)