{"collection":{"slug":"browser-automation","name":"Browser Automation & Scraping"},"digest":{"id":"cwd_tl9qcSUfWxVYfIg3Z7FLE","weekStart":"2026-10-26","title":"Firecrawl turns Alexandria into a data marketplace while Browserbase unlocks logged-in pages","intro":"Firecrawl spent the week turning Alexandria into something agents can shop in — recruiting shortlists, dependency vulnerability checks, and a hook into Vercel's eve framework — while Browserbase made Fetch able to read pages behind a login and Apify hardened its child-run orchestration.","body":"### Alexandria becomes the product\n\nFirecrawl's week was less about crawling and more about what the crawl feeds. Three announcements all point the same direction: Alexandria, its web-data layer, is being packaged into ready-made datasets that chat assistants and coding agents can query directly.\n\nThe most consumer-facing is [Directory, a free recruiting dataset for ChatGPT and Claude](/release/rel_NZp3weEA_oFu1cfI8flLD-firecrawl-launches-directory-for-free-recruiting-data-in-chatgpt-and-claude): describe a role, get a shortlist drawn from 250M+ profiles with experience and work emails attached. On the developer side, Firecrawl [added cybersecurity data to Alexandria for dependency checks](/release/rel_h7x3l6_tYMtv0UQ0Cao0_-firecrawl-adds-cybersecurity-data-to-alexandria-for-dependency-vulnerability), letting Codex and Claude Code agents compare a project's dependencies against 400,000+ known vulnerabilities and patch them before anyone else finds them. And the distribution play: [Firecrawl is now an integration in eve](/release/rel_kH7usAn0b_TEekdaYlnUR-firecrawl-launches-integration-for-eve-vercel-s-open-source-agent-framework), Vercel's open-source agent framework, where a single command wires web access into an agent. Stacked together, these read as a shift from \"we fetch pages\" to \"we sell the answers,\" with the integration doing the funnel work.\n\n### Fetch gets past the login wall\n\nBrowserbase's changelog entry is small in scope but big in practice. [Fetch can now reuse saved login cookies from a Context](/release/rel_guyiBPSIDGzKe0oiaFPcB-browserbase-fetch-reuses-context-login-cookies-to-retrieve-pages-behind-a-login) by passing a contextId, returning pages behind a login as raw content, markdown, or structured JSON. The workflow is the one scrapers already know: log in through a browser session with persist: true, end the session to save cookies, then point Fetch at the Context. One caveat worth planning around — authenticated Fetch reads cookies from the last saved session and never writes updated ones back, so token refreshes and rotated sessions won't propagate. It removes the browser round-trip for authenticated reads but leaves session hygiene in your hands.\n\n### Apify tightens the orchestration layer\n\nApify's SDK update is housekeeping for people running Actors inside Actors. The headline is [a spend ceiling on task calls](/release/rel_ge8CNwOPnIHHMRguisdDZ-apify-sdk-4-2-0-adds-max-total-charge-usd-and-deprecates-max-items): Actor.start_task and Actor.call_task now accept max_total_charge_usd, and the older max_items is deprecated in its favor — a more sensible guardrail now that much of the platform bills by usage rather than item count. The same update adds Actor.child_runs, with clients for named child runs, reattaches those named runs after migration or resurrection, and aborts them when the parent is gracefully aborted. Add Python 3.15 support and it's a release aimed squarely at teams whose Actors fan out into subtasks and need those subtasks to survive restarts and die cleanly with the parent.\n\n### What it adds up to\n\nThe through-line this week is agents getting safer, more authenticated access to data they previously couldn't reach: Firecrawl shipping datasets that arrive already vetted or already filtered, Browserbase punching through login walls without a full browser session, and Apify putting a dollar cap on the fan-out. Browser automation is increasingly the plumbing under data products rather than the product itself.","releaseIds":["rel_NZp3weEA_oFu1cfI8flLD","rel_h7x3l6_tYMtv0UQ0Cao0_","rel_kH7usAn0b_TEekdaYlnUR","rel_guyiBPSIDGzKe0oiaFPcB","rel_ge8CNwOPnIHHMRguisdDZ"],"releaseCount":5,"generatedAt":"2026-11-02T06:20:01.144Z","releases":[{"id":"rel_NZp3weEA_oFu1cfI8flLD","title":"Firecrawl launches Directory for free recruiting data in ChatGPT and Claude","path":"/release/rel_NZp3weEA_oFu1cfI8flLD-directory-serves-recruiting-shortlists-from-250m-profiles","url":"https://www.firecrawl.dev/changelog/introducing-directory","org":{"slug":"firecrawl","name":"Firecrawl","avatarUrl":"https://media.releases.sh/orgs/firecrawl.png","githubHandle":"firecrawl"},"product":null,"importance":3,"composition":{"bugs":0,"features":1,"enhancements":0},"publishedAt":"2026-10-28T00:00:00.000Z"},{"id":"rel_h7x3l6_tYMtv0UQ0Cao0_","title":"Firecrawl adds cybersecurity data to Alexandria for dependency vulnerability checks","path":"/release/rel_h7x3l6_tYMtv0UQ0Cao0_-alexandria-covers-400k-vulnerabilities-in-code-dependencies","url":"https://www.firecrawl.dev/changelog#introducing-cybersecurity-data-in-alexandria","org":{"slug":"firecrawl","name":"Firecrawl","avatarUrl":"https://media.releases.sh/orgs/firecrawl.png","githubHandle":"firecrawl"},"product":null,"importance":3,"composition":{"bugs":0,"features":1,"enhancements":0},"publishedAt":"2026-10-29T00:00:00.000Z"},{"id":"rel_kH7usAn0b_TEekdaYlnUR","title":"Firecrawl launches integration for eve, Vercel's open-source agent framework","path":"/release/rel_kH7usAn0b_TEekdaYlnUR-firecrawl-lands-in-eve-agent-framework","url":"https://www.firecrawl.dev/changelog/eve-integration","org":{"slug":"firecrawl","name":"Firecrawl","avatarUrl":"https://media.releases.sh/orgs/firecrawl.png","githubHandle":"firecrawl"},"product":null,"importance":3,"composition":{"bugs":0,"features":1,"enhancements":0},"publishedAt":"2026-10-30T00:00:00.000Z"},{"id":"rel_guyiBPSIDGzKe0oiaFPcB","title":"Browserbase Fetch reuses Context login cookies to retrieve pages behind a login","path":"/release/rel_guyiBPSIDGzKe0oiaFPcB-fetch-now-reaches-pages-behind-a-login-via-saved-context-cookies","url":"https://www.browserbase.com/changelog#authenticated-fetch","org":{"slug":"browserbase","name":"Browserbase","avatarUrl":"https://media.releases.sh/orgs/browserbase.png","githubHandle":"browserbase"},"product":null,"importance":3,"composition":{"bugs":0,"features":1,"enhancements":0},"publishedAt":"2026-10-27T00:00:00.000Z"},{"id":"rel_ge8CNwOPnIHHMRguisdDZ","title":"Apify SDK 4.2.0 adds max_total_charge_usd and deprecates max_items","path":"/release/rel_ge8CNwOPnIHHMRguisdDZ-max-items-deprecated-for-max-total-charge-usd-python-3-15-support","url":"https://github.com/apify/apify-sdk-python/releases/tag/v4.2.0","org":{"slug":"apify","name":"Apify","avatarUrl":"https://media.releases.sh/orgs/apify.png","githubHandle":"apify"},"product":null,"importance":3,"composition":{"bugs":4,"features":6,"enhancements":1},"publishedAt":"2026-10-30T11:52:50.000Z"}],"sections":[{"heading":"Alexandria becomes the product","anchor":"alexandria-becomes-the-product","lede":"Firecrawl's week was less about crawling and more about what the crawl feeds.","releaseIds":["rel_NZp3weEA_oFu1cfI8flLD","rel_h7x3l6_tYMtv0UQ0Cao0_","rel_kH7usAn0b_TEekdaYlnUR"],"releases":[{"id":"rel_NZp3weEA_oFu1cfI8flLD","title":"Firecrawl launches Directory for free recruiting data in ChatGPT and Claude","path":"/release/rel_NZp3weEA_oFu1cfI8flLD-directory-serves-recruiting-shortlists-from-250m-profiles","url":"https://www.firecrawl.dev/changelog/introducing-directory","org":{"slug":"firecrawl","name":"Firecrawl","avatarUrl":"https://media.releases.sh/orgs/firecrawl.png","githubHandle":"firecrawl"},"product":null,"importance":3,"composition":{"bugs":0,"features":1,"enhancements":0},"publishedAt":"2026-10-28T00:00:00.000Z"},{"id":"rel_h7x3l6_tYMtv0UQ0Cao0_","title":"Firecrawl adds cybersecurity data to Alexandria for dependency vulnerability checks","path":"/release/rel_h7x3l6_tYMtv0UQ0Cao0_-alexandria-covers-400k-vulnerabilities-in-code-dependencies","url":"https://www.firecrawl.dev/changelog#introducing-cybersecurity-data-in-alexandria","org":{"slug":"firecrawl","name":"Firecrawl","avatarUrl":"https://media.releases.sh/orgs/firecrawl.png","githubHandle":"firecrawl"},"product":null,"importance":3,"composition":{"bugs":0,"features":1,"enhancements":0},"publishedAt":"2026-10-29T00:00:00.000Z"},{"id":"rel_kH7usAn0b_TEekdaYlnUR","title":"Firecrawl launches integration for eve, Vercel's open-source agent framework","path":"/release/rel_kH7usAn0b_TEekdaYlnUR-firecrawl-lands-in-eve-agent-framework","url":"https://www.firecrawl.dev/changelog/eve-integration","org":{"slug":"firecrawl","name":"Firecrawl","avatarUrl":"https://media.releases.sh/orgs/firecrawl.png","githubHandle":"firecrawl"},"product":null,"importance":3,"composition":{"bugs":0,"features":1,"enhancements":0},"publishedAt":"2026-10-30T00:00:00.000Z"}]},{"heading":"Fetch gets past the login wall","anchor":"fetch-gets-past-the-login-wall","lede":"Browserbase's changelog entry is small in scope but big in practice.","releaseIds":["rel_guyiBPSIDGzKe0oiaFPcB"],"releases":[{"id":"rel_guyiBPSIDGzKe0oiaFPcB","title":"Browserbase Fetch reuses Context login cookies to retrieve pages behind a login","path":"/release/rel_guyiBPSIDGzKe0oiaFPcB-fetch-now-reaches-pages-behind-a-login-via-saved-context-cookies","url":"https://www.browserbase.com/changelog#authenticated-fetch","org":{"slug":"browserbase","name":"Browserbase","avatarUrl":"https://media.releases.sh/orgs/browserbase.png","githubHandle":"browserbase"},"product":null,"importance":3,"composition":{"bugs":0,"features":1,"enhancements":0},"publishedAt":"2026-10-27T00:00:00.000Z"}]},{"heading":"Apify tightens the orchestration layer","anchor":"apify-tightens-the-orchestration-layer","lede":"Apify's SDK update is housekeeping for people running Actors inside Actors.","releaseIds":["rel_ge8CNwOPnIHHMRguisdDZ"],"releases":[{"id":"rel_ge8CNwOPnIHHMRguisdDZ","title":"Apify SDK 4.2.0 adds max_total_charge_usd and deprecates max_items","path":"/release/rel_ge8CNwOPnIHHMRguisdDZ-max-items-deprecated-for-max-total-charge-usd-python-3-15-support","url":"https://github.com/apify/apify-sdk-python/releases/tag/v4.2.0","org":{"slug":"apify","name":"Apify","avatarUrl":"https://media.releases.sh/orgs/apify.png","githubHandle":"apify"},"product":null,"importance":3,"composition":{"bugs":4,"features":6,"enhancements":1},"publishedAt":"2026-10-30T11:52:50.000Z"}]},{"heading":"What it adds up to","anchor":"what-it-adds-up-to","lede":"The through-line this week is agents getting safer, more authenticated access to data they previously couldn't reach: Firecrawl shipping datasets that arrive already vetted or already filtered, Browserbase punching through login walls without a full browser session, and Apify putting a dollar cap on the fan-out.","releaseIds":[],"releases":[]}]}}