LLMs.txt API and Deep Research API launch

Introducing LLMs.txt API: The /llmstxt endpoint transforms websites into clean, LLM-ready text files (llms.txt and llms-full.txt).

Introducing Deep Research API (Alpha): The /deep-research endpoint enables AI-powered deep research and analysis on any topic.

Official Firecrawl MCP Server: Firecrawl MCP Server for Cursor, Windsurf, and Claude with enhanced web extraction capabilities.

Fixes & Enhancements: Improved charset detection, fixed extract token limit issues, addressed includes/excludes handling, fixed AI SDK JSON response handling.

New Features & Improvements: AI-SDK migration, auto-recharge emails, Fire-Index system, self-hosting enhancements (OpenAI-compatible API & Ollama support), batch billing, Supabase read replica routing.

Crawler & AI Improvements: Claude 3.7 and GPT-4.5 web crawlers, Groq web crawler example, improved crawl-status behavior, better cross-origin redirect handling.

Documentation & Maintenance: Updated Dockerfile, fixed missing "required" field in docs.