OpenSERP Files

OpenSERP v0.8.6

Full diff: https://github.com/karust/openserp/compare/v0.8.3...v0.8.6

Added

• Added structured CLI search output via openserp search <engine> <query>.
• Supports json, markdown, text, and ndjson with --format.
• Supports --limit, --lang, --region, --start, --site, --file, --extract, --features, --full, and --search-timeout.
• Added a shared engine registry used by both the CLI and server.
• Added X-Proxy-Attempts response header for proxy retry visibility.
• Added Ecosia Cloudflare captcha detection for browser and raw modes.
• Added test coverage for CLI output, extraction parsing, proxy rotation, ranking, raw HTTP fingerprinting, and SERP features.

Changed

• CLI output now matches the HTTP API v2.1 response format.
• CLI now defaults to quiet mode, sending logs to stderr and keeping stdout clean.
• Replaced extract_top with extract=N.
• Raw HTTP requests now use tls-client with Chrome-like TLS fingerprints, Client Hints, and header ordering.
• Reworked raw HTTP client pooling to prevent idle client growth.
• Unified browser and raw ranking logic using shared RankState.
• Normalized SERP feature links and text before returning results.
• features=false now consistently disables feature extraction.
• Improved Google and Bing SERP feature extraction, including AI summaries, answer boxes, related questions, and related searches.
• Updated README, OpenAPI spec, examples, and CI configuration.

Fixed

• CLI logs no longer pollute stdout.
• Chrome processes are now cleaned up after CLI browser searches.
• Invalid app.block_resources values no longer cause request panics.
• Challenged proxies are rotated out before retrying.
• Browser health checks no longer run immediately after captcha detection.
• Authenticated SOCKS proxies are now rejected in browser mode instead of failing later.
• Raw and library search paths now share the same rate limiter state.
• Extraction now falls back to nearby results when top candidates fail.
• Google AI Overview placeholders no longer leak into serp_features.
• Improved Google related searches and People Also Ask extraction for newer layouts.
• Improved Bing title/description fallbacks, AI answers, answer boxes, related questions, and related searches.
• Bing click-tracking URLs are stripped from normalized links.
• features=false is now respected by Baidu, Ecosia, Google, and Yandex raw search.
• Yandex browser parsing now reuses the raw HTML parser.
• Fixed ranking edge cases where ads could affect organic result positions.