Download Latest Version
v2.48.13 -- CLI authenticate for Spider Cloud source code.tar.gz (838.8 kB)
Get an email when there's a new version of Spider
| Name | Modified | Size | Downloads / Week |
|---|---|---|---|
| Parent folder | |||
| README.md | 2026-03-25 | 942 Bytes | |
| v2.48.2 -- Parallel Crawl Backends source code.tar.gz | 2026-03-25 | 820.5 kB | |
| v2.48.2 -- Parallel Crawl Backends source code.zip | 2026-03-25 | 982.5 kB | |
| Totals: 3 Items | 1.8 MB | 0 | |
Race alternative browser engines alongside your primary crawl. Best HTML wins.
:::rust
use spider::configuration::{BackendEndpoint, BackendEngine, ParallelBackendsConfig};
let mut website = Website::new("https://example.com");
website.configuration.parallel_backends = Some(ParallelBackendsConfig {
backends: vec![BackendEndpoint {
engine: BackendEngine::LightPanda,
endpoint: Some("ws://127.0.0.1:9222".to_string()),
binary_path: None,
protocol: None,
}],
..Default::default()
});
website.crawl().await;
// page.backend_source → "primary" | "lightpanda" | "servo" | "custom"
Features: lightpanda, servo, parallel_backends_full, custom backends via BackendEngine::Custom.
Zero overhead when disabled, anti-fingerprint jitter, auto-disable on failures, custom quality validator, full network interception parity with Chrome.
