scrape-it is a Node.js library for converting web pages and HTML documents into structured JavaScript objects. Developers describe the desired output through a declarative schema based on CSS selectors. Fields can extract text, raw HTML, element attributes, repeated items, and nested lists. Conversion functions can transform captured values into dates, numbers, or other application-specific types. The library supports promises, async and await workflows, and callback-based usage. It can request ordinary pages directly or parse HTML obtained from local files and headless browsers. Scrape It does not execute client-side JavaScript itself, so dynamic sites may require an API endpoint or a separate browser automation tool.
Features
- Declarative CSS selector schemas
- Text, HTML, and attribute extraction
- Nested list scraping
- Custom value conversion functions
- Remote and local HTML processing
- Promise and async workflow support