Search Results for "web crawler delphi"
Sort By:
Showing 81 open source projects for "web crawler delphi"
View related business solutions-
Push Code. Get a Production URL. Done.Skip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
-
Powerful App Monitoring Without Surprise BillsTired of monitoring tools that punish you for scaling? AppSignal offers transparent, predictable pricing with every feature unlocked on every plan. Track errors, monitor performance, detect anomalies, and manage logs across Ruby, Python, Node.js, and more. Trusted by developers since 2012 with free dev-to-dev support. No credit card required to start your 30-day trial.
-
1
Spatie Crawler
An easy to use, powerful crawler implemented in PHP
Spatie Crawler is a PHP library that allows developers to crawl websites and extract information efficiently. It can be used for web scraping, link checking, or automated testing of web pages. The library is simple to use and supports customizable crawling strategies, including controlling crawl depth and handling redirects. It’s suitable for building crawlers that navigate large or dynamically generated websites. -
2
WebMagic
A scalable web crawler framework for Java
WebMagic is a scalable crawler framework. It covers the whole lifecycle of crawler, downloading, url management, content extraction and persistent. It can simplify the development of a specific crawler. WebMagic is a simple but scalable crawler framework. You can develop a crawler easily based on it. WebMagic has a simple core with high flexibility, a simple API for html extracting. It also provides annotation with POJO to customize a crawler, and no configuration is needed. Some other... -
3
Heritrix
Internet Archive's open-source, web-scale, web crawler project
Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project. Heritrix (sometimes spelled heretrix, or misspelled or missaid as heratrix/heritix/heretix/heratix) is an archaic word for heiress (woman who inherits). Since our crawler seeks to collect and preserve the digital artifacts of our culture for the benefit of future researchers and generations, this name seemed apt. -
4
Horse
Fast, opinionated, minimalist web framework for Delphi
Horse is an Express-inspired web framework for Delphi and Lazarus. Designed to ease things up for fast development in a minimalist way and with high performance. Fast, opinionated, minimalist web framework for Delphi. Horse works with Delphi 11 Alexandria, Delphi 10.4 Sydney, Delphi 10.3 Rio, Delphi 10.2 Tokyo, Delphi 10.1 Berlin, Delphi 10 Seattle, Delphi XE8 and Delphi XE7. -
Go From Idea to Deployed AI App FastAccess Gemini 3 and 200+ models. Build chatbots, agents, or custom models with built-in monitoring and scaling.
-
5
Delphi Web Utils contain the uJson . uJson unit contain the class: JSONObject, JSONArray and JSONTokenezer .This classes handle json structures.
-
6
miniblink49
Lighter, faster browser kernel of blink to integrate HTML UI in apps
...Headless mode, which greatly saves resources and is suitable for crawlers (headless mode, be suitable for Web Crawler). -
7
X-Crawl
Flexible Node.js AI-assisted crawler library
A high-performance web crawling and scraping framework for Node.js, designed for large-scale data extraction. -
8
Python-Spider
Python3 web crawler practice
Python-Spider is a repository intended to teach or provide examples for writing web spiders / crawlers in Python — part of a broader learning and resource collection by its author. The code and documentation are oriented toward beginners or intermediate learners who want to learn how to fetch, parse, and extract data from websites programmatically. As part of the author’s public learning-path repositories, python-spider likely includes examples of HTTP requests, HTML parsing, maybe... -
9
SiteOne Crawler (desktop app)
A free, feature-rich web analyzer and exporter/cloner you will love!
A free in-depth website analyzer providing audits of security, performance, SEO, accessibility and other technical aspects. Available as a desktop application for Windows/macOS/Linux and as a CLI tool for advanced users and CI/CD processes. It also includes an offline web page exporter (website clone, mirror). -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
10
-
11
Screen Color Picker
Screen Color Picker - another screen color picking tool for designer
Screen Color Picker is a lightweight, high-performance Windows utility built using the classic Delphi 7 framework. It is designed to be a "portable" tool, meaning it runs as a single, native 32-bit executable without the need for heavy dependencies like .NET or Java -
12
XMLRAD
Web Application Server Stack for Delphi/FreePascal/Lazarus
Build HTML5 web apps based on DSL (Domain Specific Language) for Delphi/FreePascal/Lazarus: - XMLGram to create XMLServices using DBExtract to select from DB, DBBatch to update DB, macros using programming patterns such as Multicast and RetroFit, - XQL (eXtensible Query Language) to select records in the embedded database XQLite, - XML to load/store record/dataset, - XTL (eXtensible Template Language) to design HTML5 pages based on templates, includes templates for multiple layouts: desktop, mobile and tablet devices XMLRAD includes an Embedded Web Server running natively on Windows and Linux with Delphi/FreePascal/Lazarus. -
13
xxm
A non-IDE, compile-on-refresh, web platform for Delphi.
xxm is a web platform for Delphi. Combine Delphi and HTML into a compiled library loadable by an ISAPI extension, a stand-alone HTTP service, an Internet Explorer snap-in, a FireFox module, an Apache module, oldskool CGI... -
14
Report Manager
Reporting tool, libraries and designer
Report Manager is both a print scheme designer (report) and a high level printing (reporting) engine. Also a TCP Report Server and a Web Report Server (PDF on the fly), supports Windows and Linux. Connectivity to almost all databases is provided. -
15
TorBot
Dark Web OSINT Tool
Contributions to this project are always welcome. To add a new feature fork the dev branch and give a pull request when your new feature is tested and complete. If its a new module, it should be put inside the modules directory. The branch name should be your new feature name in the format <Feature_featurename_version(optional)>. On Linux platforms, you can make an executable for TorBot by using the install.sh script. You will need to give the script the correct permissions using chmod +x... -
16
Gerapy
Distributed Crawler Management Framework Based on Scrapy
Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Scrapyd-Client, Scrapyd-API, Django and Vue.js. Someone who has worked as a crawler with Python may use Scrapy. Scrapy is indeed a very powerful crawler framework. It has high crawling efficiency and good scalability. It is basically a necessary tool for developing crawlers using Python. If you use Scrapy as a crawler, then of course we can use our own host to crawl when crawling, but when the crawl is very large, we can’t... -
17
Delphi Cross-Platform Application Help
Ziphelp is a HTML-based cross-platform application help system
...It works inside an archive, with uncompressed folders or with HTML content loaded directly from a website. A Delphi desktop app may be deployed with local application help, uncompressed, zipped or embedded. A mobile or web application might not ship with local HTML content, but refer to an online version instead. -
18
Goutte
Goutte, a simple PHP Web Scraper
...The method returns a Crawler object (Symfony\Component\DomCrawler\Crawler). To use your own HTTP settings, you may create and pass an HttpClient instance to Goutte. For example, to add a 60 second request timeout. Read the documentation of the BrowserKit, DomCrawler, and HttpClient Symfony Components for more information about what you can do with Goutte. Goutte is a thin wrapper around the following Symfony Components: BrowserKit, CssSelector, DomCrawler, and HttpClient. -
19
ReconSpider
Most Advanced Open Source Intelligence (OSINT) Framework
...Reconnaissance is a mission to obtain information by various detection methods, about the activities and resources of an enemy or potential enemy, or geographic characteristics of a particular area. A Web crawler, sometimes called a spider or spiderbot and often shortened to crawler, is an Internet bot that systematically browses the World Wide Web, typically for the purpose of Web indexing (web spidering). -
20
CEF Python
Python bindings for the Chromium Embedded Framework (CEF)
Python bindings for the Chromium Embedded Framework (CEF). CEF Python is an open source project founded by Czarek Tomczak in 2012 to provide Python bindings for the Chromium Embedded Framework (CEF). The Chromium project focuses mainly on Google Chrome application development while CEF focuses on facilitating embedded browser use cases in third-party applications. Lots of applications use CEF control, there are more than 100 million CEF instances installed around the world. There are... -
21
WenQuanYi (Spring of Letters)
Crowd-sourcing CJK font project
This project aims to develop the most complete, standard compliant, high-quality Chinese (and CJKV) fonts and resources, including bitmap and outline fonts of various styles. We also develop web-based tools to facilitate online font-dev collaborations. -
22
Raudus - Extensions
Raudus Extensions for web development with delphi and lazarus
Raudus Web Framework Complement and Examples for web development in Lazarus and Delphi https://www.facebook.com/RaudusExperts/ https://www.youtube.com/watch?v=BlENxwApW2Q https://youtu.be/eL1d7z4uFLw -
23
API Server for Firebird
API Server for Firebird
The server is accessed through the standard GET, POST methods, the parameters of which specify SQL, written in JSON format. The query result is returned as an array of JSON format. -
24
ShadowSocksShare
Python ShadowSocks framework
This project obtains the shared ss(r) account from the ss(r) shared website crawler, redistributes the account and generates a subscription link by parsing and verifying the account connectivity. Since Google plus will be closed on April 2, 2019, almost all the available accounts crawled before come from Google plus. So if you are building your own website, please keep an eye on the updates of this project and redeploy using the latest source code. -
25
Zoom Website Editor
Text based Website Editor
A text/code editor which allows direct editing of web pages over FTP
