Search Results for "web crawler source code"
Sort By:
Showing 254 open source projects for "web crawler source code"
View related business solutions-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
1
CrossUI
CrossUI is a free Cross-Browser Javascript framework
Build fully interactive experiences codeless and serverless. Create code into Github repository directly. CrossUI No-Code App Builder enables anyone (no software developer required) to Create Interactive Apps Without Coding. Prototype, develop and package the exactly same code into Web Apps, Native Desktop (Windows, Linux and Mac) Apps, as well as Mobile Apps. Rich client-side API, works with any backend or static HTML pages. -
2
pREST
PostgreSQL REST, low-code, simplify and accelerate development
pREST (PostgreSQL REST), simplify and accelerate development, instant, realtime, high-performance on any Postgres application, existing or new. There is PostgREST written in Haskell, but keeping Haskell software in production is not an easy job. With this need pREST was born. Instant, realtime, high-performance on any Postgres application, existing or new. Add the JWT Authentication Middleware to implement authentication using JSON Web Token. This middleware will process the authorization... -
3
Testcontainers node
Supports tests, providing lightweight, throwaway instances of database
Testcontainers is an open source library for providing throwaway, lightweight instances of databases, message brokers, web browsers, or just about anything that can run in a Docker container. No more need for mocks or complicated environment configurations. Define your test dependencies as code, then simply run your tests and containers will be created and then deleted. -
4
Full Stack FastAPI and PostgreSQL
Full stack, modern web application generator
Generate a backend and frontend stack using Python, including interactive API documentation. Production ready Python web server using Uvicorn and Gunicorn. Very high performance, on par with NodeJS and Go (thanks to Starlette and Pydantic). Great editor support. Completion everywhere. Less time debugging. Designed to be easy to use and learn. Less time reading docs. Minimize code duplication. Multiple features from each parameter declaration. Get production-ready code. With automatic... -
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
5
SQLite JDBC Driver
SQLite JDBC Driver
SQLite JDBC is a library for accessing and creating SQLite database files in Java. Our SQLiteJDBC library requires no configuration since native libraries for major OSs, including Windows, Mac OS X, Linux etc., are assembled into a single JAR (Java Archive) file. The usage is quite simple; download our sqlite-jdbc library, then append the library (JAR file) to your classpath. SQLite JDBC is a library for accessing SQLite databases through the JDBC API. SQLite supports on-memory database... -
6
marko
A declarative, HTML-based language that makes building web apps fun
A declarative, HTML-based language that makes building web apps fun. If you know HTML, CSS, and Javascript, you know Marko. Streaming, partial hydration, an optimizing compiler, & a small runtime. Start with simple HTML templates and add powerful components as needed. Marko is powering high-traffic websites like ebay.com. Marko is HTML re-imagined as a language for building dynamic and reactive user interfaces. Just about any valid HTML is valid Marko, but Marko extends the HTML language to... -
7
OpenRefine
A free, open source, powerful tool for working with messy data
OpenRefine is a powerful Java-based tool designed to work with messy data and improve it. With OpenRefine you can load data, understand it, clean it up, transform it, reconcile it, and augment it with web services and external data. It allows you to do this all from a web browser and in the convenience and privacy of your own computer. OpenRefine keeps all data securely in your computer by running a small server on it, using your web browser to interact with it. When you're ready, then that... -
8
Npgsql
Npgsql is the .NET data provider for PostgreSQL
Npgsql is an open source ADO.NET Data Provider for PostgreSQL, it allows programs written in C#, Visual Basic, F# to access the PostgreSQL database server. It is implemented in 100% C# code, is free and is open source. An Entity Framework Core provider is also available and exposes some features unique to the PostgreSQL database to EF Core users. Finally, a legacy Entity Framework 6.x (non-Core) provider is also available but is no longer being actively maintained. Npgsql is the open source... -
9
directus
Directus wraps any SQL database with a real-time GraphQL+REST API
With over 18 million downloads, Directus is the world's first Open Data Platform for instantly turning any SQL database into an API and beautiful no-code app. Power any project with a modern, open-source data platform. A modern data platform, designed for developers. Our modular codebase is 100% JavaScript, leveraging the power of Node.js and Vue.js 3 for blazing performance and easy extensibility. You remain in complete control of your new or existing database. No need to migrate to a... -
Go from Code to Production URL in SecondsSkip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
-
10
OWASP Amass
In-depth attack surface mapping and asset discovery
The OWASP Amass Project has developed a tool to help information security professionals perform network mapping of attack surfaces and perform external asset discovery using open source information gathering and active reconnaissance techniques. The Open Web Application Security Project (OWASP) is a nonprofit foundation that works to improve the security of software. All of our projects ,tools, documents, forums, and chapters are free and open to anyone interested in improving application... -
11
CodeChecker
CodeChecker is an analyzer tooling, defect database
CodeChecker is a static analysis infrastructure built on the LLVM/Clang Static Analyzer toolchain, replacing scan-build in a Linux or macOS (OS X) development environment. Executes Clang-Tidy and Clang Static Analyzer with Cross-Translation Unit analysis, Statistical Analysis (when checkers are available). Creates the JSON compilation database by wiretapping any build process (e.g., CodeChecker log -b "make"). Automatically analyzes GCC cross-compiled projects: detecting GCC or Clang... -
12
OSV.dev
Open source vulnerability DB and triage service
...The platform includes a web UI, API, and a Go-based dependency scanner that checks software dependencies, container images, SBOMs (SPDX, CycloneDX), and Git repositories for known vulnerabilities. This repository contains the full infrastructure code for deploying osv.dev on Google Cloud Platform, including Terraform configurations, APIs, data pipelines, indexers, and background workers for vulnerability ingestion and impact analysis. -
13
Motor
The async Python driver for MongoDB and Tornado or asyncio
Motor is an asynchronous Python driver for MongoDB that enables developers to work with MongoDB using non-blocking I/O patterns, making it ideal for high-performance and scalable applications. Built on top of Python’s Tornado and asyncio frameworks, Motor lets you issue database operations without blocking the event loop, enabling concurrency in web servers, real-time systems, and microservices. It provides a familiar API surface similar to the official synchronous PyMongo driver, so you can... -
14
This project has evolved from its original version into Calimero (a new Windows desktop wallpaper manager). Details here: https://sourceforge.net/projects/kalimero/ WallPaper (alias crawlpaper) is a desktop changer (NOT a screensaver) which includes a web crawler for picture download, an audio stream ripper, an audio player, a mini mp3 tag editor,etc. Also included support for .zip and .rar files and an interface to the BerkleyDB code for small databases.
-
15
"Aubit 4GL" is a project to make GPL, OpenSource, Informix-4GL compatible compiler, and continue to extend functionality needed to write most efficient and productive business related, database oriented applications. See "Home Page" link for more.
-
16
nuBuilder Forte
nuBuilder Forte is a cloud database builder.
nuBuilder Forte is the 4th version of nuBuilder. A open-source browser-based tool created for developing web-based database applications. nuBuilder uses either MySQL or MariaDB databases and gives its users the ability to do database operations like... • Search, Create, Insert, Read, Update, Delete ✪ With low-code tools that create ... - Forms with the Form Builder - Fast Reports - Database queries with the SQL Builder - Customised date and number formats with the Format Builder - Calculated fields with the Formula Builder - Email Templates - Move and resize objects... -
17
deltasql
Version Control for your Database
deltasql is an advanced Database Schema Version Control. It allows a team to commonly develop a data model on the fly, while the source code is growing. Sync algo supports branches and tags. Works for postgreSQL, Oracle, mySQL, MariaDB, Microsoft SQL Server or any SQL-like db. -
18
LiteDB
An open source MongoDB-like database with zero configuration
LiteDB is a serverless database delivered in a single small DLL (< 450kb) fully written in .NET C# managed code (compatible with .NET 4.5 and NETStandard 2.0). Install it via NuGet or just copy the DLL to your bin project folder. LiteDB is a simple and fast NoSQL database solution. Ideal for mobile apps (Xamarin ready), desktop/local applications, application file format, web applications, and one database per account/user data store. Portable UWP and Xamarin iOS/Android, ACID transactions,... -
19
GeoTools, the Java GIS toolkit
Toolkit for working with and mapping geospatial data
GeoTools is an open source (LGPL) Java code library which provides standards compliant methods for the manipulation of geospatial data. GeoTools is an Open Source Geospatial Foundation project. The GeoTools library data structures are based on Open Geospatial Consortium (OGC) specifications. -
20
OpenSparrow
Advanced Data Management Platform | PHP + vanilla JS + Postgres!
OpenSparrow is an open-source, self-hosted PHP + PostgreSQL platform with a vanilla JS frontend. Define your tables and relations in the friendly admin panel or directly in a JSON configuration file — the platform automatically generates data grids, forms, dashboards, and calendars. Full control over your data, zero vendor lock-in, zero dependency on external libraries. Perfect building HR/WMS/ERP/CRM systems, booking applications, task trackers and other custom application. Data Grid -... -
21
Anti-Plagiarism - software designed to effectively detect and thereby prevent plagiarism. It is a versatile tool to deal with World Wide Web copy-pasting information from the assignment of authorship. The goal of this program is to help reduce the impact of plagiarism on education and educational institutions. Checking documents in a format *.rtf, *.doc, *.docx, *.pdf Check the source code C, C++, C#, Java, ... Download - https://ap.km.ua/ Documentation - https://ap.km.ua/
-
22
rdfxx
C++ wrapper for Redland librdf
This library provides a thin abstraction layer over the Redland librdf library. It provides a simple to use C++ interface for RDF data. This is a component of the SASSY project. Please note that this code is at the prototyping phase. New features will be added as they are identified as a requirement for other SASSY projects. If you think that this software would be useful in your project, but need additional features please raise a ticket describing your requirement. Similarly, please... -
23
JVx - Enterprise Application Framework
Java Application Framework
Develop professional database applications, highly performant with little source code. JVx is a full-stack application framework to create multi tier applications with Single Sourcing for different technologies (Swing, vaadin, react, ...). Nightly builds are available: https://dev.sibvisions.com/jvx.nightly/ Maven snapshots are available: https://oss.sonatype.org/content/repositories/snapshots Eclipse plugin is available: http://marketplace.eclipse.org/search/site/eplug -
24
Formitable is a PHP class which can output HTML forms from MySQL database tables. The table is analyzed in order to output a form which uses the best input type for each field. The forms are customizable and data is inserted into the table on submission.
-
25
HTML5 Boilerplate
The web’s most popular front-end template
HTML5 Boilerplate is a popular and professional front-end template that lets you build fast, robust and adaptable web sites or applications. It’s built with the combined knowledge and effort of hundreds of developers over a span of years, creating a powerful tool in one small package. HTML5 Boilerplate comes loaded with great features, such as HTML5 support, optimized Google Analytics snippet, jQuery and Modernizr, and so much more. It supports the latest and most popular browsers and...
