Search Results for "data collection algorithm"
Sort By:
Showing 22 open source projects for "data collection algorithm"
View related business solutions-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
Our Free Plans just got better! | Auth0You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
-
1
douyin
Open source Douyin crawler for collecting and downloading public data
DouyinCrawler is an open source data collection tool designed to gather publicly available information from the Douyin platform. It demonstrates how to build a Python-based web crawler combined with a graphical interface and command line functionality. It allows users to collect data from various types of Douyin content, including user profiles, videos, hashtags, and music pages. -
2
Immutable.js
Immutable collections for JavaScript
Immutable.js offers a collection of Persistent Immutable data structures for JavaScript. Immutable data is unchangeable once created, which makes application development so much simpler. There’s no defensive copying, and you get advanced memoization and change detection techniques with simple logic. Persistent data gives you a mutative API, one that doesn’t update data in-place but always produces new and updated data. -
3
POI POI POI
Scalable KanColle browser and tool
poi is a scalable browser and tool set for Kantai Collection(KanColle). Key features include proxy,HTTP, Socks5 and PAC (Experimental). Cache, including custom cache. Data synthesis and analysis. Notification and plugin support for extensive functionalities. -
4
crawler
Collection of JS reverse engineering examples for web scraping study
crawler is a collection of web scraping and JavaScript reverse engineering examples designed for learning how modern websites protect their data and how those protections can be analyzed. It contains many case studies that demonstrate how to analyze and replicate request parameters, cookies, and encryption logic used by real websites. Each directory in the project focuses on a specific target service or scenario, showing how browser network requests and JavaScript code can be studied to reproduce API calls programmatically. ... -
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
5
Waterfox
Privacy browser built for users who value customization & control
...It began as a 64-bit-focused fork and has grown into a full-featured browser available on Windows, macOS, Linux, and Android, making it a versatile alternative to mainstream browsers. Waterfox removes or disables much of Firefox’s telemetry and unnecessary data collection by default, giving users greater control over what is shared with third parties while still supporting classic and modern add-ons. The project emphasizes speed and efficiency through optimizations and choice, letting users tweak settings or install favored extensions without being locked into ecosystem constraints. Because it’s open source and actively developed by the community, new features, security updates, and performance improvements arrive regularly to align with web standards. -
6
Jimp
An image processing library written entirely in JavaScript for Node
An image processing library for Node written entirely in JavaScript, with zero native dependencies. If you're using this library with TypeScript the method of importing slightly differs from JavaScript. Instead of using require, you must import it with ES6 default import scheme. If you're using a web bundles (webpack, rollup, parcel) you can benefit from using the module build of jimp. Using the module build will allow your bundler to understand your code better and exclude things you aren't... -
7
DotnetSpider
Lightweight .NET framework for fast web crawling and data scraping
...DotnetSpider is modular, allowing different components such as request schedulers, downloaders, and storage systems to work together in a flexible workflow. DotnetSpider also supports distributed crawling environments, making it possible to scale data collection across multiple agents and machines. With support for various storage backends and extensible parsing mechanisms, it is suitable for building complex scraping systems or automated data gathering pipelines. -
8
spider_collection
Collection of Python web scraping scripts for data extraction tasks
...Several scripts also incorporate multi-threading and proxy usage to improve scraping efficiency and help avoid common anti-scraping limitations. In addition to raw data collection, some spiders include basic data processing and analysis using tools such as pandas and simple visualization with matplotlib. It also contains examples of proxy pool integration and encapsulation to support more reliable crawling when working with sites that enforce request limits. -
9
Hirtius
A Historical Research Assistant
Hirtius is a web-based historical research assistant created by Les Ateliers du Héron. Its goal is to replace the historian's notebook and box of cards, while providing a collaborative work environment for a whole team of researchers, that can be thought of as a purpose-built CMS cross-bred with a digital pictures management system, a genealogy application and a Wiki. Eventually, based on the information you stored in the application, and the links you created between the various data... -
$300 Free Credits for Your Google Cloud ProjectsLaunch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.
-
10
CloudMapper
CloudMapper analyzes your Amazon Web Services (AWS) environments
...You must have AWS credentials configured that can be used by the CLI with reading permissions for the different metadata to collect. Cloudmapper needs to make IAM calls and cannot use session credentials for collection, so you cannot use the AWS-vault server if you want to collect data, and must pass role credentials indirectly or configure AWS credentials manually inside the container. Generate HTML report. Includes a summary of the accounts and audit findings. Generate an HTML report for the IAM information of an account. -
11
React Performance Devtool
A browser developer tool extension to inspect performance
...With every re-render, measures are updated and logged to the console. To use this devtool extension, you'll need to register an observer in your app which will observe a collection of data (performance measures) over time. Registering an observer hooks an object containing information about the events and performance measures of React components to the window object, which can then be accessed inside the inspected window using eval(). -
12
AWS Serverless Workshops
Code and walkthrough labs to set up serverless applications
This repository contains a collection of workshops and other hands-on content that will guide you through building various serverless applications using AWS Lambda, Amazon API Gateway, Amazon DynamoDB, AWS Step Functions, Amazon Kinesis, and other services. This workshop shows you how to build a dynamic, serverless web application. You'll learn how to host static web resources with Amazon S3, how to use Amazon Cognito to manage users and authentication, and how to build a RESTful API for... -
13
SD Download Manager
Download anything from the Internet, with 32 connections and quickly
A fast download manager with 32 connection for download anything from internet SD Download Manager is a advanced and powerful tool to increase download speed up-to 500%, resume broken/dead downloads. SD Download Manager uses sophisticated dynamic segmentation algorithm,data compression and connection reuse to speed up the download process. SD Download Manager supports HTTP, HTTPS and FTP protocols, firewalls, proxy servers, automatic proxy scripts, file redirects, cookies, authorization etc. - Do you have a problem in download ? - Is your downloads speed is low ? - Are you looking for a way to download faster ? ... -
14
GIIAF Microscopy Library
The GIIAF Microscopy Library, that uses customised OMERO software
This project incorporates a suite of tools that aim to allow researchers within Griffith's Imaging and Image Analysis Facility (GIIAF) to efficiently and effectively provide secure, centralised, web-accessible data storage, management and manipulation. The open-source Java-based OMERO software was customised to provide most of the features of this project. -
15
Metadata.net is a collection of website components and tools for creating and using metadata produced by the eResearch Group at ITEE, University of Queensland.
-
16
A collection of JavaScript libraries for painless client-side SVG manipulation: SVGKit provides browser-independent access and interaction, SVGCanvas implements Canvas API with SVG-specific additions, and SVGPlot plots/graphs data and functions.
-
17
Cloud Suite is a collection of web apps, meant to be run on a personal server. This is an excellent substitute for the large cloud, for those who are concerned about privacy. Because it is not run by a company, you have full control over your data.
-
18
This API enables objects to be easily passed from Java to JavaScript via XML. It consists of a Java library and a JavaScript file. The Java recursively turns any bean or collection into XML. The JavaScript returns an object similar to the Java object.
-
19
Brewthology
PHP based BeerXML homebrew recipe database
Web based Brewing Recipe Database with integrated calculator and XML Support. Allows users to upload or create beer recipes, save them, and download them as BeerXML files. Visitors can view, rate, and download recipes from the collection. -
20
eDemonOnline is a set of libraries for ASP .NET. It includes the PHP .NET sub-project(a port of PHP functions library to the .NET framework) along with a collection of web controls, class libraries and tools. For more info see the documentation section.
-
21
Sqlmatrix
Web table that connects to a mySQL table and shows its data
Collection of JS / Php files that implement a html/js table, which can connect to a table in an mySQL database and show it's contains. The source is designed in a way that is easy to add to your website with the minimum configuration. The project makes use of Twitter Bootstrap. The main difference from DataTables is that only the appropriate elements are selected from the DB and every time a page change occurs (or a search) a new request is sent. This is optimal for tables with many records. -
22
ECI4All
A complete tool for the European Citizens' Initiative Organizer
ECI4All aims to be a fare replacement for the current Online Collection System for ECI. It allows ECI organizers to easily set up a system capable of gathering statements of support. Main features: - built on top of the Annex III of the Regulation on the citizens’ initiative - fully compliant with the Commission Implementing Regulation (EU) No 1179/2011 - fully customizable - can be easily integrated into the ECI campaign website - AMP solution (very easy and cheap to host) - built with security in mind (using hardware token based authentication) - data integrity can be checked at any given moment by the organizer - fast exporting operations - fast decryption of signatures - widgets for signature distributions
- Previous
- You're on page 1
- Next