Search Results for "data collection algorithm" - Page 3
Sort By:
Showing 126 open source projects for "data collection algorithm"
View related business solutions-
Our Free Plans just got better! | Auth0You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
1
LymPHOS2
LymPHOS2 Web-App
...DOI: 10.1021/pr800500r - Ovelleiro, D., Carrascal, M., Casas, V., Abian, J., LymPHOS: design of a phosphosite database of primary human T cells. Proteomics 2009, 9, 3741–3751. DOI: 10.1002/pmic.200800701 - Gallardo, Ó., Ovelleiro, D., Gay, M., Carrascal, M., Abian, J., A collection of open source applications for mass spectrometry data mining. Proteomics 2014, 20, 2275-2279. DOI: 10.1002/pmic.20140012 -
2
XRichText
An Android rich text class library that supports graphic & text mixing
...Use ScrollView as the outermost layout containing LineaLayout, filled with TextView and ImageView. When deleting, delete the TextView and ImageView according to the position of the cursor, and the text will be automatically merged. The generated data is a list collection, and the data format can be customized. Version V1.4 opens the image click event interface and delete image interface. For specific usage methods, please refer to the following documentation, or refer to the demo implementation. The picture selector in the Demo is the Zhihu open-source library Matisse, which is adapted to the Android 7.0 system and uses FileProvider to obtain the picture path. ... -
3
ECommerceCrawlers
Collection of Python ecommerce and website crawler examples projects
ECommerceCrawlers is a collection of practical Python web crawler projects designed to gather data from a variety of ecommerce platforms, websites, and online services. It aggregates many independent crawler examples created by contributors and organized into separate subprojects that target specific sites or data sources. These examples demonstrate how to build and operate web scrapers capable of collecting structured information such as product listings, news content, job postings, social media data, and other publicly available web data. ... -
4
React Performance Devtool
A browser developer tool extension to inspect performance
...With every re-render, measures are updated and logged to the console. To use this devtool extension, you'll need to register an observer in your app which will observe a collection of data (performance measures) over time. Registering an observer hooks an object containing information about the events and performance measures of React components to the window object, which can then be accessed inside the inspected window using eval(). -
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
5
ATTENTION: For more info and latest version, refer to https://github.com/estigma88/jdhtuq. jDHTUQ is a peer-to-peer DHT system based in Chord algorithm, but built like API to generalize the implementation of peer-to-peer DHT systems. jDHTUQ have two fundamental services , put and get of resource.
-
6
mzitu
Python crawler that downloads image galleries and analyzes titles
...This makes the repository both a scraping example and a small data analysis experiment built around the collected content. Overall, mzitu serves as a learning-oriented implementation of Python web scraping, data processing, and visualization techniques. -
7
WeChatSogou
Python library to crawl and retrieve data from WeChat accounts
...These components work together to process HTTP requests, handle verification mechanisms, and transform HTML or JSON responses into usable objects. Developers can integrate the library into scripts or larger data collection systems to automate gathering content from public accounts. -
8
Notary
Have trust over arbitrary collections of data
Notary is a project that aims to make the internet more secure by simplifying how people publish and verify content. The Notary project is made up of a server and a client made to run and interact with trusted collections. Instead of relying on TLS to secure communications with a web server that's susceptible to malicious content, publishers can sign their content offline using secure keys with Notary. Once ready to make the content available, publishers can then push their signed trusted... -
9
haipproxy
Distributed proxy IP pool for web crawlers using Scrapy and Redis
...It automatically crawls proxy resources from the internet and aggregates them into a centralized pool that can be accessed by distributed spiders and scraping systems. It is built using Python and relies on Scrapy for high-performance crawling while Redis is used for data storage, communication, and task coordination between components. It includes crawlers that discover proxy servers, validators that test proxy availability and performance, and schedulers that manage crawling and validation tasks. HAipproxy aims to maintain a high availability proxy pool with low latency so that scraping frameworks can rotate proxies efficiently and avoid blocking during large-scale data collection. ... -
$300 Free Credits for Your Google Cloud ProjectsLaunch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.
-
10
casync
Content-addressable data synchronization tool
...Let's call this directory a "chunk store". At the same time, generate a "chunk index" file that lists these chunk hash values plus their respective chunk sizes in a simple linear array. The chunking algorithm is supposed to create variable, but similarly sized chunks from the data stream. -
11
beanbun
PHP multiprocess web crawling framework with distributed support
Beanbun is a web crawling framework written in PHP that is designed to help developers build scalable and customizable web scrapers. Beanbun focuses on simplicity while providing a flexible architecture that supports complex crawling workflows. It supports both normal execution mode and daemon mode, allowing crawlers to run continuously in long-running background processes when needed. Beanbun uses a downloader component based on Guzzle and integrates with Workerman to enable multi-process... -
12
AWS Serverless Workshops
Code and walkthrough labs to set up serverless applications
This repository contains a collection of workshops and other hands-on content that will guide you through building various serverless applications using AWS Lambda, Amazon API Gateway, Amazon DynamoDB, AWS Step Functions, Amazon Kinesis, and other services. This workshop shows you how to build a dynamic, serverless web application. You'll learn how to host static web resources with Amazon S3, how to use Amazon Cognito to manage users and authentication, and how to build a RESTful API for... -
13
AlienVault OSSIM
Open Source SIEM
OSSIM, AlienVault’s Open Source Security Information and Event Management (SIEM) product, provides event collection, normalization and correlation. For more advanced functionality, AlienVault Unified Security Management (USM) builds on OSSIM with these additional capabilities: * Log management * Advanced threat detection with a continuously updated library of pre-built correlation rules * Actionable threat intelligence updates from AlienVault Labs Security Research Team * Rich analytics dashboards and data visualization -
14
MediaWiki Extpack
The collection of extensions for MediaWiki software.
MediaWiki Extpack contains a collection of useful extensions for MediaWiki software. The Multi-Category Search extension allows users to find wiki pages that are included in several specified categories at once. MS SQL Database Authentication extension authenticates users and gets users data from external Microsoft SQL Server database. Ticket Authentication extension provides customizable ticket-based authentication for SSO solutions. -
15
SD Download Manager
Download anything from the Internet, with 32 connections and quickly
A fast download manager with 32 connection for download anything from internet SD Download Manager is a advanced and powerful tool to increase download speed up-to 500%, resume broken/dead downloads. SD Download Manager uses sophisticated dynamic segmentation algorithm,data compression and connection reuse to speed up the download process. SD Download Manager supports HTTP, HTTPS and FTP protocols, firewalls, proxy servers, automatic proxy scripts, file redirects, cookies, authorization etc. - Do you have a problem in download ? - Is your downloads speed is low ? - Are you looking for a way to download faster ? ... -
16
complemento
Complemento is a collection of tools for pentesters.
Complemento is a collection of tools for pentesters: LetDown is a powerful tcp flooder ReverseRaider is a domain scanner that use wordlist scanning or reverse resolution scanning Httsquash is an http server scanner, banner grabber and data retriever -
17
HelloAbacusUtil
A general programming utility library in Java
It's a tutorial project for AbacusUtil. AbacusUtil is a general java programming utility library/framework. It provides below features: 1, Exclusive SQL executor with well-designed API. It’s more than two times faster than SpringJDBC/iBatis/Hibernate. 2, Supports serialization from java object to JSON/XML or deserialization from JSON/XML to java object with concise and high performance APIs. 3, Supports http client and web service programming in simple way. 4, The big 'N', a... -
18
Constrained Ellipse Fitting
MATLAB Code for Constrained Ellipse Fitting with Center on a Line
The provided Matlab code allows for fitting an ellipse to given data points with the additional prior knowledge that the center of the ellipse is located on a given line. The usage of this constraint in a new global convergent one-dimensional search problem ("Tunneling") improves the fitting accuracy compared to other ellipse fitting methods. You can find more details on the theoretical background of the presented algorithm here: http://doi.org/10.1007/s10851-015-0584-x If you use the code please cite our paper: Waibel, P; Matthes, J.; Gröll, L; Constrained Ellipse Fitting with Center on a Line; Journal of Mathematical Imaging and Vision; November 2015, Volume 53, Issue 3, pp 364-382 -
19
Intelligent Keyword Miner
Intelligent SEO keyword miner and predicing tool
...Programs that have similar idea are: Google AdWords, SERPWoo's Keyword Finder, Wordpot, and others. Difference is, this program is intelligent and it accepts your input data and then predicts keywords based on your likes or dislikes. As the main engine, it uses the SMOReg algorithm to analyze and map the keyword frequencies of your data. This can be a great SEO tool to help increase the traffic of any website featuring a product. -
20
The Mooty Tool Kit (MTK) is a feature-rich Bash tool kit that makes it easy for you to perform High Performance Administration (HPA) task in your environment. HPA task include: * Mass-management of computers * Deployment of files * Collection of system data reports * And much, much more The MTK leverages existing Network Operating System infrastructure, so it is very light, flexible, portable and powerful. The kit comes with multiple tools that make mass management simple and effective. The MTK can be set up quickly, and torn down just as quickly. Use the MTK when you need tools to perform mass tasks BELOW other configuration and mass management tools. ...
-
21
PHP Voucher
PHP Voucher Manager
PHP Voucher is a simple manager to create, check and execute unique vouchers. It works without SQL database. The generated codes are encrypted with MD5 algorithm and saved in data files (*.dat). Executed vouchers are registered and cannot be used again. Generating codes: makecode.php Checking codes: checkvoucher.php Configuration: config.php Style: main.css -
22
nsapache
NSA Apache Log Inspector
This program (alogrpt) will find activities in your Apache Log Files which indicate mass data collection quickly using a simple alogrithm. A supplement program is included (aplogip) for more functional Log searches and can be used to confirm results of alogrpt. It has been in use for over a year and has identified thousands of snoopers. Both programs expect Apache Default Log Formats. -
23
Job Crawler
Job Data Collection - Web Crawler
...Moreover, program is going to reply on these figures, and performs a detailed analysis for the employment situation of the states of the USA. What is the hot job in your state? This report is going to explain how to design and implement solution for Job data collection system. It also includes some links for source code, class diagram, algorithm -
24
webStraktor is a programmable World Wide Web data extraction client. Its purpose is to scrape HTML based content via the HTTP protocol and extract relevant information. webStraktor features a scripting language to facilitate the collection, the extraction and the storage of information available on the web, including images. The scripting language uses elements of the Regular Expression and xPath syntax.
-
25
QPass is easy to use, open source password manager application with built-in password generator. You can store in it's database such data as passwords and logins which will be encrypted using AES-256 with PBKDF2(number of iterations set by user). Each entry can include additional information about entry such as name, url adress and description.