Search Results for "automate data"
Sort By:
Showing 22 open source projects for "automate data"
View related business solutions-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
Save Up to 91% on Cloud Compute With Spot VMsRun batch jobs at 60-91% off with Spot VMs. Long-running workloads get automatic discounts with sustained use.
-
1
Automa
A chrome extension for automating your browser by connecting blocks
Automa is a browser extension for browser automation. From auto-fill forms, doing a repetitive task, taking a screenshot, to scraping data of the website, it's up to you what you want to do with this extension. Automa has provided various kinds of blocks that will help you do automation, and all you need to do is connect them. Want your workflow to run every day or every time you visit a specific website? You can set the workflow trigger on the trigger block. Try a workflow from the... -
2
BrowserOS
Agentic browser; privacy-first alternative to ChatGPT Atlas
...Rather than just doing standard browsing, it places AI intelligence at the core: you can connect your own API keys (for e.g., OpenAI, Anthropic, Google Gemini) or run local models (via e.g., Ollama) so that your browsing data and automation stay on your machine — privacy and control are emphasized throughout. The interface remains familiar to users of Chrome (including support for Chrome extensions), but adds new capabilities: the browser can automate tasks for you, help you research by extracting and summarizing content, and enable agent-based workflows (e.g., “go fetch this info,” “fill this form,” “monitor this site”). ... -
3
skycaiji
Open source web scraping system for automated data collection tasks
SkyCaiji is an open source web scraping and data collection system designed to gather information from websites through configurable extraction rules. It focuses on simplifying the process of building crawlers by allowing users to visually define scraping rules rather than writing complex code. It can collect structured or unstructured data from many types of webpages and automate the extraction process for large datasets. -
4
Amazon SSM Agent
An agent to enable remote management of your EC2 instances
AWS Systems Manager is a secure end-to-end management solution for hybrid cloud environments. AWS Systems Manager is the operations hub for your AWS applications and resources, and is broken into four core feature groups. Aggregate data in a single console and gain actionable insights across AWS services such as Amazon CloudWatch, AWS CloudTrail, and AWS Config, as well as third-party tools. Leverage operational data to easily manage applications and identify issues quickly across associated AWS resource groups. Automate proactive processes such as patching and resource changes, as well as reactive processes, to quickly diagnose and remediate operational issues before they affect users. ... -
Go from Code to Production URL in SecondsSkip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
-
5
Etaoin
Pure Clojure Webdriver protocol implementation
A pure Clojure implementation of the Webdriver protocol, named after Etaoin Shrdlu, a typing machine that came to life after a mysterious note was produced on it. Use the Etaoin library to automate a browser, test your frontend behavior, simulate human actions or whatever you want. Currently supports Chrome, Firefox, Safari, and Edge. Can either connect to a remote WebDriver process or have Etaoin launch one for you. Run your unit tests directly from Emacs by pressing C-t t as usual. Can... -
6
Symfony Panther
A browser testing and web crawling library for PHP and Symfony
Symfony Panther is a browser testing and web scraping tool that allows developers to interact with websites programmatically. It uses headless Chrome or Firefox to automate browser tasks, making it suitable for end-to-end testing and data extraction. Panther integrates well with Symfony and PHPUnit, allowing developers to write comprehensive tests for web applications. -
7
MDCx
Movie metadata scraper and organizer for media libraries and NFO
MDCx is an open source media metadata scraping and organization tool designed to automate the process of collecting detailed information for movie files. It retrieves metadata from multiple online sources and applies it to local media collections, helping users maintain structured and well-organized libraries. MDCx can download information such as titles, cast data, artwork, and other metadata, then generate standardized NFO files compatible with media management systems. ... -
8
Python API for JMComic
Python crawler and API for downloading JMComic albums and images
...It provides a structured API that allows developers to retrieve albums, chapters, and images using simple Python code while handling the necessary network requests and data processing behind the scenes. It supports both web-based and mobile API interfaces, enabling flexible interaction with the platform depending on the available endpoints. Its architecture includes components for configuration management, download orchestration, and client communication, allowing users to automate the retrieval of manga chapters or entire albums. ... -
9
Mixpost
Self-hosted social media management software (Buffer alternative)
Mixpost it's the coolest Self-hosted social media management software. This package is the Lite version of Mixpost Pro. Mixpost is a robust and versatile social media management platform, designed to streamline social media operations and enhance content marketing strategies. Our platform empowers brands and businesses to effectively manage their online presence, leading them to success in the dynamic digital landscape. Mixpost's mission is to offer a comprehensive and powerful solution,... -
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
10
apache-logs-to-mysql
Apache Log Parser and Data Normalization Application
Apache Log Parser and Data Normalization Application Python handles File Processing & MySQL handles Data Processing ApacheLogs2MySQL consists of two Python Modules & one MySQL Schema to automate importing Access & Error files and normalizing data into database designed for reports & data analysis. Runs on Windows, Linux and MacOS & tested with MySQL versions 8.0.39, 8.4.3, 9.0.0 & 9.1.0. 4 LogFormats & 2 ErrorLogFormats can be loaded and 5 MySQL Stored Procedures can be processed in a single Python `ProcessLogs function` execution. ... -
11
uweb browser: unlimited power
minimal suckless android web browser with unlimited power
... - Tiny: less than 200k - Fast: run fast, even with thousands of user provided css/scripts - Efficient: less touches, one click to reach any number of search engines without repeated input; automate online services. - URL bar command line support ("!" and .js files as commands). - user-defined site-specific JS/CSS/HTML/preprocessing. - Online play/preview/preprocess for downloadable resources. - Multiple type profiles: switch any data including logins/config orthogonally - web automation, crontab (alarm clock) -
12
go-dork
Fast Go-based CLI scanner for running automated search engine dorks
go-dork is an open source command-line tool designed to automate search engine dorking and reconnaissance tasks. Written in the Go programming language, it focuses on speed and efficiency when executing advanced search queries across multiple search engines. It allows users to run specialized queries, often referred to as “dorks,” to discover publicly exposed data, misconfigurations, or potentially vulnerable resources. -
13
MD Log parser
Standalone application for parsing MD simulation Log files
...Log files from MD simulations contain crucial details regarding the simulation's progression, energy terms, trajectories, and other pertinent parameters. Extracting and comprehensively analyzing this data manually can be both time-intensive and demanding. Consequently, the MD Log Parser project seeks to automate this procedure, offering researchers a user-friendly tool to efficiently extract valuable insights from MD simulation log files. -
14
mlscraper
ML-based HTML scraper that learns extraction rules from examples
...The result is a developer-oriented tool that aims to automate common scraping workflows. -
15
DumpItBlue
Dump Facebook stuff for analysis or reporting purposes.
Investigators, researchers or other analysts often have to get local copies of Facebook data. It can be necessary for a lot of reasons like submitting Facebook data as evidence, doing advanced offline analysis, etc. But Facebook interface has not been designed for that and does not provide printing or saving functions. DumpItBlue has been designed to help people to extract data from Facebook. It provides usefull functions to automate a lot of tasks that have to be done manually otherwise. ... -
16
WeChatSogou
Python library to crawl and retrieve data from WeChat accounts
...These components work together to process HTTP requests, handle verification mechanisms, and transform HTML or JSON responses into usable objects. Developers can integrate the library into scripts or larger data collection systems to automate gathering content from public accounts. -
17
FreeFileSync
Free data backup software to synchronize files and folders
FreeFileSync is a free Open Source software that helps you synchronize files and synchronize folders for Windows, Linux and macOS. It is designed to save your time setting up and running data backups while having nice visual feedback along the way. _______________________________________________________________ DOWNLOAD LINKS (official homepage): https://freefilesync.org/ -
18
VBot
JSON based visual regression testing library
A visual regression testing library/tool, aims to quickly automate browser-based tests with minimum development overhead. To test flexibly in different testing scenarios, either testing against web UI wired with backends or just static web pages, VBot exposes API to be used with testing frameworks like mocha or ava, etc. Therefore, the test data variables can be updated according to different conditions, in order to decouple from real backends and avoid false negative results. -
19
...It uses the IPv4 address to determine the geographic location of the request by using maxminds geo IP file and takes action accordingly. Next to the module, 2 tools are included. 1 to quickly lookup the country for a specific IP address and 1 to help you automate the update of the MaxMind data file. An extensive manual is available to install and use the module.
-
20
AWK Statistics
awkStatistics generates statistics from csv-data with awk.
AwkStatistics is a script which is used to generate statistical data for csv data by using awk. It takes two columns from the input file, one is used to identify the row(option -i) and the other one is the column where the values are taken from (option -v). The script was designed for performance engineers to be able to analyze CSV-Data on the fly and have a good possibility to automate the analysis process. -
21
What is a domain-specific language intended for constructing web services on top of ordinary web pages, or otherwise automate web-related tasks. Using a powerful pattern matching sublanguage, What strives to be for XML/HTML what Perl is for text analysis
-
22
Provide a command line client to automate the download of and password removal from market data archives available on the McLagan website 'https://www.McLaganCompResults.com'.
- Previous
- You're on page 1
- Next