Search Results for "task"
Sort By:
Showing 13 open source projects for "task"
View related business solutions-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
1
Dataproc Templates
Dataproc templates and pipelines for solving simple in-cloud data task
Dataproc templates are designed to address various in-cloud data tasks, including data import/export/backup/restore and bulk API operations. These templates leverage the power of Google Cloud's Dataproc, supporting both Dataproc Serverless and Dataproc clusters. Google provides this collection of pre-implemented Dataproc templates as a reference and for easy customization. -
2
Denwer SE
Local web stack for Windows (Apache, PHP, MySQL, MariaDB)
...It features a modern Python-based control panel (DenwerSE.exe) to easily manage Apache, multiple PHP versions, and MySQL/MariaDB database engines simultaneously without manual configuration wrappers. Key features include pre-configured virtual hosts generation based on directory contents, automated hosts file updates, virtual drive mapping, a built-in task scheduler (cron background daemon), and full HTTPS local Root CA certificate management. Pre-bundled components: Apache 2.4, PHP (5.6 to 8.5), MySQL 5.7, MariaDB 11.8, and phpMyAdmin. An unofficial community build designed for seamless, isolated offline web development workflows on Windows 7 SP1 up to Windows 11. -
3
Open-CD
A Change Detection Repo Standing on the Shoulders of Giants
Open-CD is an open source change detection toolbox based on a series of open source general vision task tools. -
4
Crawlab
Distributed web crawler admin platform for spiders management
...The frontend app interacts with the master node, which communicates with other components such as MongoDB, SeaweedFS and worker nodes. Master node and worker nodes communicate with each other via gRPC (a RPC framework). Tasks are scheduled by the task scheduler module in the master node, and received by the task handler module in worker nodes, which executes these tasks in task runners. Task runners are actually processes running spider or crawler programs, and can also send data through gRPC (integrated in SDK) to other data sources, e.g. MongoDB. -
$300 Free Credits to Build on Google CloudStart your next project with $300 in free Google Cloud credit. Spin up VMs, run containers, query petabytes in BigQuery, or build agents with Gemini Enterprise Agent Platform. Once your credits are used, keep building with 20+ always-free tier products including Compute Engine, Cloud Storage, GKE, and Cloud Run functions. No commitment required—just sign up and start building.
-
5
pspider
Simple Python framework for building multithreaded web crawlers
PSpider is a lightweight web crawling framework written in Python designed to simplify the development of custom web spiders. It focuses on providing an easy-to-understand architecture while still supporting concurrent crawling for improved performance. It uses a multithreaded model that separates the crawling workflow into several components responsible for fetching, parsing, and saving data. Tasks are managed through queues, allowing different parts of the crawler to process work... -
6
pyspider
A powerful Spider(Web Crawler) system in Python
pyspider is a powerful Spider(Web Crawler) system in Python. Components are connected by message queue. Every component, including message queue, is running in their own process/thread, and replaceable. That means, when process is slow, you can have many instances of processor and make full use of multiple CPUs, or deploy to multiple machines. This architecture makes pyspider really fast. benchmarking. Since pyspider has various components, you can just run pyspider to start a standalone and... -
7
haipproxy
Distributed proxy IP pool for web crawlers using Scrapy and Redis
...It automatically crawls proxy resources from the internet and aggregates them into a centralized pool that can be accessed by distributed spiders and scraping systems. It is built using Python and relies on Scrapy for high-performance crawling while Redis is used for data storage, communication, and task coordination between components. It includes crawlers that discover proxy servers, validators that test proxy availability and performance, and schedulers that manage crawling and validation tasks. HAipproxy aims to maintain a high availability proxy pool with low latency so that scraping frameworks can rotate proxies efficiently and avoid blocking during large-scale data collection. ... -
8
raapchikftp
single click ftp tool
Feed up with file upload software Here is good News, RaapchikFTP Allows do all FTP task on single click so download RaapchikFTP RaapchikFTP is single click FTP tool, Allows you to upload, download files by just single click. Allow to transfer files over FTP, FTPS, SSH. Supported on windows 64 bits machine. Linux ubuntu and fedora version coming soon plz watch video https://www.youtube.com/watch?v=cDGzzxcvdA0 -
9
Web Crawler Security Tool
A web crawler oriented to information security.
Last update on tue mar 26 16:25 UTC 2012 The Web Crawler Security is a python based tool to automatically crawl a web site. It is a web crawler oriented to help in penetration testing tasks. The main task of this tool is to search and list all the links (pages and files) in a web site. The crawler has been completely rewritten in v1.0 bringing a lot of improvements: improved the data visualization, interactive option to download files, increased speed in crawling, exports list of found files into a separated file (useful to crawl a site once, then download files and analyse them with FOCA), generate an output log in Common Log Format (CLF), manage basic authentication and more! ... -
Your monitoring isn't a stack. It's a pile. Fix that.Replace Datadog, New Relic, and Sentry without adding three more dashboards.
-
10
Fstorage is a free, open-source, lightweight and fast File Storage Software. Storage is task of server and file hosting. Clients/APIs are designed for use by C/C++/Python/PHP programmers can send files and receive files for particular FileKey.
-
11
Software tool that emphasizes useful information, communication, and intent. Accomplish any conceivable computer task by transforming fuzzy abstract data-structures in a fractal vector graphics user interface.
-
12
...The overall search technology is built on the individual components of this project, each component is released under the BSD License, and is written in the language most suited to its task.
-
13
LivingPages is a really easy to use web development environment based on Apache, PHP and MySQL. It provides you a GUI to manage your webserver and a lot of utilities that will make managing your web projects an incredibly easy task.
- Previous
- You're on page 1
- Next
