Search Results for "python web crawler" - Page 38
Sort By:
Showing 3076 open source projects for "python web crawler"
View related business solutions-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
1
BlackWidow
Python web scanner for OSINT gathering and OWASP vulnerability fuzzing
BlackWidow is a Python-based web application scanning tool designed to crawl target websites and collect open-source intelligence (OSINT) while identifying potential security vulnerabilities. It functions as a web spider that systematically explores a site to gather valuable information such as URLs, dynamic parameters, subdomains, email addresses, and phone numbers associated with the target domain. -
2
IntrospectDB
File System Relational / Object Oriented DBMS/CMS
Introspect is a File System oriented Database Management System And CMS built on UNIX as a Python and HTML webapp. For the latest version use the Bitbucket repository: https://bitbucket.org/mieszkowski/introspect/src/master/ -
3
Ansible Examples
A few starter examples of ansible playbooks, to show features
This repository collects practical, real-world examples of using Ansible to automate infrastructure, deployments, and configurations. Each directory demonstrates a specific use case—ranging from setting up web servers, load balancers, and databases to orchestrating multi-tier applications in cloud environments. The examples highlight common Ansible practices such as organizing inventories, writing reusable playbooks, using roles, and handling variables and templates. They’re designed to be... -
4
Unified Sessions Manager
Pioneering Private and Public Cloud Management since 2008
The UnifiedSessionsManager supports the integrated management of user sessions within Private-Clouds, comprising heterogeneous IT landscapes of various physical and virtual machines, hypervisor management, and virtual user sessions with remote desktops. Extracted documents see https://sourceforge.net/projects/ctys-doc. -
Train ML Models With SQL You Already KnowBuild and deploy ML models using familiar SQL. Automate data prep with built-in Gemini. Query 1 TB and store 10 GB free monthly.
-
5
Decentralized Internet
SDK for building decentralized web and distributed computing projects
This project was created in order to support a new internet. One that is more open, free, and censorship-resistant in comparison to the old internet. An internet that eventually wouldn't need to rely on telecom towers, an outdated grid, or all these other "old school" forms of tech. We believe P2P compatibility is an important part of the future of the net. Grid Computing also plays a role in having a better means of transferring information in a speedy, more cost-efficient and reliable manner. -
6
Free Queue Manager
Web based python-flask Queue management system
A web based management system developed for the purpose of easing the process of orgnizing queues and lines. Like many other (QMS)s Queue Management Systems, FQM does provide a basic dashboard to allow the users of the system and customers alike to interact with the system via a basic yet simple user interface . Brief user guide can be found on https://fqms.github.io/images/user_guide.pdf -
7
iHome by ionware
iHome Smart Home System Platform
iHome is a fully tested Smart Home Automation system using the Raspberry Pi Zero WiFi SBC and Linux OS and has all the functional features of NEST or ECOBEE smart thermostats with the added benefit of full privacy and security at less than half the price! It incorporates MBLogic with algorithms and Modbus coms for HVAC home control via the ionware modbus compatible ionC1 input/output controller board. The iHome software system comes fully configured as a SD Card image file for... -
8
FavFreak
Favicon hash–based reconnaissance tool for security research
FavFreak is an open source reconnaissance tool designed to assist security researchers, bug bounty hunters, and penetration testers in identifying web technologies using favicon hashes. It works by taking one or more URLs as input and automatically retrieving the favicon.ico file associated with each target website. After fetching the favicon, it calculates a hash value and organizes the scanned domains, subdomains, or IP addresses according to these hashes. FavFreak then compares the... -
9
nginx ui
Nginx UI allows you to access and modify the nginx configurations
We use nginx in our company lab environment. It often happens that my colleagues have developed an application that is now deployed in our Stage or Prod environment. To make this application accessible nginx has to be adapted. Most of the time my colleagues don't have permission to access the server and change the configuration files and since I don't feel like doing this for everyone anymore I thought a UI could help us all. If you feel the same way I wish you a lot of fun with the... -
Demo Series - Small Business Backup By VeeamWatch this on-demand demo series and learn how to protect your Microsoft 365 data with clear, simple, actionable steps that are easy to implement for businesses of all sizes.
-
10
motionEyeOS
A video surveillance OS for single-board computers
motionEyeOS is a Linux distribution that turns a single-board computer into a video surveillance system. The OS is based on BuildRoot and uses motion as a backend and motionEye for the frontend. Compatible with most USB cameras as well as with the Raspberry PI camera module. Motion detection with email notifications and working schedule. JPEG files for still images, AVI files for videos. Connects to your local network using ethernet or wifi. File storage on SD card, USB drive or network SMB... -
11
Nyaa.si Batch Uploader
Mass upload torrents to normal and sukebe versions of Nyaa.si
Note: I am NOT the coder for this software but the only client of the one who coded this in 2017 from a forum, and I have not heard back from him since. So regarding help on this I will do the best that I can... This software will let you upload torrents to nyaa.si and sukebe.nyaa.si in batch quantities instead of manually doing one by one. -
12
-
13
Alfred-Workflow
Full-featured library for writing Alfred 3 & 4 workflows
Alfred-Workflow is a Python helper library for Alfred 2, 3 and 4 workflow authors, developed and hosted on GitHub. Alfred workflows typically take user input, fetch data from the Web or elsewhere, filter them and display results to the user. Alfred-Workflow takes care of a lot of the details for you, allowing you to concentrate your efforts on your workflow’s functionality. -
14
GoogleScraper
Python tool for scraping search engine results from many providers
GoogleScraper is a Python-based tool designed to automatically collect and process search engine results from multiple providers. It enables developers and researchers to programmatically query search engines and extract useful information such as links, titles, and result descriptions. GoogleScraper supports several major search engines and can be used to gather structured datasets from search result pages for further analysis. It provides two different scraping approaches: sending direct... -
15
COCO Annotator
Web-based image segmentation tool for object detection & localization
COCO Annotator is a web-based image annotation tool designed for versatility and efficiently label images to create training data for image localization and object detection. It provides many distinct features including the ability to label an image segment (or part of a segment), track object instances, label objects with disconnected visible parts, and efficiently store and export annotations in the well-known COCO format. The annotation process is delivered through an intuitive and... -
16
Nyaa.si Batch Torrent Upload
Batch torrent uploader for Nyaa.si
Batch upload via desktop to nyaa.si and sukebe.nyaa.si -
17
CBMPy
PySCeS Constraint Based Modelling
PySCeS CBMPy is a new platform for constraint based modelling and analysis. It has been designed using principles developed in the PySCeS simulation software project: usability, flexibility and accessibility. CBMPy supports the latest standards for encoding CBM models encoding, SBML L3 FBC, COBRA as well as MIRIAM compliant RDF and custom annotations. Its architecture is both extensible and flexible using data structures that are intuitive to the biologist while transparently... -
18
Python4Proteomics Course
Python course for Proteomics analysis
Python course (in Spanish) for Proteomics analysis using basically Jupyter NoteBooks. For more information, you can have a look at the readme.md file in the source code tree: https://sourceforge.net/p/lp-csic-uab/p4p/code/ci/default/tree/readme.md -
19
cintruder
CIntruder - OCR Bruteforcing Toolkit
Captcha Intruder is an automatic pentesting tool to bypass captchas. -> CIntruder-v0.4 (.zip) -> md5 = 6326ab514e329e4ccd5e1533d5d53967 -> CIntruder-v0.4 (.tar.gz) ->md5 = 2256fccac505064f3b84ee2c43921a68 -------------------------------------------- -
20
TCellXTalk
TCellXTalk Web-App from LP CSIC/UAB
TCellXTalk is a comprehensive database of experimentally detected phosphorylation, ubiquitination and acetylation sites in human T cells. The web-app at www.TCellXTalk.org makes TCellXTalk accessible from Internet, and enables the in silico prediction of potential co-modified peptides to facilitate their experimental detection, using targeted or directed mass spectrometry, for the study of protein post-translational modification cross-talk. More detailed information on TCellXTalk and... -
21
LymPHOS2
LymPHOS2 Web-App
LymPHOS2 is a web-based Application at www.LymPHOS.org containing peptidic and protein sequences and spectrometric information on the PhosphoProteome of human T-Lymphocytes. - Nguyen, TD., Vidal-Cortes, O., Gallardo, Ó., Abian, J., Carrascal, M., LymPHOS 2.0: an update of a phosphosite database of primary human T cells. Database 2015, 2015. DOI: 10.1093/database/bav115 - Carrascal, M., Ovelleiro, D., Casas, V., Gay, M., Abian, J., Phosphorylation analysis of primary human T lymphocytes... -
22
GoodByeCatpcha
Solver ReCaptcha v2 Free
An async Python library to automate solving ReCAPTCHA v2 by images/audio using Mozilla's DeepSpeech, PocketSphinx, Microsoft Azure’s, Google Speech and Amazon's Transcribe Speech-to-Text API. Also image recognition to detect the object suggested in the captcha. Built with Pyppeteer for Chrome automation framework and similarities to Puppeteer, PyDub for easily converting MP3 files into WAV, aiohttp for async minimalistic web-server, and Python’s built-in AsyncIO for convenience. -
23
Tux Math Scrabble
12÷16×3=9÷4
Latest version 0.9.1 runs on Python3. Date: June 15, 2023 Online/touch-screen version: https://www.asymptopia.com/tuxmathscrabble/ Encourages kids to construct compound equations and consider multiple abstract possibilities. -
24
Zappa
Serverless Python
Zappa makes it super easy to build and deploy serverless, event-driven Python applications (including, but not limited to, WSGI web apps) on AWS Lambda + API Gateway. Think of it as "serverless" web hosting for your Python apps. That means infinite scaling, zero downtime, zero maintenance - and at a fraction of the cost of your current deployments! With a traditional HTTP server, the server is online 24/7, processing requests one by one as they come in. ... -
25
Decentralized-Internet
A SDK/library for decentralized web and distributing computing project
The Decentralized-Internet project by Lonero Team is a software development kit (SDK) and library aimed at facilitating the creation of decentralized web and distributed computing applications. It provides developers with tools to build applications that operate independently of centralized servers, promoting a more open and resilient internet infrastructure.
