Search Results for "python web crawler"
Sort By:
Showing 103 open source projects for "python web crawler"
View related business solutions-
Level Up Your Cyber Defense with External Threat ManagementMove beyond alerts. Gain full visibility, context, and control over your external attack surface to stay ahead of every threat.
-
Smart Business Texting that Generates PipelineTextUs is the leading text messaging service provider for businesses that want to engage in real-time conversations with customers, leads, employees and candidates. Text messaging is one of the most engaging ways to communicate with customers, candidates, employees and leads. 1:1, two-way messaging encourages response and engagement. Text messages help teams get 10x the response rate over phone and email. Business text messaging has become a more viable form of communication than traditional mediums. The TextUs user experience is intentionally designed to resemble the familiar SMS inbox, allowing users to easily manage contacts, conversations, and campaigns. Work right from your desktop with the TextUs web app or use the Chrome extension alongside your ATS or CRM. Leverage the mobile app for on-the-go sending and responding.
-
1
Advanced Alchemy
A carefully crafted, thoroughly tested, optimized companion library
advanced-alchemy is an opinionated ORM toolkit built on SQLAlchemy and designed for integration with the Litestar web framework. It simplifies common ORM patterns such as CRUD, pagination, and async support while providing extensibility and best practices out of the box. It’s designed to accelerate backend development for modern Python web apps. -
2
Grafana
Leading open-source visualization and observability platform
Grafana Open Source is a leading open-source visualization and observability platform that lets you query, visualize, alert on, and explore your data—regardless of where it’s stored. With support for 100+ data source plugins (such as Prometheus, Loki, Elasticsearch, InfluxDB, SQL/NoSQL databases, OpenTelemetry, and more), you can unify metrics, logs, traces, and other observability signals in one place. Grafana OSS empowers you to build dynamic, reusable dashboards with rich... -
3
pagodo
Automate Google Hacking Database scraping and searching
pagodo automates Google searching for potentially vulnerable web pages and applications on the Internet. It replaces manually performing Google dork searches with a web GUI browser. There are 2 parts. The first is ghdb_scraper.py that retrieves the latest Google dorks and the second portion is pagodo.py that leverages the information gathered by ghdb_scraper.py. This version of pagodo also supports native HTTP(S) and SOCKS5 application support, so no more wrapping it in a tool like... -
4
OSV.dev
Open source vulnerability DB and triage service
osv.dev (Open Source Vulnerabilities) is Google’s open source platform and API for aggregating, managing, and analyzing vulnerability data across multiple ecosystems. It powers the osv.dev website, providing a unified, queryable database of vulnerabilities that map directly to open source packages and versions. The system hosts vulnerability data for ecosystems such as PyPI, npm, Go, Maven, and Debian, among others. The platform includes a web UI, API, and a Go-based dependency scanner... -
Turn traffic into pipeline and prospects into customersDocket is an AI-powered sales enablement platform designed to unify go-to-market (GTM) data through its proprietary Sales Knowledge Lake™ and activate it with intelligent AI agents. The platform helps marketing teams increase pipeline generation by 15% by engaging website visitors in human-like conversations and qualifying leads. For sales teams, Docket improves seller efficiency by 33% by providing instant product knowledge, retrieving collateral, and creating personalized documents. Built for GTM teams, Docket integrates with over 100 tools across the revenue tech stack and offers enterprise-grade security with SOC 2 Type II, GDPR, and ISO 27001 compliance. Customers report improved win rates, shorter sales cycles, and dramatically reduced response times. Docket’s scalable, accurate, and fast AI agents deliver reliable answers with confidence scores, empowering teams to close deals faster.
-
5
CodeChecker
CodeChecker is an analyzer tooling, defect database
CodeChecker is a static analysis infrastructure built on the LLVM/Clang Static Analyzer toolchain, replacing scan-build in a Linux or macOS (OS X) development environment. Executes Clang-Tidy and Clang Static Analyzer with Cross-Translation Unit analysis, Statistical Analysis (when checkers are available). Creates the JSON compilation database by wiretapping any build process (e.g., CodeChecker log -b "make"). Automatically analyzes GCC cross-compiled projects: detecting GCC or Clang... -
6
Cinemagoer
Python package useful to retrieve and manage the data of IMDb
Cinemagoer (previously known as IMDbPY) is a Python package for retrieving and managing the data of the IMDb movie database about movies and people. You can use the search_movie method of the access object to search for movies with a given (or similar) title. Similarly, you can search for people and companies using the search_person and the search_company methods. Movie, person, and company objects have id attributes which -when fetched through the IMDb web server- store the IMDb id of the object. ... -
7
Cinemagoer
Python package to retrieve and manage data of the IMDb
Cinemagoer is a Python package useful to retrieve and manage the data of the IMDb movie database about movies, people, characters and companies. Platform-independent, it can retrieve data from both the IMDb's web server and a local copy of the whole db. -
8
aiopg
aiopg is a library for accessing a PostgreSQL database
aiopg is an asynchronous PostgreSQL database driver for Python built on top of asyncio and psycopg2. It provides support for asynchronous query execution and connection pooling, enabling efficient, non-blocking database access in Python applications. aiopg is well-suited for web services and microservices that require concurrency without threads. -
9
Pity
API test platform
Pity is a powerful and user-friendly open-source API test platform that supports automated test case creation, test scheduling, and result visualization. Designed for developers and QA teams, it provides a web-based interface for writing, organizing, and executing HTTP tests, making it easy to maintain robust API quality in CI/CD pipelines. -
Financial reporting cloud-based software.The software is cloud based and automates complexities around consolidating and reporting for groups with multiple year ends, currencies and ERP systems with a slice and dice approach to reporting. While retaining the structure, control and validation needed in a financial reporting tool, we’ve managed to keep things flexible.
-
10
PHP mini vulnerability suite
Multiple server/webapp vulnerability scanner
github: https://github.com/samedog/phpmvs -
11
Tera
An Internet-scale database
...Multi-type table support (RAMDISK/SSD/DISK table). Easy to use C++/Java/Python/REST-ful API. Column-oriented storage and locality group support. Ranged and hashed sharding strategies. -
12
Scalaris
Distributed, transactional key-value store
Scalaris is a scalable, transactional, distributed key-value store. It was the first NoSQL database, that supported the ACID properties for multi-key transactions. It can be used for building scalable Web 2.0 services. Scalaris uses a structured overlay with a non-blocking Paxos commit protocol for transaction processing with strong consistency over replicas. Scalaris is implemented in Erlang. -
13
NoSQLMap
Automated NoSQL database enumeration and web application exploitation
A security tool for detecting and exploiting vulnerabilities in NoSQL databases, similar to SQLMap for traditional databases. -
14
PyLucid is a Open Source web content management system written in Python using the Django Framework. fully customizable output, expandable with plugins, i18n, L10n, Revision controled, support many database engines, WSGI conform and many more...
-
15
Collective Mind Technology
plugin-based framework for systematic and reproducible experimentation
New version moved to http://github.com/ctuning/ck Collective Mind framework (cM) is an open-source plugin-based schema-free repository and infrastructure for collaborative, systematic and reproducible research and experimentation. This 3rd version (started in 2006) helps to implement, preserve, share and reproduce the whole experimental setup as connected modules and data. cM uses crowdsourcing to leverage knowledge and computational resources of multiple users. For example, it... -
16
huhamhire-hosts
hosts for Internet Freedom
Since the governments of some countries are using the blocking the internet access to several websites and web service providers which includes some world famous sites like Google, YouTube, twitter, Facebook, and Wikipedia etc., we designed this tiny utility in order to help people getting through the Internet blockade. Hosts Setup Utility provides basic tools to manage the hosts file on current operating systems. It also provides both support for Graphical Desktop environment with... -
17
helenos
Web based GUI tool to manage your data stored in Apache Cassandra
Helenos is a free web based environment that simplifies a data exploring & schema managament with Apache Cassandra database. -
18
AMPPS
AMPPS is a LAMP/MAMP/WAMP stack
AMPPS is a stack of Apache, MySQL, PHP, Perl & Python. AMPPS enables you to focus more on using applications rather than maintaining them. With AMPPS you can create a website by installing any of the 330+ Apps, customizing it, and then simply publishing it on the internet via a wide choice of hosting service providers. A complete package on your desktop, same like the server that provides many open source web applications. -
19
The goal of this project is to make possible to access Progress database from any external program that can use sockets. The server (broker and agents) are written in Progress 4GL and made use of sockets capabilities of Progress V9.
-
20
StackCollect
A server and database monitoring platform.
The StackCollect SCM is written in Python and is free to download, more advanced features can be purchased from StackCollect. Monitored Server Platforms Include: Windows Server 2012 R2 Monitored Database Platforms Include: PostgreSQL Microsoft SQL Server MariaDb MySQL -
21
PHP Mailman allows the integration of Mailman into a dynamic website without using Python or requiring permission to Mailman binaries.
-
22
Framework (scripts, configuration, code) to build free and public services around travel and leisure data. That project makes an extensive use of already existing data sources such as Geonames and dbPedia, and adds some glue around those (eg, links).
-
23
Seven-Labs
Application Development
This repository serves as our entire project space which contains all of the open-source projects we've worked on. - C/C++ - C#/.NET - PHP - HTML5/CSS3 -
24
meBiblio
meBiblio is a bibliography tool
meBiblio was specially developed as a small and accessible Python-based bibliography tool. meBiblio can organize your reference library, allows easy search in your references and permits immediate retrieval and examination of digitally stored literature items. It connects to online catalogs as PUBMED to retrieve data. -
25
Plantlore is a botanical occurence database being written in Java. It also has a BIOCASE Provider software based web interface.
