Search Results for "python web crawler" - Page 2
Sort By:
Showing 71 open source projects for "python web crawler"
View related business solutions-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
Demo Series - Small Business Backup By VeeamWatch this on-demand demo series and learn how to protect your Microsoft 365 data with clear, simple, actionable steps that are easy to implement for businesses of all sizes.
-
1
Yao Open Prompts
A Chinese AI prompt vocabulary covering work, learning, content, etc.
Yao Open Prompts is an open-source AI prompt library focused on real work, study, content, marketing, education, and everyday use cases. The repository organizes 116 Chinese prompt files into practical categories and also provides synchronized English versions. Each prompt is cleaned and structured for reuse, keeping the copyable prompt body while removing promotional material, screenshots, and irrelevant formatting from the original collection. The library includes prompts for meta-prompt... -
2
Flask-SocketIO
Socket.IO integration for Flask applications
Flask-SocketIO is an extension for the Flask web framework that enables real-time bi-directional communication between clients and servers using WebSockets or long-polling fallbacks, making it possible to build interactive applications like chat systems, live dashboards, and collaborative tools. It abstracts the complexities of asynchronous sockets by providing a familiar Flask-style API where developers can define event handlers that trigger on client messages, broadcast to connected users,... -
3
aws-devops-zero-to-hero
AWS zero to hero repo for devops engineers to learn AWS in 30 Days
aws-devops-zero-to-hero is a 30-day AWS learning roadmap aimed squarely at DevOps engineers who want both conceptual understanding and hands-on projects. The README is structured as a day-by-day syllabus, starting with “Day 1: Introduction to AWS” and moving through IAM, EC2, VPC networking, security, DNS (Route 53), storage (S3), and many other core services. Each day mixes explanation with at least one concrete project or lab, such as deploying applications on EC2, designing secure VPCs,... -
4
Shumai
Fast Differentiable Tensor Library in JavaScript & TypeScript with Bun
...Built on Bun and Flashlight, with ArrayFire as its numerical backend, Shumai brings GPU-accelerated tensor operations, automatic differentiation, and scientific computing tools directly to JavaScript developers. It allows seamless integration of machine learning, deep learning, and custom differentiable programs into web-based or server-side environments without relying on Python frameworks. The library supports matrix operations, gradient computation, and tensor conversions with intuitive APIs and near-native speed, thanks to Bun’s low-overhead FFI bindings. It can automatically leverage GPU acceleration on Linux (via CUDA) and CPU computation on macOS. -
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
5
lixa
LIXA, LIbre XA, is a free and open source XA transaction manager
...LIXA is a Transaction Manager but it's not a Transaction Monitor: this is the distinguishing feature of the project. LIXA technology enables every application container, like a web server or a shell, to become a two phase commit application server. The client/server architecture of LIXA allows many application containers to share a single LIXA (state) server: this is ideal when horizontal scalability is a must and many identical application containers must refer to a single transactional environment. LIXA can be used with the C, C++, Java, Python and COBOL programming languages. -
6
eCxx
A C++ library for AVR and NodeMCU
NOTE: This project is marked with 'Status: Abandoned' on SourceForge because not enough time can be dedicated to this project. However it may still get sporadic commits to the repository. eCxx is a library for AVR and NodeMCU tailored for micro LED displays and lighting effects. eCxx is utilizing Makefile build system. Java and Python based applications/tools are also included to ease the development and debugging process using the host PC. On one side, eCxx supports the original... -
7
Name-That-Hash
Identify MD5, SHA256 and 300+ other hashes
...The tool provides concise “hash summaries” that explain where a given hash format is commonly used, helping users decide how to proceed with cracking or further analysis. Name-That-Hash is accessible via a Python CLI (nth) and also exposes an API and JSON output, making it easy to plug into other tools or workflows, and there is also a web app that requires no local installation. -
8
Whisper Library
Whisper is a file-based time-series database format for Graphite
Whisper is one of three components within the Graphite project. Whisper is a fixed-size database, similar in design and purpose to RRD (round-robin-database). It provides fast, reliable storage of numeric data over time. Whisper allows for higher resolution (seconds per point) of recent data to degrade into lower resolutions for long-term retention of historical data. Copies data from src in dst, if missing. Unlike whisper-merge, don't overwrite data that's already present in the target... -
9
Google Cloud Vision API examples
Sample code for Google Cloud Vision
The cloud-vision repository is a sample code collection for the Google Cloud Vision API that shows developers how to implement image analysis tasks across a wide range of languages and platforms. It contains examples organized by language and environment, including Go, Java, Node.js, PHP, Python, Ruby, .NET, Android, iOS, and even a Chrome extension, which makes it especially valuable as a cross-platform learning resource. The repository demonstrates concrete image understanding use cases,... -
Cut Data Warehouse Costs by 54%BigQuery delivers 54% lower TCO with exabyte scale and flexible pricing. Free migration tools handle the SQL translation automatically.
-
10
Spyne
A transport agnostic sync/async RPC library
Spyne is a Python RPC toolkit that makes it easy to expose online services that have a well-defined API using multiple protocols and transports. It integrates with popular Python web frameworks as well as libraries like SQLAlchemy to keep your code as DRY as possible. Spyne aims to save the protocol implementers the hassle of implementing their own remote procedure call api and the application programmers the hassle of jumping through hoops just to expose their services using multiple protocols and transports. ... -
11
PyG2Plot
Python3 binding Plotting Library
PyG2Plot is a Python 3 binding for AntV G2Plot, an interactive and responsive charting library. It lets Python users create statistical charts through a small amount of code while relying on G2Plot’s grammar-of-graphics foundation. The library is inspired by pyecharts and is designed to make web-based charts available from Python workflows. Users create a Plot instance, set chart options, and render the result as an HTML file, HTML string, notebook preview, or JupyterLab output. ... -
12
Hack-Tools
Hack tools
hack-tools is a collection of various hacking tools and utilities. It serves as a comprehensive toolkit for penetration testers and cybersecurity enthusiasts, encompassing a wide range of functionalities. -
13
Python Crawler Tutorial Starts From Zero
Python crawler tutorial, taking you from zero to one
Python Crawler Tutorial Starts From Zero is a Chinese-language learning repository that teaches web crawling from introductory concepts through practical examples. Early lessons explain HTTP requests, request analysis, the Python Requests library, and common categories of extracted data. Separate chapters cover JSON processing and regular expressions for transforming responses into structured information. -
14
bluetroller
A library and interface for controlling bluetooth LE devices
bluetroller is a library and interface for controlling all kinds of bluetooth LE devices. A vast number of devices can be controlled via Bluetooth LE, including fitness trackers, lighting, camera sliders, gimbals and many more. Right now these devices can only be controlled via phone apps which are frequently buggy, unmaintained and will stop working after some future phone update. This project aims to grow to become an exhaustive library of these devices. -
15
Ansible Examples
A few starter examples of ansible playbooks, to show features
This repository collects practical, real-world examples of using Ansible to automate infrastructure, deployments, and configurations. Each directory demonstrates a specific use case—ranging from setting up web servers, load balancers, and databases to orchestrating multi-tier applications in cloud environments. The examples highlight common Ansible practices such as organizing inventories, writing reusable playbooks, using roles, and handling variables and templates. They’re designed to be... -
16
Alfred-Workflow
Full-featured library for writing Alfred 3 & 4 workflows
Alfred-Workflow is a Python helper library for Alfred 2, 3 and 4 workflow authors, developed and hosted on GitHub. Alfred workflows typically take user input, fetch data from the Web or elsewhere, filter them and display results to the user. Alfred-Workflow takes care of a lot of the details for you, allowing you to concentrate your efforts on your workflow’s functionality. -
17
GoodByeCatpcha
Solver ReCaptcha v2 Free
An async Python library to automate solving ReCAPTCHA v2 by images/audio using Mozilla's DeepSpeech, PocketSphinx, Microsoft Azure’s, Google Speech and Amazon's Transcribe Speech-to-Text API. Also image recognition to detect the object suggested in the captcha. Built with Pyppeteer for Chrome automation framework and similarities to Puppeteer, PyDub for easily converting MP3 files into WAV, aiohttp for async minimalistic web-server, and Python’s built-in AsyncIO for convenience. -
18
12306 Ticket Buying Assistant
12306 Smart ticket swiping, ticket booking
12306 is an automation and ticket-purchasing tool designed to interact with China’s official railway booking system, providing users with a programmatic way to search, reserve, and purchase train tickets. The project replicates the workflow of the official platform while adding automation features that help users secure tickets in high-demand scenarios. It supports querying schedules, checking seat availability, and performing booking actions through scripts, which reduces the need for... -
19
Easy Web automation library
Easy Web automation library
This library has been designed to work with selenium for web automation. It has incorporated functions and handled exception from selenium. It uses selenium library for web interfaces. -
20
Face Recognition
World's simplest facial recognition api for Python & the command line
Face Recognition is the world's simplest face recognition library. It allows you to recognize and manipulate faces from Python or from the command line using dlib's (a C++ toolkit containing machine learning algorithms and tools) state-of-the-art face recognition built with deep learning. Face Recognition is highly accurate and is able to do a number of things. It can find faces in pictures, manipulate facial features in pictures, identify faces in pictures, and do face recognition on a... -
21
Assorted projects. General-purpose libraries for Python, C++, Scala, bash, and others. Meta-programming tools. System utilities. UI components. Web APIs. Configuration files. Benchmarks. Programming competition entries. And much more.
-
22
Flasky
Companion code to my O'Reilly book "Flask Web Development"
Flasky is a comprehensive example web application built with the Flask microframework that demonstrates best practices for developing real-world Python web applications, covering everything from project structure and configuration to database models, authentication, and deployment. It serves as both a tutorial and sample codebase that walks developers through building a full-featured web application, including user registration and login, role-based permissions, user profiles, and content creation. ... -
23
TensorFlow World
Simple and ready-to-use tutorials for TensorFlow
This repository aims to provide simple and ready-to-use tutorials for TensorFlow. The explanations are present in the wiki associated with this repository. There are different motivations for this open source project. TensorFlow (as we write this document) is one of / the best deep learning frameworks available. The question that should be asked is why has this repository been created when there are so many other tutorials about TensorFlow available on the web? Deep Learning is in very high... -
24
That project aims at providing a clean API, and the corresponding C++ implementation, for the basis of Airline IT Business Object Model (BOM), ie, to be used by several other Open Source projects, such as RMOL, Air-Sched, Travel-CCM, OpenTREP, etc.
-
25
Icon Font to PNG
Python script (and library) for exporting icons from icon fonts
Python script (and library) for easy and simple export of icons from web icon fonts (e.g. Font Awesome, Octicons) as PNG images. The best part is the provided shell script, but you can also use it’s functionality directly in your (probably awesome) Python project. There’s also font-awesome-to-png script for backward compatibility with the first iteration of the concept.
