Search Results for "python web crawler" - Page 34
Sort By:
Showing 3076 open source projects for "python web crawler"
View related business solutions-
Veeam Data Platform v13.1 - Get Your Free TrialTry Veeam Data Platform today. Experience the unified platform that's secure by design, portable by default, and proven to recover clean, fast, and anywhere.
-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
1
AI-Writer
RWKV for Chinese novel generation
AI-Writer is an experimental Chinese AI writing project built with the RWKV model family. It focuses on generating Chinese web fiction, including fantasy and romance-style writing. The project includes Python scripts, server files, model folders, and a web-client workflow for continuing user-written text. It supports CPU use and GPU acceleration paths depending on hardware, although much of the repository’s original setup information is now marked as outdated. ... -
2
e-Dokyumento
e-Dokyumento is web-based Document Management System (DMS)
e-Dokyumento is opensource web-based Document Management System (DMS) A Document Management which automates the basic office document workflow such as receiving, filing, routing, and approving through capturing (scanning), digitizing (OCR Reading), storing, tagging, and electronically routing and approving (e-signature) of electronic documents. # Demo : https://e-dokyumento.herokuapp.com/ https://edokyu.seillig.com/ (refer to Readme.md for the... -
3
instagram-profilecrawl
Instagram profile crawler that extracts posts, tags, and stats
instagram-profilecrawl is a Python-based automation script designed to collect publicly available information from Instagram profiles. It crawls profile data such as follower counts, post information, hashtags, and other engagement-related metadata. It operates by automating a web browser using Selenium and performing requests to gather structured information from the platform. instagram-profilecrawl can analyze multiple usernames in a single run and store the extracted information locally in structured formats such as JSON. ... -
4
pdf-editor
Edit your PDFs without needing a subscription or creating accounts
Edit your PDFs without needing a subscription or creating accounts. Add a GUI/Turn it into a web application. Add a parser for the command line to do multiple commands at once e.g. merge (cut pdf1) pdf2. Tested working with Python 3.8.5. Install venv (py -3.8 -m pip install virtualenv). PDF and Word documents are binary files, which makes them much more complex than plaintext files. In addition to text, they store lots of font, color, and layout information. -
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
5
Arxiv Sanity Lite
arxiv-sanity lite: tag arxiv papers of interest get recommendations
Arxiv Sanity Lite is a lightweight rewrite of Karpathy’s original arXiv discovery tool for tracking machine-learning research. It periodically polls the arXiv API for new papers and stores them locally for browsing. Users can tag papers they find relevant and receive recommendations tailored to each tag. Recommendations are generated with support vector machines trained on TF-IDF features extracted from paper abstracts. The web interface supports searching, ranking, sorting, and filtering... -
6
Spyne
A transport agnostic sync/async RPC library
Spyne is a Python RPC toolkit that makes it easy to expose online services that have a well-defined API using multiple protocols and transports. It integrates with popular Python web frameworks as well as libraries like SQLAlchemy to keep your code as DRY as possible. Spyne aims to save the protocol implementers the hassle of implementing their own remote procedure call api and the application programmers the hassle of jumping through hoops just to expose their services using multiple protocols and transports. ... -
7
sidmon3
Sudden ionospheric distubance (SID) monitor
sidmon is a python program for receiving and recording submarine-transmitter signal intensities and directions in the VLF frequency range using a computer sound card. The intensities of these signals reflect the ability of radio waves at those wavelengths to propagate in what is essentially a waveguide formed by the earth and the ionosphere above it. -
8
VQGAN-CLIP web app
Local image generation using VQGAN-CLIP or CLIP guided diffusion
VQGAN-CLIP has been in vogue for generating art using deep learning. Searching the r/deepdream subreddit for VQGAN-CLIP yields quite a number of results. Basically, VQGAN can generate pretty high-fidelity images, while CLIP can produce relevant captions for images. Combined, VQGAN-CLIP can take prompts from human input, and iterate to generate images that fit the prompts. Thanks to the generosity of creators sharing notebooks on Google Colab, the VQGAN-CLIP technique has seen widespread... -
9
Kaplan Desktop
Free and open-source CAT tool for linguists
A free and open-source computer-assisted translation tool built with Django/Python and Electronjs/Nodejs. For the relevant repositories, please see https://github.com/kaplanPRO kaplanpy currently handles the following doctypes: • .docx • .odp • .ods • .odt • .txt • .xliff (very limited coverage) • .po -
Cut Data Warehouse Costs by 54%BigQuery delivers 54% lower TCO with exabyte scale and flexible pricing. Free migration tools handle the SQL translation automatically.
-
10
UltraDDOS-v2
DDOS tool
One of the most overpowered DDOS weapon on the internet. This software is mainly for pen testing websites or servers. -
11
ADFILT
Web filter lists for countless different topics
This is the place where I, Imre Kristoffer Eilertsen, host my web filter lists for countless different topics, for use in adblock tools and the like. GitHub was in mid-2017 by far the easiest way for laymen like me to store pure text files, which is a necessity to create subscribable lists. This is a hobby project of mine, in which I work just as much on these lists and this repo as I feel like. But don't be fooled by the appearance, as these are nevertheless some lists that I've placed lots... -
12
python-tutorial
Practical Python tutorials, including Python basics
python-tutorial is a practical Python learning repository that collects examples for everyday programming tasks. It covers Python fundamentals, advanced language features, object-oriented programming, multithreading, databases, data science, Flask development, web crawling, and utility scripting. The project is intended for beginners learning Python and for working developers who want reference implementations for common scripts. -
13
A set of tools (command line and GUI) to provide a complete digital photo workflow for Unixes. EXIF headers are used as the central information repository, so users may change their software at any time without loosing any data.
-
14
A multi-player networked clone of the classical Bubble Bobble board game. Throw bubbles at monsters and collect dozens of different bonuses before your co-players! A modernized version running the clients in browsers is available at https://bitbucket.org/arigo/bub-n-bros/
-
15
Bandwidth
Monitor monthly internet Transmit and Receive bandwidth usage - Linux
Keep track of bandwidth usage Allows Linux users to monitor their Transmit and Receive bandwidth usage with a simple text based menu, via your browser or from the command line. Some of us are unable to get "unlimited", "all that you can eat", internet packages and are left trying to stay within our Download/Upload limits, whilst paying dearly for the "privilege". Equally, we didn't have the foresight or the money to purchase an snmp managed router, so we are unable to strip the traffic... -
16
Raiden Network
Raiden Network
Use Raiden to enrich your dApp with nearly instant, low-fee and scalable payments. It comes with an easy-to-use API and is compatible with the Ethereum ERC20 token standard. Incentivized, decentralized P2P live streaming with micropayments using Raiden, introducing “Proof-of-Stream-Payment”. The Raiden Network is an infrastructure layer on top of the Ethereum Blockchain. While the basic idea is simple, the underlying protocol is quite complex and the implementation non-trivial. Nonetheless... -
17
Zenoss Community Edition
Zenoss - Intelligent IT Operations Management
Zenoss provides software-defined IT operations for the world’s largest organizations. We deliver the ultimate level of IT service health with simplicity by providing the most granular and intelligent IT service modeling possible, at any scale, and sharing these unique insights with other IT operations management (ITOM) tools to make them more efficient. Zenoss Community Edition is not a “demo” or trial version of Zenoss Enterprise or Zenoss Cloud! Before You install Zenoss Community... -
18
MiModD
Mutation Identification in Model Organism Genomes using Desktop PCs
MiModD is a software package for genomic variant identification from next-generation sequencing (NGS) data with optimized usage of system resources and a user-friendly interface. For most model organism genomes it lets the user carry out a complete analysis from unaligned genomic NGS read data to an annotated list of variants on a regular Desktop PC within a few hours. Its user-interface is beginner-friendly and designed to encourage geneticists to analyze NGS data themselves without the... -
19
Automation Orchestrator
Automation Orchestrator application to orchestrate digital processes
The Automation Orchestrator allows you to run a local Django Web Application to administrate and orchestrate automation scripts such as Nintex RPA botflows but you may also orchestrate other automation such as Python scripts, batch files, and other RPA tools. The Automation Orchestrator is tested with and supports Nintex RPA version = 15.1. As described on the official Django project site, it "is a high-level Python Web framework that encourages rapid development and clean, pragmatic design. ... -
20
OpenEMM e-mail & marketing automation
software for email automation (newsletters, transaction mails, etc.)
This is an archive for old versions of OpenEMM. You will find the latest version of OpenEMM here: https://wiki.openemm.org OpenEMM is a browser-based enterprise application for email automation like info and marketing newsletters, transaction mails or multi-stage email campaigns. OpenEMM offers tons of features for professional users, among them: a great user interface, template-based HTML mailings, automatic bounce management, mail opening and link tracking, lots of graphical realtime... -
21
Jarvis Python AI Assistant
Python AI assistant
Jarvis is a voice commanding assistant service in Python 3.8 It can recognize human speech, talk to user and execute basic commands. Opens a web page (e.g 'Jarvis open youtube') Play music in Youtube (e.g 'Jarvis play mozart') Increase/decrease the speakers master volume (also can set max/mute speakers volume) (e.g 'Jarvis volume up!') Opens libreoffice suite applications (calc, writer, impress) (e.g 'Jarvis open calc') Tells about something, by searching on the internet (e.g 'Jarvis tells me about oranges') Tells the weather for a place (e.g 'Jarvis tell_the_skills me the weather in London') Tells the current time and/or date (e.g 'Jarvis tell me time or date') Set an alarm (e.g 'Jarvis create a new alarm') Tells the internet speed (ping, uplink and downling) (e.g 'Jarvis tell_the_skills me the internet speed') Tells the internet availability (e.g 'Jarvis is the internet connection ok?') ... -
22
Arxiv Sanity Preserver
Web interface for browsing, search and filtering arxiv submissions
...Personalized recommendations are generated through models trained from user preferences. The web interface uses Flask, Tornado, and SQLite, while the indexing pipeline relies on scientific Python libraries. A newer rewrite called arxiv-sanity-lite later became the recommended successor. -
23
Code Cookbook
Reusable code patterns which you can use as reference or copy
Reusable code patterns which you can use as reference or copy to your project. Achieve small or large tasks using recipes that contain steps, scripts, and config files. -
24
What is DracOS GNU/Linux Remastered ? DracOS GNU/Linux Remastered ( https://github.com/dracos-linux ) is the Linux operating system from Indonesia , open source is built based on Debian live project under the protection of the GNU General Public License v3.0. This operating system is one variant of Linux distributions, which is used to perform security testing (penetration testing). Dracos linux in Arm by hundreds hydraulic pentest, forensics and reverse engineering. Use a GUI-based...
-
25
Aquila X
Easy build your personal search engine with Aquila Network
Easy build your personal search engine with Aquila Network. Aquila X is the gateway to Aquila Network and it's applications. AquilaX is a smart bookmarking tool. You can keep your bookmarks and search through it's contents. Choose to keep all your data in a local server or in the cloud. This is an open source software and thus is auditable.
