Search Results for "python web crawler" - Page 20
Sort By:
Showing 2706 open source projects for "python web crawler"
View related business solutions-
Our Free Plans just got better! | Auth0You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
-
No-Nonsense Code-to-Cloud Security for Devs | AikidoAikido provides a unified security platform for developers, combining 12 powerful scans like SAST, DAST, and CSPM. AI-driven AutoFix and AutoTriage streamline vulnerability management, while runtime protection blocks attacks.
-
1
pdf-editor
Edit your PDFs without needing a subscription or creating accounts
Edit your PDFs without needing a subscription or creating accounts. Add a GUI/Turn it into a web application. Add a parser for the command line to do multiple commands at once e.g. merge (cut pdf1) pdf2. Tested working with Python 3.8.5. Install venv (py -3.8 -m pip install virtualenv). PDF and Word documents are binary files, which makes them much more complex than plaintext files. In addition to text, they store lots of font, color, and layout information. If you want your programs to read... -
2
Jarvis Python AI Assistant
Python AI assistant
Jarvis is a voice commanding assistant service in Python 3.8 It can recognize human speech, talk to user and execute basic commands. Opens a web page (e.g 'Jarvis open youtube') Play music in Youtube (e.g 'Jarvis play mozart') Increase/decrease the speakers master volume (also can set max/mute speakers volume) (e.g 'Jarvis volume up!') Opens libreoffice suite applications (calc, writer, impress) (e.g 'Jarvis open calc') Tells about something, by searching on the internet (e.g 'Jarvis tells me... -
3
Spyne
A transport agnostic sync/async RPC library
Spyne is a Python RPC toolkit that makes it easy to expose online services that have a well-defined API using multiple protocols and transports. It integrates with popular Python web frameworks as well as libraries like SQLAlchemy to keep your code as DRY as possible. Spyne aims to save the protocol implementers the hassle of implementing their own remote procedure call api and the application programmers the hassle of jumping through hoops just to expose their services using multiple protocols... -
4
-
Gen AI apps are built with MongoDB AtlasMongoDB Atlas is the developer-friendly database used to build, scale, and run gen AI and LLM-powered apps—without needing a separate vector database. Atlas offers built-in vector search, global availability across 115+ regions, and flexible document modeling. Start building AI apps faster, all in one place.
-
5
Raiden Network
Raiden Network
Use Raiden to enrich your dApp with nearly instant, low-fee and scalable payments. It comes with an easy-to-use API and is compatible with the Ethereum ERC20 token standard. Incentivized, decentralized P2P live streaming with micropayments using Raiden, introducing “Proof-of-Stream-Payment”. The Raiden Network is an infrastructure layer on top of the Ethereum Blockchain. While the basic idea is simple, the underlying protocol is quite complex and the implementation non-trivial. Nonetheless... -
6
AnotherWar
FPShooter Game
FPShooter Game open soruce game in Python Thanks to https://github.com/fogleman/Minecraft (MIT-License) This game can be modified into a multiplayer Minecraft with guns FPS game ! -
7
Docksal
Docksal is a tool for defining and managing web development
Running Docker on macOS and Windows is supported via VirtualBox as well as Docker for Mac / Docker for Windows. Docksal project stacks are pre-loaded with common development tools, which include Composer, PHP Code Sniffer, php-cli, node, npm, ruby, bundler, and python. For PHP, Drupal, and WordPress development, it comes with Drush, Drupal Console, and WP-CLI. There is built-in support for Apache Solr, Varnish, Memcache, Selenium, and Behat. Since services are containerized with Docker... -
8
ADFILT
Web filter lists for countless different topics
This is the place where I, Imre Kristoffer Eilertsen, host my web filter lists for countless different topics, for use in adblock tools and the like. GitHub was in mid-2017 by far the easiest way for laymen like me to store pure text files, which is a necessity to create subscribable lists. This is a hobby project of mine, in which I work just as much on these lists and this repo as I feel like. But don't be fooled by the appearance, as these are nevertheless some lists that I've placed lots... -
9
Envelop (Risk and Audits software)
Governance, Risk, and Compliance Management Tool
Envelop is a management tool that focuses on governance, risk and compliance processes and documentation. Auditing and managing audit workflows is the main feature of this tool. Envelop is an audit software, that helps with internal and external audits to be managed. The common usage of this tool would be for audits, e.g. financial audits done by internal or external auditors. The overall structure follows this hierarchy : Process > Objective > Risk > Control > Test > Finding You... -
Build apps or websites quickly on a fully managed platformRun frontend and backend services, batch jobs, host LLMs, and queue processing workloads without the need to manage infrastructure.
-
10
Automation Orchestrator
Automation Orchestrator application to orchestrate digital processes
The Automation Orchestrator allows you to run a local Django Web Application to administrate and orchestrate automation scripts such as Nintex RPA botflows but you may also orchestrate other automation such as Python scripts, batch files, and other RPA tools. The Automation Orchestrator is tested with and supports Nintex RPA version = 15.1. As described on the official Django project site, it "is a high-level Python Web framework that encourages rapid development and clean, pragmatic design... -
11
Code Cookbook
Reusable code patterns which you can use as reference or copy
Reusable code patterns which you can use as reference or copy to your project. Achieve small or large tasks using recipes that contain steps, scripts, and config files. -
12
xsser
XSSer: Cross Site Scripter
Cross Site "Scripter" is an automatic -framework- to detect, exploit and report XSS vulnerabilities in web-based applications. XSSer v1.8-3.tar.gz -> md5: 3058a17a1599b0ece5c722fd2e7ff455 XSSer v1.8-3.zip -> md5:840d94fe8d297ec3bbea70fb3bd57f0e -
13
Aquila X
Easy build your personal search engine with Aquila Network
Easy build your personal search engine with Aquila Network. Aquila X is the gateway to Aquila Network and it's applications. AquilaX is a smart bookmarking tool. You can keep your bookmarks and search through it's contents. Choose to keep all your data in a local server or in the cloud. This is an open source software and thus is auditable. -
14
SabroCMS CMS and Online FTP
SABROCMS (CONTENT MANAGEMENT SYSTEM) PHP SCRIPT TO EDIT WEBSITES
SabroCMS is a Freemium PHP Script that allows you to manage the files of your hosting or your website, from any web browser, either from your computer, tablet or cell phone, with online FTP functions, ideal for uploading files, deleting files, renaming files, clone files, create or delete directories and especially to create and edit files online, such as HTML files, Javascript JS files, CSS Style Sheets, Python PT Scripts, PHP Scripts, Perl, CGI and all kinds of TXT, XML, and more! -
15
Photonix Photo Manager
A modern, web-based photo management server
A modern, web-based photo management server. Run it on your home server and it will let you find the right photo from your collection on any device. Smart filtering is made possible by object recognition, face recognition, location awareness, color analysis and other ML algorithms. This project is currently in development and not feature complete for a version 1.0 yet. If you don't mind putting up with broken parts or want to help out, run the Docker image and give it a go. I'd love for other... -
16
e-Dokyumento
e-Dokyumento is web-based Document Management System (DMS)
e-Dokyumento is opensource web-based Document Management System (DMS) A Document Management which automates the basic office document workflow such as receiving, filing, routing, and approving through capturing (scanning), digitizing (OCR Reading), storing, tagging, and electronically routing and approving (e-signature) of electronic documents. # Demo : https://e-dokyumento.herokuapp.com/ https://edokyu.seillig.com/ (refer to Readme.md for the accounts... -
17
Webware for Python
The Classic Webware for Python
Webware for Python is a suite of components for dynamic, server-side web development. -
18
fget
A cli used to download files
This is a cli developed in python used to download files from the web! -
19
JSSoup
JavaScript + BeautifulSoup = JSSoup
I'm a fan of Python library BeautifulSoup. It's feature-rich and very easy to use. But when I am working on a small react-native project, and I tried to find a HTML parser library like BeautifulSoup, I failed. So I want to write a HTML parser library that can be so easy to use just like BeautifulSoup in Javascript. JSSoup uses tautologistics/node-htmlparser as HTML dom parser, and creates a series of BeautifulSoup like API on top of it. JSSoup supports both node and react-native. JSSoup tries... -
20
Argos Translate
Open-source offline translation library written in Python
Argos Translate uses OpenNMT for translations and can be used as either a Python library, command-line, or GUI application. Argos Translate supports installing language model packages which are zip archives with a ".argosmodel" extension containing the data needed for translation. LibreTranslate is an API and web-app built on top of Argos Translate. Argos Translate also manages automatically pivoting through intermediate languages to translate between languages that don't have a direct... -
21
ReconSpider
Most Advanced Open Source Intelligence (OSINT) Framework
... the capabilities of Wave, Photon and Recon Dog to do a comprehensive enumeration of attack surfaces. Reconnaissance is a mission to obtain information by various detection methods, about the activities and resources of an enemy or potential enemy, or geographic characteristics of a particular area. A Web crawler, sometimes called a spider or spiderbot and often shortened to crawler, is an Internet bot that systematically browses the World Wide Web, typically for the purpose of Web indexing (web spidering). -
22
UltraDDOS-v2
DDOS tool
One of the most overpowered DDOS weapon on the internet. This software is mainly for pen testing websites or servers. -
23
Zenoss Community Edition
Zenoss - Intelligent IT Operations Management
Zenoss provides software-defined IT operations for the world’s largest organizations. We deliver the ultimate level of IT service health with simplicity by providing the most granular and intelligent IT service modeling possible, at any scale, and sharing these unique insights with other IT operations management (ITOM) tools to make them more efficient. Zenoss Community Edition is not a “demo” or trial version of Zenoss Enterprise or Zenoss Cloud! Before You install Zenoss Community... -
24
FlaskBB
A classic Forum Software in Python using Flask
... can customize every template in FlaskBB. Besides that, you can also install community-made themes. Our goal is to develop a forum system with modern technologies and sticking to already well-tested and approved layouts. FlaskBB is a simple and extensible forum software that should be seen as the foundation for building communities. It is written in Python using the web framework Flask. FlaskBB is being distributed under the BSD 3-Clause License. -
25
sidmon3
Sudden ionospheric distubance (SID) monitor
sidmon is a python program for receiving and recording submarine-transmitter signal intensities and directions in the VLF frequency range using a computer sound card. The intensities of these signals reflect the ability of radio waves at those wavelengths to propagate in what is essentially a waveguide formed by the earth and the ionosphere above it. Fluctuations in those signal intensities and directions often reflect daytime perturbations of the ionosphere by solar processes, such as solar...
