Search Results for "python web crawler" - Page 29
Sort By:
Showing 3144 open source projects for "python web crawler"
View related business solutions-
Our Free Plans just got better! | Auth0You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
-
Picsart Enterprise Background Removal API for Stunning eCommerce VisualsWith our Remove Background API tool, you can access the transformative capabilities of automation , which will allow you to turn any photo asset into compelling product imagery. With elevated visuals quality on your digital platforms, you can captivate your audience, and therefore achieve higher engagement and sales.
-
1
FirePlus
Complete Edition
Universal ThinKing Machine -
2
WebSploit Framework
WebSploit is a high level MITM Framework
WebSploit Advanced MITM Framework [+]Autopwn - Used From Metasploit For Scan and Exploit Target Service [+]wmap - Scan,Crawler Target Used From Metasploit wmap plugin [+]format infector - inject reverse & bind payload into file format [+]phpmyadmin Scanner [+]CloudFlare resolver [+]LFI Bypasser [+]Apache Users Scanner [+]Dir Bruter [+]admin finder [+]MLITM Attack - Man Left In The Middle, XSS Phishing Attacks [+]MITM - Man In The Middle Attack [+]Java Applet Attack [+]MFOD... -
3
Offensive Web Testing Framework
Offensive Web Testing Framework (OWTF), is a framework
OWASP OWTF is a project focused on penetration testing efficiency and alignment of security tests to security standards like the OWASP Testing Guide (v3 and v4), the OWASP Top 10, PTES and NIST so that pentesters will have more time to see the big picture and think out of the box. More efficiently find, verify and combine vulnerabilities. Have time to investigate complex vulnerabilities like business logic/architectural flaws or virtual hosting sessions. Perform more tactical/targeted... -
4
rest-dev-vnc-docker
Restful / SOAP API Development with common tools in VNC/noVNC Docker
... accessible ubiquitously from Your favorite smartphones, tablets, e.g., iPad, SurfacePro, Amazon Fire tablet, Chrome PC, Desktop PC, etc. (Hmmm! in theory, if you can read tiny screens, you can even use your Apple iWatch to use KNIME, Eclipse Photon, IntelliJ, etc. as long as it can display HTML-5 Web Browsers. -
Gen AI apps are built with MongoDB AtlasMongoDB Atlas is the developer-friendly database used to build, scale, and run gen AI and LLM-powered apps—without needing a separate vector database. Atlas offers built-in vector search, global availability across 115+ regions, and flexible document modeling. Start building AI apps faster, all in one place.
-
5
TestRest
TestRest is a fully QA Management Tool
TestRest is Test Management offers test case authoring, reusable test cases, test execution and reporting. TestRest supports statistic and graph reports with simple modern UI interfaces. -
6
WebExKit
An HTML/CSS/JavaScript editor with preview window
The Web Experimentation Kit allows you to enter HTML, CSS and JavaScript and see the results immediately in a browser frame side-by-side with the editor. If you've seen the W3Schools Tryit Editor, JSFiddle or CodePen then this should be familiar to you. The difference between WebExKit and these other applications is that WebExKit is a stand-alone application that runs on your desktop and it allows you to save (and reload) files to your own disk drive. The editor shows a properly formed HTML... -
7
PlatformIO Storage
An open source ecosystem for IoT development
... embedded boards and IDE Library Manager - Hundreds Popular Libraries are organized into single Web 2.0 platform: list by categories, keywords, authors, compatible platforms and frameworks; learn via examples; be up-to-date with the latest version Atmel AVR & SAM, Espressif, Freescale Kinetis, Nordic nRF51, NXP LPC, Silicon Labs EFM32, ST STM32, TI MSP430 & Tiva, Teensy, Arduino, mbed, libOpenCM3, etc. -
8
Full Stack FastAPI Couchbase
Full stack, modern web application generator
Full stack, modern web application generator. Using FastAPI, Couchbase as a database, Docker, automatic HTTPS, and more. Couchbase has a great set of features that is not easily or commonly found in alternatives. REST backend tests based on Pytest, integrated with Docker, so you can test the full API interaction, independent on the database. As it runs in Docker, it can build a new data store from scratch each time (so you can use ElasticSearch, MongoDB, or whatever you want, and just test... -
9
yz-next-apyref
Arno-Can's Python based API Reference Generator.
Multi-Syntax-Version and Multi-Implementation API reference documentation generator. Supports local and remote sources. -
Build Securely on AWS with Proven FrameworksMoving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
-
10
pyindi-client
Python binding to the libindi library
... there are also bindings for node.js, Tcl (incomplete) and PHP (not useful). As application examples you will find a Python Websocket server with which you may build a web application interacting with Indi servers, and a simple PyQt application similar to the Kstars Indi Control Panel (was built as an exercise). Finally there is an equatorial mount 3D simulator written with Freecad and Python, planned to be connected with the PyIndi module. *** The pyindi-client binding has moved to github. *** -
11
Walle 2.0
Walle 2.0 web
... application, review, grayscale release, real-time websocket. Walle allows users to release code and finally can not only choose jenkins! Support various web code releases, release and rollback of php, java, python, go and other codes can be completed with one click through the web. walle is a freely configurable project, more user-friendly, high-value, an open source online deployment system that supports git, multi-user, multi-language, multi-project, and multi-environment simultaneous deployment. -
12
NeuralCoref
Fast Coreference Resolution in spaCy with Neural Networks
NeuralCoref is a pipeline extension for spaCy 2.1+ which annotates and resolves coreference clusters using a neural network. NeuralCoref is production-ready, integrated in spaCy's NLP pipeline and extensible to new training datasets. For a brief introduction to coreference resolution and NeuralCoref, please refer to our blog post. NeuralCoref is written in Python/Cython and comes with a pre-trained statistical model for English only. NeuralCoref is accompanied by a visualization client... -
13
django-rest-auth
This app makes it extremely easy to build Django powered SPA's
This app makes it extremely easy to build Django powered SPA's (Single Page App) or Mobile apps exposing all registration and authentication-related functionality as CBV's (Class Base View) and REST (JSON). Tivix rebuilt a NATO software system to organize and coordinate rescue missions for submarines in distress across the globe. The United Nations Partner Portal (UNPP) is a web application built for a group of UN agencies to simplify their business processes and streamline collaboration... -
14
ShadowSocksShare
Python ShadowSocks framework
This project obtains the shared ss(r) account from the ss(r) shared website crawler, redistributes the account and generates a subscription link by parsing and verifying the account connectivity. Since Google plus will be closed on April 2, 2019, almost all the available accounts crawled before come from Google plus. So if you are building your own website, please keep an eye on the updates of this project and redeploy using the latest source code. -
15
bristoSOFT Contacts
bristoSOFT Contacts is group oriented contact management software.
bristoSOFT Contacts is a group oriented contact management software application written in Python, PyQt and PostgreSQL based on MVC software architecture. All contacts include email, telephone, address, title, name, company and also include notes, files, integrated google maps, activities such as phone calls, appointments, messaging, calendar. Contacts is a novel project with cutting edge technology. -
16
Raven Python
Raven is the legacy Python client for Sentry
Raven is the official legacy Python client for Sentry, officially supports Python 2.6–2.7 & 3.3–3.7, and runs on PyPy and Google App Engine. It tracks errors and exceptions that happen during the execution of your application and provides instant notification with detailed information needed to prioritize, identify, reproduce, and fix each issue. It provides full out-of-the-box support for many of the popular Python frameworks, including Django, and Flask. Raven also includes drop-in support... -
17
lazynlp
Library to scrape and clean web pages to create massive datasets
LazyNLP is a lightweight tool for collecting and curating large-scale text datasets for machine learning and NLP applications with minimal manual effort. -
18
Requests-HTML
Pythonic HTML Parsing for Humans
This library intends to make parsing HTML (e.g. scraping the web) as simple and intuitive as possible. When using this library you automatically get full JavaScript support! (Using Chromium, thanks to puppeteer) CSS Selectors (a.k.a jQuery-style, thanks to PyQuery). XPath Selectors, for the faint of heart. Mocked user-agent (like a real web browser). Automatic following of redirects. Connection–pooling and cookie persistence. The Requests experience you know and love, with magical parsing... -
19
Python Taint
Static Analysis Tool for Detecting Security Vulnerabilities in Python
Static analysis of Python web applications based on theoretical foundations (Control flow graphs, fixed point, dataflow analysis) Detect command injection, SSRF, SQL injection, XSS, directory traveral etc. A lot of customization is possible. For functions from builtins or libraries, e.g. url_for or os.path.join, use the -m option to specify whether or not they return tainted values given tainted inputs, by default this file is used. -
20
Music + Video + Animation Maker & App
Why Music + Video + Animation Maker & App is Fun?
Javaimagephp All-in-one video/film editor or maker makes sense as simple to use app for video/film or movie editing and animations/slideshows. It gets most of your imagination of an All-in-one video/film Animation editor / maker App. Video editing is made intuitive and simple. Lots of Special Effects ( > 55) ! For example this one http://ogena.ridoua.nu Formats supported are mp4, avi, flv, mov, flv and more. Description given image animation which seeks audio given a description.... -
21
django-dynamic-scraper
Creating Scrapy scrapers via the Django admin interface
Django Dynamic Scraper (DDS) is an app for Django build on top of the scraping framework Scrapy. While preserving many of the features of Scrapy it lets you dynamically create and manage spiders via the Django admin interface. With Django Dynamic Scraper (DDS) you can define your Scrapy scrapers dynamically via the Django admin interface and save your scraped items in the database you defined for your Django project. Since it simplifies things DDS is not usable for all kinds of scrapers, but... -
22
Trigger Happy
Automate the exchanges of the data between applications
Automate the exchanges of the data between the applications and services you use on the web. Make Twitter talk to Mastodon, make Github talk to Mattermost, store your favorite tweets by creating notes in Evernote, follow RSS feeds and post each news in Wallabag, Pocket or Evernote. The possibilities are too numerous to name all of them, but with that project you won't have to raise your little finger at all: automate everything and make your life easier. And last but not least, as this is your... -
23
ATX
Smart phone automation tool. Support iOS, Android, WebApp and game
ATX (AutomatorX) is an open source automated testing tool that supports testing native applications, games, and Web applications on iOS and Android platforms. Use Python to write test cases, and use image recognition and control positioning technology to complete the automation of the game. Attach a dedicated IDE to complete scripting quickly. The libraries for Android and iOS native application testing have been separated and can be used alone (it is strongly recommended to use it alone... -
24
Easy Web automation library
Easy Web automation library
This library has been designed to work with selenium for web automation. It has incorporated functions and handled exception from selenium. It uses selenium library for web interfaces. -
25
Pikon-Stelarium interface
Pikon-Stelarium interface to use with azimuthal mount
This is a full project to make an software-drived azimuthal mount for the Pikon telescope, it can be use for others telescope. This project include : . Some other parts to print to adapt to the Pikon . Python code for raspberry Needed parts for "as it" use : . 1 Raspberry (model A suit well) . 3 motors steppers . 3 steppers drivers . 1 BNO055 (the one from adafruit was used) . 1 Pikon driver . 1 GPS module Sofware requirement : . raspbian . python 3 . some python libraries
