Search Results for "python web crawler" - Page 16
Sort By:
Showing 3141 open source projects for "python web crawler"
View related business solutions-
Our Free Plans just got better! | Auth0You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
-
No-Nonsense Code-to-Cloud Security for Devs | AikidoAikido provides a unified security platform for developers, combining 12 powerful scans like SAST, DAST, and CSPM. AI-driven AutoFix and AutoTriage streamline vulnerability management, while runtime protection blocks attacks.
-
1
PMS for REGZA
A DLNA-compliant UPnP Media Server
PMS for REGZA is a DLNA-compliant Media Server. As a fork build of well-known "PS3 Media Server", This aims especially to improve functionality on TOSHIBA REGZA TVs With preserving applicabilities to other Renderers. Details: Home Page: http://www32.atwiki.jp/pms_regza -
2
uweb browser: unlimited power
minimal suckless android web browser with unlimited power
...: run fast, even with thousands of user provided css/scripts - Efficient: less touches, one click to reach any number of search engines without repeated input; automate online services. - URL bar command line support ("!" and .js files as commands). - user-defined site-specific JS/CSS/HTML/preprocessing. - Online play/preview/preprocess for downloadable resources. - Multiple type profiles: switch any data including logins/config orthogonally - web automation, crontab (alarm clock) -
3
MahfLoader
No ads ,No login ,Download in HD, 4K, even 8K! ,Fastest download
🚀 Introducing MahfLoader – Your Ultimate YouTube Video Downloader for Windows! 🎬 ✅ No ads ✅ No login ✅ Download in HD, 4K, even 8K! ✅ Fastest download speed ✅ Clean, easy-to-use interface ✅ Built with yt-dlp + ffmpeg 💻 📥 Download Now: 👉 see on comment box 🔥 Save your favorite videos in one click. Perfect for students, editors, and creators! -
4
ahCrawler
A PHP search engine for your website and web analytics tool. GNU GPL3
ahCrawler is a set to implement your own search on your website and an analyzer for your web content. It can be used on a shared hosting. It consists of * crawler (spider) and indexer * search for your website(s) * search statistics * website analyzer (http header, short titles and keywords, linkchecker, ...) You need to install it on your own server. So all crawled data stay in your environment. You never know when an external webspider updated your content. Trigger a rescan... -
Build Securely on AWS with Proven FrameworksMoving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
-
5
Moodle, DSpace 7, Koha, Calibre Live ISO
Moodle 4.2 + DSpace 7.6 + Koha 23.11 Live ISO based on Ubuntu 22.04.3
Moodle, DSpace, Koha, Calibre-Web is a Live Bootable and Installer ISO based on Ubuntu 22.04.3 Moodle Version: 4.2.1 DSpace Version: 7.6 Koha Version: 23.11.01 Calibre Version: 6.26 This ISO boots only in Legacy BIOS mode and not in Secure Boot Mode After booting from the Live DVD/USB, use the following login credentials: Login: library (Displayed as 'Open Learning Platform') Password: admin123 This Live ISO contains additional Desktop Environments (aka D.E) providing... -
6
MyCrypto Web App
Tool that allows you to manage your Ethereum accounts privately
... to be sure you're sending to the right place. A fan favorite since 2018, the MyCrypto Desktop App continues to provide an additional layer of security for your Ethereum assets. On systems where a pre-built version of node-hid is not available (e.g. 32-bit versions of Windows and Linux), you additionally need Python (3+) and node-gyp installed. -
7
LAMP package in Complete Virtual Machine
A Quick LAMP/WAMP/MAMP/XAMPP Pkg for development, testing & production
This VM is created for 2 reasons: 1. Very little initial setup work required to Develop / Test / Deploy a Dynamic Web Application live, within minutes. 2. This system should keep running for Years, without requiring Updates / Breakages. If you are new to Virtual Machines, then please watch the Video below ( taken from my other sample PHP project called teamdocs. You may cleanup this Application from the htdocs home folder link & its corresponding database, after logging into mysql. The mysql... -
8
Shinkai: Local AI Agents
Shinkai allows you to create advanced AI (local) agents effortlessly
Shinkai is a free, open-source AI platform that lets anyone create powerful AI agents without coding. These agents can collaborate with each other, handle complex tasks, and operate in decentralized crypto environments. Key Features: - No-Code Agent Creation - Build specialized agents (trading bots, sentiment trackers, etc.) with simple descriptions - Multi-Agent Collaboration - Agents work together to solve complex problems - Crypto Integration - Built-in support for decentralized... -
9
OctoBot
Crypto investment, now on autopilot
OctoBot is built for investors to get the best of their investments using the most profitable strategies. - Automate your crypto investment with proven strategies - Test before using your real funds - Enjoy the best trading strategies for free - Follow your investment from your mobile - Turn your best trading ideas into automated strategies with TradingView or python -
Gen AI apps are built with MongoDB AtlasMongoDB Atlas is the developer-friendly database used to build, scale, and run gen AI and LLM-powered apps—without needing a separate vector database. Atlas offers built-in vector search, global availability across 115+ regions, and flexible document modeling. Start building AI apps faster, all in one place.
-
10
justniffer is a TCP sniffer. It reassembles and reorders packets and displays the tcp flow in a customizable way. It can log network traffic in web server log format. It can also log network services performances (e.g. web server response times) and extract http content (images, html, scripts, etc)
-
11
Roundup Issue Tracker
Simple-to-use/-install issue-tracking system: web, REST, email, CLI
Roundup is a simple-to-use and -install issue-tracking system with command-line, web, REST, XML-RPC, and e-mail interfaces. It runs on python 2.7 or 3.6 or newer. Roundup has been deployed for: * bug tracking and TODO list management (the classic installation) * customer help desk support (with a wizard for the phone answerers, linking to networking, system and development issue trackers) * issue management for IETF working groups * sales lead tracking ...and so on. It's been... -
12
ScrapBot 1.40 64bits
Task automation software for accessing and manipulating website data.
ScrapBot is a task automation software that allows you to access, authenticate, extract, and insert data on any website. The software utilizes JavaScript to execute tasks, eliminating the need for server or additional software installations. The system can control the accessed webpage through JavaScript, and the entire navigation can be viewed in the program window. The main.js script runs in a separate frame from the navigation frame but can access all page content without any restrictions. -
13
Buku
Powerful command-line bookmark manager. Your mini web!
buku is a powerful bookmark manager written in Python3 and SQLite3. buku fetches the title of a bookmarked web page and stores it along with any additional comments and tags. You can use your favourite editor to compose and update bookmarks. With multiple search options, including regex and a deep scan mode (particularly for URLs), it can find any bookmark instantly. Multiple search results can be opened in the browser at once. Though a terminal utility, it's possible to add bookmarks... -
14
Odoo ERP CRM System For Local Intranets
Web,Sales,Finance,Inventory,Manufacture,HR,Marketing,Services,Efficacy
This VM is created for 2 reasons: 1. Very little initial setup work required to make a ERP live, within minutes. 2. This system should keep running for Years, without requiring Updates / Breakages. If you are new to Virtual Machines, then please watch the Video below ( taken from my other project. just replace td with ec wherever mentioned ) After starting this VM, please login to its administration panel with: Website Address: https://ec.local/ ( Accept Any Warnings ) Admin... -
15
VerySSH
A minimal, fast GUI for quickly launching SSH sessions from keychain
A minimal, fast GUI for quickly launching SSH sessions from your ~/.ssh/config. SSH keychain 🔑🔗 Type to filter hosts Arrow Up/Down: Navigate through the list of hosts Enter: Connect to the selected host Esc: Close the application Delete: Clear the filter -
16
AI Bulk Mailer
Phần mềm gửi email hàng loạt với tạo nội dung bằng AI
Phần mềm gửi email hàng loạt với khả năng hỗ trợ đa luồng, tạo nội dung tự động bằng nhiều mô hình AI và thu thập tất cả email trên một trang web. -
17
YoungerSibling
YoungerSibling: Cross-platform OSINT tool for quick data gathering.
YoungerSibling is a Python-based terminal utility script designed for educational purposes. It provides a set of useful tools to perform tasks like searching the web, performing lookups (Google search, IP lookup, username lookup, etc.), and extracting metadata from images, directly from the terminal. This project aims to help students, developers, and hobbyists learn about web scraping, API usage, and terminal interaction with Python. -
18
rotki
A portfolio tracking, analytics, accounting and tax reporting app
A portfolio tracking, analytics, accounting and tax reporting application that respects your privacy -
19
barcraft
A simple QrCode / barcode generator in python
A simple QrCode / barcode generator that you can also use from this website version : https://secret-guest.github.io/barcraft/ Interface made with pyQt5, made with a MSI installer with Inno setup -
20
http-proxy-tunnel
Create nested tunnels through HTTP proxies
Http-proxy-tunnel creates TCP tunnels through http proxies that permit the CONNECT method. It differs from other proxy tunnelling programs in that it can tunnel through multiple proxies, and can use SSL tunnels. These abilities mean that in combination with a web server that can proxy (such as Apache) you can serve normal web pages from ports 80 and 443 and connect to the server (using ssh say) via those ports at the same time. All available documentation can be read online at http... -
21
Liveliness and Face Identification
Leading free and open-source liveliness check &face recognition system
This is a free and open-source liveliness check and face recognition project. Essentially, it is an application that can be used as a standalone server or deployed in the cloud. You don’t need prior machine learning skills to set up and use. The application is customizable react based mobile friendly UI and Python based backend. The program is a real-time face detection application. It allows you to detect faces using your webcam and displays the video feed with oval drawn around the detected... -
22
Whakerexa
A minimalist and lightweight web kit for accessible contents
`Whakerexa` offers CSS frameworks and JavaScript scripts to generate an accessible HTML content. It is intended to be as simple as possible to make **accessible web content**, and to minimize the use of CSS classes for enhancing the readability of HTML code. It was designed to be easily customizable, allowing users to adjust properties such as fonts, colors, borders, etc., effortlessly. Most of the properties are stored into variables which makes possible to re-define them, then to obtain... -
23
elFinder is a file manager for web similar to that you use on your computer. Written in JavaScript using jQuery UI, it just work's in any modern browser. Its creation is inspired by simplicity and convenience of Finder.app program used in Mac OS X.
-
24
Hullu Vulnerable System
Pentesting OVA, suits VMware or VirtualBox
Hullu is a custom-built lightweight offensive security training VM based on Alpine Linux. It's intended for educational use, penetration testing practice, and Capture The Flag (CTF)-style scenarios in isolated virtual lab environments. Pre-installed Tools and Services: + Web Stack: - Python3 + Flask - Apache2 with HTTPS - PHP + MySQL (MariaDB) - phpMyAdmin - FlaskVA (Python-based vulnerable app) - DVWA (PHP-based vulnerable app) https://github.com/digininja/DVWA + Protocols Simulated... -
25
MyConnector
Remote desktop chooser
This is an aggregator program to connnect to various servers using all of the popular remote desktop protocols (RDP, VNC, Citrix, VMware, etc). http://myconnector.ru https://github.com/MyConnector/MyConnector
