Search Results for "python web crawler" - Page 27
Sort By:
Showing 2706 open source projects for "python web crawler"
View related business solutions-
Enterprise-grade ITSM, for every businessFreshservice is an intuitive, AI-powered platform that helps IT, operations, and business teams deliver exceptional service without the usual complexity. Automate repetitive tasks, resolve issues faster, and provide seamless support across the organization. From managing incidents and assets to driving smarter decisions, Freshservice makes it easy to stay efficient and scale with confidence.
-
Picsart Enterprise Background Removal API for Stunning eCommerce VisualsWith our Remove Background API tool, you can access the transformative capabilities of automation , which will allow you to turn any photo asset into compelling product imagery. With elevated visuals quality on your digital platforms, you can captivate your audience, and therefore achieve higher engagement and sales.
-
1
GCB_package
Stand-alone version of the Genome Complexity Browser
This application allows observing genome rearrangements in prokaryotic genomes. It provides rearrangements frequencies profiles and genomes graph representation. -
2
e-Species
A taxonomically intelligent biodiversity search engine
This is a pure Python CGI-based implementation of a taxonomically intelligent species search engine. It searches biological databases for a taxonomic name. The search is done "on the fly" using web services (SOAP/XML) or URL API's. -
3
-
4
Grab Framework Project
Web Scraping Framework
Grab is a python framework for building web scrapers. With Grab you can build web scrapers of various complexity, from simple 5-line scripts to complex asynchronous website crawlers processing millions of web pages. Grab provides an API for performing network requests and for handling the received content e.g. interacting with DOM tree of the HTML document. The single request/response API that allows you to build network request, perform it and work with the received content. The API is built... -
Crowdtesting That Delivers | TesteumTesteum connects your software, app, or website to a worldwide network of testers, delivering detailed feedback in under 48 hours. Ensure functionality and refine UX on real devices, all at a fraction of traditional costs. Trusted by startups and enterprises alike, our platform streamlines quality assurance with actionable insights. Click to perfect your product now.
-
5
pyspider
A powerful Spider(Web Crawler) system in Python
pyspider is a powerful Spider(Web Crawler) system in Python. Components are connected by message queue. Every component, including message queue, is running in their own process/thread, and replaceable. That means, when process is slow, you can have many instances of processor and make full use of multiple CPUs, or deploy to multiple machines. This architecture makes pyspider really fast. benchmarking. Since pyspider has various components, you can just run pyspider to start a standalone... -
6
myHouse
Home monitoring and automation suite now known as eGeoffrey
PLEASE NOTE: myHouse has been a nice starting point but difficult to customize, maintain and evolve. For these and many other reasons, I've completely re-designed- re-architect myHouse also giving it a new name (eGeoffrey). The basic principles are the same, the software is still open source but now is supposed to be way simpler to configure (entirely via the web interface), use, customize and extend. If you want to give it a look, check out https://www.egeoffrey.com. I've also put... -
7
WhatsappToDesktop
Esse é um pacote de compilado do Whatsapp Web versão 1.0.
Esse é um pacote de compilado do Whatsapp Web versão 1.0. Esse é um aplicativo multiplataforma de mensagens instantâneas e chamadas de voz para smartphones. Além de mensagens de texto, os usuários podem enviar vídeos, vídeos e documentos em formato PDF, além de fazer a livre conexão com o meio de uma conexão com internet ... -
8
Thexyz Cloud Drive
Mobile Sync for Files, Email, Calendars, and Contacts
Thexyz Cloud Drive application allows you to synchronize files on your desktop with your cloud storage space. This gives you instant access to the most recent versions of important files from anywhere and from any device. Need to edit that important document, but don’t have access to your desktop computer? With the editors included in Cloud Drive, you can create, access, and edit documents and spreadsheets right from your browser. -
9
Face Recognition
World's simplest facial recognition api for Python & the command line
Face Recognition is the world's simplest face recognition library. It allows you to recognize and manipulate faces from Python or from the command line using dlib's (a C++ toolkit containing machine learning algorithms and tools) state-of-the-art face recognition built with deep learning. Face Recognition is highly accurate and is able to do a number of things. It can find faces in pictures, manipulate facial features in pictures, identify faces in pictures, and do face recognition... -
Secure remote access solution to your private network, in the cloud or on-prem.OpenVPN is here to bring simple, flexible, and cost-effective secure remote access to companies of all sizes, regardless of where their resources are located.
-
10
Syllog
Syllog is a system for teaching logic, with anonymous answer logging
Syllog is a system for teaching various forms of logic, including syllogistic logic. It consists of a student-facing Java Applet that runs in the student's browser, and a teacher-facing, server-based logging facility for recording the answers given by students. The student-facing part simply poses questions, to which the student must provide an answer. The teacher-oriented logging facility then logs the answers anonymously for further investigation by the teacher. -
11
crawler4j
Open source web crawler for Java
crawler4j is an open source web crawler for Java which provides a simple interface for crawling the Web. Using it, you can setup a multi-threaded web crawler in few minutes. You need to create a crawler class that extends WebCrawler. This class decides which URLs should be crawled and handles the downloaded page. shouldVisit function decides whether the given URL should be crawled or not. In the above example, this example is not allowing .css, .js and media files and only allows pages within... -
12
Vaex
Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python
Data science solutions, insights, dashboards, machine learning, deployment. We start at 100GB. Vaex is a high-performance Python library for lazy Out-of-Core data frames (similar to Pandas), to visualize and explore big tabular datasets. It calculates statistics such as mean, sum, count, standard deviation etc, on an N-dimensional grid for more than a billion (10^9) samples/rows per second. Visualization is done using histograms, density plots and 3d volume rendering, allowing interactive... -
13
Clustergrammer
An interactive heatmap visualization built using D3.js
Clustergrammer is a visualization library built using D3.js that enables intuitive interaction with high-dimensional data. Clustergrammer was built with biological data in mind. Clustergrammer is a web-based tool for visualizing high-dimensional data (e.g. a matrix) as an interactive and shareable hierarchically clustered heatmap. Clustergrammer's front end (Clustergrammer-JS) is built using D3.js and its back-end (Clustergrammer-PY) is built using Python. Clustergrammer produces highly... -
14
Transcrypt
Python in the Browser
Lean and mean Python 3.6 to JavaScript compiler. Supports multiple inheritance, operator overloading and Python source level debugging, even of minified Javascript files. Transcrypt code is as fast and compact as its Javascript counterpart, and it is precompiled for page load speed. You can now develop your web applications completely in Python, with full access to any Javascript library. -
15
dadosSemiotica
Collecter and manager of semiotica annalisis data
This program is a web application to collect and organize data of text analysis. It works with sets of texts and the analysis are done on portions of the length of a sentence. One of the preprocessing modules is based on CoGroo (A LibreOffice & OpenOffice.org Portuguese Grammar Checker). -
16
PyTom
http://www.sciencedirect.com/science/article/pii/S1047847711003492
PyTom is a toolbox developed for interpreting cryo electron tomography data. All steps from reconstruction, localization, alignment and classification are covered with standard and improved methods. Please sign up to our mailing list to keep up with the most recent updates and versions. -
17
gdpr
Tool to maintain gdpr data protection declaration
Admins often maintain multiple web pages, each of which under EU-GDPR requires a privacy statement. In order to keep them coherent, up-to-date and at the same time avoiding doing the same work multiple times, this project provides a tool to automatically create the appropriate statements for each page from a single source. The project is currently available in PHP, however if anyone is willing to provide a version in Python or Perl or whatever, it is more than welcome. The project... -
18
squirreldns
simple way to show your current ip to the world
simple way to login to a flask server and set your ip address so that others can communicate with you. Also has basic function to allow failover of nodes -
19
OpenSearchServer Search Engine
An open source search engine with RESTFul API and crawlers
OpenSearchServer is a powerful, enterprise-class, search engine program. Using the web user interface, the crawlers (web, file, database, etc.) and the client libraries (REST/API , Ruby, Rails, Node.js, PHP, Perl) you will be able to integrate quickly and easily advanced full-text search capabilities in your application: Full-text with basic semantic, join queries, boolean queries, facet and filter, document (PDF, Office, etc.) indexation, web scrapping,etc. OpenSearchServer runs on Windows... -
20
... the use of services (...) 5. XBRL Similarity Tool implements a process to evaluate similarity between concepts of XBRL (...) 6. XBRL SPED Taxonomy is a data model, in order to create a standard, organized to support to Brazilian Public Digital Bookkeeping System (SPED)(...) 7. easyXBRL is a Python-based XBRL library (...) 8. J-easyXBRL is a Java-based XBRL library (...) 9. Xbrl Parser converts XBRL file from XML to JSON format; https://sourceforge.net/p/xbrlframework/wiki/Home
-
21
Leo is an outlining-oriented project manager and browser. With Leo you can organize programs, web sites, URL's, pictures or any other kind of data. Leo is fully scriptable in Python. Leo is 100% pure Python. It requires the Qt gui toolkit.
-
22
A project for a highly scalable protocol and framework and a collection of software tools for m2m (machine to machine communication) and IoT Internet of Things. The programs here works on Windows and Linux and are based around VSCP, The Very Simple Control Protocol. Repository is here: https://github.com/grodansparadis/vscp_software and here https://github.com/grodansparadis/vscp_firmware
-
23
"Circular Multilateral Barter" (CMB) is aimed at supplying entrepreneurs with a way to exchange goods and services within a p2p-network, without using money, overcoming the "double coincidence of wants" problem, inherent to traditional barter. Most importantly, CMB allows traders to issue their own currencies (called "products"), which others can redeem, trade, or make payments with. One thing that distinguishes CMB from other "credit commons" is that all debts in CMB are user-to-user...
-
24
PiHass
Pre-defined and easy to use Home-Assistant Image for raspberry pi
This is a Raspbain Strech base image with Home-Assistant on it. i used Virtual Env based installation and added some Custom Ui and Custom Components. i have also configured MySQL server and database and also some scripts, sensors and groups to help users start working with the system. -
25
OTPspot
Wireless hotspot with OTP captive portal
Run a captive portal on your raspberry (or any linux box) to allow your guests to register before accessing your Wifi at home. Users will be requested for an OTP code that you can generate on your phone through the Google Authenticator/Authy app. Get rid of captive portal's static username and password, without the need for a complex radius server. OTPspot (since version 2.0) is fully compatible with nodogsplash and can run as a FAS service. In this configuration, nodogsplash will...
