Search Results for "python web crawler" - Page 33
Sort By:
Showing 3175 open source projects for "python web crawler"
View related business solutions-
Gen AI apps are built with MongoDB AtlasMongoDB Atlas is the developer-friendly database used to build, scale, and run gen AI and LLM-powered apps—without needing a separate vector database. Atlas offers built-in vector search, global availability across 115+ regions, and flexible document modeling. Start building AI apps faster, all in one place.
-
Keep company data safe with Chrome EnterpriseMake AI work your way with Chrome Enterprise. Block unapproved sites and set custom data controls that align with your company's policies.
-
1
CloverDX
Design, automate, operate and publish data pipelines at scale
.... Simple data manipulation jobs can be created visually. More complex business logic can be implemented using Clover's domain-specific-language CTL, in Java or languages like Python or JavaScript. Through its DataServices functionality, it allows to quickly turn data pipelines into REST API endpoints. The platform allows to easily scale your data job across multiple cores or nodes/machines. Supports Docker/Kubernetes deployments and offers AWS/Azure images in their respective marketplace -
2
GCB_package
Stand-alone version of the Genome Complexity Browser
This application allows observing genome rearrangements in prokaryotic genomes. It provides rearrangements frequencies profiles and genomes graph representation. -
3
Twitter Intelligence
Twitter Intelligence OSINT project performs tracking and analysis
A project written in Python for Twitter tracking and analysis without using Twitter API. This project is a Python 3.x application. The package dependencies are in the file requirements.txt. Run that command to install the dependencies. SQLite is used as the database. Tweet data is stored on the Tweet, User, Location, Hashtag, HashtagTweet tables. The database is created automatically. analysis.py performs analysis processing. User, hashtag, and location analyzes are performed. You must write... -
4
e-Species
A taxonomically intelligent biodiversity search engine
This is a pure Python CGI-based implementation of a taxonomically intelligent species search engine. It searches biological databases for a taxonomic name. The search is done "on the fly" using web services (SOAP/XML) or URL API's. -
Photo and Video Editing APIs and SDKsUnlock Picsart's full editing suite by embedding our Editor SDK directly into your platform. Offer your users the power of a full design suite without leaving your site.
-
5
etalon
Standards Document Redaction System
The best process for creating standards is that of the IETF’s RFCs. Standard documents are written, submitted for publication, reviewed, and finally approved. Then they get a official number and hence can be referenced. Some can even be blessed to be an official standard. Etalon will implement this whole process, web-based and with markdown documents. Create your company’s standards the RFC way! -
6
WhatsappToDesktop
Esse é um pacote de compilado do Whatsapp Web versão 1.0.
Esse é um pacote de compilado do Whatsapp Web versão 1.0. Esse é um aplicativo multiplataforma de mensagens instantâneas e chamadas de voz para smartphones. Além de mensagens de texto, os usuários podem enviar vídeos, vídeos e documentos em formato PDF, além de fazer a livre conexão com o meio de uma conexão com internet ... -
7
myHouse
Home monitoring and automation suite now known as eGeoffrey
PLEASE NOTE: myHouse has been a nice starting point but difficult to customize, maintain and evolve. For these and many other reasons, I've completely re-designed- re-architect myHouse also giving it a new name (eGeoffrey). The basic principles are the same, the software is still open source but now is supposed to be way simpler to configure (entirely via the web interface), use, customize and extend. If you want to give it a look, check out https://www.egeoffrey.com. I've also put... -
8
Thexyz Cloud Drive
Mobile Sync for Files, Email, Calendars, and Contacts
Thexyz Cloud Drive application allows you to synchronize files on your desktop with your cloud storage space. This gives you instant access to the most recent versions of important files from anywhere and from any device. Need to edit that important document, but don’t have access to your desktop computer? With the editors included in Cloud Drive, you can create, access, and edit documents and spreadsheets right from your browser. -
9
Resume Match
A tool to match resumes with job descriptions
An ultra light and easy tool based on Python to match your resume against the job description. Companies use software to match the numerous resumes they receive with the job description they have posted. Higher the percentage of the match, higher is the chances of the resume to be actually looked at by the HR teams. This is an attempt to help job seekers in the above mentioned regards. This is by no means the best or even a powerful tool. But, it works and it might help... -
Secure remote access solution to your private network, in the cloud or on-prem.OpenVPN is here to bring simple, flexible, and cost-effective secure remote access to companies of all sizes, regardless of where their resources are located.
-
10
-
11
pyspider
A powerful Spider(Web Crawler) system in Python
pyspider is a powerful Spider(Web Crawler) system in Python. Components are connected by message queue. Every component, including message queue, is running in their own process/thread, and replaceable. That means, when process is slow, you can have many instances of processor and make full use of multiple CPUs, or deploy to multiple machines. This architecture makes pyspider really fast. benchmarking. Since pyspider has various components, you can just run pyspider to start a standalone... -
12
Face Recognition
World's simplest facial recognition api for Python & the command line
Face Recognition is the world's simplest face recognition library. It allows you to recognize and manipulate faces from Python or from the command line using dlib's (a C++ toolkit containing machine learning algorithms and tools) state-of-the-art face recognition built with deep learning. Face Recognition is highly accurate and is able to do a number of things. It can find faces in pictures, manipulate facial features in pictures, identify faces in pictures, and do face recognition... -
13
Syllog
Syllog is a system for teaching logic, with anonymous answer logging
Syllog is a system for teaching various forms of logic, including syllogistic logic. It consists of a student-facing Java Applet that runs in the student's browser, and a teacher-facing, server-based logging facility for recording the answers given by students. The student-facing part simply poses questions, to which the student must provide an answer. The teacher-oriented logging facility then logs the answers anonymously for further investigation by the teacher. -
14
crawler4j
Open source web crawler for Java
crawler4j is an open source web crawler for Java which provides a simple interface for crawling the Web. Using it, you can setup a multi-threaded web crawler in few minutes. You need to create a crawler class that extends WebCrawler. This class decides which URLs should be crawled and handles the downloaded page. shouldVisit function decides whether the given URL should be crawled or not. In the above example, this example is not allowing .css, .js and media files and only allows pages within... -
15
Zoom Website Editor
Text based Website Editor
A text/code editor which allows direct editing of web pages over FTP -
16
Vaex
Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python
Data science solutions, insights, dashboards, machine learning, deployment. We start at 100GB. Vaex is a high-performance Python library for lazy Out-of-Core data frames (similar to Pandas), to visualize and explore big tabular datasets. It calculates statistics such as mean, sum, count, standard deviation etc, on an N-dimensional grid for more than a billion (10^9) samples/rows per second. Visualization is done using histograms, density plots and 3d volume rendering, allowing interactive... -
17
Transcrypt
Python in the Browser
Lean and mean Python 3.6 to JavaScript compiler. Supports multiple inheritance, operator overloading and Python source level debugging, even of minified Javascript files. Transcrypt code is as fast and compact as its Javascript counterpart, and it is precompiled for page load speed. You can now develop your web applications completely in Python, with full access to any Javascript library. -
18
fapws3
my own copy of Fapws3 (Fast asynchronous Python web Server)
This my copy of Fapws developped by william.os4y (https://github.com/william-os4y/fapws3) -
19
dadosSemiotica
Collecter and manager of semiotica annalisis data
This program is a web application to collect and organize data of text analysis. It works with sets of texts and the analysis are done on portions of the length of a sentence. One of the preprocessing modules is based on CoGroo (A LibreOffice & OpenOffice.org Portuguese Grammar Checker). -
20
Clustergrammer
An interactive heatmap visualization built using D3.js
Clustergrammer is a visualization library built using D3.js that enables intuitive interaction with high-dimensional data. Clustergrammer was built with biological data in mind. Clustergrammer is a web-based tool for visualizing high-dimensional data (e.g. a matrix) as an interactive and shareable hierarchically clustered heatmap. Clustergrammer's front end (Clustergrammer-JS) is built using D3.js and its back-end (Clustergrammer-PY) is built using Python. Clustergrammer produces highly... -
21
PyTom
http://www.sciencedirect.com/science/article/pii/S1047847711003492
PyTom is a toolbox developed for interpreting cryo electron tomography data. All steps from reconstruction, localization, alignment and classification are covered with standard and improved methods. Please sign up to our mailing list to keep up with the most recent updates and versions. -
22
gdpr
Tool to maintain gdpr data protection declaration
Admins often maintain multiple web pages, each of which under EU-GDPR requires a privacy statement. In order to keep them coherent, up-to-date and at the same time avoiding doing the same work multiple times, this project provides a tool to automatically create the appropriate statements for each page from a single source. The project is currently available in PHP, however if anyone is willing to provide a version in Python or Perl or whatever, it is more than welcome. The project... -
23
WebSrapper
Webscraping with UI
Hello , i have made this simple web scrapping tool so that one can have fun web scrapping with with ease . -
24
squirreldns
simple way to show your current ip to the world
simple way to login to a flask server and set your ip address so that others can communicate with you. Also has basic function to allow failover of nodes -
25
... the use of services (...) 5. XBRL Similarity Tool implements a process to evaluate similarity between concepts of XBRL (...) 6. XBRL SPED Taxonomy is a data model, in order to create a standard, organized to support to Brazilian Public Digital Bookkeeping System (SPED)(...) 7. easyXBRL is a Python-based XBRL library (...) 8. J-easyXBRL is a Java-based XBRL library (...) 9. Xbrl Parser converts XBRL file from XML to JSON format; https://sourceforge.net/p/xbrlframework/wiki/Home
