Search Results for "python web crawler"
Sort By:
Showing 39 open source projects for "python web crawler"
View related business solutions-
Get the most trusted enterprise browserDefend against security incidents with Chrome Enterprise. Create customizable controls, manage extensions and set proactive alerts to keep your data and employees protected without slowing down productivity.
-
Gen AI apps are built with MongoDB AtlasMongoDB Atlas is the developer-friendly database used to build, scale, and run gen AI and LLM-powered apps—without needing a separate vector database. Atlas offers built-in vector search, global availability across 115+ regions, and flexible document modeling. Start building AI apps faster, all in one place.
-
1
AWS Lambda Python Runtime Interf Client
Seamlessly extend your preferred base images to be Lambda compatible
We have open-sourced a set of software packages, Runtime Interface Clients (RIC), that implement the Lambda Runtime API, allowing you to seamlessly extend your preferred base images to be Lambda compatible. The Lambda Runtime Interface Client is a lightweight interface that allows your runtime to receive requests from and send requests to the Lambda service. The Lambda Python Runtime Interface Client is vended through pip. You can include this package in your preferred base image to make... -
2
Docker Compose
Define and run multi-container applications with Docker
Docker Compose is an open source tool for defining and running multi-container applications with Docker. Compose lets you use a YAML file to configure your application’s services, and then create and start all the services from your configuration with just a single command. Compose works great in all environments: production, staging, testing, development, and on CI workflows. Compose has commands for every stage of your application lifecycle, from starting, stopping and rebuilding services,... -
3
Jupyter Enterprise Gateway
Enables Jupyter Notebooks to share resources across clusters
Jupyter Enterprise Gateway is a headless web server with a pluggable framework for anyone supporting multiple notebook users in a managed-cluster environment. Some of the core functionality it provides is better optimization of compute resources, improved multi-user support, and more granular security for your Jupyter notebook environment - making it suitable for enterprise, scientific, and academic implementations. From a technical perspective, Jupyter Enterprise Gateway is a web server... -
4
Tarsier
Vision utilities for web interaction agents
At Reworkd, we iterated on all these problems across tens of thousands of real web tasks to build a powerful perception system for web agents... Tarsier! In the video below, we use Tarsier to provide webpage perception for a minimalistic GPT-4 LangChain web agent. Tarsier visually tags interactable elements on a page via brackets + an ID e.g. [23]. In doing this, we provide a mapping between elements and IDs for an LLM to take actions upon (e.g. CLICK [23]). We define interactable elements... -
Our Free Plans just got better! | Auth0You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
-
5
CBMPy
PySCeS Constraint Based Modelling
... these into the underlying mathematical structures. . CBMPy implements popular analyses such as FBA, FVA, element/charge balancing, network analysis and model editing as well as advanced methods developed for the ecosystem modelling. CBMPy supports user interaction via: - interactive console or as a library for advanced use - GUI, visual representation of the model, analysis methods - a SOAP based webAPI exposes high level functionality via web services -
6
crawler4j
Open source web crawler for Java
crawler4j is an open source web crawler for Java which provides a simple interface for crawling the Web. Using it, you can setup a multi-threaded web crawler in few minutes. You need to create a crawler class that extends WebCrawler. This class decides which URLs should be crawled and handles the downloaded page. shouldVisit function decides whether the given URL should be crawled or not. In the above example, this example is not allowing .css, .js and media files and only allows pages within... -
7
Linux Dash
A beautiful web dashboard for Linux
Using the 3 bar hamburger icon on each module (widget) on Linux Dash, you can drag and re-arrange them. It is strongly recommended that all linux-dash installations be protected via a security measure of your choice. All of your changes are saved in LocalStorage, so your changes will be preserved permanently on that browser for convenience. Each of the modules (widgets) on the Linux Dash screen can be minimized to hide it, expanded in one click to maximize it, adjusted to a custom width.... -
8
PyXB (“pixbee”) is a pure Python package that generates Python source code for classes that correspond to data structures defined by XMLSchema. In concept it is similar to JAXB for Java and CodeSynthesis XSD for C++.
-
9
Note: latest version can be found at https://github.com/targeted/pythomnic3k Pythomnic3k is a Python 3 framework for service-oriented middleware with hot reloading and fault tolerance. It is used for integrating various systems in enterprise network or writing standalone network services.
-
Simply solve complex auth. Easy for devs to set up. Easy for non-devs to use.Custom auth drains 25% of dev time and risks 62% more breaches, stalling enterprise deals. Frontegg platform delivers a simple login box, seamless authentication (SSO, MFA, passwordless), robust multi-tenancy, and a customizable Admin Portal. Integrate fast with the React SDK, meet compliance needs, and focus on innovation.
-
10
Cloud Export is a tool to automatically extract your data from web applications and save it to your local file system for backup purposes, but more extensive than Google Takeout. Plans are based on http://www.dataliberation.org.
-
11
GreasySpoon
An ICAP Services Factory
-
12
blog4y
Easy blogging for you.
Project goal is to allow you easy post and backup blog articles to most free blogging hosting. Provide Python API, command line utility, Emacs integration and GTK interface. -
13
Meresco is both an OAI Data Provider and a Service Provider. SourceForge is only used to host the source control (subversion). Sources: http://sources.meresco.org/ Binaries: http://repository.cq2.org/ Mail: http://groups.google.com/group/meresco
-
14
python library with utility classes for: - access mysql via - nevow / form - mangaing form and new field for form - building pdf report with reportlab
-
15
A PHP script with maps of the World, China, Canada, USA, India, Africa and Europe that allows the user to select the countries, provinces or states by clicking on them or selecting a checkboxes. Selection causes the entity to turn a default color which contrasts with defaults colors of all bordering countries. Thus a patchwork is made to show the history of countries, states or provinces traveled. Added features allow users to download their maps, to blow them up to posters of any...
-
16
SuStorID is an advanced Intrusion Detection System (IDS) for web services, based on machine learning. Its name comes from the term “Su Stori”, which in Sardinian language means “The Falcon”. It’s version is experimental, but demonstrates a number of interesting features, that can be readily exploited to detect and act against web attacks. SuStorID can be coupled with modsecurity, the well known web application firewall, to gather training data and provide for real-time counteractions. So...
-
17
-
18
-
19
A pure HTML implementation of VNC, using the HTML 5 canvas tag and JavaScript as a client and an RFB to HTTP proxy served up by Python. Requires Python and Python Imaging Library to be installed on the server.
-
20
pyxser stands for python xml serialization and is a python object to XML serializer that validates every XML deserialization against the pyxser 1.0 XML Schema. pyxser is written entirely in C as a python extension.
-
21
Convserver is a threaded XML-RPC webserver that converts files into various formats remotely. Convserver is not meant as a end-user tool but as middleware facilitating other applications like web applications, mobile apps and traditional GUI tools.
-
22
NOTE: This project is now on Github. Please go to https://github.com/scaryclam/python-webdav A WebDAV client library for python. The purpose of this project is to make a python WebDAV client library that is easy and convenient to use, while remaining flexible enough for developers who may want a finer grain of control. UPDATE: The test suite passes using Python 3.1 so we will now be supporting Python3 issues. The library will try to continue to work on both Python 2 and Python 3 until...
-
23
A command-line Python utility to mine information on open source projects using the ohloh web service APIs. The script is enables analysis of open source projects indexed by ohloh by providing source lines of code (SLOC), contributor data and other info.
-
24
A Python GUI tool for rapidshare premium member to download rapidshare links. Features: Resumable. Download rapidshare folder/linklist. Multiple concurrent files download / multiple concurrent parts per file. Proxy (HTTP, SOCKS). Urlcash, anonym.to
-
25
The suds project is a python soap web services client lib. Suds leverages python meta programming to provide an intuative API for consuming web services. Runtime objectification of types defined in the WSDL is provided without class generation.
