Search Results for "python web crawler"
Sort By:
Showing 46 open source projects for "python web crawler"
View related business solutions-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
Get the most trusted enterprise browserDefend against security incidents with Chrome Enterprise. Create customizable controls, manage extensions and set proactive alerts to keep your data and employees protected without slowing down productivity.
-
1
AWS Lambda Python Runtime Interf Client
Seamlessly extend your preferred base images to be Lambda compatible
We have open-sourced a set of software packages, Runtime Interface Clients (RIC), that implement the Lambda Runtime API, allowing you to seamlessly extend your preferred base images to be Lambda compatible. The Lambda Runtime Interface Client is a lightweight interface that allows your runtime to receive requests from and send requests to the Lambda service. The Lambda Python Runtime Interface Client is vended through pip. You can include this package in your preferred base image to make... -
2
Docker Compose
Define and run multi-container applications with Docker
Docker Compose is an open source tool for defining and running multi-container applications with Docker. Compose lets you use a YAML file to configure your application’s services, and then create and start all the services from your configuration with just a single command. Compose works great in all environments: production, staging, testing, development, and on CI workflows. Compose has commands for every stage of your application lifecycle, from starting, stopping and rebuilding services,... -
3
Jupyter Enterprise Gateway
Enables Jupyter Notebooks to share resources across clusters
Jupyter Enterprise Gateway is a headless web server with a pluggable framework for anyone supporting multiple notebook users in a managed-cluster environment. Some of the core functionality it provides is better optimization of compute resources, improved multi-user support, and more granular security for your Jupyter notebook environment - making it suitable for enterprise, scientific, and academic implementations. From a technical perspective, Jupyter Enterprise Gateway is a web server... -
4
Tarsier
Vision utilities for web interaction agents
At Reworkd, we iterated on all these problems across tens of thousands of real web tasks to build a powerful perception system for web agents... Tarsier! In the video below, we use Tarsier to provide webpage perception for a minimalistic GPT-4 LangChain web agent. Tarsier visually tags interactable elements on a page via brackets + an ID e.g. [23]. In doing this, we provide a mapping between elements and IDs for an LLM to take actions upon (e.g. CLICK [23]). We define interactable elements... -
Simply solve complex auth. Easy for devs to set up. Easy for non-devs to use.Custom auth drains 25% of dev time and risks 62% more breaches, stalling enterprise deals. Frontegg platform delivers a simple login box, seamless authentication (SSO, MFA, passwordless), robust multi-tenancy, and a customizable Admin Portal. Integrate fast with the React SDK, meet compliance needs, and focus on innovation.
-
5
ZK is an open-source Java framework for building modern web and mobile applications. It enables developers to create rich, interactive UIs using only Java — no JavaScript required. With 200+ Ajax-powered components, event-driven architecture, and support for popular technologies like Spring, Java EE, and JSP/JSF, ZK makes it simple to deliver powerful and user-friendly web applications.
-
6
CBMPy
PySCeS Constraint Based Modelling
... these into the underlying mathematical structures. . CBMPy implements popular analyses such as FBA, FVA, element/charge balancing, network analysis and model editing as well as advanced methods developed for the ecosystem modelling. CBMPy supports user interaction via: - interactive console or as a library for advanced use - GUI, visual representation of the model, analysis methods - a SOAP based webAPI exposes high level functionality via web services -
7
crawler4j
Open source web crawler for Java
crawler4j is an open source web crawler for Java which provides a simple interface for crawling the Web. Using it, you can setup a multi-threaded web crawler in few minutes. You need to create a crawler class that extends WebCrawler. This class decides which URLs should be crawled and handles the downloaded page. shouldVisit function decides whether the given URL should be crawled or not. In the above example, this example is not allowing .css, .js and media files and only allows pages within... -
8
PyXB (“pixbee”) is a pure Python package that generates Python source code for classes that correspond to data structures defined by XMLSchema. In concept it is similar to JAXB for Java and CodeSynthesis XSD for C++.
-
9
Note: latest version can be found at https://github.com/targeted/pythomnic3k Pythomnic3k is a Python 3 framework for service-oriented middleware with hot reloading and fault tolerance. It is used for integrating various systems in enterprise network or writing standalone network services.
-
Our Free Plans just got better! | Auth0You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
-
10
Cloud Export is a tool to automatically extract your data from web applications and save it to your local file system for backup purposes, but more extensive than Google Takeout. Plans are based on http://www.dataliberation.org.
-
11
Maximo SOAP Web Service Tester
Simple application for testing XML Web Services in Maximo
Maximo SOAP WebService Tester (Windows) Source: https://github.com/SVSagi/mxwst -
12
GreasySpoon
An ICAP Services Factory
-
13
blog4y
Easy blogging for you.
Project goal is to allow you easy post and backup blog articles to most free blogging hosting. Provide Python API, command line utility, Emacs integration and GTK interface. -
14
python library with utility classes for: - access mysql via - nevow / form - mangaing form and new field for form - building pdf report with reportlab
-
15
A PHP script with maps of the World, China, Canada, USA, India, Africa and Europe that allows the user to select the countries, provinces or states by clicking on them or selecting a checkboxes. Selection causes the entity to turn a default color which contrasts with defaults colors of all bordering countries. Thus a patchwork is made to show the history of countries, states or provinces traveled. Added features allow users to download their maps, to blow them up to posters of any...
-
16
SuStorID is an advanced Intrusion Detection System (IDS) for web services, based on machine learning. Its name comes from the term “Su Stori”, which in Sardinian language means “The Falcon”. It’s version is experimental, but demonstrates a number of interesting features, that can be readily exploited to detect and act against web attacks. SuStorID can be coupled with modsecurity, the well known web application firewall, to gather training data and provide for real-time counteractions. So...
-
17
-
18
-
19
A pure HTML implementation of VNC, using the HTML 5 canvas tag and JavaScript as a client and an RFB to HTTP proxy served up by Python. Requires Python and Python Imaging Library to be installed on the server.
-
20
NOTE: This project is now on Github. Please go to https://github.com/scaryclam/python-webdav A WebDAV client library for python. The purpose of this project is to make a python WebDAV client library that is easy and convenient to use, while remaining flexible enough for developers who may want a finer grain of control. UPDATE: The test suite passes using Python 3.1 so we will now be supporting Python3 issues. The library will try to continue to work on both Python 2 and Python 3 until...
-
21
An standalone Divx movie streamer implemented using python. Utilising the DivxFest.com website and VLC media player to grab and play the streams.
-
22
WSFuzzer is a fuzzing penetration testing tool used against HTTP SOAP based web services. It tests numerous aspects (input validation, XML Parser, etc) of the SOAP target. It is only to be used against targets that have granted permission to be teste
-
23
The suds project is a python soap web services client lib. Suds leverages python meta programming to provide an intuative API for consuming web services. Runtime objectification of types defined in the WSDL is provided without class generation.
-
24
Lucid Desktop is a Web Desktop/WebOS/Web Operating System built with Dojo. For more info, please visit http://www.lucid-desktop.org/
-
25
ZK Light is renamed to ZKuery and moved to http://code.google.com/p/zkuery/. ZK Light is a client-only version of ZK; Support Java, C, PHP, Python...
