Search Results for "define"
Sort By:
Showing 19 open source projects for "define"
View related business solutions-
Gemini 3 and 200+ AI Models on One PlatformBuild, govern, and optimize agents and models with Gemini Enterprise Agent Platform.
-
Stop Cyber Threats with VM-Series Next-Gen Firewall on AzureGain integrated visibility across all traffic in a single pass. Deploy Palo Alto Networks VM-Series to determine application identity and content while automating security policy updates via rich APIs.
-
1
Toapi
Convert websites into structured APIs automatically with Python tool
...Instead of building a traditional web crawler that collects and stores data before exposing it through an API, Toapi simplifies the process by allowing developers to define data structures that automatically generate an API layer from existing web pages. It works by parsing HTML content from a source site and mapping selected elements into structured data that can be returned as JSON through API endpoints. Developers define items and routes that determine how web pages are parsed and how the resulting data is exposed through the API interface. ... -
2
Cloud Custodian
Rules engine for cloud security, cost optimization, and governance
Cloud Custodian enables users to be well managed in the cloud. The simple YAML DSL allows you to easily define rules to enable a well-managed cloud infrastructure, that's both secure and cost-optimized. It consolidates many of the ad-hoc scripts organizations have into a lightweight and flexible tool, with unified metrics and reporting. Custodian supports managing AWS, Azure, and GCP public cloud environments. Besides just providing reports of issues, Custodian can actively enforce the security policies you define. ... -
3
gain
Asyncio-based Python framework for building fast web crawling spiders
...It is built on top of asynchronous technologies such as asyncio, aiohttp, and uvloop to support high-performance crawling with concurrent network requests. It provides a structured framework for creating spiders that can navigate websites, extract structured data, and process the collected results. Developers define crawlers using components such as spiders, parsers, and items, allowing them to organize crawling logic and data extraction rules clearly. Gain supports CSS selectors and XPath expressions for parsing page content and extracting specific elements. Gain also allows developers to configure headers, concurrency levels, and proxy settings to control how crawlers interact with target websites. ... -
4
pyinfra
pyinfra turns Python code into shell commands
pyinfra is a high-performance infrastructure automation and configuration management framework that uses Python instead of YAML to define deployments and operational workflows. The system converts Python code into shell commands and executes them across servers, Docker containers, and local machines through an agentless architecture. Designed as an alternative to tools like Ansible, pyinfra prioritizes speed, scalability, and developer flexibility while maintaining a declarative operational model. ... -
Our Free Plans just got better! | Auth0You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
-
5
Grab Framework Project
Web Scraping Framework
...The single request/response API that allows you to build network request, perform it and work with the received content. The API is built on top of urllib3 and lxml libraries. The Spider API to build asynchronous web crawlers. You write classes that define handlers for each type of network request. Each handler is able to spawn new network requests. Network requests are processed concurrently with a pool of asynchronous web sockets. Grab provides interface called Spider to develop multithreaded web-site scrapers. -
6
AWS SAM CLI
CLI tool to build, test, debug, and deploy Serverless applications
...The AWS Serverless Application Model (SAM) is an open-source framework for building serverless applications. It provides shorthand syntax to express functions, APIs, databases, and event source mappings. With just a few lines per resource, you can define the application you want and model it using YAML. During deployment, SAM transforms and expands the SAM syntax into AWS CloudFormation syntax, enabling you to build serverless applications faster. To get started with building SAM-based applications, use the SAM CLI. SAM CLI provides a Lambda-like execution environment that lets you locally build, test, debug, and deploy AWS serverless applications. -
7
requests-cache
Persistent HTTP cache for python requests
...Works with several storage backends including SQLite, Redis, MongoDB, and DynamoDB; or save responses as plain JSON files, YAML, and more. Use Cache-Control and other standard HTTP headers, define your own expiration schedule, and keep your cache clutter-free with backends that natively support TTL or any combination of strategies. Works out of the box with zero config, but with a robust set of features for configuring and extending the library to suit your needs. -
8
JobFunnel
Scrape job websites into a single spreadsheet with no duplicates.
...If you have a job website you'd like to write a scraper for, you are welcome to implement it, Review the Base Scraper for implementation details. JobFunnel supports scraping jobs from the same job website across locales & domains. If you are interested in adding support, you may only need to define session headers and domain strings, Review the Base Scraper for further implementation details. -
9
Whakerexa
A minimalist and lightweight web kit for accessible contents
...It was designed to be easily customizable, allowing users to adjust properties such as fonts, colors, borders, etc., effortlessly. Most of the properties are stored into variables which makes possible to re-define them, then to obtain a custom different style, enabling users to achieve a unique style easily. It can be combined with the use of WhakerPy, an open source library to create dynamic HTML content: <https://whakerpy.sf.net>. Features: - Lightweight and semantic - Light or dark mode - Normal or high-Contrast mode - Easy use and customization - Human-readable: could be extended or composed for your specific needs - No extr -
AI-powered service management for IT and enterprise teamsGive your IT, operations, and business teams the ability to deliver exceptional services—without the complexity. Maximize operational efficiency with refreshingly simple, AI-powered Freshservice.
-
10
StreamAlert
StreamAlert is a serverless, realtime data analysis framework
StreamAlert is a serverless, real-time data analysis framework that empowers you to ingest, analyze, and alert on data from any environment, using data sources and alerting logic you define. Computer security teams use StreamAlert to scan terabytes of log data every day for incident detection and response. Incoming log data will be classified and processed by the rules engine. Alerts are then sent to one or more outputs. Rules are written in Python; they can utilize any Python libraries or functions. Merge similar alerts and automatically promote new rules if they are not too noisy. ... -
11
googler
Google from the terminal
...However, it has grown into a very handy and flexible utility that delivers much more. For example, fetch any number of results or start anywhere, limit the search by any duration, define aliases to google search any number of websites, and switch domains easily, all of this in a very clean interface without ads or stray URLs. The shell completion scripts make sure you don't need to remember any options. -
12
ruia
Async Python framework for fast and flexible web scraping spiders
...Ruia follows a “write less, run faster” philosophy, emphasizing concise code and streamlined spider development. It provides a structured approach to building scraping projects through components such as data items, spiders, middleware, and plugins. Developers can define structured fields to extract information from HTML content and process responses asynchronously to improve crawling performance. It also supports middleware and plugin systems that allow customization of request handling, response processing, and additional functionality. -
13
googler
Google Search, Google Site Search, Google News from the terminal
...However, it has grown into a very handy and flexible utility that delivers much more. For example, fetch any number of results or start anywhere, limit search by any duration, define aliases to google search any number of websites, switch domains easily... all of this in a very clean interface without ads or stray URLs. The shell completion scripts make sure you don't need to remember any options. googler isn't affiliated to Google in any way. Demo: https://asciinema.org/a/85019 -
14
django-dynamic-scraper
Creating Scrapy scrapers via the Django admin interface
...While preserving many of the features of Scrapy it lets you dynamically create and manage spiders via the Django admin interface. With Django Dynamic Scraper (DDS) you can define your Scrapy scrapers dynamically via the Django admin interface and save your scraped items in the database you defined for your Django project. Since it simplifies things DDS is not usable for all kinds of scrapers, but it is well suited for the relatively common case of regularly scraping a website with a list of updated items (e.g. news, events, etc.) and then dig into the detail page to scrape some more infos for each item. ... -
15
Felix Felicis
Felix Felicis (aka liquidluck) is a static blog generator in python
LiquidLuck is an open-source static site generator powered by Ruby, originally built to enable fast, flexible blog and documentation sites with modern features such as Markdown authoring, custom taxonomies, tags, collections, and theming. It is similar in purpose to Jekyll, Hugo or Hexo, but emphasizes ease of customization and rich templating, allowing authors to define custom content models and build plug-in extensions. The generator supports live previews and incremental builds so content changes reflect quickly, and it includes built-in support for features like pagination, RSS feeds, and code syntax highlighting to suit developers. It is aimed at creators who want to author content in a lightweight workflow without heavy CMS overhead and still maintain full control over markup, design, and deployment. ... -
16
Fetches topics with new posts from ZetaBoards forums and does something with the URLs, like opening them in a browser. Configurations can be stored and manipulated for quicker fetching. Development, translations, bug reports, etc. are handled at Launchpad: https://launchpad.net/zb-fetcher SourceForge is used to host released files.
-
17
Nanon is a web page manager, ideal for simple sites with no server generated content. It lets you define templates and reusable html code blocks like menus and ad sections. Nanon is a spiffy command line tool that you can learn how to use in minutes.
-
18
Monmaster is a web site and web application monitoring tool written in Python. You define pages, servers, tests, and applications, and Monmaster can test and restart apps. Notification of error and recovery status via email is available, as is a web UI
-
19
Internet survey CGI engine. Allows to define the colleted data set, generate SQL database tables, displays survey form, validates them and finally stores in the database. Written in Python.
- Previous
- You're on page 1
- Next
