Search Results for "python distributed list" - Page 2
Sort By:
Showing 71 open source projects for "python distributed list"
View related business solutions-
Gen AI apps are built with MongoDB AtlasMongoDB Atlas is the developer-friendly database used to build, scale, and run gen AI and LLM-powered apps—without needing a separate vector database. Atlas offers built-in vector search, global availability across 115+ regions, and flexible document modeling. Start building AI apps faster, all in one place.
-
Our Free Plans just got better! | Auth0You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
-
1
Odigos
Distributed tracing without code changes
Odigos supports any application written in Java, Python, .NET, Node.js and Go. Historically, compiled languages like Go have been difficult to instrument without code changes. Odigos solves this problem by uniquely leveraging eBPF. Odigos currently supports all the popular managed and open source destinations. By producing data in the OpenTelemetry format, Odigos can be used with any observability tool that supports OTLP. Odigos automatically scales OpenTelemetry collectors based... -
2
OneFlow
OneFlow is a deep learning framework designed to be user-friendly
OneFlow is a deep learning framework designed to be user-friendly, scalable and efficient. An extension for OneFlow to target third-party compiler, such as XLA, TensorRT and OpenVINO etc.CUDA runtime is statically linked into OneFlow. OneFlow will work on a minimum supported driver, and any driver beyond. For more information. Distributed performance (efficiency) is the core technical difficulty of the deep learning framework. OneFlow focuses on performance improvement and heterogeneous... -
3
Apache Sedona
Cluster computing framework for processing large-scale geospatial data
Apache Sedona™ is a cluster computing system for processing large-scale spatial data. Sedona extends existing cluster computing systems, such as Apache Spark and Apache Flink, with a set of out-of-the-box distributed Spatial Datasets and Spatial SQL that efficiently load, process, and analyze large-scale spatial data across machines. According to our benchmark and third-party research papers, Sedona runs 2X - 10X faster than other Spark-based geospatial data systems on computation-intensive... -
4
django-money
Money fields for Django forms and models
A little Django app that uses py-moneyed to add support for Money fields in your models and forms. The default currency code length is 3 but you can change it with the CURRENCY_CODE_MAX_LENGTH setting. Currencies are listed on moneyed, and these modules use this to provide a choice list on the admin, also for validation. Django-money leaves you to use any custom model managers you like for your models, but it needs to wrap some of the methods to allow searching for models with money values... -
Simple, Secure Domain RegistrationRegister or renew your domain and pay only what we pay. No markups, hidden fees, or surprise add-ons. Choose from over 400 TLDs (.com, .ai, .dev). Every domain is integrated with Cloudflare's industry-leading DNS, CDN, and free SSL to make your site faster and more secure. Simple, secure, at-cost domain registration.
-
5
SentenceTransformers
Multilingual sentence & image embeddings with BERT
SentenceTransformers is a Python framework for state-of-the-art sentence, text and image embeddings. The initial work is described in our paper Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks. You can use this framework to compute sentence / text embeddings for more than 100 languages. These embeddings can then be compared e.g. with cosine-similarity to find sentences with a similar meaning. This can be useful for semantic textual similar, semantic search, or paraphrase mining... -
6
IVY
The Unified Machine Learning Framework
Take any code that you'd like to include. For example, an existing TensorFlow model, and some useful functions from both PyTorch and NumPy libraries. Choose any framework for writing your higher-level pipeline, including data loading, distributed training, analytics, logging, visualization etc. Choose any backend framework which should be used under the hood, for running this entire pipeline. Choose the most appropriate device or combination of devices for your needs. DeepMind releases... -
7
django-split-settings
Organize Django settings into multiple files and directories
Organize Django settings into multiple files and directories. Easily override and modify settings. Use wildcards in settings file paths and mark settings files as optional. Managing Django’s settings might be tricky. There are severals issues which are encountered by any Django developer along the way. First one is caused by the default project structure. Django clearly offers us a single settings.py file. It seams reasonable at the first glance. And it is actually easy to use just after the... -
8
TensorFlow Model Garden
Models and examples built with TensorFlow
The TensorFlow Model Garden is a repository with a number of different implementations of state-of-the-art (SOTA) models and modeling solutions for TensorFlow users. We aim to demonstrate the best practices for modeling so that TensorFlow users can take full advantage of TensorFlow for their research and product development. To improve the transparency and reproducibility of our models, training logs on TensorBoard.dev are also provided for models to the extent possible though not all models... -
9
Gerapy
Distributed Crawler Management Framework Based on Scrapy
Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Scrapyd-Client, Scrapyd-API, Django and Vue.js. Someone who has worked as a crawler with Python may use Scrapy. Scrapy is indeed a very powerful crawler framework. It has high crawling efficiency and good scalability. It is basically a necessary tool for developing crawlers using Python. If you use Scrapy as a crawler, then of course we can use our own host to crawl when crawling, but when the crawl is very large, we can’t run... -
Build Securely on AWS with Proven FrameworksMoving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
-
10
Horovod
Distributed training framework for TensorFlow, Keras, PyTorch, etc.
Horovod was originally developed by Uber to make distributed deep learning fast and easy to use, bringing model training time down from days and weeks to hours and minutes. With Horovod, an existing training script can be scaled up to run on hundreds of GPUs in just a few lines of Python code. Horovod can be installed on-premise or run out-of-the-box in cloud platforms, including AWS, Azure, and Databricks. Horovod can additionally run on top of Apache Spark, making it possible to unify data... -
11
Grassroots DICOM
Cross-platform DICOM implementation
Grassroots DiCoM is a C++ library for DICOM medical files. It is accessible from Python, C#, Java and PHP. It supports RAW, JPEG, JPEG 2000, JPEG-LS, RLE and deflated transfer syntax. It comes with a super fast scanner implementation to quickly scan hundreds of DICOM files. It supports SCU network operations (C-ECHO, C-FIND, C-STORE, C-MOVE). PS 3.3 & 3.6 are distributed as XML files. It also provides PS 3.15 certificates and password based mecanism to anonymize and de-identify DICOM... -
12
ClassyVision
An end-to-end PyTorch framework for image and video classification
... distributed training, reproducible experiments, and flexible configuration tools. It offers high performance and scalability—capable of training models like ResNet-50 on ImageNet in just minutes—while remaining accessible to both researchers and production engineers. The library integrates seamlessly with PyTorch Hub for easy access to pretrained models and supports elastic training using PyTorch Elastic, making distributed training robust to changes in cluster resources or hardware failures. -
13
Apache MXNet (incubating)
A flexible and efficient library for deep learning
Apache MXNet is an open source deep learning framework designed for efficient and flexible research prototyping and production. It contains a dynamic dependency scheduler that automatically parallelizes both symbolic and imperative operations. On top of this is a graph optimization layer, overall making MXNet highly efficient yet still portable, lightweight and scalable. -
14
Smart Contract Sanctuary
A home for ethereum smart contracts
A home for Ethereum smart contracts verified on Etherscan. This is the index repository for the smart contract sanctuary. Bookmark this repo. Chain-specific sub-repos and the index are updated twice a day. Expect a full, recursive check-out to take 2GB+ disk space. Existing repository but submodules never initialized - checkout submodules and update all chain-specific sub repositories. Contains smart contract sources for various networks, grouped by the first two chars of the contract... -
15
Nameko
Python framework for building microservices
Write regular Python methods and classes to implement your service. Nameko will manage connections, transports, and concurrency for you. Spin up multiple service instances to easily scale out. Nameko gives you effortless concurrency by yielding workers when they wait for I/O, leaving you free to handle many requests without the worry of threading. Nameko is compatible with almost any protocol, transport or database. Simply use the built-in extensions, build your own or leverage the community... -
16
go-nsq
The Go package for NSQ
The Go package for NSQ. See godoc and the main repo apps directory for examples of clients built using this package. Tests are run via ./test.sh (which requires nsqd and nsqlookupd to be installed). Operationally, NSQ is easy to configure and deploy (all parameters are specified on the command line and compiled binaries have no runtime dependencies). For maximum flexibility, it is agnostic to data format (messages can be JSON, MsgPack, Protocol Buffers, or anything else). Go and Python... -
17
FlaskBB
A classic Forum Software in Python using Flask
... can customize every template in FlaskBB. Besides that, you can also install community-made themes. Our goal is to develop a forum system with modern technologies and sticking to already well-tested and approved layouts. FlaskBB is a simple and extensible forum software that should be seen as the foundation for building communities. It is written in Python using the web framework Flask. FlaskBB is being distributed under the BSD 3-Clause License. -
18
0x Monorepo
0x protocol monorepo - includes our smart contracts
0x protocol monorepo, includes our smart contracts and many developer tools. 0x is an open protocol that facilitates the trustless, low-friction exchange of Ethereum-based assets. For more information on how it works, check out the 0x protocol specification. This repository is a monorepo including the 0x protocol smart contracts and numerous developer tools. Each public sub-package is independently published to NPM. Visit our developer portal for a comprehensive list of core & community... -
19
PyText
A natural language modeling framework based on PyTorch
... them at scale. Distributed-training support built on the new C10d backend in PyTorch 1.0. Mixed precision training support through APEX (trains faster with less GPU memory on NVIDIA Tensor Cores). Extensible components that allows easy creation of new models and tasks. -
20
pythonbrew
Python Environment manager
pythonbrew is the Python environments manager. it's easy to switch between them. Inspired by perlbrew and rvm. The recommended way to download from each releases and put it somewhere in your PATH. -
21
Yandex Tank
Load and performance benchmark tool
Yandex.Tank is an extensible open-source load testing tool for advanced Linux users which is especially good as a part of an automated load testing suite. Different load generators are supported. Evgeniy Mamchits' phantom is a very fast (100 000+ RPS) shooter written in C++ (default) JMeter is an extendable and widely known one. BFG is a Python-based generator that allows you to write your load scenarios in Python. Experimental Golang generator: pandora. Performance analytics backend service... -
22
Django Celery
Old Celery integration project for Django
Celery is a simple, flexible, and reliable distributed system to process vast amounts of messages, while providing operations with the tools required to maintain such a system. It’s a task queue with focus on real-time processing, while also supporting task scheduling. Celery has a large and diverse community of users and contributors, you should come join us on IRC or our mailing-list. Celery is Open Source and licensed under the BSD License. A task queue’s input is a unit of work called... -
23
MMF
A modular framework for vision & language multimodal research
MMF is a modular framework for vision and language multimodal research from Facebook AI Research. MMF contains reference implementations of state-of-the-art vision and language models and has powered multiple research projects at Facebook AI Research. MMF is designed from ground up to let you focus on what matters, your model, by providing boilerplate code for distributed training, common datasets and state-of-the-art pre-trained baselines out-of-the-box. MMF is built on top of PyTorch... -
24
setuplib
Extensions for setuptools - detailed information on entry points
The *setuplib* package provides core functions for the query of meta information and installation repositories of *Python* packages. It provides query and filter options on the installed packages and the available information, while displaying the result data in various formats, e.g. as table, list, or JSON, XML, YAML, CSV, etc. The provided commands and extension points integrate seamless into the standard *setuptools* and/or *distutils*. The *setuplib* is member of the group... -
25
django-dynamic-scraper
Creating Scrapy scrapers via the Django admin interface
..., but it is well suited for the relatively common case of regularly scraping a website with a list of updated items (e.g. news, events, etc.) and then dig into the detail page to scrape some more infos for each item. Django Dynamic Scraper tries to keep its data structure in the database as separated as possible from the models in your app, so it comes with its own Django model classes for defining scrapers, runtime information related to your scraper runs and classes.
