Search Results for "tensor"
Sort By:
Showing 28 open source projects for "tensor"
View related business solutions-
$300 Free Credits for Your Google Cloud ProjectsLaunch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.
-
Our Free Plans just got better! | Auth0You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
-
1
ggml
Tensor library for machine learning
ggml is an open-source tensor library designed for efficient machine learning computation with a focus on running models locally and with minimal dependencies. Written primarily in C and C++, the library provides low-level tensor operations and automatic differentiation that allow developers to implement machine learning algorithms and neural networks efficiently. -
2
Shumai
Fast Differentiable Tensor Library in JavaScript & TypeScript with Bun
Shumai is an experimental differentiable tensor library for TypeScript and JavaScript, developed by Facebook Research. It provides a high-performance framework for numerical computing and machine learning within modern JavaScript runtimes. Built on Bun and Flashlight, with ArrayFire as its numerical backend, Shumai brings GPU-accelerated tensor operations, automatic differentiation, and scientific computing tools directly to JavaScript developers. -
3
Distributed Llama
Connect home devices into a powerful cluster to accelerate LLM
Distributed Llama is an open-source project that enables users to connect multiple home devices into a powerful cluster to accelerate Large Language Model (LLM) inference. By leveraging tensor parallelism and high-speed synchronization over Ethernet, it allows for faster performance as more devices are added to the cluster. The system supports various operating systems, including Linux, macOS, and Windows, and is optimized for both ARM and x86_64 AVX2 CPUs. -
4
ArrayFire
ArrayFire, a general purpose GPU library
ArrayFire is a general-purpose tensor library that simplifies the process of software development for the parallel architectures found in CPUs, GPUs, and other hardware acceleration devices. The library serves users in every technical computing market. Data structures in ArrayFire are smartly managed to avoid costly memory transfers and to take advantage of each performance feature provided by the underlying hardware. -
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
5
XNNPACK
High-efficiency floating-point neural network inference operators
...The library is written in C/C++ and designed for maximum portability, efficiency, and performance, leveraging platform-specific instruction sets (e.g., NEON, AVX, SIMD) for optimized execution. It supports NHWC tensor layouts and allows flexible striding along the channel dimension to efficiently handle channel-split and concatenation operations without additional cost. -
6
fairseq2
FAIR Sequence Modeling Toolkit 2
...Unlike the original fairseq—which evolved into a large, monolithic codebase—fairseq2 introduces a clean, plugin-oriented architecture designed for long-term maintainability and rapid experimentation. It supports multi-GPU and multi-node distributed training using DDP, FSDP, and tensor parallelism, capable of scaling up to 70B+ parameter models. The framework integrates seamlessly with PyTorch 2.x features such as torch.compile, Fully Sharded Data Parallel (FSDP), and modern configuration management. -
7
CUTLASS
CUDA Templates for Linear Algebra Subroutines
...To support a wide variety of applications, CUTLASS provides extensive support for mixed-precision computations, providing specialized data-movement and multiply-accumulate abstractions for half-precision floating point (FP16), BFloat16 (BF16), Tensor Float 32 (TF32), etc. -
8
TensorFlow
TensorFlow is an open source library for machine learning
...Available across all common operating systems (desktop, server and mobile), TensorFlow provides stable APIs for Python and C as well as APIs that are not guaranteed to be backwards compatible or are 3rd party for a variety of other languages. The platform can be easily deployed on multiple CPUs, GPUs and Google's proprietary chip, the tensor processing unit (TPU). TensorFlow expresses its computations as dataflow graphs, with each node in the graph representing an operation. Nodes take tensors—multidimensional arrays—as input and produce tensors as output. The framework allows for these algorithms to be run in C++ for better performance, while the multiple levels of APIs let the user determine how high or low they wish the level of abstraction to be in the models produced. ... -
9
Mooncake
Mooncake is the serving platform for Kimi
Mooncake is an open-source infrastructure platform designed to optimize large language model serving by focusing on efficient management and transfer of model data and KV cache. The platform was originally developed as part of the serving infrastructure for the Kimi large language model system. Its architecture centers on a high-performance transfer engine that provides unified data transfer across different storage and networking technologies. This engine enables efficient movement of... -
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
10
TensorRT
C++ library for high performance inference on NVIDIA GPUs
...TensorRT is built on CUDA®, NVIDIA’s parallel programming model, and enables you to optimize inference leveraging libraries, development tools, and technologies in CUDA-X™ for artificial intelligence, autonomous machines, high-performance computing, and graphics. With new NVIDIA Ampere Architecture GPUs, TensorRT also leverages sparse tensor cores providing an additional performance boost. -
11
LiteRT
LiteRT, successor to TensorFlow Lite
LiteRT is Google's next-generation on-device machine learning framework and the successor to TensorFlow Lite, designed for high-performance AI and generative AI deployment across edge devices. It provides efficient model conversion, optimization, and runtime execution while leveraging hardware acceleration from CPUs, GPUs, and NPUs. LiteRT supports a wide range of platforms, including Android, iOS, Linux, macOS, Windows, web environments, and IoT devices. The framework simplifies on-device... -
12
zkcm
A C++ library for multiprecision complex-number matrix calculations.
zkcm library is a C++ library for multi-precision complex-number matrix calculations. It provides a number of functionalities including the LU decomposition, the singular value decomposition, tensor product calculation, tracing-out operations, etc. -
13
jif3d
3D Joint Inversion Framework
jif3d is a framework for joint inversion of different types of geophysical data in 3D. It currently comprises forward solvers for first arrival traveltimes, scalar and tensor gravity data, magnetics, magnetotellurics, electrical resistivity tomography and surface waves.The framework is flexible in terms of the coupling approach between the different datasets. At the moment cross-gradient coupling, variation of information and deterministic parameter relationships are implemented. Other coupling approaches can be added relatively easily. -
14
This program manipulates representations of compact semi-simple Lie algebras. It can compute tensor products, (anti-)symmetric parts and the branching rules into maximal subalgebras.
-
15
FasterTransformer
Transformer related optimization, including BERT, GPT
...The library supports multiple deep learning frameworks, including TensorFlow, PyTorch, and Triton, allowing developers to integrate it into existing pipelines without major changes. It includes advanced optimization techniques such as mixed precision, tensor parallelism, and efficient memory management, enabling large models to run across multiple GPUs and nodes. FasterTransformer is particularly focused on inference workloads, where it significantly improves performance compared to standard framework implementations. Although development has transitioned toward TensorRT-LLM, the project remains an important reference for understanding optimized transformer execution. -
16
Flashlight library
A C++ standalone library for machine learning
Flashlight is a fast, flexible machine learning library written entirely in C++ by Facebook AI Research and the creators of Torch, TensorFlow, Eigen, and Deep Speech. Native support in C++ and simple extensibility make Flashlight a powerful research framework that's hackable to its core and enables fast iteration on new experimental setups and algorithms with little unopinionated and without sacrificing performance. In a single repository, Flashlight provides apps for research across... -
17
RMGDFT
Real Space Multigrid based electronic structure code.
News: active RMG development has moved to github https://github.com/RMGDFT News: V4.1.0 released on 09/29/2020 News: V4.0.0 released on 09/01/2020 with major updates. News: V3.0.0 released on 06/09/2018 with major updates. News: V2.2.2 released on 10/14/2017 with minor bug fixes. News: V2.2 with performance enhancements, bug fixes and new features released on 06/26/2017. Sources are available with binaries to follow soon. News: V2.1 with many improvements released on... -
18
Tensor Algebra Compiler
The Tensor Algebra Compiler (taco) computes sparse tensor expressions
A fast and versatile compiler-based library for sparse linear and tensor algebra. TACO can be used to implement sparse linear and tensor algebra applications in a wide range of domains. TACO supports a wide range of sparse (and dense) linear/tensor algebra computations, from simpler ones like sparse matrix-vector multiplication to more complex ones like MTTKRP on higher-order sparse tensors. Tensors can be stored in a variety of storage formats, including commonly-used sparse matrix and tensor formats like CSR and COO as well as specialized formats like CSF. ... -
19
Tensor Comprehensions
A domain specific language to express machine learning workloads
Tensor Comprehensions (TC) is a fully functional C++ library that automatically synthesizes high-performance machine learning kernels using Halide, ISL, and NVRTC or LLVM. TC additionally provides basic integration with Caffe2 and PyTorch. We provide more details in our paper on arXiv. This library is designed to be highly portable, machine-learning-framework agnostic and only requires a simple tensor library with memory allocation, offloading, and synchronization capabilities. -
20
Tiramisu
Polyhedral compiler for expressing fast and portable data algorithms
...It provides a simple C++ API for expressing algorithms (Tiramisu expressions) and how these algorithms should be optimized by the compiler. Tiramisu can be used in areas such as linear and tensor algebra, deep learning, image processing, stencil computations and machine learning. The Tiramisu compiler is based on the polyhedral model thus it can express a large set of loop optimizations and data layout transformations. Currently, it targets (1) multicore X86 CPUs, (2) Nvidia GPUs, (3) Xilinx FPGAs (Vivado HLS) and (4) distributed machines (using MPI). ... -
21
NNVM
Open deep learning compiler stack for cpu, gpu
...Infrastructure to automatically generates and optimize models on more backend with better performance. Compilation and minimal runtimes commonly unlock ML workloads on existing hardware. Automatically generate and optimize tensor operators on more backends. Need support for block sparsity, quantization (1,2,4,8 bit integers, posit), random forests/classical ML, memory planning, MISRA-C compatibility, Python prototyping or all of the above? NNVM flexible design enables all of these things and more. -
22
Laxor is a C++ template library for componentwise tensor algebra, which uses the "Einstein" index notation in expressions and produces efficient binary code.
-
23
WavePacket
Dynamics of quantum systems, controlled by external fields
...The Matlab/Octave version is mature and has been used in production for decades. The C++/Python version has been superseded by https://github.com/ulflor/wavepacket. Using tensor train techniques, the additional WaveTrain package aims at beating the curse of dimensionalit -
24
vIST/e
Interactive visualization of DTI, HARDI and other complex imaging data
vIST/e is a C++ application that allows interactive visualization of various kinds of imaging datasets, both simple scalar data as well as complex high-dimensional data such as diffusion tensor imaging (DTI) and high angular resolution imaging data (HARDI). vIST/e is based on VTK, Qt and is designed as a plugin system which allows it to be extended in a flexible way. vIST/e emerged from being the main research tool of Imaging Science and Technology Eindhoven (IST/e), a major imaging group Eindhoven University of Technology, the Netherlands which brings together all university faculties involved in medical or industrial imaging. ... -
25
TCE
The Tensor Contraction Engine
A domain-specific compiler that facilitates the generation of high-performance parallel programs for a class of scientific computations encountered in chemistry and physics.
