Search Results for "compression" - Page 4
Sort By:
Showing 128 open source projects for "compression"
View related business solutions-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
1
Arctic TimeSeries and Tick store
High performance datastore for time series and tick data
...Serializes a number of data types eg. Pandas DataFrames, Numpy arrays, Python objects via pickling etc. so you don't have to handle different datatypes manually. Uses LZ4 compression by default on the client side to get big savings on network / disk. Allows you to version different stages of an object and snapshot the state (In some ways similar to git), and allows you to freely experiment and then just revert back the snapshot. [VersionStore only] Does the chunking (breaking a Dataframe to smaller part for you. ... -
2
CLIP-as-service
Embed images and sentences into fixed-length vectors
...No learning curve, minimalist design on client and server. Intuitive and consistent API for image and sentence embedding. Async client support. Easily switch between gRPC, HTTP, WebSocket protocols with TLS and compression. Smooth integration with neural search ecosystem including Jina and DocArray. Build cross-modal and multi-modal solutions in no time. -
3
Neural Network Intelligence
AutoML toolkit for automate machine learning lifecycle
Neural Network Intelligence is an open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning. NNI (Neural Network Intelligence) is a lightweight but powerful toolkit to help users automate feature engineering, neural architecture search, hyperparameter tuning and model compression. The tool manages automated machine learning (AutoML) experiments, dispatches and runs experiments' trial jobs generated by tuning algorithms to search the best neural architecture and/or hyper-parameters in different training environments like Local Machine, Remote Servers, OpenPAI, Kubeflow, FrameworkController on K8S (AKS etc.) ... -
4
Bulk Image Optimizer and Converter
Imagine having all your images well compressed and optimized :)
...The optimized images are saved in a separate folder named "optimized" within the input folder. The tool displays progress information, including the number of images processed, the average compression ratio, and the total space saved. -
Veeam Data Platform v13.1 - Get Your Free TrialTry Veeam Data Platform today. Experience the unified platform that's secure by design, portable by default, and proven to recover clean, fast, and anywhere.
-
5
sqlitedict
Persistent dict, backed by sqlite3 and pickle, multithread-safe
sqlitedict is a lightweight Python wrapper that provides a persistent dictionary backed by SQLite. Applications interact with stored data using familiar dictionary operations such as indexing, keys, values, items, and length. Values can contain any picklable Python object instead of being restricted to basic SQL types. Multiple independent dictionary tables can live inside the same SQLite database file. The library supports access to one connection from multiple threads while internally... -
6
EnCodec
State-of-the-art deep learning based audio codec
...The model can operate in real time and supports variable bandwidths, bitrates, and multi-band audio. Encodec has applications in speech and music compression, generative modeling, and efficient data transmission for communication systems. The repository includes pretrained checkpoints, PyTorch inference code, and examples for integrating Encodec as a module in downstream generative or streaming systems. -
7
FedLab
A flexible Federated Learning Framework based on PyTorch
A Python-based framework for federated learning simulation, emphasizing modularity, communication efficiency, and algorithmic flexibility. Supports both server- and client-side customization for research and development purposes. -
8
Crunch
Insane(ly slow but wicked good) PNG image optimization
Crunch is an image compression tool for lossy PNG image file optimization. Using a combination of selective bit depth, color palette reduction and color type, as well as zopfli DEFLATE compression algorithm encoding that employs the pngquant and zopflipng PNG optimization tools, Crunch is effectively able to optimize and compress images with minimal decrease in image quality. -
9
Crunch PNG
Insane(ly slow but wicked good) PNG image optimization
Crunch is a tool for lossy PNG image file optimization. It combines selective bit depth, color type, and color palette reduction with zopfli DEFLATE compression algorithm encoding using the pngquant and zopflipng PNG optimization tools. This approach leads to a significant file size gain relative to lossless approaches at the expense of a relatively modest decrease in image quality. Continuous benchmark testing is available in our GitHub Actions CI. Please see the benchmarks directory of this repository for details about the benchmarking approach and instructions on how to execute benchmarks locally on the reference images distributed in this repository or with your own image files. -
Save Up to 91% on Cloud Compute With Spot VMsRun batch jobs at 60-91% off with Spot VMs. Long-running workloads get automatic discounts with sustained use.
-
10
...It supports Apache access log, Syslog, NTP, Apache 1 SSL engine log, modified ISO date/time log file formats, and Apache-like logs like CUPS, ProFTPD, Pure-FTPd… etc., and gzip and bzip2 compression methods.
-
11
Minkowski Engine
Auto-diff neural network library for high-dimensional sparse tensors
...To run the examples, please install the package and run the command in the package root directory. Compressing a neural network to speed up inference and minimize memory footprint has been studied widely. One of the popular techniques for model compression is pruning the weights in convnets, is also known as sparse convolutional networks. Such parameter-space sparsity used for model compression compresses networks that operate on dense tensors and all intermediate activations of these networks are also dense tensors. -
12
AliceMind
ALIbaba's Collection of Encoder-decoders from MinD
This repository provides pre-trained encoder-decoder models and its related optimization techniques developed by Alibaba's MinD (Machine IntelligeNce of Damo) Lab. Pre-trained models for natural language understanding (NLU). We extend BERT to a new model, StructBERT, by incorporating language structures into pre-training. Specifically, we pre-train StructBERT with two auxiliary tasks to make the most of the sequential order of words and sentences, which leverage language structures at the... -
13
TextBrewer
A PyTorch-based knowledge distillation toolkit
TextBrewer is a PyTorch-based model distillation toolkit for natural language processing. It includes various distillation techniques from both NLP and CV field and provides an easy-to-use distillation framework, which allows users to quickly experiment with the state-of-the-art distillation methods to compress the model with a relatively small sacrifice in the performance, increasing the inference speed and reducing the memory usage. -
14
lzhw
LZHW Windows command line lossless compression tool for tabular files
LZHW Command Line Lossless Compression Tool is a Windows command line tool used to compress and decompress files from and to any form, csv, excel etc without any dependencies or installations. Using an optimized algorithm (LZHW) developed from Lempel-Ziv, Huffman and LZ-Welch algorithms. The tool can work in parallel and most of its code is written in Cython, so it is pretty fast. -
15
FastoCloud PRO
IPTV/NVR/CCTV/Video cloud https://fastocloud.com
IPTV/Video cloud Features: Cross-platform (Linux, MacOSX, FreeBSD, Raspbian/Armbian) GPU/CPU Encode/Decode/Post Processing Stream statistics CCTV Adaptive hls streams Load balancing Temporary urls HLS push EPG scanning Subtitles to text conversions AD insertion Logo overlay Video effects Relays Timeshifts Catchups Playlists Restream/Transcode from online streaming services like Youtube, Twitch Mozaic Many Outputs Physical Inputs Streaming Protocols File Formats Presets Vods/Series server-side support Pay per view channels Channels on demand HTTP Live Streaming (HLS) server-side support Public API, client server communication via JSON RPC Protocol gzip compression Deep learning video analysis Supported deep learning frameworks: Tensorflow NCSDK Caffe ML Hardware: -
16
pyTivo is both an HMO and GoBack server. Similar to TiVo Desktop pyTivo loads many standard video compression codecs and outputs mpeg2 video to the TiVo. However, pyTivo is able to load MANY more file types than TiVo Desktop.
-
17
Grey Compressor+FTP
Grey Compressor+FTP compresses and uploads file to ftp server.
Grey Compressor+FTP compresses and uploads a single.7z (7-Zip) file to an ftp server. An output .bat file and password .txt file are produced. Send the .bat file and .txt file to the recipient. The recipient then double-clicks the .bat file, and the .7z file is downloaded to the recipient's computer. Pros: * The bat file produced after the file/folder is compressed is the same size each time (easy to send to recipient). * No need to upload compressed file to ftp and send recipient... -
18
Fast Forward
Free video editor to convert, cut, trim, stream select and encode
Fast Forward is free video editing software that allows you to convert, cut, trim, remove streams, encode and customise a variety of parameters such as frame rate, bitrate, frame size and output file size. Fast Forward can encode H264, MPEG2 or Xvid video, as well as Dolby Digital AC3, Dolby Digital Plus eAC3+, AAC and Vorbis audio. It is very useful for removing ads from recorded TV programs, or combining the .VOB files from a DVD file system. Thanks to FFmpeg, these processes are extremely... -
19
pyCompry
A Python Script to Compress and Backup a Folder
This tool is featured with a very high compression mechanism hence useful in backing up large sized folders over a slow network, Or useful in reducing the backup size to a maximum possible. For detailed help, please refer to http://blogger.iamamazing.in/2016/01/automate-backup-with-python-script.html -
20
Buckling in compression EC3
Programe to design coloumbs in commpression
-
21
Encryption with symmetric-key algorithm Kirmah - generate keys with exotic chars - redefine key length - key mark to ensure decryption capabilities - mix data - fast with multiprocessing - possible compression - gui on gtk3 - cli tool - python3 DEPENDENCIES : ======== python3, python-gobject, gobject-introspection, pygtk 3 modes are available to encrypt : ======== - compression (full / disabled or only final step) - random (simulate a random order - based on crypted key - to randomize data) - mix (mix data according to a generated map - based on crypted key - with addition of noise) Process is as follow : ======== encrypt : file > [ compress > ] encrypt > [randomiz data > mix data > compress > ] file.kmh decrypt: file.kmh > [ uncompress > unmix data > unrandomiz data] > decrypt > [uncompress > ] file ======== for encrypt/decrypt large binary files, use the fastest alternative : split/merge
-
22
squeeze
compresses files by automatically selecting the best program
squeeze is a python script that compresses a given (set of) file(s) by trying each compression program available on your system and keeping the resulting archive with the smallest size. -
23
File based backup 52
Content Based File level Data Backup in Python
Content Based File level Data Backup in Python. This is a utility to backup your files. It can do full and incremental backups. It will take a directory as input, and will back up the files in that folder and all sub-folders to the backup destination directory. It can compress each file individually while backing-up. Mirrors the source directory structure under the target directory. Creates 1 archive file for each source file. Even if the backup/restore program or backup database is not... -
24
Patchamama is a binary patch maker/applier that works on directory tree. It can be used in application deployment, large scale project patching (including source and binary data). It use bsdiff for the binary diff job and 7zip for compression.
-
25
PyInstaller
Converts (packages) Python programs into stand-alone executables
PyInstaller is a program that converts (packages) Python programs into stand-alone executables, under Windows, Linux, Mac OS X, AIX and Solaris. Its main advantages over similar tools are that PyInstaller works with any version of Python since 2.3, it builds smaller executables thanks to transparent compression, it is fully multi-platform, and uses the OS support to load the dynamic libraries, thus ensuring full compatibility. The main goal of PyInstaller is to be compatible with 3rd-party packages out-of-the-box. This means that, with PyInstaller, all the required tricks to make external packages work are already integrated within PyInstaller itself so that there is no user intervention required. ...
