Data compression in TensorFlow
-
Updated
Jan 29, 2025 - Python
Data compression in TensorFlow
Pure python implementation of product quantization for nearest neighbor search
Data Compression using Arithmetic Encoding in Python
A large compression model for weather and climate data, which compresses a 400+ TB ERA5 dataset into a new 0.8 TB CRA5 dataset.
The implementation of various data compression techniques.
Compression suite for data frames and tabular data files, csv, excel etc. Using LZHW algorithm.
监控在应用程序中的键盘活动,并自动记录定时通过邮件发送 / Monitor keyboard activities in applications, automatically recording and sending logs regularly via email
A lightweight rANSCoder meant for rapid prototyping.
LLMA = LLM + Arithmetic coder, which use LLM to do insane text data compression. LLMA=大模型+算术编码,它能使用LLM对文本数据进行暴力的压缩,达到极高的压缩率。
A parallel implementation of the bzip2 data compressor in python, this data compression pipeline is using algorithms like Burrows–Wheeler transform (BWT) and Move to front (MTF) to improve the Huffman compression. For now, this tool only will be focused on compressing .csv files, and other files on tabular format.
Caffe/Neon prototxt training file for our Neurocomputing2017 work: Fuzzy Quantitative Deep Compression Network
Autoencoders are neural networks used for data compression, image de-noising, and dimensionality reduction. Using PyTorch.
[Journal of Turbulence, DCC 2022] Dimension Reduced Turbulent Flow Data From Deep Vector Quantizers
Sketching algorithms for Tensor Train decompositions
This library helps you compress your dataset to optimize Ai Training costs.
A simple encoder/decoder multi-tool for qr code data compression that utilizes gzip, base64 and hex.
we can compress and decompress text data or image with this project. This project is created in python with LZW-data-compresstion -decompresstion algorithom
Reduced Compressed Description for Direct Electron Microscopy Data
[DCC 2020] DRASIC: Distributed Recurrent Autoencoder for Scalable Image Compression
PyTorch implementation of variational entropy-constrained vector quantization.
Add a description, image, and links to the data-compression topic page so that developers can more easily learn about it.
To associate your repository with the data-compression topic, visit your repo's landing page and select "manage topics."