Pytorch implementation of various Knowledge Distillation (KD) methods.

A PyTorch-based knowledge distillation toolkit for natural language processing

PaddleSlim is an open-source library for deep model compression and architecture search.

推荐/广告/搜索领域工业界经典以及最前沿论文集合。A collection of industry classics and cutting-edge papers in the field of recommendation/advertising/search.

The official repo for [NeurIPS'22] "ViTPose: Simple Vision Transformer Baselines for Human Pose Estimation" and [TPAMI'23] "ViTPose++: Vision Transformer for Generic Body Pose Estimation"

高质量中文预训练模型集合：最先进大模型、最快小模型、相似度专门模型

MEAL V2: Boosting Vanilla ResNet-50 to 80%+ Top-1 Accuracy on ImageNet without Tricks. In NeurIPS 2020 workshop.

Prompt engineering for developers

Segmind Distilled diffusion

⚡ Flash Diffusion ⚡: Accelerating Any Conditional Diffusion Model for Few Steps Image Generation (AAAI 2025 Oral)

A Python library for adversarial machine learning focusing on benchmarking adversarial robustness.

irresponsible innovation. Try now at https://chat.dev/

Quantization library for PyTorch. Support low-precision and mixed-precision quantization, with hardware implementation through TVM.

(CVPR 2022) A minimalist, mapless, end-to-end self-driving stack for joint perception, prediction, planning and control.

BERT distillation（基于BERT的蒸馏实验 ）

A Compressed Stable Diffusion for Efficient Text-to-Image Generation [ECCV'24]

Papers and Book to look at when starting AGI 📚

Insightface Keras implementation

A brain-inspired version of generative replay for continual learning with deep neural networks (e.g., class-incremental learning on CIFAR-100; PyTorch code).

Knowledge distillation in text classification with pytorch. 知识蒸馏，中文文本分类，教师模型BERT、XLNET，学生模型biLSTM。