Contexts Optical Compression
Robust Speech Recognition via Large-Scale Weak Supervision
A robust, efficient, low-latency speech-to-text library
A Powerful Native Multimodal Model for Image Generation
Dataset of GPT-2 outputs for research in detection, biases, and more
Code for running inference and finetuning with SAM 3 model
Audiocraft is a library for audio processing and generation
Mixture-of-Experts Vision-Language Models for Advanced Multimodal
CLIP, Predict the most relevant text snippet given an image
tiktoken is a fast BPE tokeniser for use with OpenAI's models
A Unified Framework for Text-to-3D and Image-to-3D Generation
Multimodal-Driven Architecture for Customized Video Generation
Implementation of Make-A-Video, new SOTA text to video generator
TextWorld is a sandbox learning environment for the training
Open-Sora: Democratizing Efficient Video Production for All
Diffusion Transformer with Fine-Grained Chinese Understanding
Implementation of AudioLM audio generation model in Pytorch
Guiding Instruction-based Image Editing via Multimodal Large Language
Towards Real-World Vision-Language Understanding
Generate 3D objects conditioned on text or images
Implementation of "MobileCLIP" CVPR 2024
Documentation for Google's Gen AI site - including Gemini API & Gemma
Code for the paper Language Models are Unsupervised Multitask Learners
Official code for Style Aligned Image Generation via Shared Attention
Memory-efficient and performant finetuning of Mistral's models