CMT reduces the training cost of diffusion-based flow map models by up to 90% while reaching SOTA performance
A framework for Identify which training examples influenced specific concepts within the diffusion model
Improved object-centric diffusion learning with registers and contrastive alignment
An improved mechanism for applying classifier-free guidance in discrete diffusion
Learning conditional, unconditional, and matching-aware discriminator with adaptive weighting mechanism (cSAN)
Propose tensor-decomposition-based PEFT method, showing its effectiveness on T-to-I generation tasks
Theoretical analysis of limitation of current discrete diffusion and a method for effectively capturing element-wise dependency
Classifier-Free Guidance inside the Attraction Basin May Cause Memorization
A general method to find an optimal sampling schedule for inference in discrete diffusion
A method efficiently leverages online human feedback to fine-tune Stable Diffusion for various range of tasks
An enhanced multimodal representation using weighted point clouds and its theoretical benefits
A 64x64 pre-trained diffusion model is all you need for 1-step high-resolution SOTA generation
Unified framework enables diverse samplers and 1-step generation SOTAs
Applications:
[SoundGen]
Fast, Efficient, Training-Free, and Controllable diffusion-based generation method
DeepResonance: Enhancing Multimodal Music Understanding via Music-centric Multi-way Instruction Tuning
[EMNLP] [arXiv] [data]
CARE: Assessing the Impact of Multilingual Human Preference Learning on Cultural Awareness
[MRR@ICCV25] [arXiv]
Towards reporting bias in visual-language datasets: bimodal augmentation by decoupling object-attribute association
[TMLR] [arXiv]
GLOV: Guided Large Language Models as Implicit Optimizers for Vision Language Models
Cross-Modal Learning for Music-to-Music-Video Description Generation
VinaBench: Benchmark for Faithful and Consistent Visual Narratives
penMU: Your Swiss Army Knife for Music Understanding
Few-shot Dialogue Strategy Learning for Motivational Interviewing via Inductive Reasoning
PeaCoK: Persona Commonsense Knowledge for Consistent and Engaging Narratives
(Outstanding Paper Award)
Automatic music mixing using a generative model of effect embeddings
Automatic Music Sample Identification with Multi-Track Contrastive Learning
Leveraging Whisper Embeddings for Audio-based Lyrics Matching
Large-Scale Training Data Attribution for Music Generative Models via Unlearning
Reductive, exclusionary, normalising: The limits of generative AI music
Can Large Language Models Predict Audio Effects Parameters from Natural Language?
Inference-Time Optimisation for Vocal Effects Style Transfer using DiffVox
SOTA Fx representation: Extract instrument-wise audio effects representations from music mixtures
Inference Time Optimization for Music Mastering Style Transfer
Reverse Engineering of Music Mixing Graphs with Differentiable Processors and Iterative Pruning
Supervised contrastive learning from weakly-labeled audio segments for musical version matching
Music Foundation Model as Generic Booster for Music Downstream Tasks
DiffVox: A Differentiable Model for Capturing and Analysing Professional Effects Distributions
VRVQ: Variable Bitrate Residual Vector Quantization for Audio Compression
Latent Diffusion Bridges for Unsupervised Musical Audio Timbre Transfer
Searching For Music Mixing Graphs: A Pruning Approach
Improving Unsupervised Clean-to-Rendered Guitar Tone Transformation Using GANs and Integrated Unaligned Clean Data
MusicMagus: Zero-Shot Text-to-Music Editing via Diffusion Models
Timbre-Trap: A Low-Resource Framework for Instrument-Agnostic Music Transcription
VRDMG: Vocal Restoration via Diffusion Posterior Sampling with Multiple Guidance
Automatic Piano Transcription with Hierarchical Frequency-Time Transformer
An Attention-based Approach To Hierarchical Multi-label Music Instrument Classification
Unsupervised Vocal Dereverberation with Diffusion-based Generative Models
Music Mixing Style Transfer: A Contrastive Learning Approach to Disentangle Audio Effects
DiffRoll: Diffusion-based Generative Music Transcription with Unsupervised Pretraining Capability
Hierarchical Diffusion Models for Singing Voice Neural Vocoder
Distortion Audio Effects: Learning How to Recover the Clean Signal
Automatic Music Mixing with Deep Learning and Out-of-Domain Data
Automatic DJ Transitions with Differentiable Audio Effects and Generative Adversarial Networks
VIRTUE: Visual-Interactive Text-Image Universal Embedder
CCStereo: Audio-Visual Contextual and Contrastive Learning for Binaural Audio Generation
TITAN-Guide: Taming Inference-Time AligNment for Guided Text-to-Video Diffusion Models
MMAudio: Taming Multimodal Joint Training for High-Quality Video-to-Audio Synthesis
MMDisCo: Multi-Modal Discriminator-Guided Cooperative Diffusion for Joint Audio and Video Generation
SoundCTM: Unifying Score-based and Consistency Models for Full-band Text-to-Sound Generation
Mining Your Own Secrets: Diffusion Classifier Scores for Continual Personalization of Text-to-Image Diffusion Models
GenWarp: Single Image to Novel Views with Semantic-Preserving Generative Warping
SpecMaskGIT: Masked Generative Modeling of Audio Spectrograms for Efficient Audio Synthesis and Beyond
BigVSAN: Enhancing GAN-based Neural Vocoders with Slicing Adversarial Network
Zero- and Few-shot Sound Event Localization and Detection
STARSS23: An Audio-Visual Dataset of Spatial Recordings of Real Scenes with Spatiotemporal Annotations of Sound Events
Extending Audio Masked Autoencoders Toward Audio Restoration
Diffiner: A Versatile Diffusion-based Generative Refiner for Speech Enhancement
CLIPSep: Learning Text-queried Sound Separation with Noisy Unlabeled Videos
Sound Event Localization and Detection Evaluated in Real Spatial Sound Scenes
