VQ-GAN vs. RVQ (soundstream)

[WinterStraw]

Would people consider using RVQ as a replacement for VQ? It is similar to the structure of audioLM. For example, let the llama model predict shallow RVQ first, then deep RVQ based on shallow RVQ. Finally, passed RVQ to the vocoder to generate the audio.