Skip to content

Comments

Fix audio server defaults and CUDA fallback#46

Open
Th0rgal wants to merge 5 commits intoFunAudioLLM:mainfrom
Th0rgal:main
Open

Fix audio server defaults and CUDA fallback#46
Th0rgal wants to merge 5 commits intoFunAudioLLM:mainfrom
Th0rgal:main

Conversation

@Th0rgal
Copy link

@Th0rgal Th0rgal commented Feb 10, 2026

  • Align simple_server.py with web_demo defaults for speech generation\n- Add bad_words_ids in generation kwargs\n- Add CUDA arch hint and nvfuser disable helper\n\nNote: CUDA kernel compilation still fails on GB10 unless CUDA is disabled; I ran server with CUDA_VISIBLE_DEVICES="" to validate end-to-end audio.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant