📄

A Unified Framework for Speculative Decoding with Multiple Drafters as a Bandit

Conference and Journal

NeurIPS2024

Workshop

Author

1st author

Keyword

Speculative Decoding

Large Language Model

Link

Specification