FPFront Page

Tech

Towards Optimal Multi-draft Speculative Decoding

By Zhengmian Hu, Tong Zheng, Vignesh Viswanathan, Ziyi Chen, Ry · arXiv cs.CL

cs.CLcs.DS

Read it at arXiv cs.CL

arXiv:2502.18779v2 Announce Type: replace Abstract: Large Language Models (LLMs) have become an indispensable part of natural language processing tasks. However, autoregressive sampling has become an efficiency bottleneck…

Published
(17 h ago)
Outlet
arXiv cs.CL
Section
Tech
Length here
Headline and 27-word snippet. The full article is at the source.

More from arXiv cs.CL and around the same time

An open laptop and a stack of books on a deskA Conditional Mutual Information Analysis of Response Variety in Language ModelsarXiv:2611.03836v1 Announce Type: new Abstract: Large language models provide a variety of responses at inference (generation) that conventionally depend on a temperature parameter. Using a conditional mutual information…arXiv cs.CL · 17 h ago · reads at arXiv cs.CLAn open laptop and a stack of books on a deskAI Ethics by Design: Implementing Customizable Guardrails for Responsible AI DevelopmentarXiv:2411.14442v2 Announce Type: replace-cross Abstract: This paper explores the development of an ethical guardrail framework for AI systems, emphasizing the importance of customizable guardrails that align with diverse user…arXiv cs.CL · 17 h ago · reads at arXiv cs.CLAn open laptop and a stack of books on a deskBalancing Chain-of-Thought and Answer Supervision for Small Language Models on Medical Question AnsweringarXiv:2611.03948v1 Announce Type: new Abstract: Small language models (<=9B parameters) can support local medical question answering (QA) while reducing privacy and latency concerns, but effective fine-tuning remains challenging…arXiv cs.CL · 17 h ago · reads at arXiv cs.CLAn open laptop and a stack of books on a deskDory1.0-4B: A Looped Normalized-GPTarXiv:2611.03998v1 Announce Type: new Abstract: We introduce Dory1.0-4B, a 4-billion-parameter looped (latent-recurrent) language model with elastic depth: a single checkpoint serves different inference compute budgets…arXiv cs.CL · 17 h ago · reads at arXiv cs.CLAn open laptop and a stack of books on a deskEvaluation Contracts and Evaluation Leverage: Sliced-Gap Readings in Structured Prediction Can Move Without Model ChangearXiv:2611.04099v1 Announce Type: new Abstract: NLP evaluation reports routinely cite sliced performance differences, most prominently the intra-inter gap in document-level relation extraction, as capability evidence. We show…arXiv cs.CL · 17 h ago · reads at arXiv cs.CLAn open laptop and a stack of books on a deskEvoGroup: A Self-Evolving Harness for Group Agents in Shared ContextsarXiv:2611.03868v1 Announce Type: new Abstract: With the rise of Group Agent such as Claude Tag, agents increasingly serve as digital workers for long-term team collaboration. These agents operate over shared contexts that…arXiv cs.CL · 17 h ago · reads at arXiv cs.CL

This page holds the headline and a short snippet as published by arXiv cs.CL, whose feed they came from. The story itself, the photography and the rights stay with them, and the button above goes straight to their site. We keep this page so the headline has a stable address and a record of when it ran.

An open laptop and a stack of books on a desk