Tech
Evaluation Contracts and Evaluation Leverage: Sliced-Gap Readings in Structured Prediction Can Move Without Model Change
arXiv:2611.04099v1 Announce Type: new Abstract: NLP evaluation reports routinely cite sliced performance differences, most prominently the intra-inter gap in document-level relation extraction, as capability evidence. We show…
- Published
- (17 h ago)
- Outlet
- arXiv cs.CL
- Section
- Tech
- Length here
- Headline and 27-word snippet. The full article is at the source.
More from arXiv cs.CL and around the same time
A Conditional Mutual Information Analysis of Response Variety in Language ModelsarXiv:2611.03836v1 Announce Type: new Abstract: Large language models provide a variety of responses at inference (generation) that conventionally depend on a temperature parameter. Using a conditional mutual information…AI Ethics by Design: Implementing Customizable Guardrails for Responsible AI DevelopmentarXiv:2411.14442v2 Announce Type: replace-cross Abstract: This paper explores the development of an ethical guardrail framework for AI systems, emphasizing the importance of customizable guardrails that align with diverse user…Balancing Chain-of-Thought and Answer Supervision for Small Language Models on Medical Question AnsweringarXiv:2611.03948v1 Announce Type: new Abstract: Small language models (<=9B parameters) can support local medical question answering (QA) while reducing privacy and latency concerns, but effective fine-tuning remains challenging…Dory1.0-4B: A Looped Normalized-GPTarXiv:2611.03998v1 Announce Type: new Abstract: We introduce Dory1.0-4B, a 4-billion-parameter looped (latent-recurrent) language model with elastic depth: a single checkpoint serves different inference compute budgets…EvoGroup: A Self-Evolving Harness for Group Agents in Shared ContextsarXiv:2611.03868v1 Announce Type: new Abstract: With the rise of Group Agent such as Claude Tag, agents increasingly serve as digital workers for long-term team collaboration. These agents operate over shared contexts that…FlagRot: Selective Rotation for Low-Bit KV CachesarXiv:2611.03992v1 Announce Type: new Abstract: Long-context inference is bound by the KV cache, which 2-bit codes could shrink about sixfold if their error stays in check. The usual remedy rotates keys before quantizing…This page holds the headline and a short snippet as published by arXiv cs.CL, whose feed they came from. The story itself, the photography and the rights stay with them, and the button above goes straight to their site. We keep this page so the headline has a stable address and a record of when it ran.
