News Archive
2026
[2026-09] Paper “SP²ec: Adaptive Self-Speculative Decoding for Vision-Language Models” accepted to NeurIPS 2026. We exploit the single-peak structure in self-speculative decoding to further boost the inference speed.
[2026-09] Paper “Rethinking “RL Generalizes, SFT Memorizes”: The Role of SFT Data” accepted to NeurIPS 2026. We revisit the generalization ability of SFT and RL training from the data perspective. Great thanks to the wonderful collaborators!
[2026-07] “On the Benefits of Free Exploration for Regret Minimization in Multi-Armed Bandits” accepted to EWRL 2026. We study a variant of the regret minimization problem in stochastic MAB, where the learner is granted a free exploration time period before regret starts to accumulate. Joint work with Zixin and Vincent.
[2026-06] Posted “Bayesian Best-Arm Identification with Abstention: A Polynomial-to-Exponential Phase Transition”. We study fixed-budget BAI in the Bayesian setting, allowing the learner to abstain at the end of the sampling process. This abstention option induces a fundamental transition in the error probability from polynomial to exponential decay. Joint work with Yuqi and Vincent.
[2026-06] “Rethinking “RL Generalizes, SFT Memorizes”: The Role of SFT Data” accepted to the first Foundations of Deep Generative Models (FoGen) workshop, ICML 2026, and 2026 INFORMS Annual Meeting. We revisit the generalization ability of SFT and RL training from the data perspective. Great thanks to the wonderful collaborators!
[2026-06] “Demystifying the Slash Pattern in Attention: The Role of RoPE” accepted to the first Foundations of Deep Generative Models (FoGen) workshop, ICML 2026.
[2026-05] Posted “On the Benefits of Free Exploration for Regret Minimization in Multi-Armed Bandits”. We study a variant of the regret minimization problem in stochastic MAB, where the learner is granted a free exploration time period before regret starts to accumulate. Joint work with Zixin and Vincent.
[2026-01] I PhinisheD my PhD study! Great thanks to the support from everyone, especially my supervisor Prof. Vincent Tan!
[2026-01] Posted “Demystifying the Slash Pattern in Attention: The Role of RoPE”. We found RoPE is related to the emergence of slash patterns in attention matrices. Huge thanks to the amazing collaborators!
2025
- [2025-12-22] Yunlong’s homepage was finally online! 🎉 Hello, world!