An Independent Safety Evaluation of Kimi K2.5

Zheng-Xin Yong* , Parv Mahajan* , Andy Wang , Ida Caspary , Yernat Yestekov , Zora Che , Mosh Levy , Elle Najt , Dennis Murphy , Prashant Kulkarni , Lev McKinney , Kei Nishimura-Gasparian , Ram Potham , Aengus Lynch , Michael L. Chen

Self-Jailbreaking: Language Models Can Reason Themselves Out of Safety Alignment After Benign Reasoning Training

Zheng-Xin Yong , Stephen H Bach

Towards Understanding the Fragility of Multilingual LLMs against Fine-Tuning Attacks

Samuele Poppi , Zheng-Xin Yong , Yifei He , Bobbie Chern , Han Zhao , Aobo Yang , Jianfeng Chi

Preference Tuning For Toxicity Mitigation Generalizes Across Languages

Xiaochen Li* , Zheng-Xin Yong* , Stephen H Bach

Aya Model: An Instruction Finetuned Open-Access Multilingual Language Model

Ahmet Ustun* , Viraat Aryabumi* , Zheng-Xin Yong* , Wei-Yin Ko* , Daniel D'souza* , Gbemileke Onilude , Neel Bhandari , Shivalika Singh , Hui-Lee Ooi , Amr Kayid , Freddie Vargus , Phil Blunsom , Shayne Longpre , Niklas Muennighoff , Marzieh Fadaee , Julia Kreutzer , Sara Hooker

Low-Resource Languages Jailbreak GPT-4

Zheng-Xin Yong , Cristina Menghini , Stephen H Bach

Humanity's Last Exam

Long Phan , Alice Gatti , Ziwen Han , Nathaniel Li , Josephina Hu , Hugh Zhang , Chen Bo Calvin Zhang , Mohamed Shaaban , John Ling , Sean Shi , Michael Choi , Anish Agrawal , Arnav Chopra , Adam Khoja , Ryan Kim , Richard Ren , Jason Hausenloy , et al. (including Zheng-Xin Yong)

Omnilingual ASR: Open-Source Multilingual Speech Recognition for 1600+ Languages

Omnilingual ASR team , Gil Keren , Artyom Kozhevnikov , Yen Meng , Christophe Ropers , Matthew Setzler , Skyler Wang , Ife Adebara , Michael Auli , Can Balioglu , Kevin Chan , Chierh Cheng , Joe Chuang , Caley Droof , Mark Duppenthaler , Paul-Ambroise Duquenne , Alexander Erben , et al. (including Zheng-Xin Yong)

The State of Multilingual LLM Safety Research: From Measuring the Language Gap to Mitigating It

Zheng-Xin Yong , Beyza Ermis , Marzieh Fadaee , Stephen H Bach , Julia Kreutzer

Effects of Speaker Count, Duration, and Accent Diversity on Zero-Shot Accent Robustness in Low-Resource ASR

Zheng-Xin Yong , Vineel Pratap , Michael Auli , Jean Maillard

Can We Predict Alignment Before Models Finish Thinking? Towards Monitoring Misaligned Reasoning Models

Yik Siu Chan* , Zheng-Xin Yong* , Stephen H Bach

Crosslingual Reasoning through Test-Time Scaling

Zheng-Xin Yong , M Farid Adilazuarda , Jonibek Mansurov , Ruochen Zhang , Niklas Muennighoff , Carsten Eickhoff , Genta Indra Winata , Julia Kreutzer , Stephen H Bach , Alham Fikri Aji

Sailor2: Sailing in South-East Asia with Inclusive Multilingual LLMs

Longxu Dou , Qian Liu , Fan Zhou , Changyu Chen , Zili Wang , Ziqi Jin , Zichen Liu , Tongyao Zhu , Cunxiao Du , Penghui Yang , Haonan Wang , Jiaheng Liu , Yongchi Zhao , Xiachong Feng , Xin Mao , Man Tsung Yeung , Kunat Pipatanakul , et al. (including Zheng-Xin Yong)

SEACrowd: A Multilingual Multimodal Data Hub and Benchmark Suite for Southeast Asian Languages

Holy Lovenia , Rahmad Mahendra , Salsabil Maulana Akbar , Lester James V Miranda , Jennifer Santoso , Elyanah Aco , Akhdan Fadhilah , Jonibek Mansurov , Joseph Marvin Imperial , Onno P Kampman , Joel Ruben Antony Moniz , Muhammad Ravi Shulthan Habibi , Frederikus Hudi , Railey Montalan , Ryan Ignatius , Joanito Agili Lopo , William Nixon , et al. (including Zheng-Xin Yong)

CVQA: Culturally-diverse Multilingual Visual Question Answering Benchmark

David Romero , Chenyang Lyu , Haryo Akbarianto Wibowo , Teresa Lynn , Injy Hamed , Aditya Nanda Kishore , Aishik Mandal , Alina Dragonetti , Artem Abzaliev , Atnafu Lambebo Tonja , Bontu Fufa Balcha , Chenxi Whitehouse , Christian Salamea , Dan John Velasco , David Ifeoluwa Adelani , David Le Meur , Emilio Villa-Cueva , et al. (including Zheng-Xin Yong)

LexC-Gen: Generating Data for Extremely Low-Resource Languages with Large Language Models and Bilingual Lexicons

Zheng-Xin Yong , Cristina Menghini , Stephen H Bach

A Safe Harbor for AI Evaluation and Red Teaming

Shayne Longpre , Sayash Kapoor , Kevin Klyman , Ashwin Ramaswami , Rishi Bommasani , Borhane Blili-Hamelin , Yangsibo Huang , Aviya Skowron , Zheng-Xin Yong , Suhas Kotha , Yi Zeng , Weiyan Shi , Xianjun Yang , Reid Southen , Alexander Robey , Patrick Chao , Diyi Yang , et al.

Representativeness as a Forgotten Lesson for Multilingual and Code-switched Data Collection and Preparation

A Seza Dogruoz , Sunayana Sitaram , Zheng-Xin Yong

Prompting Multilingual Large Language Models to Generate Code-Mixed Texts: The Case of South East Asian Languages

Zheng-Xin Yong , Ruochen Zhang , Jessica Zosa Forde , Skyler Wang , Arjun Subramonian , Holy Lovenia , Samuel Cahyawijaya , Genta Indra Winata , Lintang Sutawika , Jan Christian Blaise Cruz , Yin Lin Tan , Long Phan , Rowena Garcia , Thamar Solorio , Alham Fikri Aji

What Language Model to Train if You Have One Million GPU Hours?

Teven Le Scao , Thomas Wang , Daniel Hesslow , Lucile Saulnier , Stas Bekman , M Saiful Bari , Stella Biderman , Hady Elsahar , Niklas Muennighoff , Jason Phang , Ofir Press , Colin Raffel , Victor Sanh , Sheng Shen , Lintang Sutawika , Jaesung Tae , Zheng Xin Yong , et al.

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

BigScience Workshop , Teven Le Scao , Angela Fan , Christopher Akiki , Ellie Pavlick , Suzana Ilic , Daniel Hesslow , Roman Castagne , Alexandra Sasha Luccioni , Francois Yvon , Matthias Galle , Jonathan Tow , Alexander M Rush , Stella Biderman , Albert Webson , Pawan Sasanka Ammanamanchi , Thomas Wang , et al. (including Zheng-Xin Yong)

Current Status of NLP in South East Asia with Insights from Multilingualism and Language Diversity

Alham Fikri Aji , Jessica Zosa Forde , Alyssa Marie Loo , Lintang Sutawika , Skyler Wang , Genta Indra Winata , Zheng Xin Yong , Ruochen Zhang , A Seza Dogruoz , Yin Lin Tan , Jan Christian Blaise Cruz

The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challenges

Genta Indra Winata , Alham Fikri Aji , Zheng-Xin Yong , Thamar Solorio

Crosslingual Generalization through Multitask Finetuning

Niklas Muennighoff , Thomas Wang , Lintang Sutawika , Adam Roberts , Stella Biderman , Teven Le Scao , M Saiful Bari , Sheng Shen , Zheng-Xin Yong , Hailey Schoelkopf , Xiangru Tang , Dragomir Radev , Alham Fikri Aji , Khalid Almubarak , Samuel Albanie , Zaid Alyafeai , Albert Webson , et al.

BLOOM+1: Adding Language Support to BLOOM for Zero-Shot Prompting

Zheng-Xin Yong , Hailey Schoelkopf , Niklas Muennighoff , Alham Fikri Aji , David Ifeoluwa Adelani , Khalid Almubarak , M Saiful Bari , Lintang Sutawika , Jungo Kasai , Ahmed Baruwa , Genta Indra Winata , Stella Biderman , Edward Raff , Dragomir Radev , Vassilina Nikoulina

Frame Shift Prediction

Zheng-Xin Yong , Patrick D Watson , Tiago Timponi Torrent , Oliver Czulo , Collin F Baker

PromptSource: An Integrated Development Environment and Repository for Natural Language Prompts

Stephen H Bach* , Victor Sanh* , Zheng-Xin Yong , Albert Webson , Colin Raffel , Nihal V Nayak , Abheesht Sharma , Taewoon Kim , M Saiful Bari , Thibault Fevry , Zaid Alyafeai , Manan Dey , Andrea Santilli , Zhiqing Sun , Srulik Ben-David , Canwen Xu , Gunjan Chhablani , et al.

Multitask Prompted Training Enables Zero-Shot Task Generalization

Victor Sanh , Albert Webson , Colin Raffel , Stephen H Bach , Lintang Sutawika , Zaid Alyafeai , Antoine Chaffin , Arnaud Stiegler , Teven Le Scao , Arun Raja , Manan Dey , M Saiful Bari , Canwen Xu , Urmish Thakker , Shanya Sharma Sharma , Eliza Szczechla , Taewoon Kim , et al. (including Zheng Xin Yong)

Semi-Supervised Deep Embedded Clustering With Anomaly Detection for Semantic Frame Induction

Zheng Xin Yong , Tiago Timponi Torrent