COMAL: A Convergent Meta Algorithm for Aligning LLMs with General PreferencesYixin Liu, Argyris Oikonomou, Weiqiang Zheng, Yang Cai, Arman CohanLast updated on Nov 1, 2024Cite arXiv FITML workshop