Justin Lovelace

Gates Hall

Cornell University

Ithaca, NY

My current research focuses on developing diffusion models for language and speech generation, aiming to advance the capabilities and controllability of generative models in these domains. I am fortunate to be advised by Prof. Kilian Q. Weinberger.

Previously, I earned my M.S. in Language Technologies from Carnegie Mellon University, where I conducted NLP research under the advisement of Dr. Carolyn Rosé. I completed my undergraduate studies at Texas A&M University, where I engaged in Clinical NLP research with Dr. Bobak Mortazavi.

selected publications

COLM

Stop-Think-AutoRegress: Language Modeling with Latent Diffusion Planning

Justin Lovelace, Christian Belardi, Sofian Zalouk, and 3 more authors

Conference on Language Modeling (COLM), 2025

Bib Paper

@article{lovelace2025stopthink,
  title = {{Stop-Think-AutoRegress}: Language Modeling with Latent Diffusion Planning},
  author = {Lovelace, Justin and Belardi, Christian and Zalouk, Sofian and Polavaram, Adhitya and Kundurthy, Srivatsa and Weinberger, Kilian Q},
  journal = {Conference on Language Modeling (COLM)},
  year = {2025},
  paper = {https://openreview.net/forum?id=c05qIG1Z2B}
}

Preprint

SpeechOp: Inference-Time Task Composition for Generative Speech Processing

Justin Lovelace, Rithesh Kumar, Jiaqi Su, and 3 more authors

ArXiv Preprint, 2025

Bib Paper

@article{lovelace2025speechop,
  title = {SpeechOp: Inference-Time Task Composition for Generative Speech Processing},
  author = {Lovelace, Justin and Kumar, Rithesh and Su, Jiaqi and Chen, Ke and Weinberger, Kilian Q and Jin, Zeyu},
  journal = {ArXiv Preprint},
  year = {2025},
  paper = {https://arxiv.org/abs/2509.14298}
}

Preprint

Pre-training Limited Memory Language Models with Internal and External Knowledge

Linxi Zhao, Sofian Zalouk, Christian Belardi, and 5 more authors

ArXiv Preprint, 2025

Bib Paper

@article{zhao2025pretraining,
  title = {Pre-training Limited Memory Language Models with Internal and External Knowledge},
  author = {Zhao, Linxi and Zalouk, Sofian and Belardi, Christian and Lovelace, Justin and Zhou, Jin Peng and Weinberger, Kilian Q and Artzi, Yoav and Sun, Jennifer},
  journal = {ArXiv Preprint},
  year = {2025},
  paper = {https://arxiv.org/abs/2505.15962}
}

ACL Findings

Diffusion Guided Language Modeling

Justin Lovelace, Varsha Kishore, Yiwei Chen, and 1 more author

Findings of the Annual Meeting of the Association for Computational Linguistics (Findings of ACL), 2024

Bib Paper

@article{lovelace2024diffusion,
  title = {Diffusion Guided Language Modeling},
  author = {Lovelace, Justin and Kishore, Varsha and Chen, Yiwei and Weinberger, Kilian Q},
  journal = {Findings of the Annual Meeting of the Association for Computational Linguistics (Findings of ACL)},
  year = {2024},
  paper = {https://arxiv.org/abs/2408.04220}
}

NeurIPS

Latent Diffusion for Language Generation

Justin Lovelace, Varsha Kishore, Chao Wan, and 2 more authors

Conference on Neural Information Processing Systems (NeurIPS), 2023

Bib Paper

@article{lovelace2023latent,
  title = {Latent Diffusion for Language Generation},
  author = {Lovelace, Justin and Kishore, Varsha and Wan, Chao and Shekhtman, Eliot and Weinberger, Kilian Q},
  journal = {Conference on Neural Information Processing Systems (NeurIPS)},
  year = {2023},
  paper = {https://arxiv.org/abs/2212.09462}
}