Justin Lovelace

Gates Hall

Cornell University

Ithaca, NY 14853

My current research focuses on developing diffusion models for language and speech generation, aiming to advance the capabilities and controllability of generative models in these domains. I am fortunate to be advised by Prof. Kilian Q. Weinberger.

Previously, I earned my M.S. in Language Technologies from Carnegie Mellon University, where I conducted NLP research under the advisement of Dr. Carolyn Rosé. I completed my undergraduate studies at Texas A&M University, where I engaged in Clinical NLP research with Dr. Bobak Mortazavi.

selected publications

COLM

Stop-Think-AutoRegress: Language Modeling with Latent Diffusion Planning

Justin Lovelace, Christian Belardi, Sofian Zalouk, and 3 more authors

Conference on Language Modeling (COLM), 2025

(To Appear)

Bib

@article{lovelace2025stopthink,
  title = {{Stop-Think-AutoRegress}: Language Modeling with Latent Diffusion Planning},
  author = {Lovelace, Justin and Belardi, Christian and Zalouk, Sofian and Polavaram, Adhitya and Kundurthy, Srivatsa and Weinberger, Kilian Q},
  journal = {Conference on Language Modeling (COLM)},
  year = {2025},
  note = {(To Appear)},
}

ArXiv

Pre-training Large Memory Language Models with Internal and External Knowledge

Linxi Zhao, Sofian Zalouk, Christian Belardi, and 5 more authors

ArXiv Preprint, 2025

Bib Paper

@article{zhao2025pretraining,
  title = {Pre-training Large Memory Language Models with Internal and External Knowledge},
  author = {Zhao, Linxi and Zalouk, Sofian and Belardi, Christian and Lovelace, Justin and Zhou, Jin Peng and Weinberger, Kilian Q and Artzi, Yoav and Sun, Jennifer},
  journal = {ArXiv Preprint},
  year = {2025},
  paper = {https://arxiv.org/abs/2505.15962}
}

Interspeech

Sample-Efficient Diffusion for Text-To-Speech Synthesis

Justin Lovelace, Soham Ray, Kwangyoun Kim, and 2 more authors

Interspeech, 2024

Bib Paper

@article{lovelace2024sampleefficient,
  title = {Sample-Efficient Diffusion for Text-To-Speech Synthesis},
  author = {Lovelace, Justin and Ray, Soham and Kim, Kwangyoun and Weinberger, Kilian Q and Wu, Felix},
  journal = {Interspeech},
  year = {2024},
  paper = {https://arxiv.org/abs/2409.03717}
}

ACL Findings

Diffusion Guided Language Modeling

Justin Lovelace, Varsha Kishore, Yiwei Chen, and 1 more author

Findings of the Annual Meeting of the Association for Computational Linguistics (Findings of ACL), 2024

Bib Paper

@article{lovelace2024diffusion,
  title = {Diffusion Guided Language Modeling},
  author = {Lovelace, Justin and Kishore, Varsha and Chen, Yiwei and Weinberger, Kilian Q},
  journal = {Findings of the Annual Meeting of the Association for Computational Linguistics (Findings of ACL)},
  year = {2024},
  paper = {https://arxiv.org/abs/2408.04220}
}

NeurIPS

Latent Diffusion for Language Generation

Justin Lovelace, Varsha Kishore, Chao Wan, and 2 more authors

Conference on Neural Information Processing Systems (NeurIPS), 2023

Bib Paper

@article{lovelace2023latent,
  title = {Latent Diffusion for Language Generation},
  author = {Lovelace, Justin and Kishore, Varsha and Wan, Chao and Shekhtman, Eliot and Weinberger, Kilian Q},
  journal = {Conference on Neural Information Processing Systems (NeurIPS)},
  year = {2023},
  paper = {https://arxiv.org/abs/2212.09462}
}