Papers

Sometimes this page gets a bit out of date. My full list of papers is here.

EdgeBERT: Sentence-Level Energy Optimizations for Latency-Aware Multi-Task NLP Inference
Thierry Tambe and Others.
IEEE MICRO 2021

GenNI: Human-AI Collaboration for Data-Backed Text Generation
Hendrik Strobelt, Jambay Kinley, Robert Krueger, Johanna Beyer, Alexander M. Rush, Hanspeter Pfister.
IEEE VIS 2021

Parameter-efficient transfer learning with diff pruning
Demi Guo, Alexander M. Rush, Yoon Kim.
ACL 2021
pdf
How many data points is a prompt worth?
Teven Le Scao, Alexander M. Rush.
NAACL Short 2021 (Best Paper - Runner-Up)
pdf
Low-Complexity Probing via Finding Subnetworks
Steven Cao, Victor Sanh, Alexander M. Rush.
NAACL Short 2021
pdf
Template Filling with Generative Transformers
Xinya Du, Alexander M. Rush, Claire Cardie.
NAACL Short 2021
pdf
Named Tensor Notation
David Chiang, Alexander M. Rush, Boaz Barak.
Arxiv
pdf
9.8 A 25mm2 SoC for IoT Devices with 18ms Noise-Robust Speech-to-Text Latency via Bayesian Speech Denoising and Attention-Based Sequence-to-Sequence DNN Speech Recognition in 16nm FinFET
Thierry Tambe, En-Yu Yang, Glenn G Ko, Yuji Chai, Coleman Hooper, Marco Donato, Paul N Whatmough, Alexander M Rush, David Brooks, Gu-Yeon Wei.
IEEE International Solid-State Circuits Conference 2021
pdf
Cascaded Text Generation with Markov Transformers
Yuntian Deng, Alexander M. Rush.
NeurIPS 2020
pdf
Latent Template Induction with Gumbel-CRFs
Yao Fu, Chuanqi Tan, Bin Bi, Mosha Chen, Yansong Feng, Alexander Rush.
NeurIPS 2020
pdf
Movement Pruning: Adaptive Sparsity by Fine-Tuning
Victor Sanh, Thomas Wolf, Alexander M. Rush.
NeurIPS 2020
pdf
Scaling Hidden Markov Language Models
Justin T. Chiu, Alexander M. Rush.
EMNLP 2020
pdf
Adversarial Semantic Collisions
Congzheng Song, Alexander M. Rush, Vitaly Shmatikov.
EMNLP 2020
pdf
Sequence-Level Mixed Sample Data Augmentation
Demi Guo, Yoon Kim, Alexander M. Rush.
EMNLP 2020
pdf
AdaptivFloat: A Floating-point based Data Type for Resilient Deep Learning Inference
Thierry Tambe, En-Yu Yang, Zishen Wan, Yuntian Deng, Vijay Janapa Reddi, Alexander Rush, David Brooks, Gu-Yeon Wei.
DAC 2020 (Best Paper)
pdf
Transformers: State-of-the-art Natural Language Processing
Thomas Wolf et al.
EMNLP Demos 2020
pdf
Torch-Struct: Deep Structured Prediction Library
Alexander Rush.
ACL Demos 2020 (Best Demo Honorable Mention)
pdf
What is Learned in Visually Grounded Neural Syntax Acquisition
Noriyuki Kojima, Hadar Averbuch-Elor, Alexander M. Rush, Yoav Artzi.
ACL 2020 (Short)
pdf
Posterior Control of Blackbox Generation
Xiang Lisa Li, Alexander M. Rush.
ACL 2020
pdf
Automating Botnet Detection with Graph Neural Networks
Jiawei Zhou, Zhiying Xu, Alexander M. Rush, Minlan Yu.
AutoML for Networking and Systems Workshop
pdf
LAN -- A materials notation for 2D layered assemblies
Georgios A. Tritsaris, Yiqi Xie, Alexander M. Rush, Stephen Carr, Marios Mattheakis, Efthimios Kaxiras.

pdf
MASR: A Modular Accelerator for Sparse RNNs
Udit Gupta, Brandon Reagen, Lillian Pentecost, Marco Donato, Thierry Tambe, Alexander M. Rush, Gu-Yeon Wei, David Brooks.
PACT 2019

Commonsense Knowledge Mining from Pretrained Models
Joe Davison, Joshua Feldman and Alexander Rush.
EMNLP 2019

Neural Linguistic Steganography
Zachary Ziegler, Yuntian Deng and Alexander Rush.
EMNLP 2019
pdf
Compound Probabilistic Context-Free Grammars for Grammar Induction
Yoon Kim, Chris Dyer, Alexander M. Rush.
ACL 2019
pdf code
Visual Interaction with Deep Learning Models through Collaborative Semantic Inference
Gehrmann S, Strobelt H, Krueger R, Pfister H, and Alexander M. Rush.
InfoVis 2019
pdf code
Simple Unsupervised Summarization by Contextual Matching
Jiawei Zhou, Alexander M. Rush.
ACL 2019
pdf
GLTR: Statistical Detection and Visualization of Generated Text
Sebastian Gehrmann, Hendrik Strobelt, Alexander M Rush.
ACL Demo 2019 (Best Demo Honorable Mention)
pdf code
Unsupervised Recurrent Neural Network Grammars
Yoon Kim, Alexander M. Rush, Lei Yu, Adhiguna Kuncoro, Chris Dyer, Gabor Melis.
NAACL 2019
pdf code
Avoiding Latent Variable Collapse With Generative Skip Models
Adji B. Dieng, Yoon Kim, Alexander M. Rush, David M. Blei.
AISTATS 2019
pdf
Tensor Variable Elimination for Plated Factor Graphs
Fritz Obermeyer, Eli Bingham, Martin Jankowiak, Justin Chiu, Neeraj Pradhan, Alexander Rush, Noah Goodman.
ICML 2019
pdf code
Latent Normalizing Flows for Discrete Sequences
Zachary M. Ziegler, Alexander M. Rush.
ICML 2019
pdf code
Deep Latent-Variable Models for Natural Language
Yoon Kim, Sam Wiseman, Alexander M. Rush.
EMNLP 2018 (Tutorial)
pdf code
End-to-End Content and Plan Selection for Data-to-Text Generation
Sebastian Gehrmann, Falcon Z. Dai, Henry Elder, Alexander M. Rush.
INLG 2018
pdf code
Latent Alignment and Variational Attention
Yuntian Deng*, Yoon Kim*, Justin Chiu, Demi Guo, Alexander M. Rush.
NIPS 2018
pdf code
Learning Neural Templates for Text Generation
Sam Wiseman, Stuart M. Shieber, Alexander Rush.
EMNLP 2018
pdf code
Bottom-Up Abstractive Summarization
Sebastian Gehrmann, Yuntian Deng, Alexander Rush.
EMNLP 2018
pdf
Training for Diversity in Image Paragraph Captioning
Luke Melas-Kyriazi, George Han, Alexander Rush.
EMNLP 2018 (Short)
pdf
Entity Tracking Improves Cloze-style Reading Comprehension
Luong Hoang, Sam Wiseman, Alexander Rush.
EMNLP 2018 (Short)
pdf
Seq2Seq-Vis: A Visual Debugging Tool for Sequence-to-Sequence Models
Hendrik Strobelt, Sebastian Gehrmann, Michael Behrisch, Adam Perer, Hanspeter Pfister, Alexander M. Rush.
VAST 2018, EMNLP-BlackBox 2018 (Best Paper - Honorable Mention)
pdf code
The Annotated Transformer
Alexander M. Rush.
ACL NLP-OSS 2018
pdf code
OpenNMT System Description for WNMT 2018: 800 words/sec on a single-core CPU
Jean Senellart, Dakun Zhang, Bo Wang, Guillaume Klein, J.P. Ramatchandirin, Josep Crego, Alexander M. Rush.
WNMT 2018 (First-Place CPU Speed/Memory)
pdf
Semi-Amortized Variational Autoencoders
Yoon Kim, Sam Wiseman, Andrew C. Miller, David Sontag, Alexander M. Rush.
ICML 2018
pdf code
Compressing Deep Neural Networks with Probabilistic Data Structures
Brandon Reagen, Udit Gupta, Robert Adolf, Michael M. Mitzenmacher, Alexander M. Rush, Gu-Yeon Wei, David Brooks.
ICML 2018, SysML 2018
pdf
Adapting Sequence Models for Sentence Correction
Allen Schmaltz, Yoon Kim, Alexander M. Rush, Stuart M. Shieber.
EMNLP 2017
pdf
Challenges in Data-to-Document Generation
Sam Wiseman, Stuart M Shieber Alexander M. Rush.
EMNLP 2017
pdf slides code
Adversarially Regularized Autoencoders
Junbo Zhao, Yoon Kim, Kelly Zhang, Alexander M. Rush, Yann LeCun.
ICML 2018, NIPS 2017 Workshop
pdf code
OpenNMT: Open-Source Toolkit for Neural Machine Translation
Guillaume Klein, Yoon Kim, Yuntian Deng, Jean Senellart, Alexander M. Rush.
ACL Demo 2017 (Best Demo Runner-up)
pdf
Dilated Convolutions for Modeling Long-Distance Genomic Dependencies
Ankit Gupta, Alexander M. Rush.
ICML CompBio 2017 (Best Poster)
pdf
Image-to-Markup Generation with Coarse-to-Fine Attention
Yuntian Deng, Anssi Kanervisto, Jeffrey Ling, and Alexander M. Rush.
ICML 2017
pdf slides code
LSTMVis: A Tool for Visual Analysis of Hidden State Dynamics in Recurrent Neural Networks
Hendrik Strobelt, Sebastian Gehrmann, Hanspeter Pfister, and Alexander M. Rush.
InfoVis 2017
pdf code
Structured Attention Networks
Yoon Kim, Carl Denton, Luong Hoang, and Alexander M. Rush.
ICLR 2017
pdf slides code
Lie-Access Neural Turing Machines
Greg Yang and Alexander M. Rush.
ICLR 2017
pdf code
Sequence-Level Knowledge Distillation
Yoon Kim and Alexander M. Rush.
EMNLP 2016
pdf slides code
Sequence-to-Sequence Learning as Beam-Search Optimization
Sam Wiseman and Alexander M. Rush.
EMNLP 2016 (Best Paper Runner-Up)
pdf slides
An Embedding Model for Predicting Roll-Call Votes
Peter Kraft, Hirsh Jain, and Alexander M. Rush.
Proceedings of EMNLP 2016
pdf slides
Word Ordering Without Syntax
Allen Schmaltz, Alexander M. Rush, and Stuart M. Shieber.
EMNLP 2016
pdf slides code
Sentence-Level Grammatical Error Identification as Sequence-to-Sequence Correction
Allen Schmaltz, Yoon Kim, Alexander M. Rush, and Stuart M. Shieber.
Workshop Submission for AESW 2016 (Top Performing System)
pdf slides
Learning Global Features for Coreference Resolution
Sam Wiseman, Alexander M. Rush, and Stuart M. Shieber.
NAACL 2016
pdf code
Abstractive Sentence Summarization with Attentive Recurrent Neural Networks
Sumit Chopra, Michael Auli, and Alexander M. Rush.
NAACL 2016
pdf code
Character-Aware Neural Language Models
Yoon Kim, Yacine Jernite, David Sontag, and Alexander M. Rush.
AAAI 2016
pdf slides code
A Neural Attention Model for Abstractive Sentence Summarization
Alexander M. Rush, Sumit Chopra, and Jason Weston.
EMNLP 2015.
pdf slides code
Towards AI-Complete Question Answering A Set of Prerequisite Toy Tasks
Jason Weston, Antoine Bordes, Sumit Chopra, Tomas Mikolov, and Alexander M. Rush.
ArXiv Preprint
pdf
Learning Anaphoricity and Antecedent Ranking Features for Coreference Resolution
Sam Wiseman, Alexander M. Rush, Jason Weston, and Stuart M. Shieber.
ACL 2015.
pdf slides code
A Fast Variational Approach for Learning Markov Random Field Language Models
Yacine Jernite, Alexander M. Rush, and David Sontag.
ICML 2015.
pdf slides code
Transforming Dependencies into Phrase Structures
Lingpeng Kong, Alexander M. Rush, and Noah A. Smith.
NAACL 2015.
pdf slides code

PhD Publications