I am a current PhD student at MIT CSAIL working with Antonio Torralba and Phillip Isola on leveraging learned representation to enable intelligent agents that are capable, robust, efficient, and general. My current focuses are representation learning for various structures and geometries in data, and enabling efficient, adaptive and general control via learned representations. I am broadly interested in representation learning, reinforcement learning, dataset distillation, and machine learning in general.

I have spent time at Meta AI working with Yuandong Tian, Amy Zhang, and Simon S. Du. I also collaborate with Alyosha Efros and Jun-Yan Zhu.

Before joining MIT, I worked at Facebook AI Research (now Meta AI) on PyTorch, and studied computer science and statistics at UC Berkeley, where I was fortunate to work with Stuart J. Russell, Ren Ng, and Alyosha Efros.

Selected Publications

  1. Denoised MDPs: Learning World Models Better Than The World
    [ICML 2022] [Project Page] [arXiv] [code]
    Tongzhou Wang, Simon S. Du, Antonio Torralba, Phillip Isola, Amy Zhang, Yuandong Tian

  2. On the Learning and Learnablity of Quasimetrics
    [ICLR 2022] [Project Page] [arXiv] [OpenReview] [code]
    Tongzhou Wang, Phillip Isola


  3. Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hypersphere
    [ICML 2020] [Project Page] [arXiv] [code]
    Tongzhou Wang, Phillip Isola

    # bsz : batch size (number of positive pairs)
    # d   : latent dim
    # x   : Tensor, shape=[bsz, d]
    #       latents for one side of positive pairs
    # y   : Tensor, shape=[bsz, d]
    #       latents for the other side of positive pairs
    def align_loss(x, y, alpha=2):
        return (x - y).norm(p=2, dim=1).pow(alpha).mean()
    def uniform_loss(x, t=2): return torch.pdist(x, p=2).pow(2).mul(-t).exp().mean().log()
    PyTorch implementation of the alignment and uniformity losses
  4. Dataset Distillation
    [Project Page] [arXiv] [code]
    Tongzhou Wang, Jun-Yan Zhu, Antonio Torralba, Alexei A. Efros


  5. Meta-Learning MCMC Proposals
    [NeurIPS 2018] [PROBPROG 2018] [ICML 2017 AutoML Workshop Oral] [arXiv]
    Tongzhou Wang, Yi Wu, David A. Moore, Stuart J. Russell


  6. Learning to Synthesize a 4D RGBD Light Field from a Single Image
    [ICCV 2017] [arXiv]
    Pratul Srinivasan, Tongzhou Wang, Ashwin Sreelal, Ravi Ramamoorthi, Ren Ng light-field-synthesis-pipeline

Selected Projects

  1. Improved Training of Cycle-Consistent Adversarial Networks

    Tongzhou Wang and Yihan Lin with research group of Prof. Alexei A. Efros

    Related report: CycleGAN with Better Cycles.

  2. Modeling Punctuations in Online Reviews
    [technical report]

    Tongzhou Wang