I am a current PhD student at MIT CSAIL working with Antonio Torralba and Phillip Isola on machine learning. My current focuses are geometric structures of learned representations, and enabling efficient, adaptive and general agents via such representations. I am broadly interested in representation learning, reinforcement learning, dataset distillation, and machine learning in general.

I have spent time at Meta AI working with Yuandong Tian, Amy Zhang, and Simon S. Du. I also collaborate with Alyosha Efros and Jun-Yan Zhu.

Before joining MIT, I worked at Facebook AI Research (now Meta AI) on PyTorch, and studied computer science and statistics at UC Berkeley, where I was fortunate to work with Stuart J. Russell, Ren Ng, and Alyosha Efros.

Selected Publications

  1. Denoised MDPs: Learning World Models Better Than The World
    [ICML 2022] [Project Page] [arXiv] [code]
    Tongzhou Wang, Simon S. Du, Antonio Torralba, Phillip Isola, Amy Zhang, Yuandong Tian

  2. On the Learning and Learnablity of Quasimetrics
    [ICLR 2022] [Project Page] [arXiv] [OpenReview] [code]
    Tongzhou Wang, Phillip Isola

    quasimetric-function-spaces

  3. Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hypersphere
    [ICML 2020] [Project Page] [arXiv] [code]
    Tongzhou Wang, Phillip Isola

    hypersphere_stl10_scatter_linear_output
    # bsz : batch size (number of positive pairs)
    # d   : latent dim
    # x   : Tensor, shape=[bsz, d]
    #       latents for one side of positive pairs
    # y   : Tensor, shape=[bsz, d]
    #       latents for the other side of positive pairs
    def align_loss(x, y, alpha=2):
        return (x - y).norm(p=2, dim=1).pow(alpha).mean()
    def uniform_loss(x, t=2): return torch.pdist(x, p=2).pow(2).mul(-t).exp().mean().log()
    PyTorch implementation of the alignment and uniformity losses
  4. Dataset Distillation
    [Project Page] [arXiv] [code]
    Tongzhou Wang, Jun-Yan Zhu, Antonio Torralba, Alexei A. Efros

    dataset_distillation_fixed_mnist

  5. Meta-Learning MCMC Proposals
    [NeurIPS 2018] [PROBPROG 2018] [ICML 2017 AutoML Workshop Oral] [arXiv]
    Tongzhou Wang, Yi Wu, David A. Moore, Stuart J. Russell

    meta_learning_mcmc_gmm_trace

  6. Learning to Synthesize a 4D RGBD Light Field from a Single Image
    [ICCV 2017] [arXiv]
    Pratul Srinivasan, Tongzhou Wang, Ashwin Sreelal, Ravi Ramamoorthi, Ren Ng light-field-synthesis-pipeline

Selected Projects

  1. Improved Training of Cycle-Consistent Adversarial Networks

    Tongzhou Wang and Yihan Lin with research group of Prof. Alexei A. Efros

    Related report: CycleGAN with Better Cycles.

  2. Modeling Punctuations in Online Reviews
    [technical report]

    Tongzhou Wang

    light-field-synthesis-pipeline