Pengyuan Shi (Frank)

Passionate Computer Science Student

About Me

Hi, my name is Frank, and I graduated from the University of Waterloo with a Bachelor of Computer Science, specialized in AI. I’m super excited about multimodal learning, computer vision and robotics. I have broad interests in

  • deep learning
  • generative models
  • view synthesis
  • 3D reconstruction
  • scene understanding
  • autonomous driving
  • semi-supervised learning

During my undergraduate study, I interned at Uber and Twitter to apply AI technology in the real world, which grants me invaluable industrial experiences.

Starting Fall 2023, I will study at Columbia University as a Master student to further explore the state-of-the-art in AI and ML.

Education

Columbia University

Master of Science in Computer Science - Machine Learning Track

Starting 2023 Fall

University of Waterloo

Bachelor of Computer Science - AI Specialization

2018 - 2023

GPA: 3.97/4.0 (93/100)

  • Awards:
    • Dean’s Honours
    • Term Distinction
    • President’s Scholarship
  • Fav Courses:
    • Artificial Intelligence
    • Machine Learning
    • Computer Vision
    • Neural Networks
    • Machine Intelligence
    • Computer Graphics
    • Autonomous Vehicles
    • Software Architectures
    • Universe

Research Experience & Publications

Research Assistant

Volunteer

May 2022 - June 2023

Advised by Dr. Zahra Sheikhbahaee

Computational Health Informatics Lab

Research on world models for imaginative planning in reinforcement learning

Research Assistant

Part-time

January 2022 - June 2023

Advised by Prof. Alexander Wong

Vision and Image Processing Group

COVID-Net Assistant: A Deep Learning-Driven Virtual Assistant for Early COVID-19 Recommendation

Pengyuan Shi^, Yuetong Wang^, Saad Abbasi, Alexander Wong (^ denotes equal contribution)

Accepted by CVIS 2022 [Link to Paper]

Research Assistant

Part-time

September 2019 - January 2023

Advised by Prof. Yizhou Zhang

Applied & Principled PL Group

Type-Preserving, Dependence-Aware Guide Generation for Sound, Effective Amortized Probabilistic Inference

Jianlin Li, Leni Ven, Pengyuan Shi, and Yizhou Zhang

Accepted by POPL 2023 [Link to Paper]

Industry Experience

Uber

Software Engineering Intern

May 2022 - Dec 2022

Building deep learning models for image and document processing in the applied AI team. Also developing backend service for serving machine learning models via gRPC API

Twitter

Engineering Intern

May 2021 - December 2021

Architected data pipeline and machine learning models for user engagement prediction in the home modeling team

Darwin AI

Deep Learning and DevOps/QA Developer Intern

Jan 2021 - April 2021

Optimized training pipeline and analyzed Tensorflow deep learning models for object detection, image segmentation and classification

Darwin AI

Machine Learning Test Automation Developer Intern

May 2020 - August 2020

Implemented an end-to-end automated testing system for machine learning platform

Genesys

Quality Assurance Intern

September 2019 - December 2019

Developed a Python multithreaded inbounded calls simulation program for automated testing

Projects

COVIDNet-Assistant

Github Link

anime.ai

Github Link

ai-breaker

Github Link

Rebirth (OpenGL Animation Project)

Youtube Demo

Semi-Supervised Learning in Image Classification

Github Link

Miscellaneous

Alongside my interests in computer science some of my other interests and hobbies are:

  • Astronomy (Stargazing)
  • Gym Workout
  • Piano
  • Photographing
  • Sketching
  • Thinking