I am Ayush Jain, a final year student pusrsuing B.E. in computer science from BITS Pilani, Pilani Campus. Currently, I am also a research assistant at Carnegie Mellon University advised by Prof. Katerina Fragkiadaki. My research interests include computer vision and its intersection with language and control. I want to enable self-supervised robots that can learn about the world in a never-ending learning fashion without requiring explicit human supervision.
B.E. in Computer Science, 2021
BITS PILANI, Pilani Campus
Humans learn to better understand the world by moving around their environment to get more informative viewpoints of the scene. Most methods for 2D visual recognition tasks such as object detection and segmentation treat images of the same scene as individual samples and do not exploit object permanence in multiple views. Generalization to novel scenes and views thus requires additional training with lots of human annotations. In this paper, we propose a self-supervised framework to improve an object detector in unseen scenarios by moving an agent around in a 3D environment and aggregating multi-view RGB-D information.
[Aug 2020] I’ll be attending Google Research India’s AI Summer School (Computer Vision track) from August 20-22, 2020!
[May 2020] Joined Prof. Katerina Fragkiadaki’s Lab as Research Associate at Carnegie Mellon University.
Reviewed, compared and analysed three recent papers proposed in generalising to novel views through the use of view-prediction …
Built simulation of various tasks like writing a cursive and block alphabets on a paper and building complex curved designs using …
Built multilayer perceptron network for Named Entity Recognition on CONLL2003 dataset from scratch, implementing backpropagation and …
erplag-cc is a compiler for the custom language ERPLAG, written in C. The compiler generates assembly code that can be run on a Linux …
An artificially agent created to play Minesweepers. external_link
.
Implemented Rundle et al.’s research paper for probabilistic prediction of earthquake based on nowcasting. Using the previous …
I have served as a teaching assistant for the following courses at BITS Pilani: