Umar Masud

I am a pre-final year undergrad at JMI University, New Delhi.
My interest is in research in the field of ML/AI and Computer Vision.
I have applied knowledge of Image Processing, Machine Learning, and Deep Learning, with hands-on practice in various image-related tasks in Computer Vision. I keep reading multiple relevant pieces of literature and try to implement them in code.
I also have a basic to intermediate knowledge of web development technologies.

Apart from exploring the latest research and technology developments, I can be found consuming content about innovation, ideas, entrepreneurship, start-ups, finance, and alike. A keen interest in the start-up ecosystem.


Experience

Research Intern

Indian Institute of Science (IISc)

Associated with VCL Lab, where I am working on Domain Generalisation for Person Re-identification task.

January 2022 - Present

Research collaborator

Ecole normale superieure - PSL

Worked with members of Computational Bioimaging and Bioinformatics team headed by Auguste Genovesio for a project on Quality Control of out-of-focus/noised images Phenotypic Screening using Self/Semi Supervised learning.
Responsible for setting up pipelines to pre-train SOTA self-supervised methods on 2.1M images and evaluate the results on downstream classification task. Performed studies with transfer learning and semi-supervised learning as well. Finally presented the results in a paper which is under review.

December 2021 - March 2022

Summer Research Intern

IIIT-Allahabad

Worked on the topic of "Automatic Detection of Image Splicing", under Prof. Anupam Agarwal , in Interactive Technologies and Multimedia Research (ITMR) Lab.
Did literature review and comparative analysis, implemented baselines from scratch and ran various experiments/simulations, cross-evaluated the SOTA papers with different datasets and out-of-distribution training/testing environments. Concluded a study that the latest methods have an overestimated performance and are unsuitable for real-world applications. (arXiv)

May 2021 - July 2021

Undergraduate Researcher

Jamia Millia Islamia

Working on a problem pertaining to "Facial Mask Detection and Positioning", under Prof. Sarfaraz Masood.
Designing a research participation form and collecting a dataset from scratch for our purpose. Exploring various benchmark Facial Recognition datasets, literature review and analysis, applying latest Object Detection techniques on a novel sythentic dataset we developed by image stitching using homography matrix for our purpose.

May 2021 - Present

Junior ML Engineer

Omdena Global

Collaborating in a team of 50+ ML engineers to develop a production-ready deep vision system that uses geospatial data to provide accurate rooftop solar PV analy- sis, inlcuding factors such as total roof-area, roof obstacles, shadows/solar potatential, rooftop material, etc. This project is in association with Rebase Energy.

September 2021 - November 2021

ML/AI Dev

Google Developer Student Club - JMI.

One of the core team members, responsible for all the activities being carried out for the dissemination of knowledge about ML/AI to students.

August 2021 - Present

Youth Ambassador

HundrED Global Organization

HundrED Youth Ambassadors is an active community of students from around the world who are passionate about improving education and want to work with other like-minded young changemakers.

January 2021 - December 2021

Web Development Volunteer

M.I.N.D.S

Responsible for the development and timely updating of their website.

December 2020 - January 2020

Web Development and Design Intern

The Sparks Foundation

Built two mini-projects
1.) A transaction based small banking system.
2.) A demo-webpage integrated with a payment gateway for donation purposes.

December 2020 - January 2020

Education

Jamia Millia Islamia University

Bachelor of Technology
Electronics and Communication

CGPA: 9.44/10

August 2019 - May 2023

The Frank Anthony Public School

Science Stream

98%, ICSE 12th

April 2004 - March 2019

Skills

Programming Languages
  • Python,
  • Java,
  • HTML/CSS,
  • PHP,
  • Javascript.
Libraries/Frameworks
  • NumPy,
  • Pandas,
  • Matplotlib,
  • Sklearn,
  • OpenCV,
  • Keras,
  • TensorFlow,
  • PyTorch,
  • Flask.
Database
  • MySql,
  • PostgreSQL
Interpersonal
  • Communication,
  • Public Speaking,
  • Critical Thinking,
  • Team Leadership,
  • Team Management.


Projects

Machine Learning
  • Classical ML
    • Reproduced 5 papers on the topic Image Forgery Detection that uses handcrafted features for classification of pristine and tampered images.
    • Diabetic Retinopathy Detection using Texture Features and Ensemble Learning (paper implementation). Achieved F1-score = 0.97 and accuracy = 97.2%.
    • Fog detection in images using GLCM based features and SVM (paper implementation). Got F1-score = 0.83 and test accuracy = 82.3%
    • Phishing URL detection system based on URL features using SVM (paper implementation). Achieved F1-score = 0.99 and test accuracy = 99.2%
  • OpenCV Projects
    • Air-Piano, an air-based piano enabling the person to play through hand(fingertip) movements.
    • Air-Drum System, an air-based drum beat generator.
    • Background Color Detection, uses 2 techniques to detect a suitable background for the input image.
  • Deep Learning
    • Image Inpainting using a U-Net model with a fused ConvMixer encoder. (Report)
    • Different Descriptors for Squeeze and Excitation Attention Block - experimented with standard deviation, trace, largest singular value, and DC coefficient of DCT instead of usual GlobalAvgPool2d. (Report)
    • Background Remover tool for portrait images of humans, made using a U-Net model trained for semantic segmentation of the image. The model achieved 0.981 IOU-score on test data. Also deployed on a web-app.
    • Implemented the paper - Medical image denoising using Convolutional Denoising Autoencoders(CAE). Achieved a loss = 0.106 or Structural Similarity Index(SSIM) = 0.894 .
    • Image similarity measure through Siamese network on fashion apparels. Got an evaluation accuracy of 94.2%
    • Plant Pathology Challenge, a FGVC8 workshop challenge at CVPR-2021 for multi-label classification of plant leaf diseases. Got 87.34 accuracy with a pre-trained model as feature extractor.
    • Human Emotion Detection, Pneumonia Prediction models.

Web Development
  • Banking System
    • The project contains a simple banking system that enables to transact between the customers. It uses HTML, CSS, bootstrap, PHP, and MySQL, with the local server provided by the XAMPP.
  • Website Template for InnerveSOC
    • As a part of the InnerveSOC competition, designed a complete website template for Innerve Tech-Fest 2020, IGDTUW. I was the adjudged winner.

Awards & Honors

  • DAAD-WISE Scholarship 2022: Financial aid for Summer Research Internship in Germany.
  • Workshop on AI for Computational Social Systems(ACSS) 2021: - 3rd place in Student Paper Competition.
  • 5th Summer School of AI 2021 - IIIT Hyderabad - One amongst 500 participants worldwide.
  • Winner-Innerve Summer of Code Challenge 2020 - Indira Gandhi Delhi Technical University for Women.
  • INSPIRE Science Award For Top 1% - Scholarship for Higher Studies by Govt. of India.
  • Mr. Harbinder Singth Dugal Rolling Trophy - Awarded for Proficiency in Science ISC-XII
  • Mr. G W Mayer’s Merit Scholarship - Awarded for excellence in Mathematics and Science
  • Shanker Sumeda Rolling Trophy - Awarded for Excellence in Academics.