Vyom Bhatia

Principal Data Engineer

New Delhi, IN.

About

Highly experienced Data Engineer with 9 years of expertise in designing, developing, and optimizing scalable data infrastructure and ETL processes. Proven ability to lead teams, migrate on-premises systems to cloud platforms like Azure, and implement strategic optimizations that significantly enhance data processing efficiency and performance. Adept at leveraging PySpark, Databricks, and Azure Data Factory to build robust, high-impact data pipelines for diverse business applications, ensuring seamless data integration and actionable insights.

Work

MongoDB

|

Principal, Data Strategy and Insights

Gurgaon, Haryana, India

→

Summary

Currently leading a team at MongoDB to translate complex data into actionable insights and automate critical processes for Sales Operations.

Highlights

Guided a team in translating complex data into actionable visual reports for various stakeholders, driving informed strategic decisions.

Designed, documented, and automated critical manual processes for Sales Operations, significantly enhancing efficiency and reducing operational overhead.

Drove strategic initiatives for data utilization and reporting, aligning data insights with business objectives to maximize impact.

GM Analytics Solutions

|

Lead Data Engineer

Gurgaon, Haryana, India

→

Summary

Led a team in designing and implementing robust ETL processes, migrating on-premises infrastructure to Azure Cloud, and optimizing ADF pipeline performance.

Highlights

Led a team in designing and implementing robust ETL processes, ensuring efficient data extraction, transformation, and loading from diverse sources into a centralized data warehouse.

Spearheaded the migration of on-premises data infrastructure to Microsoft Azure Cloud, leveraging Azure Data Factory for orchestrating data workflows and ensuring seamless integration with existing systems.

Implemented strategic optimizations to enhance performance and efficiency of existing ADF pipelines, resulting in streamlined data processing and improved workflow execution.

7N Consulting Pvt. Ltd.

|

Senior Software Engineer

Gurgaon, Haryana, India

→

Summary

Developed and maintained real-time and batch data pipelines, reducing processing time by 20%, and created backend logic for Power BI dashboards.

Highlights

Developed and maintained real-time and batch data pipelines, achieving a 20% reduction in data processing time.

Created robust backend logic for Power BI dashboards, ensuring seamless data integration and effective visualization for key business insights.

Streamlined data workflows and enhanced data quality, improving accessibility and reliability for critical business reporting.

Sun Life India Service Centre Private Ltd.

|

Analyst Developer

Gurgaon, Haryana, India

→

Summary

Collaborated with cross-functional teams to design scalable data models, optimize data storage, and implement complex T-SQL solutions.

Highlights

Collaborated with cross-functional teams to define data requirements, designing scalable data models and optimizing data storage for improved retrieval performance.

Developed and implemented complex T-SQL queries, stored procedures, and views to support diverse business applications and reporting needs.

Contributed to database performance tuning and data integrity initiatives, ensuring reliable and efficient data operations.

Cognizant Technology Solutions

|

Programmer Analyst

Coimbatore, Tamil Nadu, India

→

Summary

Assisted in designing and developing database solutions, including data modeling, schema design, and stored procedure implementation.

Highlights

Assisted in the design and development of foundational database solutions, including data modeling and schema design.

Implemented and optimized stored procedures to enhance data manipulation and retrieval efficiency.

Supported data migration efforts, ensuring data accuracy and integrity across various database systems.

Contributed to data analysis and reporting by generating ad-hoc queries and reports for business stakeholders.

Education

SRM University

Chennai, Tamil Nadu, India
→
B.Tech Information Technology Grade: CGPA 7.73

Sachdeva Public School

New Delhi, Delhi, India
→
High School Diploma Senior Secondary Grade 12 Grade: 73.4%

Sachdeva Public School

New Delhi, Delhi, India
→
High School Diploma High School Grade 10 Grade: CGPA 8.8

Skills

Programming and Big Data

Python, PySpark, Databricks.

ETL

Azure Data Factory, SQL Server Integrated Services.

Database Management

T-SQL, Trino, Hive, SQL Server Management Studio, Azure Data Studio.

Version Control

Git, Liquibase.

Business Intelligence

Sigma Computing, PowerBI, Tableau.

Projects

ADT Ingestion Engine

→

Summary

Orchestrated seamless integration of Admission, Discharge, and Transfer (ADT) HL7 alerts into the data warehouse using Azure Data Factory (ADF).

SSIS to ADF Migration

→

Summary

Seamlessly transitioned from SQL Server Integration Services (SSIS) to Azure Data Factory (ADF), incorporating PySpark and Databricks to enhance scalability and streamline data integration workflows.

Data Migration to Databricks Hive

→

Summary

Executed a seamless transition from Microsoft SQL Server to Databricks Hive, optimizing data processing for enhanced scalability.

Onboarding EMRs for Value Based Care Services

→

Summary

Executed a seamless data onboarding initiative, tackling the challenge of diverse Electronic Medical Record (EMR) systems with varying input file formats and layouts for unified healthcare data management.