# Vyom Bhatia - Principal Data Engineer
Source: https://hello.cv/vyombhatia
New Delhi

## Links
- LinkedIn | https://www.linkedin.com/in/vyombhatia

## About
Highly experienced Data Engineer with 9 years of expertise in designing, developing, and optimizing scalable data infrastructure and ETL processes. Proven ability to lead teams, migrate on-premises systems to cloud platforms like Azure, and implement strategic optimizations that significantly enhance data processing efficiency and performance. Adept at leveraging PySpark, Databricks, and Azure Data Factory to build robust, high-impact data pipelines for diverse business applications, ensuring seamless data integration and actionable insights.

## Work
### Principal, Data Strategy and Insights | MongoDB
Currently leading a team at MongoDB to translate complex data into actionable insights and automate critical processes for Sales Operations.
- Guided a team in translating complex data into actionable visual reports for various stakeholders, driving informed strategic decisions.
- Designed, documented, and automated critical manual processes for Sales Operations, significantly enhancing efficiency and reducing operational overhead.
- Drove strategic initiatives for data utilization and reporting, aligning data insights with business objectives to maximize impact.
### Lead Data Engineer | GM Analytics Solutions
Led a team in designing and implementing robust ETL processes, migrating on-premises infrastructure to Azure Cloud, and optimizing ADF pipeline performance.
- Led a team in designing and implementing robust ETL processes, ensuring efficient data extraction, transformation, and loading from diverse sources into a centralized data warehouse.
- Spearheaded the migration of on-premises data infrastructure to Microsoft Azure Cloud, leveraging Azure Data Factory for orchestrating data workflows and ensuring seamless integration with existing systems.
- Implemented strategic optimizations to enhance performance and efficiency of existing ADF pipelines, resulting in streamlined data processing and improved workflow execution.
### Senior Software Engineer | 7N Consulting Pvt. Ltd.
Developed and maintained real-time and batch data pipelines, reducing processing time by 20%, and created backend logic for Power BI dashboards.
- Developed and maintained real-time and batch data pipelines, achieving a 20% reduction in data processing time.
- Created robust backend logic for Power BI dashboards, ensuring seamless data integration and effective visualization for key business insights.
- Streamlined data workflows and enhanced data quality, improving accessibility and reliability for critical business reporting.
### Analyst Developer | Sun Life India Service Centre Private Ltd.
Collaborated with cross-functional teams to design scalable data models, optimize data storage, and implement complex T-SQL solutions.
- Collaborated with cross-functional teams to define data requirements, designing scalable data models and optimizing data storage for improved retrieval performance.
- Developed and implemented complex T-SQL queries, stored procedures, and views to support diverse business applications and reporting needs.
- Contributed to database performance tuning and data integrity initiatives, ensuring reliable and efficient data operations.
### Programmer Analyst | Cognizant Technology Solutions
Assisted in designing and developing database solutions, including data modeling, schema design, and stored procedure implementation.
- Assisted in the design and development of foundational database solutions, including data modeling and schema design.
- Implemented and optimized stored procedures to enhance data manipulation and retrieval efficiency.
- Supported data migration efforts, ensuring data accuracy and integrity across various database systems.
- Contributed to data analysis and reporting by generating ad-hoc queries and reports for business stakeholders.

## Education
### SRM University | Information Technology
CGPA 7.73
### Sachdeva Public School | Senior Secondary Grade 12
73.4%
### Sachdeva Public School | High School Grade 10
CGPA 8.8

## Skills
### Programming and Big Data
Advanced
- Python
- PySpark
- Databricks
### ETL
Advanced
- Azure Data Factory
- SQL Server Integrated Services
### Database Management
Advanced
- T-SQL
- Trino
- Hive
- SQL Server Management Studio
- Azure Data Studio
### Version Control
Advanced
- Git
- Liquibase
### Business Intelligence
Advanced
- Sigma Computing
- PowerBI
- Tableau

## Projects
### ADT Ingestion Engine
Orchestrated seamless integration of Admission, Discharge, and Transfer (ADT) HL7 alerts into the data warehouse using Azure Data Factory (ADF).
### SSIS to ADF Migration
Seamlessly transitioned from SQL Server Integration Services (SSIS) to Azure Data Factory (ADF), incorporating PySpark and Databricks to enhance scalability and streamline data integration workflows.
### Data Migration to Databricks Hive
Executed a seamless transition from Microsoft SQL Server to Databricks Hive, optimizing data processing for enhanced scalability.
### Onboarding EMRs for Value Based Care Services
Executed a seamless data onboarding initiative, tackling the challenge of diverse Electronic Medical Record (EMR) systems with varying input file formats and layouts for unified healthcare data management.

## Source
Read this profile on Hello.cv: https://hello.cv/vyombhatia
Create your free profile at https://hello.cv