Talent's Information
-
Location
Pune, India
-
Rate
$13.0 per Hour
-
Experience
6 Year
-
Languages Known
English,Hindi
Available for
Background Verification
40 Hr/Week
About Shivam
Experienced Data Engineer and ETL Developer with expertise in design and implementation of Data Solutions for Data Warehousing and Analytics.
Microsoft certified Azure Data Engineer and well versed with Azure Services and Strong Hands-on Experience in ETL Tool like IBM DataStage.
Tech Stack Expertise
-
Microsoft SQL Server
SQL
1 Years
Work Experience
ADF Developer
- January 2017 - December 2022 - 6 Year
- India
Projects
CCEP
- January 2018 - October 2018 - 10 Months
Technologies
Role & Responsibility
- Designed End-to-End Pipeline to Pull the records from Database/File and sending it back to Client.
- Performing Data Validation on files using Mapping Data Flow activities like Conditional Splits, Derived Column, Aggregate.
- Creating Azure Function using Python and Integrating in Azure Data Factory pipelines.
- Deploying the Pipeline to QA/Prod using ARM Templates.
- Integrated pipeline with Logic Apps, Custom Activity.
- Using Rest API’s to Extract/Insert the data.
- Performing POC to do ETL Operation on bulk data in Databricks using PySpark.
- Performance tuning of SQL Queries on Azure Synapse.
Trustmark
- October 2018 - January 2019 - 4 Months
Technologies
Role & Responsibility
- Designing the job based on the client requirement and delivering it within defined time frame.
- Analyzing the jobs and optimizing it in order to execute the flow faster.
- Involved with Tier2/Tier1 teams to solve the production failure and in creation of Restart.
Bupa
- February 2019 - October 2019 - 9 Months
Technologies
Role & Responsibility
- Designing Azure Data factory Pipelines to pull record from Azure Synapse and loading the data to ADLS.
- Performing Unit Test on the code Designed.
- Gathering Requirement from Client and designing the job.
CCDM(Cloud Migration)
- August 2020 - January 2021 - 6 Months
Technologies
Role & Responsibility
- Analyze, design and build Modern data solutions using Azure PaaS service to support visualization of data
- Created Pipelines in ADF using Linked Services, Datasets, Pipeline to Extract, Transform and load data from different sources like Azure SQL, Blob storage, Azure SQL Data warehouse, write-back tool and backwards.
- Hands on Experience of DataBricks using Pyspark for data extraction, transformation and aggregation from multiple file formats for analyzing & transforming the data.
- Designing workflow in Azure Logic Apps.
- Planning to integrate Azure Services to Analytic Platform like Azure Analytics and generating Reports using Power BI.
CCDB(ETL)
- January 2021 - January 2022 - 13 Months
Technologies
Role & Responsibility
- EClient Interaction, requirement gathering, requirement analysis and preparing Application Design documents.
- Developing ETL job flows for pulling data from Files and performing transformation based on the requirement.
- Analyzing the job flow and optimizing it in best possible way in order to get the data more efficiently.
- Developed Automated Script using Shell scripting that will reduce the manual efforts needed in creating folders in Dev, Test and Prod Env, data filtering.
Soft Skills
Industry Expertise
Education
Computer Engineering in B.E
Pune University- June 2013 - June 2016
