New Delhi, India
$9.0 per Hour
About VIVEK P
Data Engineer with 3+ years of experience. Well-acquainted with Pipelines, Data Structure, Data Management, and processing systems. Strong desire to move forward, face new challenges, and expand my skill set.
Tech Stack Expertise
Microsoft SQL Server
AWS S3,AWS Athena,AWS EMR,AWS EC2,Amazon AWS0 Years
- January 2019 - December 2022 - 4 Year
- January 2019 - November 2019 - 11 Months
In my current role I am working on data ingestion as to get the data from client apis or there data lake. And then transforming it to specified way so that other product can understand the data. Combining/joining client raw data files/sources using various methods. Handling multiple time zones. Running in batches for large data sets. Performing deduplication based on what makes a record unique.
- October 2019 - January 2020 - 4 Months
- February 2020 - August 2020 - 7 Months
To make prediction of number of people coming in next ten days. My role as a Data Engineer at Nagarro, I am responsible for building ETL pipelines. Implementing AWS Lambda functions for each step or event for big data processing. Putting input file in s3 bucket, adding a trigger to a lambda function, invoking transient EMR Cluster, Update States in DynamoDB, run transformation configs, copy data to redshift.