Talent's Information
-
Location
New Delhi, India
-
Rate
$9.0 per Hour
-
Experience
3 Year
-
Languages Known
English,Hindi
Available for
About VIVEK P
Data Engineer with 3+ years of experience. Well-acquainted with Pipelines, Data Structure, Data Management, and processing systems. Strong desire to move forward, face new challenges, and expand my skill set.
Tech Stack Expertise
-
Kotlin
Spark
0 Years -
Microsoft SQL Server
SQL
0 Years -
AWS
AWS S3,AWS Athena,AWS EMR,AWS EC2,Amazon AWS
0 Years -
Python
Python
0 Years -
Go Lang
Docker
0 Years
Work Experience
Data Engineer
- January 2019 - December 2022 - 4 Year
- India
Projects
Data Ingestion
- January 2019 - November 2019 - 11 Months
In my current role I am working on data ingestion as to get the data from client apis or there data lake. And then transforming it to specified way so that other product can understand the data. Combining/joining client raw data files/sources using various methods. Handling multiple time zones. Running in batches for large data sets. Performing deduplication based on what makes a record unique.
Meter Insights
- October 2019 - January 2020 - 4 Months
Apart from it I am also responsible to run meter insights, which is basically guide the customer which is best plan for them and divide the usage into three equal parts. So we can know the pattern of the usage of power.
COX
- February 2020 - August 2020 - 7 Months
To make prediction of number of people coming in next ten days. My role as a Data Engineer at Nagarro, I am responsible for building ETL pipelines. Implementing AWS Lambda functions for each step or event for big data processing. Putting input file in s3 bucket, adding a trigger to a lambda function, invoking transient EMR Cluster, Update States in DynamoDB, run transformation configs, copy data to redshift.
