Not Available
User

Data Engineer

BMT Score
78
78%
  • Remote

Available for

About VIVEK P

Data Engineer with 3+ years of experience. Well-acquainted with Pipelines, Data Structure, Data Management, and processing systems. Strong desire to move forward, face new challenges, and expand my skill set.
 

Tech Stack Expertise

  • Tech Stack Expertise

    Kotlin

    Spark

    0 Years
  • Tech Stack Expertise

    Microsoft SQL Server

    SQL

    0 Years
  • Tech Stack Expertise

    AWS

    AWS S3,AWS Athena,AWS EMR,AWS EC2,Amazon AWS

    0 Years
  • Tech Stack Expertise

    Python

    Python

    0 Years
  • Tech Stack Expertise

    Go Lang

    Docker

    0 Years

Work Experience

Images

Data Engineer

  • January 2019 - December 2022 - 4 Year
  • India

Projects

Images

Data Ingestion

  • January 2019 - November 2019 - 11 Months
Technologies
Role & Responsibility

    In my current role I am working on data ingestion as to get the data from client apis or there data lake. And then transforming it to specified way so that other product can understand the data. Combining/joining client raw data files/sources using various methods. Handling multiple time zones. Running in batches for large data sets. Performing deduplication based on what makes a record unique.

...see less
Images

Meter Insights

  • October 2019 - January 2020 - 4 Months
Technologies
Role & Responsibility

    Apart from it I am also responsible to run meter insights, which is basically guide the customer which is best plan for them and divide the usage into three equal parts. So we can know the pattern of the usage of power.

...see less
Images

COX

  • February 2020 - August 2020 - 7 Months
Technologies
Role & Responsibility

    To make prediction of number of people coming in next ten days. My role as a Data Engineer at Nagarro, I am responsible for building ETL pipelines. Implementing AWS Lambda functions for each step or event for big data processing. Putting input file in s3 bucket, adding a trigger to a lambda function, invoking transient EMR Cluster, Update States in DynamoDB, run transformation configs, copy data to redshift.

...see less

Industry Expertise

Our Suggestions