Not Available
User

Data Engineer

BMT Score
58
58%
  • Remote

Available for

About MAHESH

A performance driven ambitious software developer with an extraordinary blend of and technical knowledge. Ability to communicate and motivate team members to enhance strategic goals and bottom line objectives. Creative problem solving and troubleshooting skills complemented by meticulous attention to details that will result in the success of an organization by developing new applications or improving existing ones.

Work Experience

Images

Data Engineer

  • January 2020 - December 2022 - 3 Year
  • India

Projects

Images

Credit Card Fraud Dedication

  • January 2020 - January 2022 - 25 Months
Technologies
Role & Responsibility
     Maintain the day to day data in Hive Datawarehouse without lagging from different source systems. • 
    Writing the Sqoop Jobs to transfer data from SQL Server and Oracle Databases to HDFS.
     Load the processed data into Hive External table and to create Partitioning and Bucketing techniques in hive to improve the performance, involved in choosing different file format's like ORC, Parquet format. 
    Scheduling the Sqoop jobs using Airflow.
     To Check the SQL Database for monitoring daily ingestion jobs are successful if not debugging the issue. •Running Analytics Pipeline for Aggregating and joining the multiple daily ingestion tables to meet the stakeholder’s requirements. 
    Scheduled the jobs and transferring final output data into Redshift for reporting purpose. 
    Creating the cluster group in EMR for running Daily ingestion, Analytics Pipeline jobs
...see less

Industry Expertise

Education

Education

in B.E

Mumbai University
  • June 2012 - June 2015

Our Suggestions