Not Available
User

Azure Data Engineer

BMT Score
86
86%
  • Remote

Available for

About Hilal

4+ years of overall IT experience in Application Development in Big Data – Spark and Snowflake Cloud Data warehouse Domains with Creative problem solver with the ability to analyse challenges, applying strategic thinking and a results-oriented attitude.
Worked on Snowflake migration using AWS Cloud provider.
Excellent experience in    Warehouses, Roles, Schema, Databases, Resource
Monitor.

Tech Stack Expertise

  • Tech Stack Expertise

    Kotlin

    Spark

    1 Years

Work Experience

Images

Azure Data Engineer

  • January 2019 - February 2023 - 4 Year
  • India

Projects

Images

XYZ

  • April 2021 - November 2021 - 8 Months
Technologies
Role & Responsibility

     Nike is an American entity which is operational around 60+ countries across globe . It designs and manufacture shoes, clothing and accessories is the largest sportswear manufacturer in the world after Nike.

    Roles and Responsibilities:

    Helping stakeholders by building backend datasets for dashboards.
    Exposure in write spark SQL transformations
    Data loading in to HDFS from various sources to hive tables integrating spark - Databricks
    monitoring pipelines for failures if any.
    Helping stakeholders during delay in loads by refreshing dashboards data manually and their dependent pipelines
    providing root cause analysis for particular business problems identifying discrepancies and provide cost efficient solutions.
    Providing lineage of the datasets and prepare Migration tracker for data-bricks.
    Collaborate with Data scientist on Business aspects.
    Combine different sources of raw data.
    Maintaining datasets and developing as per requirement changes.
    Improving data quality and data efficiency.
    Exploring ways to enhance existing datasets data quality.
    Building DQ checks for existing datasets to identify data discrepancy
    Building cost saving and optimised models
    Developing daily and weekly reports pipelines
     
...see less
Images

XYZ

  • February 2022 - February 2023 - 13 Months
Technologies
Role & Responsibility

    The mission of The Walt Disney Company is to entertain, inform and inspire people around the globe through the power of unparalleled storytelling, reflecting the iconic brands, creative minds and innovative technologies that make ours the world’s premier entertainment company.

    Roles and Responsibilities:

    Creating tables and views on snowflake as per the business needs.
    Data moved from SQL Server ---> AWS ---> snowflake .
    Worked on Bulk Loading concept.
    Created Snow pipe for continuous data loading.
    Created internal and external stages and transformed data during load.
    Created the tables and loaded data into tables based on requirement.
    Loading the data from raw zone to curated tables by using the streams and task.
    Used FLATTEN table function to produce lateral view of VARIENT.
    Worked on the data sharing concepts with consumers for Reports.
    Worked on secure and materialized views.
    Worked on queries for the business logic.
    Involved in the power BI connection with Snowflake
...see less

Industry Expertise

Education

Education

in BE

Delhi University
  • June 2015 - June 2018

Our Suggestions