216 : Data Engineer Sr / Lead (100% remote)

Overview

Hands-on experience with Azure data platform stack : Azure Databricks, Azure Data Factory, Azure Data Lake storage, Azure DevOps, Azure Functions.

8+ years of experience developing enterprise big data solutions.

5+ years of experience working Microsoft Azure data platform and an excellent grasp of the following :

Azure Cloud Services.

Experience with designing and building end-to-end pipelines (DATA PIPELINE DATA FLOW).

Experience in Azure DevOps CI / CD Stories, Bugs, and Issue management.

Strong experience in shell scripting is required.

Strong ETL knowledge.

Ability to build pipelines to process structured and semi-structured data.

Ability to work within an agile team.

Requirements

• Development of Data Ingestion & Transformation Pipelines
• Development of Complex Data Ingestion & Transformation Pipelines
• Advanced SQL Programming
• Azure Data Factory
• Azure Data Lake Storage
• Azure Synapse Analytics or Azure Databricks
• Snowflake experience is a plus
• Kafka experience is a plus
• Retail experience is a plus
• Strong ETL and shell scripting knowledge
• Advanced English

Benefits

#J-18808-Ljbffr