Data Engineer

Description:

Our client is building a cutting-edge Data & Al Platform to deliver smart insights, enable automation, and enhance strategic decision-making across multiple sectors.

We are looking for a skilled and passionate Data Engineer to help design, build, and optimize data infrastructure that drives innovation and business excellence.

*Key Responsibilities*

Design, develop, and maintain ETL/ELT pipelines using
Azure Data Factory and Azure Databricks
Implement Medallion Architecture for scalability and performance
Build and optimize workflows with PySpark and Delta Lake
Ensure data quality, validation, and governance
Collaborate with analysts, scientists, and business stakeholders
Support AI/ML model deployment (a plus)
Write clean, modular Python and SQL code
Contribute to Agile/Scrum planning and architectural

*Key Qualifications*

3+ years of experience as a Data Engineer

Proven expertise in:
Azure Data Factory (ADF)
Azure Databricks
Delta Lake / Lakehouse Architecture
PySpark, SQL, and Python

Strong understanding of data warehousing, modeling, and governance
Familiarity with CI/CD, version control, and DevOps practices

*Preferred Skills*

Knowledge of AI/ML concepts and MLOps
Experience with Azure Machine Learning or OpenAI/GPT services
Familiarity with streaming data tools (e.g., Azure Event Hubs, Kafka)
Experience with Bl/dashboarding tools (e.g., Power BI)