Senior Azure Data Engineer

Description:

Responsibilities:

Data Architecture and Modeling

• Design, implement, and manage scalable and efficient data models optimized for Azure environments.
• Collaborate closely with data engineers, business analysis, and business stakeholders to understand data requirements and translate them into effective Azure/on-prim -based solutions.

Data Integration

• Develop and implement robust ETL processes using Azure Data Factory / Azure Synapse pipeline - dataflows to extract, transform, and load data from diverse sources into our Azure-based data warehouse.
• Develop and maintain ETL processes using Microsoft technology SSRS, SSAS,SSIS Data warehouse and Data mart
• Ensure data integrity and quality throughout the Azure/on-prim -based ETL pipeline.

Azure Database Management

• Manage and optimize databases on Azure, ensuring high performance and availability.
• Implement best practices for Azure/on-prim database security, backup, and recovery procedures.

Data Visualization

• Create visually compelling and user-friendly reports using Power BI Desktop.
• Implement best practices for Power BI data visualization to enhance data-driven decision-making.
• Utilize Power BI services to enable collaboration, sharing, and distribution of reports within the organization.

Data Pipeline Automation

• Develop and maintain automated data pipelines on Azure for seamless data flow across systems.
• Implement monitoring and alerting systems using Azure Monitor to ensure the reliability of data pipelines.

Collaboration

• Collaborate closely with cross-functional teams, including data engineers, analysts, and software engineers, to understand Azure/on-prim-based data needs and deliver effective solutions.
• Provide mentorship and guidance to junior team members on Azure/on-prim data engineering best practices.

Documentation

• Create and maintain comprehensive documentation for Azure/on-prim -based data processes, workflows, and data models, technical part of proposals

Requirements

• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
• Proven experience as a Data Engineer with a focus on designing and implementing data solutions on-prim and Azure platform.
• Strong proficiency in SQL and experience with Azure/on-prim -based relational databases.
• Experience with Azure data technologies, including Azure Data Factory, and Azure Synapse Analytics.
• Expertise in Power BI services, including dashboard and report development
• Proficiency in Power BI Desktop and Report Server for creating compelling data visualizations.
• Proficiency in one or more programming languages (e.g., Python, Scala) with Azure SDK integration.
• Strong understanding and hands on experience of Azure AI offering and services (e.g., Azure Open AI, Azure AI Bot Services).
• Strong understanding and hands on experience with Azure ML and Auto ML.
• Solid understanding of data modeling principles and best practices within the Azure ecosystem.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills.
• Azure certifications (e.g., Microsoft Certified: Azure Data Engineer Associate) are a plus.