Azure Data Engineer

Description:

Responsibilities:

• Experience: 5 plus year
• Experience with object-oriented/object function scripting languages: Python, Scala, etc
• Experience in Python programming and libraries like Pandas, NumPy, SciPy Experience in shell script and simple Linux comman Strong analytic skills related to working with semi-structured datasets like JSON and XML Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
• Experience building and optimizing `big data? data pipelines, architectures and data sets.
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement
• Experience in programming using Azure Databricks and ADLS Experience with relational SQL and NoSQL databases, including Postgres.
• Experience with Azure cloud services: ADLS, Key Vaults, ADF, Log Analytics Knowledge with stream-processing systems: Spark-Streamiz