Azure Data Engineer

We are currently looking for Azure Data Engineers to become a member of Neudesic s Data & AI team.

Minimum Experience: 5 Years and above

Must Have Skills

• Prior experience in ETL, data pipelines, data flow techniques using Azure Data Services
• Working experience in Python, Scala, Py Spark, Azure Data Factory, Azure Data Lake Gen2, Databricks, Azure Synapse and file formats like JSON & Parquet
• Experience in creating ADF Pipelines to source and process data sets.
• Experience in creating Databricks notebooks to cleanse, transform and enrich data sets.
• Good understanding about SQL, Databases, NO-SQL DBs, Data Warehouse, Hadoop and various data storage options on the cloud.
• Development experience in orchestration of pipelines
• Experience in deployment and monitoring techniques
• Working experience with Azure DevOps CI/CD pipelines to deploy Azure resources.
• Experience in handling operations/Integration with source repository
• Must have good knowledge on Datawarehouse concepts and Datawarehouse modelling

Good To Have Skills

• Familiarity with DevOps, Agile Scrum methodologies and CI/CD
• Domain-driven development exposure
• Analytical / problem solving skills
• Strong communication skills
• Good experience with unit, integration and UAT support
• Able to design and code reusable components and functions
• Should be able to review design, code & provide review comments with justification
• Zeal to learn new tool/technologies and adoption
• Power BI and Data Catalog experience
• Be aware of phishing scams involving fraudulent career recruiting and fictitious job postings; visit our Phishing Scams page to learn more.