Azure Data Engineer

Neudesic, an IBM Company is home to some very smart, talented and motivated people. People who want to work for an innovative company that values their skills and keeps their passions alive with new challenges and opportunities. We have created a culture of innovation that makes Neudesic not only an industry leader, but also a career destination for todays brightest technologists. You can see it in our year-over-year growth, made possible by satisfied employees dedicated to delivering the right solutions to our clients

Must Have Skills:

• Prior experience in ETL, data pipelines, data flow techniques using

  Azure Data Services

• Working experience in

  Python, Scala, PySpark, Azure Data Factory, Azure Data Lake Gen2, Databricks, Azure Synapse

  and file formats like JSON & Parquet
• Experience in creating ADF Pipelines to source and process data sets.
• Experience in creating Databricks notebooks to cleanse, transform and enrich data sets.
• Good understanding about SQL, Databases, NO-SQL DBs, Data Warehouse, Hadoop and various data storage options on the cloud.
• Development experience in orchestration of pipelines
• Experience in deployment and monitoring techniques
• Working experience with

  Azure DevOps

  CI/CD pipelines to deploy Azure resources.
• Experience in handling operations/Integration with source repository
• Must have good knowledge on

  Datawarehouse concepts

  and Datawarehouse modelling

Good to Have Skills:

• Familiarity with DevOps, Agile Scrum methodologies and CI/CD
• Domain-driven development exposure
• Analytical / problem solving skills
• Strong communication skills
• Good experience with unit, integration and UAT support
• Able to design and code reusable components and functions
• Should able to review design, code & provide review comments with justification
• Zeal to learn new tool/technologies and adoption
• Power BI and Data Catalog experience