Lead Databricks Engineer

4 - 6 years

20 - 25 Lacs

Posted:2 weeks ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description

In this vital role you will be responsible for the development and implementation of our data strategy. The ideal candidate possesses a strong blend of technical expertise and data-driven problem-solving skills. As a Data Engineer, you will play a crucial role in building, and optimizing our data pipelines and platforms in a SAFE Agile product team.
  • Chip in to the design, development, and implementation of data pipelines, ETL/ELT processes, and data integration solutions.
  • Deliver for data pipeline projects from development to deployment, managing, timelines, and risks.
  • Ensure data quality and integrity through meticulous testing and monitoring.
  • Leverage cloud platforms (AWS, Databricks) to build scalable and efficient data solutions.
  • Work closely with product team, and key collaborators to understand data requirements.
  • Enforce to data engineering industry standards and standards.
  • Experience developing in an Agile development environment, and comfortable with Agile terminology and ceremonies.
  • Familiarity with code versioning using GIT and code migration tools.
  • Familiarity with JIRA.
  • Stay up to date with the latest data technologies and trends

Basic Qualifications:

  • Doctorate degree OR
  • Master s degree and 4 to 6 years of Information Systems experience OR
  • Bachelor s degree and 6 to 8 years of Information Systems experience OR
  • Diploma and 10 to 12 years of Information Systems experience.
  • Demonstrated hands-on experience with cloud platforms (AWS, Azure, GCP)
  • Proficiency in Python, PySpark, SQL.
  • Development knowledge in Databricks.
  • Good analytical and problem-solving skills to address sophisticated data challenges.

Preferred Qualifications:

  • Experienced with data modeling
  • Experienced working with ETL orchestration technologies
  • Experienced with software engineering best-practices, including but not limited to version control (Git, Subversion, etc.), CI/CD (Jenkins, Maven etc.), automated unit testing, and DevOps
  • Familiarity with SQL/NOSQL database

Soft Skills:

  • Skilled in breaking down problems, documenting problem statements, and estimating efforts.
  • Effective communication and interpersonal skills to collaborate with multi-functional teams.
  • Excellent analytical and problem solving skills.
  • Strong verbal and written communication skills
  • Ability to work successfully with global teams
  • High degree of initiative and self-motivation.
  • Team-oriented, with a focus on achieving team goals

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Milestone Technologies, Inc logo
Milestone Technologies, Inc

Information Technology and Services

San Jose

RecommendedJobs for You