We are seeking an experienced Databricks Administrator with 7+ years of expertise in managing and optimizing Databricks environments. The ideal candidate should have hands-on experience with Azure/AWS Databricks, cluster management, security configurations, and performance optimization. This role requires close collaboration with data engineering and analytics teams to ensure smooth operations and scalability.

About the Role

The Databricks Administrator will be responsible for managing and optimizing Databricks environments, ensuring performance, security, and scalability.

Responsibilities

Deploy, configure, and manage Databricks workspaces, clusters, and jobs.
Monitor and optimize Databricks performance, auto-scaling, and cost management.
Implement security best practices, including role-based access control (RBAC) and encryption.
Manage Databricks integration with cloud storage (Azure Data Lake, S3, etc.) and other data services.
Automate infrastructure provisioning and management using Terraform, ARM templates, or CloudFormation.
Troubleshoot Databricks runtime issues, job failures, and performance bottlenecks.
Support CI/CD pipelines for Databricks workloads and notebooks.
Collaborate with data engineering teams to enhance ETL pipelines and data processing workflows.
Ensure compliance with data governance policies and regulatory requirements.
Maintain and upgrade Databricks versions and libraries as needed.

Qualifications

7+ years of experience as a Databricks Administrator or in a similar role.
Strong knowledge of Azure/AWS Databricks and cloud computing platforms.
Hands-on experience with Databricks clusters, notebooks, libraries, and job scheduling.
Expertise in Spark optimization, data caching, and performance tuning.
Proficiency in Python, Scala, or SQL for data processing.
Experience with Terraform, ARM templates, or CloudFormation for infrastructure automation.
Familiarity with Git, DevOps, and CI/CD pipelines.
Strong problem-solving skills and ability to troubleshoot Databricks-related issues.
Excellent communication and stakeholder management skills.

Preferred Skills

Databricks certifications (e.g., Databricks Certified Associate/Professional).
Experience in Delta Lake, Unity Catalog, and MLflow.
Knowledge of Kubernetes, Docker, and containerized workloads.
Experience with big data ecosystems (Hadoop, Apache Airflow, Kafka, etc.).

Shift Timing: 10PM to 6AM IST (Fixed)

More Jobs at Numeric Technologies

SAP Data Migration expert

India

8 - 8 yrs

Salary: Not disclosed

Technical Recruiter

Bengaluru, Karnataka, India

3 - 7 yrs

Salary: Not disclosed

Senior Data Analyst (Snowflake/Python/SQL/ DBT)

Bengaluru, Karnataka, India

6 - 7 yrs

Salary: Not disclosed

SAP BTP (Fiori, CAPM)

India

Experience: Not specified

Salary: Not disclosed

Sap Financial Accounting Consultant

India

7.0 - 7.0 yrs

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Databricks Interview Now

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

Numeric Technologies

13 Jobs

Login to

Please Verify Your Phone or Email

Confirm Action

Search

Profile

Upskill and Grow with AI

Cloud Administrator