Databricks Admin with AWS

Remote

Rotational shift

Immediate Joiners only.

Key Responsibilities:
Deploy, configure, and manage Databricks workspaces, clusters, and jobs.Monitor and optimize Databricks performance, auto-scaling, and costmanagement.Implement security best practices, including role-based access control (RBAC) andencryption.Manage Databricks integration with cloud storage (Azure Data Lake, S3, etc.)and other data services.Automate infrastructure provisioning and management using Terraform, ARMtemplates, or CloudFormation.Troubleshoot Databricks runtime issues, job failures, and performancebottlenecks.Support CI/CD pipelines for Databricks workloads and notebooks.Collaborate with data engineering teams to enhance ETL pipelines and dataprocessing workflows.Ensure compliance with data governance policies and regulatory requirements.Maintain and upgrade Databricks versions and libraries as needed.

Required Skills & Qualifications:
7+ years of experience as a Databricks Administrator or in a similar role.Strong knowledge of Azure/AWS Databricks and cloud computing platforms.Hands-on experience with Databricks clusters, notebooks, libraries, and jobscheduling.Expertise in Spark optimization, data caching, and performance tuning.Proficiency in Python, Scala, or SQL for data processing.Experience with Terraform, ARM templates, or CloudFormation for infrastructureautomation.Familiarity with Git, DevOps, and CI/CD pipelines.Strong problem-solving skills and ability to troubleshoot Databricks-related issues.Excellent communication and stakeholder management skills.Preferred Qualifications:Databricks certifications (e.g., Databricks Certified Associate/Professional).Experience in Delta Lake, Unity Catalog, and MLflow.Knowledge of Kubernetes, Docker, and containerized workloads.Experience with big data ecosystems (Hadoop, Apache Airflow, Kafka, etc.)