Databricks Solution Architect

Overview:

Key Responsibilities:

• Design and architect scalable data platforms and pipelines using

  Databricks Lakehouse Platform

  .
• Lead the development and implementation of

  ETL/ELT workflows

  , data models, and analytics solutions.
• Collaborate with clients and internal teams to gather requirements and create

  technical architecture blueprints

  .
• Provide guidance on

  best practices for Spark optimization

  , data ingestion, transformation, and governance on Databricks.
• Integrate

  Databricks with Azure/AWS/GCP

  and other enterprise tools such as Power BI, Tableau, Kafka, Delta Lake, etc.
• Conduct

  technical workshops

  , POCs (Proof-of-Concepts), and solution demos for stakeholders.
• Ensure security, performance, and cost-efficiency of the data solutions.
• Provide mentorship to junior engineers and architects, promoting knowledge-sharing across the team.

Required Skills & Experience:

• 8+ years

  of experience in data engineering, analytics, or solution architecture roles.

• 3+ years hands-on experience

  with

  Databricks

  and Apache Spark.
• Strong understanding of

  big data architectures

  , data lakes, and lakehouses.
• Proficiency in

  Python, SQL

  , and optionally

  Scala

  .
• Experience with

  cloud platforms (Azure, AWS, or GCP)

  especially with services like Azure Data Lake, AWS S3, or GCP BigQuery.
• Familiarity with data governance, security practices, and compliance standards.
• Experience working with

  Delta Lake, MLflow

  , or

  Unity Catalog

  is a plus.
• Strong communication skills with the ability to explain technical concepts to non-technical audiences.