Data Architect Databricks (Azure/AWS)
Role Overview:
We are seeking an experienced
Data Architect
specializing in
Databricks
to lead the architecture, design, and migration of enterprise data workloads from on-premises systems (e.g., Oracle, Exadata, Hadoop) to
Databricks
on
Azure
or
AWS
. The role involves designing scalable, secure, and high-performing data platforms based on the
medallion architecture
(bronze, silver, gold layers), supporting large-scale ingestion, transformation, and publishing of data.
Responsibilities
Key Responsibilities:
- Define and design cloud-native data architecture on Databricks using Delta Lake, Unity Catalog, and related services.
- Develop migration strategies for moving on-premises data workloads (Oracle, Hadoop, Exadata, etc.) to Databricks on Azure/AWS.
- Architect and oversee data pipelines supporting ingestion, curation, transformation, and analytics in a multi-layered (bronze/silver/gold) model.
- Lead data modeling, schema design, performance optimization, and data governance best practices.
- Collaborate with data engineering, platform, and security teams to build production-ready solutions.
- Create standards for ingestion frameworks, job orchestration (e.g., workflows, Airflow), and data quality validation.
- Support cost optimization, scalability design, and operational monitoring frameworks.
- Guide and mentor engineering teams during the build and migration phases.
Required Skills and Experience:
- 8+ years of experience in data architecture or engineering roles, with at least 3+ years specializing in cloud-based big data solutions.
- Hands-on expertise with Databricks on Azure or AWS.
- Deep understanding of Delta Lake, medallion architecture (bronze/silver/gold zones), and data governance tools (e.g., Unity Catalog, Purview).
- Strong experience migrating large datasets and batch/streaming pipelines from on-prem to Databricks.
- Expertise with Spark (PySpark/Scala) at scale and optimizing Spark jobs.
- Familiarity with ingestion from RDBMS (Oracle, SQL Server) and legacy Hadoop ecosystems.
- Proficiency in orchestration tools (Databricks Workflows, Airflow, Azure Data Factory, AWS Glue Workflows).
- Strong understanding of cloud-native services for storage, compute, security, and networking.
Preferred Qualifications:
- Databricks Certified Data Engineer or Architect.
- Azure/AWS cloud certifications.
- Experience with real-time/streaming ingestion (Kafka, Event Hubs, Kinesis).
- Familiarity with data quality frameworks (e.g., Deequ, Great Expectations).
Self Test Question
- Do you gave relevant experience in Data Architect
- Do you have experience in Databricks
- Do you have relevant experience in any one of the cloud platform
- Do you have any experience in delivering new solution as a Data Architect
About Us
As a world leader in cloud solutions, Oracle uses tomorrow's technology to tackle today's challenges. We've partnered with industry-leaders in almost every sectorand continue to thrive after 40+ years of change by operating with integrity.We know that true innovation starts when everyone is empowered to contribute. That's why we're committed to growing an inclusive workforce that promotes opportunities for all.Oracle careers open the door to global opportunities where work-life balance flourishes. We offer competitive benefits based on parity and consistency and support our people with flexible medical, life insurance, and retirement options. We also encourage employees to give back to their communities through our volunteer programs.We're committed to including people with disabilities at all stages of the employment process. If you require accessibility assistance or accommodation for a disability at any point, let us know by emailing [HIDDEN TEXT] or by calling +1 888 404 2494 in the United States.Oracle is an Equal Employment Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability and protected veterans status, or any other characteristic protected by law. Oracle will consider for employment qualified applicants with arrest and conviction records pursuant to applicable law.
