Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Home
>
Jobs in thiruvananthapuram
>
Litmus7
>
Senior Data Engineer

Senior Data Engineer

Litmus7

5 - 9 years

0 Lacs

thiruvananthapuram kerala

Posted:6 days ago| Platform: Shine logo

Apply

Skills Required

aws azure data engineering spark data quality governance analytics sql transformation airflow data models dbt bi tools data quality validation data governance access control audit compliance continuous improvement databricks lakehouse platform distributed data processing pyspark delta lake medallion architecture databricksnative tools elt pipelines aiready datasets largescale data ingestion medallion architecture bronze silver gold elt frameworks databricks workflows azure data factory databricks clusters photon clusters autooptimize databricks sql lineage delta live tables dlt unity catalog databricks monitoring cloudwatch azure monitor runtime upgrades best practices

Work Mode

On-site

Job Type

Full Time

Job Description

As a dynamic Data Engineer with strong hands-on experience in Databricks Lakehouse Platform, your role will involve building and optimizing scalable data solutions on AWS or Azure. You should have a solid foundation in data engineering and distributed data processing, specifically Spark/PySpark, along with a deep understanding of Delta Lake, Medallion Architecture, and Databricks-native tools. Your contributions will be crucial in designing modern ELT pipelines, ensuring data quality, performance, and governance, and collaborating across teams to deliver high-impact analytics and AI-ready datasets. Key Responsibilities: - Design and implement end-to-end data pipelines in Databricks using Spark (PySpark), SQL, and Delta Lake for large-scale data ingestion, transformation, and delivery. - Apply Medallion Architecture (Bronze/Silver/Gold) to structure and optimize data flows for analytics and ML use cases. - Develop and operationalize ELT frameworks using Databricks Workflows, Airflow, or Azure Data Factory to ensure reliability and scalability. - Optimize Databricks clusters, jobs, and queries for improved performance and cost efficiency, leveraging tools like Photon, Job Clusters, and Auto-Optimize. - Collaborate with data analysts, scientists, and architects to design data models and expose curated datasets via Databricks SQL, dbt, or BI tools. - Enforce data quality, validation, and lineage through Delta Live Tables (DLT) or Unity Catalog. - Implement data governance, access control, and audit compliance aligned with enterprise policies. - Troubleshoot pipeline and performance issues using Databricks monitoring, CloudWatch, or Azure Monitor. - Contribute to continuous improvement by evaluating new Databricks features, runtime upgrades, and best practices. Qualifications Required: - Strong hands-on experience in Databricks Lakehouse Platform. - Proficiency in data engineering and distributed data processing, specifically using Spark/PySpark. - Deep understanding of Delta Lake, Medallion Architecture, and Databricks-native tools. - Experience with developing ELT pipelines, data governance, and data quality management. - Familiarity with tools like Databricks Workflows, Airflow, or Azure Data Factory. - Ability to collaborate effectively across teams and contribute to high-impact analytics projects. (Note: No additional details about the company were mentioned in the job description provided),

More Jobs at Litmus7

UX Designer (R&D)

Kochi, Kerala, India

Experience: Not specified

Salary: Not disclosed

HCL Commerce

Kochi, Kerala, India

Experience: Not specified

Salary: Not disclosed

HCL Commerce

Kochi, Kerala, India

Experience: Not specified

Salary: Not disclosed

Academic Technical Trainer

Kochi, Kerala, India

5 - 8 yrs

Salary: Not disclosed

Senior Research Engineer AI

Kochi, Kerala, India

5 - 8 yrs

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now

Litmus7

Login to

Please Verify Your Phone or Email

Confirm Action

Senior Data Engineer