Senior - Data Engineer - 5+years

5 years

0 Lacs

Posted:2 days ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Key Responsibilities:


Azure Cloud s Databricks:

o  Design and build efficient data pipelines using Azure Databricks (PySpark).

o  Implement business logic for data transformation and enrichment at scale.

o  Manage and optimize Delta Lake storage solutions.

API Development:

o  Develop REST APIs using FastAPI to expose processed data.

o  Deploy APIs on Azure Functions for scalable and serverless data access.

Data Orchestration s ETL:

o  Develop and manage Airflow DAGs to orchestrate ETL processes.

o  Ingest and process data from various internal and external sources on a scheduled basis.

Database Management:

o  Handle data storage and access using PostgreSQL and MongoDB.

o  Write optimized SQL queries to support downstream applications and analytics.

Collaboration:

o  Work cross-functionally with teams to deliver reliable, high-performance data solutions.

o  Follow best practices in code quality, version control, and documentation.


Required Skills s Experience:


·        5+ years of hands-on experience as a Data Engineer.

·        Strong experience with Azure Cloud services.

·        Proficient in Azure Databricks, PySpark, and Delta Lake.

·        Solid experience with Python and FastAPI for API development.

·        Experience with Azure Functions for serverless API deployments.

·        Skilled in managing ETL pipelines using Apache Airflow.

·        Hands-on experience with PostgreSQL and MongoDB.

·        Strong SQL skills and experience handling large datasets.

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You