Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Home

Jobs

Home
>
Jobs in Greater Kolkata Area
>
VidPro Consultancy Services
>
Azure Databricks (Architect) +Python & Pyspark

Azure Databricks (Architect) +Python & Pyspark

VidPro Consultancy Services

0 years

39 - 42 Lacs

Greater Kolkata Area

Posted:21 hours ago| Platform:

Apply

Skills Required

azure databricks python pyspark design data etl engineering spark sql efficiency checks testing security governance apache scala devops git debugging analytics power kafka integration rest mlflow orchestration management certifications

Work Mode

On-site

Job Type

Full Time

Job Description

Job Summary

We are looking for an experienced

Azure Databricks Developer

to design, develop, and manage big data solutions using Azure services, with a strong focus on

Databricks

Spark

, and

ETL pipelines

. The ideal candidate will have a solid understanding of data engineering, Azure cloud components, and real-time/batch data processing.

Key Responsibilities

Design and build scalable and robust data pipelines using Azure Databricks (Spark).
Develop ETL/ELT processes for ingesting, transforming, and loading data from various sources.
Integrate data solutions with Azure Data Lake, Azure Data Factory, and SQL Databases.
Optimize Spark jobs for performance and cost-efficiency.
Collaborate with data architects, analysts, and business stakeholders to deliver data solutions.
Implement data quality checks, validations, and unit testing.
Ensure best practices in CI/CD, data security, and governance.

Must-Have Skills

Strong hands-on experience with Azure Databricks and Apache Spark (PySpark/Scala).
Proficiency in Azure Data Factory, Azure Data Lake, and Azure Synapse (optional).
Solid understanding of SQL, Delta Lake, and data warehousing concepts.
Experience building automated data pipelines and working with large datasets.
Good understanding of DevOps, version control (e.g., Git), and CI/CD pipelines.
Strong problem-solving and debugging skills.

Nice-to-Have

Experience with Azure Synapse Analytics, Power BI, or Kafka/Event Hub integration.
Familiarity with DataBricks REST APIs, MLFlow, or Databricks Jobs orchestration.
Knowledge of data modeling, data governance, and metadata management.

Qualifications

Bachelor’s or Master’s degree in Computer Science, Information Systems, or related field.
Azure certifications (e.g., DP-203, Azure Data Engineer Associate) are a plus.

Skills: python,delta lake,apache spark (pyspark/scala),pyspark,ci/cd,azure data lake,azure,azure data factory,etl/elt processes,data governance,azure databricks,data modeling,git,databricks,metadata management,architect,sql

More Jobs at VidPro Consultancy Services

Developer II – Python & Dotnet

Ahmedabad, Gujarat, India

5 - 8 yrs

₹ 12 - 18 Lacs

Developer II – Python & Dotnet

Indore, Madhya Pradesh, India

5 - 8 yrs

₹ 12 - 18 Lacs

Azure Architect

Gurugram, Haryana, India

8 - 12 yrs

Salary: Not disclosed

Azure Architect

Pune, Maharashtra, India

8 - 12 yrs

Salary: Not disclosed

Snowflake - Azure Data Factory (ADF)

Pune, Maharashtra, India

3 - 3 yrs

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Technical Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

VidPro Consultancy Services

112 Jobs

Login to

Please Verify Your Phone or Email

Confirm Action

Search

Profile

Upskill and Grow with AI

Azure Databricks (Architect) +Python & Pyspark