Jobs
Interviews
UST logo

5+ YoE - Data Engineer – PySpark/Spark Scala with Cloud & SQL - Immediate Joiner - Kolkata

5 years

0 Lacs

Kolkata West Bengal India

Posted:1 week ago| Platform: Linkedin logo

Apply

Skills Required

data pyspark spark scala sql design integrity scalability efficiency aws azure checks automation etl querying orchestration apache databricks containerization docker devops governance security compliance

Work Mode

On-site

Job Type

Full Time

Job Description

ready to join immediately

CCTC | ECTC | Notice Period | Location Preference

nitin.patil@ust.com

Act fast for immediate attention! ⏳📩


ready to join immediately

CCTC | ECTC | Notice Period | Location Preference

nitin.patil@ust.com

Act fast for immediate attention! ⏳📩


5+ years if Experience.

Roles and Responsibilities

  • Design, develop, and maintain scalable data pipelines using Spark (PySpark or Spark with Scala).
  • Build data ingestion and transformation frameworks for structured and unstructured data sources.
  • Collaborate with data analysts, data scientists, and business stakeholders to understand requirements and deliver reliable data solutions.
  • Work with large volumes of data and ensure quality, integrity, and consistency.
  • Optimize data workflows for performance, scalability, and cost efficiency on cloud platforms (AWS, Azure, or GCP).
  • Implement data quality checks and automation for ETL/ELT pipelines.
  • Monitor and troubleshoot data issues in production and perform root cause analysis.
  • Document technical processes, system designs, and operational procedures.

Must-Have Skills

  • 3+ years of experience as a Data Engineer or similar role.
  • Hands-on experience with

    PySpark

    or

    Spark using Scala

    .
  • Strong knowledge of

    SQL

    for data querying and transformation.
  • Experience working with

    any cloud platform

    (AWS, Azure, or GCP).
  • Solid understanding of data warehousing concepts and big data architecture.
  • Experience with version control systems like Git.

Good-to-Have Skills

  • Experience with data orchestration tools like

    Apache Airflow

    ,

    Databricks Workflows

    , or similar.
  • Knowledge of

    Delta Lake

    ,

    HDFS

    , or

    Kafka

    .
  • Familiarity with containerization tools (Docker/Kubernetes).
  • Exposure to CI/CD practices and DevOps principles.
  • Understanding of data governance, security, and compliance standards.

More Jobs at UST

Architect II - Technical SAP ABAP

Bengaluru

12 - 15 yrs
|

INR 0 - 0 Lacs

Lead I - SAP FICO with PS (Project Systems) and RAR

Bengaluru

5 - 7 yrs
|

INR 0 - 0 Lacs

Lead II - SAP ABAP

Bengaluru

7 - 9 yrs
|

INR 0 - 0 Lacs

Procurement

Bengaluru, Karnataka

Experience: Not specified

|

Salary: Not disclosed

Manual & Python Automation

Bengaluru, Karnataka

Experience: Not specified

|

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Google Play App Store
coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
UST logo
UST

IT Services and IT Consulting

Aliso Viejo CA

RecommendedJobs for You

UST logo

5+ YoE - Data Engineer – PySpark/Spark Scala with Cloud & SQL - Immediate Joiner - Kolkata

UST

Kolkata, West Bengal, India

UST logo

5+ YoE - Data Engineer – PySpark/Spark Scala with Cloud & SQL - Immediate Joiner - Kolkata

UST

Kolkata, West Bengal, India