Jobs
Interviews
UST logo

Lead I - Software Engineering-Data Engineer

6 - 9 years

0 Lacs

Trivandrum Kerala India

Posted:2 weeks ago| Platform: Linkedin logo

Apply

Skills Required

software engineering data pyspark gcp hadoop hive aws devops processing design etl efficiency automation deployment monitoring security governance compliance resolve dataflow redshift sql jenkins gitlab terraform containerization orchestration docker kubernetes code spark

Work Mode

On-site

Job Type

Full Time

Job Description

Role Description

ocation:

Any UST Location

Experience:

6 to 9 years

Mandatory Skills:

PySpark, GCP, Hadoop, Hive, AWS, GCP

Good to Have:

CI/CD and DevOps experienceWe are seeking a highly skilled Senior Big Data Engineer to join our team at UST. The ideal candidate will have solid experience in Big Data technologies, cloud platforms, and data processing frameworks with a strong focus on PySpark and Google Cloud Platform (GCP).

Key Responsibilities

  • Design, develop, and maintain scalable data pipelines and ETL workflows using PySpark, Hadoop, and Hive.
  • Deploy and manage big data workloads on cloud platforms like GCP and AWS.
  • Work closely with cross-functional teams to understand data requirements and deliver high-quality solutions.
  • Optimize data processing jobs for performance and cost-efficiency on cloud infrastructure.
  • Implement automation and CI/CD pipelines to streamline deployment and monitoring of data workflows.
  • Ensure data security, governance, and compliance in cloud environments.
  • Troubleshoot and resolve data issues, monitoring job executions and system health.

Mandatory Skills

  • PySpark: Strong experience in developing data processing jobs and ETL pipelines.
  • Google Cloud Platform (GCP): Hands-on experience with BigQuery, Dataflow, Dataproc, or similar services.
  • Hadoop Ecosystem: Expertise with Hadoop, Hive, and related big data tools.
  • AWS: Familiarity with AWS data services like S3, EMR, Glue, or Redshift.
  • Strong SQL and data modeling skills.

Good To Have

  • Experience with CI/CD tools and DevOps practices (Jenkins, GitLab, Terraform, etc.).
  • Containerization and orchestration knowledge (Docker, Kubernetes).
  • Experience with Infrastructure as Code (IaC).
  • Knowledge of data governance and data security best practices.

Skills

Spark,Hadoop,Hive,Gcp

More Jobs at UST

Architect II - Technical SAP ABAP

Bengaluru

12 - 15 yrs
|

INR 0 - 0 Lacs

Lead I - SAP FICO with PS (Project Systems) and RAR

Bengaluru

5 - 7 yrs
|

INR 0 - 0 Lacs

Lead II - SAP ABAP

Bengaluru

7 - 9 yrs
|

INR 0 - 0 Lacs

Procurement

Bengaluru, Karnataka

Experience: Not specified

|

Salary: Not disclosed

Manual & Python Automation

Bengaluru, Karnataka

Experience: Not specified

|

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Google Play App Store
coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
UST logo
UST

IT Services and IT Consulting

Aliso Viejo CA

RecommendedJobs for You

Lead I - Software Engineering-Data Engineer

UST

thiruvananthapuram, kerala

UST logo

Lead I - Software Engineering-Data Engineer

UST

Trivandrum, Kerala, India

Lead I - Software Engineering-Data Engineer

UST

thiruvananthapuram, kerala

UST logo

Lead I - Software Engineering-Data Engineer

UST

Trivandrum, Kerala, India