Lead I - Software Engineering-Data Engineer

6 - 9 years

0 Lacs

Posted:2 weeks ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Role Description

ocation:

Any UST Location

Experience:

6 to 9 years

Mandatory Skills:

PySpark, GCP, Hadoop, Hive, AWS, GCP

Good to Have:

CI/CD and DevOps experienceWe are seeking a highly skilled Senior Big Data Engineer to join our team at UST. The ideal candidate will have solid experience in Big Data technologies, cloud platforms, and data processing frameworks with a strong focus on PySpark and Google Cloud Platform (GCP).

Key Responsibilities

  • Design, develop, and maintain scalable data pipelines and ETL workflows using PySpark, Hadoop, and Hive.
  • Deploy and manage big data workloads on cloud platforms like GCP and AWS.
  • Work closely with cross-functional teams to understand data requirements and deliver high-quality solutions.
  • Optimize data processing jobs for performance and cost-efficiency on cloud infrastructure.
  • Implement automation and CI/CD pipelines to streamline deployment and monitoring of data workflows.
  • Ensure data security, governance, and compliance in cloud environments.
  • Troubleshoot and resolve data issues, monitoring job executions and system health.

Mandatory Skills

  • PySpark: Strong experience in developing data processing jobs and ETL pipelines.
  • Google Cloud Platform (GCP): Hands-on experience with BigQuery, Dataflow, Dataproc, or similar services.
  • Hadoop Ecosystem: Expertise with Hadoop, Hive, and related big data tools.
  • AWS: Familiarity with AWS data services like S3, EMR, Glue, or Redshift.
  • Strong SQL and data modeling skills.

Good To Have

  • Experience with CI/CD tools and DevOps practices (Jenkins, GitLab, Terraform, etc.).
  • Containerization and orchestration knowledge (Docker, Kubernetes).
  • Experience with Infrastructure as Code (IaC).
  • Knowledge of data governance and data security best practices.

Skills

Spark,Hadoop,Hive,Gcp

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
UST logo
UST

IT Services and IT Consulting

Aliso Viejo CA

RecommendedJobs for You