Lead II - Data Engineering

7 years

0 Lacs

Posted:2 weeks ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Role Description

Job Title: Senior Data Engineer

Experience:

7+ Years

Employment Type:

Full-time

Job Summary

We are seeking a skilled

Senior Data Engineer

with strong experience in building scalable data pipelines and transforming complex data across enterprise platforms. The ideal candidate should have hands-on expertise in

Databricks, PySpark, SQL

, and

ETL/ELT

tools such as

Informatica, AWS Glue, or DataProc

. Experience with cloud data warehouses like

Snowflake, BigQuery, or Delta Lake

, and a strong understanding of

data security, compliance, and DevOps

is essential. Domain knowledge in

banking, financial services, or cybersecurity

is highly desirable.

Key Responsibilities

  • Design, build, and optimize secure data pipelines for large-scale data processing.
  • Develop ETL/ELT jobs and implement Data Quality (DQ) rules within Databricks and Aurora platforms.
  • Collaborate with Data Architects, DQ Analysts, and Cyber SMEs in Agile POD teams.
  • Manage data modeling, performance tuning, and infrastructure cost optimization.
  • Support data governance, DQ controls (e.g., BCBS 239, DUSE, DMOVE), and compliance reporting.
  • Document architecture, test strategies, and ensure code quality and scalability.

Required Skills

  • Strong proficiency in Databricks, PySpark, SQL
  • Experience with ETL tools (e.g., Glue, DataProc, ADF, Informatica)
  • Cloud experience with AWS, Azure, or GCP
  • Hands-on with data modeling, DQ implementation, and performance tuning
  • Understanding of data security, encryption, and risk controls
  • Excellent communication and stakeholder collaboration skills

Preferred Qualifications

  • Bachelor’s degree in Computer Science, Engineering, or a related field
  • Experience in banking, financial services, or cybersecurity domains
  • Familiarity with DUSE/DMOVE frameworks and cybersecurity metrics reporting
  • Certification in cloud or data engineering tools is a plus

Skills

Databricks,Pyspark,Sql,Etl

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
UST logo
UST

IT Services and IT Consulting

Aliso Viejo CA

RecommendedJobs for You

Pune, Maharashtra, India

Trivandrum, Kerala, India

Pune, Maharashtra, India

Trivandrum, Kerala, India