Data Engineering II-HO & Support-CVM CoE

Data Governance

The team will be central data governance team for Kotak bank managing Metadata platforms, Data Privacy, Data Security, Data Stewardship and Data Quality platform.

If youve right data skills and are ready for building data lake solutions from scratch for high concurrency systems involving multiple systems then this is the team for you.

You day to day role will include

• Drive business decisions with technical input and lead the team.
• Design, implement, and support an data infrastructure from scratch.
• Manage AWS resources, including EC2, EMR, S3, Glue, Redshift, and MWAA.
• Extract, transform, and load data from various sources using SQL and AWS big data technologies.
• Explore and learn the latest AWS technologies to enhance capabilities and efficiency.
• Collaborate with data scientists and BI engineers to adopt best practices in reporting and analysis.
• Improve ongoing reporting and analysis processes, automating or simplifying self-service support for customers.
• Build data platforms, data pipelines, or data management and governance tools.

BASIC QUALIFICATIONS for Data Engineer

• Bachelor's degree in Computer Science, Engineering, or a related field
• 3-5 years of experience in data engineering
• Strong understanding of AWS technologies, including S3, Redshift, Glue, and EMR
• Experience with data pipeline tools such as Airflow and Spark
• Experience with data modeling and data quality best practices
• Excellent problem-solving and analytical skills
• Strong communication and teamwork skills
• Experience in at least one modern scripting or programming language, such as Python, Java, or Scala
• Strong advanced SQL skills

PREFERRED QUALIFICATIONS

• AWS cloud technologies: Redshift, S3, Glue, EMR, Kinesis, Firehose, Lambda, IAM, Airflow
• Prior experience in Indian Banking segment and/or Fintech is desired.
• Experience with Non-relational databases and data stores
• Building and operating highly available, distributed data processing systems for large datasets
• Professional software engineering and best practices for the full software development life cycle
• Designing, developing, and implementing different types of data warehousing layers
• Leading the design, implementation, and successful delivery of large-scale, critical, or complex data solutions
• Building scalable data infrastructure and understanding distributed systems concepts
• SQL, ETL, and data modelling
• Ensuring the accuracy and availability of data to customers
• Proficient in at least one scripting or programming language for handling large volume data processing
• Strong presentation and communications skills.
• For Managers,
  • Customer centricity, obsession for customer
  • Ability to manage stakeholders (product owners, business stakeholders, cross function teams) to coach agile ways of working.
  • Ability to structure, organize teams, and streamline communication.
  • Prior work experience to execute large scale Data Engineering projects