Streamsets ETL Developer, Associate

Job Title - Streamsets ETL Developer, Associate

Location - Pune, India

Role Description

• Currently DWS sources technology infrastructure, corporate functions systems [Finance, Risk, HR, Legal, Compliance, AFC, Audit, Corporate Services etc] and other key services from DB. Project Proteus aims to strategically transform DWS to an Asset Management standalone operating platform; an ambitious and ground-breaking project that delivers separated DWS infrastructure and Corporate Functions in the cloud with essential new capabilities, further enhancing DWS highly competitive and agile Asset Management capability.
• This role offers a unique opportunity to be part of a high performing team implementing a strategic future state technology landscape for all DWS Corporate Functions globally.
• We are seeking a highly skilled and motivated ETL developer (individual contributor) to join our integration team. The ETL developer will be responsible for developing, testing and maintaining robust and scalable ETL processes to support our data integration initiatives.
• This role requires a strong understanding of database, Unix and ETL concepts, excellent SQL skills and experience with ETL tools and databases.

Your key responsibilities

• This role will be primarily responsible for creating good quality software using the standard coding practices.
• Will get involved with hands-on code development.
• Thorough testing of developed ETL solutions/pipelines.
• Do code review of other team members.
• Take E2E Accountability and ownership of work/projects and work with the right and robust engineering practices.
• Converting business requirements into technical design
• Delivery, Deployment, Review, Business interaction and Maintaining environments.
• Additionally, the role will include other responsibilities, such as:
  • Collaborating across teams
  • Ability to share information, transfer knowledge and expertise to team members
• Work closely with Stakeholders and other teams like Functional Analysis and Quality Assurance teams.
• Work with BA and QA to troubleshoot and resolve the reported bugs / issues on applications.

Your skills and experience

• Bachelors Degree from an accredited college or university with a concentration in Science or an IT-related discipline (or equivalent)
• Hands-on experience with StreamSets, SQL Server and Unix.
• Experience of developing and optimizing ETL Pipelines for data ingestion, manipulation and integration.
• Strong proficiency in SQL, including complex queries, stored procedures, functions.
• Solid understanding of relational database concepts.
• Familiarity with data modeling concepts (Conceptual, Logical, Physical)
• Familiarity with HDFS, Kafka, Microservices, Splunk.
• Familiarity with cloud-based platforms (e.g. GCP, AWS)
• Experience with scripting languages (e.g. Bash, Groovy).
• Excellent knowledge of SQL.
• Experience of delivering within an agile delivery framework
• Experience with distributed version control tool (Git, Github, BitBucket).
• Experience within Jenkins or pipelines based modern CI/CD systems