Senior Data Engineer

Job Description

Job DescriptionKey Responsibilities Attend requirements gathering workshops, design meetings, and status review meetings Experience in Solution Design for the data engineer model to build and implement respective projects on-premises and on the cloud To be able to benchmark systems, analyses system bottlenecks and propose solutions to eliminate them Lead the development team, construct, test, maintain and run Sprints for the development and roll-out of functionalities Data Analysis, Code Development experience, ideally in ETL (Ab-Initio, Informatica, DataStage, Teradata, Alteryx, etc.) and/or Big Data (Scala, Spark, Hive, Hadoop, Python/Java, PySpark) Data Warehousing Able to help programmers and leadership (Architects / Technical Project Managers) in the design, planning, and governance of implementing projects of any kind Qualifications Bachelor's or Master's degree in Computer Science or related field 5 plus years of hands-on experience in IT Software Development Industry Strong problem-solving and analytical skills Data Governance and Data Modeling experience Implement and deploy high-performance, custom applications at scale on Hadoop Strong experience with designing, creating, and maintaining Scala-based applications Strong experience over Hadoop ecosystem (Spark/Pyspark, Hive, Sqoop, ect.) based projects Extract Transform Load (ETL) expertise Experience with cloud-based data warehousing, cloud data pipeline and data management Translate complex functional and technical requirements into detailed design and development Good to have hands-on experience in Cloud Native Programming Experience GCP services like Big Query, Dataflow, Dataproc, Composer, Streaming, Pub-Sub, etc. Good to have experience over other cloud services - Azure (Data Factory, Data Bricks, Synapse etc.) / AWS (EMR, Glue, Athena, Redshift etc.) / Snowflake Proficient with agile/scrum Experience in architecting and implementing large-scale data solutions is a plus Knowledge of Hadoop, Teradata, Oracle, and other database systems is a plus Knowledge of any one of the tools Ab-Initio / Informatica / DataStage / Teradata / Alteryx / etc., good to have multiple (more than one) ETL tools hands-on