Data Engineer

The Data Engineer plays a critical role in the organization by designing, building, and maintaining scalable data pipelines and infrastructure. Collaborating closely with cross-functional teams, you ensure the smooth flow of data and enhance data-driven decision-making. Your key responsibilities include designing, developing, and maintaining data pipelines and ETL processes using tools such as Snowflake, Azure, AWS, Data Bricks, Informatica, and DataStage. You will work with data scientists and stakeholders to understand data requirements, ensuring data availability and integrity. Additionally, optimizing and tuning the performance of data infrastructure and processing systems, implementing data security and privacy measures, troubleshooting and performance tuning of ETL processes, and developing documentation for data infrastructure and processes are crucial aspects of your role. You will also participate in the evaluation and selection of new technologies and tools to enhance data engineering capabilities, provide support and mentorship to junior data engineers, adhere to best practices in data engineering, and maintain high standards of quality. Collaboration with cross-functional teams to support data-related initiatives and projects is essential for success in this role. To qualify for this position, you should possess a Bachelor's or Master's degree in Computer Science, Engineering, or a related field, along with proven experience in data engineering, ETL development, and data warehousing. Proficiency in Snowflake, AWS, Azure, Data Bricks, Informatica, and DataStage, strong programming skills in languages like Python, SQL, or Java, experience with big data technologies and distributed computing, and knowledge of data modeling and database design principles are required. Your ability to work with stakeholders, understanding data requirements, translating them into technical solutions, and knowledge of data governance, data quality, and data integration best practices are critical. Experience with cloud data platforms and services, excellent problem-solving and analytical abilities, strong communication and collaboration skills, and the ability to thrive in a fast-paced and dynamic environment are essential for success. Relevant certifications in cloud platforms and data engineering, such as AWS Certified Big Data - Specialty, Microsoft Certified: Azure Data Engineer, and SnowPro Core Certification, will be advantageous. In summary, as a Data Engineer, you will play a vital role in designing, building, and maintaining data pipelines and infrastructure, collaborating with cross-functional teams, optimizing data performance, and ensuring data security and privacy to support data-driven decision-making and initiatives effectively.,