Data Platform Engineer

Epergne Solutions is seeking a Data Platform Engineer with over 6 years of total experience, including at least 5 years of relevant experience in Python and Airflow Data Engineering. The role is based in India and is a contract position with a work-from-office mode. As a Data Platform Engineer at Epergne Solutions, you will be responsible for designing, developing, and maintaining complex data pipelines using Python for efficient data processing and orchestration. You will collaborate with cross-functional teams to understand data requirements and architect robust solutions within the AWS environment. Your role will also involve implementing data integration and transformation processes, optimizing existing data pipelines, and troubleshooting issues related to data pipelines to ensure smooth operation and minimal downtime. The ideal candidate should have a Bachelor's degree in Computer Science, Engineering, or a related field, along with proficiency in Python and SQL for data processing and manipulation. You should have a minimum of 5 years of experience in data engineering, with a strong background in Apache Airflow and AWS technologies, particularly S3, Glue, EMR, Redshift, and AWS Lambda. Knowledge of Snowflake is preferred, along with experience in optimizing and scaling data pipelines for performance and efficiency. In addition to technical skills, you should possess excellent problem-solving abilities, effective communication skills, and the capacity to work in a fast-paced, collaborative environment. Keeping abreast of the latest industry trends and best practices related to data engineering and AWS services is crucial for this role. Preferred qualifications include AWS certifications related to data engineering or big data, experience with big data technologies like Snowflake, Spark, Hadoop, or related frameworks, familiarity with other data orchestration tools besides Apache Airflow, and knowledge of version control systems like Bitbucket and Git. Epergne Solutions prefers candidates who can join within 30 days or have a lesser notice period.,