5.0 - 9.0 years

0 Lacs

pune, maharashtra

On-site

We are looking for a highly skilled and experienced Senior Data Engineer to take charge of developing complex compliance and supervision models. Your expertise in cloud-based infrastructure, ETL pipeline development, and financial domains will be crucial in creating robust, scalable, and efficient solutions. As a Senior Data Engineer, your key responsibilities will include leading the development of advanced models using AWS services such as EMR, Glue, and Glue Notebooks. You will design, build, and optimize scalable cloud infrastructure solutions, drawing on a minimum of 5 years of experience in cloud infrastructure. Creating, managing, and optimizing ETL pipelines using PySpark for large-scale data processing will also be a core part of your role. In addition, you will be responsible for building and maintaining CI/CD pipelines for deploying and maintaining cloud-based applications, performing detailed data analysis to deliver actionable insights, and collaborating closely with cross-functional teams to ensure alignment with business goals. Operating effectively in agile or hybrid agile environments and enhancing existing frameworks to support evolving business needs will be key aspects of your role. To qualify for this position, you must have a minimum of 5 years of experience with Python programming, 5+ years of experience in cloud infrastructure (particularly AWS), 3+ years of experience with PySpark (including usage with EMR or Glue Notebooks), and 3+ years of experience with Apache Airflow for workflow orchestration. A strong understanding of capital markets, financial systems, or prior experience in the financial domain is essential, along with proficiency in cloud-native technologies and frameworks. Furthermore, familiarity with CI/CD practices and tools like Jenkins, GitLab CI/CD, or AWS CodePipeline, experience with notebooks for interactive development, excellent problem-solving skills, and strong communication and interpersonal skills are required for this role. The ability to thrive in a fast-paced, dynamic environment is also crucial. In return, you will receive standard company benefits. Join us at DATAECONOMY and be part of a fast-growing data & analytics company at the forefront of innovation in the industry.,

Posted 1 week ago

Apply

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.