Data Unveil - Python Developer - ETL/PySpark

Description

About us : Data Unveil is the next generation provider of best-in-class data aggregation services. Our solutions and methodologies have been honed over the past 10 years by experienced practitioners who have collectively supported 100+ brands, 100+ data partners and 25+ new drug launches.Our integrated capabilities create a differentiated value proposition for our clients.We have the business knowledge to help define your solution, the technical expertise to bring it to life, and the operational experience to maintain it effectively, efficiently and compliantly.

Job Summary

We are seeking a Python Developer with 2-3 years of experience, skilled in Python, PySpark, Oracle, MySQL, and basic AWS services.The candidate will work on data processing, ETL pipelines, and database integration to support business analytics and reporting.

Key Responsibilities

• Develop and optimize ETL workflows and data pipelines using Python and PySpark.
• Write and optimize SQL queries for Oracle and MySQL databases.
• Use PySpark for distributed data processing and large-scale transformations.
• Implement data ingestion, transformation, and validation processes.
• Integrate AWS services like S3, Lambda, EC2, RDS, Glue, etc.
• Ensure data integrity, security, and performance optimization.
• Collaborate with data teams to understand requirements.
• Debug and optimize Spark jobs and database queries.
• Use version control (Git) and participate in code reviews.
  

Required Skills

• Python
• Pyspark
• Linux
• AWS services such as S3, Lambda, EC2, RDS, etc.
• Git and CI/CD practices.
• Oracle, Mysql
• Data extraction, transformation, and loading (ETL)
  

(ref:hirist.tech)