Data Engineer

Data Engineer

Key Responsibilities:

• Design, develop, and maintain scalable 

  ETL/ELT pipelines

   to process structured and semi-structured data.
• Write efficient and optimized 

  SQL queries

   to extract, transform, and load data from various databases.
• Utilize 

  Python

  , 

  Pandas

  , and 

  NumPy

   to perform advanced data wrangling, transformation, and analysis.
• Collaborate with data scientists, analysts, and other engineers to understand data needs and deliver timely solutions.
• Ensure data quality and integrity through automated validation checks and monitoring.
• Work with large datasets and optimize performance for data-intensive operations.
• Implement and maintain data documentation, data lineage, and metadata management practices.
• Contribute to the overall data infrastructure and architecture.

Key Requirements:

• 4+ years of hands-on experience

   in Data Engineering or a similar role.
• Proficient in 

  Python

  , with strong experience in libraries like 

  Pandas

   and 

  NumPy

  .
• Advanced SQL skills, including query optimization and data modeling.
• Experience working with 

  relational databases

   (e.g., PostgreSQL, MySQL, SQL Server) and/or 

  data warehouses

   (e.g., Snowflake, Redshift, BigQuery).
• Strong understanding of 

  data structures

  , 

  data modeling

  , and 

  ETL processes

  .
• Experience with version control tools like 

  Git

  .
• Familiarity with 

  cloud platforms

   (AWS, GCP, or Azure) is a plus.
• Experience with workflow orchestration tools (e.g., 

  Airflow

  , 

  Luigi

  ) is a plus.
• Strong problem-solving skills and attention to detail.
• Excellent communication and teamwork skills.

Preferred Qualifications:

• Bachelor's or Master's degree in 

  Computer Science

  , 

  Engineering

  , 

  Data Science

  , or a related field.
• Experience with 

  data lakes

  , 

  big data tools

   (Spark, Hadoop), or 

  streaming technologies

   (Kafka, Kinesis) is a bonus.
• Familiarity with dashboarding/BI tools (e.g., Tableau, Power BI) is a plus.