Data Engineer

Be a part of a team that harnesses advanced AI, ML, and big data technologies to develop cutting-edge healthcare technology platform, delivering innovative business solutions.

Job Title

Job Location

Job Summary:

Responsibilities:

• Design, develop, and maintain robust and scalable ETL/ELT pipelines to ingest and transform large datasets from various sources.
• Optimize and manage databases (SQL/NoSQL) to ensure efficient data storage, retrieval, and manipulation for both structured and unstructured data.
• Collaborate with data scientists, analysts, and engineers to integrate data from disparate sources and ensure smooth data flow between systems.
• Implement and maintain data validation and monitoring processes to ensure data accuracy, consistency, and availability.
• Automate repetitive data engineering tasks and optimize data workflows for performance and scalability.
• Work closely with cross-functional teams to understand their data needs and provide solutions that help scale operations.
• Ensure proper documentation of data engineering processes, workflows, and infrastructure for easy maintenance and scalability

Roles and Responsibilities

• Design, develop, test, deploy, and maintain large-scale data pipelines using AWS services such as S3, Glue, Lambda, Step Functions.
  
• Collaborate with cross-functional teams to gather requirements and design solutions for complex data engineering projects.
  
• Develop ETL/ELT pipelines using Python scripts and SQL queries to extract insights from structured and unstructured data sources.
  
• Implement web scraping techniques to collect relevant data from various websites and APIs.
  
• Ensure high availability of the system by implementing monitoring tools like CloudWatch.

Desired Profile:

• Bachelors or Masters degree in Computer Science, Information Technology, or a related field.
• 3-5 years of hands-on experience as a Data Engineer or in a related data-driven role.
• Strong experience with ETL tools like Apache Airflow, Talend, or Informatica.
• Expertise in SQL and NoSQL databases (e.g., MySQL, PostgreSQL, MongoDB, Cassandra).
• Strong proficiency in Python, Scala, or Java for data manipulation and pipeline development.
• Experience with cloud-based platforms (AWS, Google Cloud, Azure) and their data services (e.g., S3, Redshift, BigQuery).
• Familiarity with big data processing frameworks such as Hadoop, Spark, or Flink.
• Experience in data warehousing concepts and building data models (e.g., Snowflake, Redshift).
• Understanding of data governance, data security best practices, and data privacy regulations (e.g., GDPR, HIPAA).
• Familiarity with version control systems like Git..

HiLabs is an equal opportunity employer (EOE). No job applicant or employee shall receive less favorable treatment or be disadvantaged because of their gender, marital or family status, color, race, ethnic origin, religion, disability, or age; nor be subject to less favorable treatment or be disadvantaged on any other basis prohibited by applicable law.

HiLabs is proud to be an equal opportunity workplace dedicated to pursuing and hiring a diverse and inclusive workforce to support individual growth and superior business results.

Thank you for reviewing this opportunity with HiLabs! If this position appears to be a good fit for your skillset, we welcome your application.