Senior Data Engineer

As a Data Engineer, you will be responsible for managing and optimizing data processes to ensure efficient data flow within the organization. You will utilize your 4+ years of experience to design and implement data solutions using SQL. Working hands-on with modern cloud data warehousing solutions such as Snowflake, Big Query, and Redshift is a key part of your role. Additionally, you will demonstrate expertise in ETL/ELT processes for batch and streaming data processing, troubleshoot data issues effectively, and propose solutions for data optimization. You will also apply your knowledge of AWS services including S3, DMS, Glue, and Athena. Familiarizing yourself with DBT for data transformation and modeling tasks and communicating fluently in English to collaborate effectively with team members are essential aspects of this role. Desired Qualifications and experience for the role include: - Hands-on experience with additional AWS services like EC2, ECS, EKS, VPC, and IAM. - Knowledge of Infrastructure as Code (IaC) tools such as Terraform and Terragrunt. - Proficiency in Python for executing data engineering tasks efficiently. - Experience with orchestration tools like Dagster, Airflow, or AWS Step Functions. - Familiarity with pub-sub, queuing, and streaming frameworks like AWS Kinesis, Kafka, SQS, and SNS. - Exposure to CI/CD pipelines and automation practices for data processes. Please note that proficiency in the mentioned skills such as SNS, Snowflake, Terraform, Big Query, Redshift, SQS, Dagster, CI, ETL, AWS Step Functions, ELT, CD, Python, AWS Kinesis, DMS, S3, Cloud, Airflow, CI/CD, DBT, Glue, Terragrunt, Kafka, SQL, Athena, and AWS will be essential for excelling in this role.,