Data Management (AWS) developer / Data Engineer

Profile: Data Management (AWS) developer

Location: Pune/Bangalore

Experience: 5 to 10 years of experience

Overview

data catalogs, data quality management, and access management frameworks within our data lakehouse

Key Responsibilities

Integrate Acryl data catalog with AWS Glue data catalog to enhance data discoverability and management.

data classification and data quality rules in the data lakehouse.

Lake Formation access frameworks, including OpenID Connect (OIDC)

data quality and classification reports and visualizations

column-level data lineage in the data lakehouse

data stewards to ensure effective data ownership, cataloging, and metadata management.

Qualifications:

1.     Relevant experience in data management, data governance, or related technical fields.

AWS services, particularly in AWS Glue, Lake Formation, and data quality management tools.

OIDC and AWS IAM.

AWS Athena, Apache Airflow.

CDMP)

6.     Terraform, Github, Python,

Desired Skills:

§ Masters in IT or bachelor with 10+ year work experience. 

§ At least 5 years’ experience in cloud development

§ Strong analytical and problem-solving skills.

§ Ability to communicate technical concepts to non-technical stakeholders.

§ Understanding data modeling concepts (3NF, snowflake schemas, data vault).

§ Knowledge of various database technologies and data lifecycle management principles.

§ Familiarity with Open Table formats and streaming technologies (e.g., Confluent Kafka) is a plus.