Data Engineer 2

About PHENOM:

PHENOM is a global HR tech company that is revolutionizing the talent experience. Our AI-powered platform helps companies hire fa

ster, develop better, and retain longer. Were a passionate team-building solutions that empower candidates, recruiters, managers, and employees with meaningful, data-driven insights.

Phenom People is looking for bright and motivated Data Engineers to play a key role in building the next generation Enterprise Data Lake. The ideal candidate will be passionate about building extremely large, scalable Data Lake on cloud and will want to be part of a team that has accepted the goal to provide data driven innovations at Phenom. We are one of fastest growing global Talent Relationship Marketing Cloud Platform with strong technology orientation.

Responsibilities

• Translate business and functional requirements into robust, scalable solutions that work well within the overall data architecture.

• Develops and maintains scalable data pipelines and builds new API integrations.

• Design, develop, implement, test, document, and operate large scale, high volume and low latency applications.

• Design data integrations and data quality framework.

• Participate in the full development life cycle, end-to-end, from design, implementation and testing, to documentation, delivery, support,

and maintaince

• Experience in working and delivering end-to-end projects independently.

Work Experience

Must have

• Excellent knowledge in Python programming.

• 5+ Years development experience in big data using Spark.

• Experience with Dimension Modeling, Data Warehousing, and building ETL pipelines

• Strong expertise in SQL and experience in writing complex SQLs.

• Knowledge building stream processing platforms using Kafka, Spark Streaming

Nice to have

• Knowledge of using job orchestration frameworks like Airflow, Oozie, Luigi, etc

• Experience with AWS services such as S3, EMR, RDS

• Good understanding of cloud data warehouses like Snowflake is an added advantage.

• Good understanding of SQL distribution engines like Presto, Druid

• Knowledge of Streaming processing frameworks like Flink etc.

• Knowledge of NoSQL databases like HBase, Cassandra etc.