Data Engineer , Analytics Architecture

1 - 4 years

16 - 20 Lacs

Posted:23 hours ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description

  • We are looking for a Data Engineer to join our Retail Analytics & Engineering team, focused on modernizing our data ecosystem by migrating legacy pipelines to Databricks and Prophecy, and driving business outcomes in planning, merchandising, and supply chain.
  • In this role, you will work closely with Retail business users and Cloud Engineering teams to re-engineer legacy data workflows, build scalable pipelines, and deliver high-performance data products supporting retail operations.
  • You will be responsible for both business-driven retail analytics use cases and technical platform migration and optimization, enabling our transition to a modern, cloud-native data architecture.
  • Essential Duties & Responsibilities
  • Retail Data Engineering:
  • Build scalable pipelines supporting key retail analytics use cases such as sales forecasting, demand planning, inventory optimization, and logistics tracking.
  • Integrate data from retail POS systems, eCommerce platforms, warehouse management systems, and 3PL providers.
  • Develop retail data models for product hierarchies, planning attributes, and merchandising KPIs.
  • Collaborate with Planning, Merchandising, and Supply Chain teams to translate business needs into data solutions.
  • Enable real-time and batch data flows to drive operational dashboards and planning cycles.
  • Cloud Migration & Platform Modernization:
  • Lead the migration of existing on-premise or legacy ETL pipelines to Databricks and Prophecy.
  • Re-architect pipelines for Spark-based execution, leveraging Databricks-native orchestration and Prophecy low-code development.
  • Optimize Databricks Spark jobs for performance, cost, and scalability across retail datasets.
  • Collaborate with platform teams to implement Unity Catalog, cluster policies, and CI/CD pipelines.
  • Build monitoring, validation, and data quality frameworks for production-ready pipelines.
  • General Engineering:
  • Conduct performance tuning, troubleshooting, and root cause analysis of production data pipelines.
  • Document migration patterns, retail data flows, and technical designs.
  • Stay current with industry best practices in data engineering, retail analytics, and cloud data platforms.
  • Experience, Skills & Knowledge
  • Education & Experience:
  • Proven experience in data engineering roles within a Retail, eCommerce, or Supply Chain domain.
  • Hands-on experience with Databricks, Spark, and Prophecy.io or similar data orchestration tools.
  • Experience migrating ETL pipelines from legacy platforms (Informatica, SSIS, Talend, Glue) to modern cloud environments.
  • Strong proficiency in Python, PySpark, and SQL.
  • Experience working with Retail ERP systems (SAP, D365, JDA) and logistics data feeds.
  • Familiarity with data modeling for retail hierarchies and planning processes.
  • Exposure to cloud platforms (AWS or Azure preferred) and cloud-native data services.
  • Experience with CI/CD for data pipelines and environment automation.
  • Strong analytical skills and ability to troubleshoot complex data issues.
  • Excellent communication and collaboration skills.

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Ralph Lauren logo
Ralph Lauren

Retail Apparel and Fashion

New York New York

RecommendedJobs for You