Easyrewardz - Senior Data Engineer - Spark

About Easyrewardz

Key Responsibilities

• Architect, build, and maintain real-time and batch data pipelines using tools like Apache Spark, PySpark, RisingWave, Redpanda, and ScyllaDB.
• Develop and maintain data transformation and integration workflows using Python and Airflow.
• Design and orchestrate reliable ETL/ELT pipelines that ingest data from SDKs, APIs, webhooks, and third-party systems.
• Collaborate with product, analytics, and engineering teams to build scalable data solutions that support BI, customer analytics, and marketing automation.
• Optimize query performance and data storage using systems like ScyllaDB, MySQL, and cloud-native data lakes.
• Ensure high standards of data quality, validation, and lineage through monitoring and alerting frameworks.
• Work closely with DevOps to deploy resilient, cloud-native infrastructure to support scalable data systems.
• Mentor junior engineers and participate in the development of the teams technical strategy and roadmap.
  

Must-Have Skills

Programming & Scripting :

• Strong proficiency in Python, including PySpark for distributed data processing.
• Experience building scalable ETL/ELT workflows using Apache Airflow or similar orchestration tools.
  

Stream & Batch Processing

• Hands-on expertise with real-time data platforms such as Apache Spark, Kafka/Redpanda, RisingWave, or equivalent streaming solutions.
• Deep understanding of event-driven architecture and handling large-scale customer event data.
  

Data Engineering & Modeling

• Skilled in data modeling, working with distributed databases like ScyllaDB and Cassandra, and optimizing for performance and scalability.
• Proficient in working with SQL and NoSQL systems (e.g., MySQL, ScyllaDB) and cloud-native storage solutions.
  

Data Quality & Governance

• Strong grasp of data quality frameworks, automated testing, lineage, and data governance best practices.
  

Good-to-Have Skills

• Experience with marketing automation platforms or CRM systems (e.g., Braze, Salesforce, HubSpot).
• Familiarity with modern data tools like dbt, Snowflake, or Databricks.
• Working knowledge of n8n or other orchestration frameworks.
• Understanding of SDK-based event capture and retry mechanisms.
  

What We Offer

• Opportunity to shape the data strategy of one of Indias top Martech platforms.
• Collaborative work environment with a focus on innovation.
• Flexible work hours and remote-friendly setup.
• Attractive compensation and growth path.
  

Location :

Experience Required :

Department :