Lead Data Engineer

Job Description

We are seeking a highly motivated and experienced Lead Data Engineer to join our growing engineering team. In this role, you will be a key contributor to building and scaling our data infrastructure, ensuring data quality, and enabling real-time analytics for our platform. You will work closely with engineers and product managers to deliver impactful solutions that drive business growth. Key Focus Areas Develop and maintain scalable backend services and APIs for our applications powe'red by real-time databases. Architect and implement data pipelines for ingestion, processing, and storage leveraging cloud services, preferably AWS. Set up, manage, and optimize Apache Pinot for real-time analytics, including schema design, indexing strategies, and query tuning. Design and implement data lake strategies for storing and accessing raw and processed data. Implement data quality and anomaly checks and monitoring across backend and data pipelines. Develop and maintain ETL processes, integrating them with backend services. Optimize data models and storage for performance and efficiency. Contribute to data infrastructure design, focusing on scalability and fault tolerance. Troubleshoot and resolve data-related issues in backend and pipelines. Stay current with backend and data engineering trends. Participate in code reviews and improve engineering practices. Contribute to automated testing and deployment processes. About You 5 8 years of experience in data engineering. Strong understanding of data engineering concepts, including data architecture, pipeline design, data modeling, and data quality. Proficiency in SQL and experience with relational databases. Experience with Python and data processing libraries (eg, Pandas). Experience with real-time analytics platforms (eg, Apache Pinot/Druid) is highly desired. Experience with ETL tools and processes, including Fivetran or similar platforms. Experience with cloud platforms (eg, AWS, GCP, Azure) is a plus. Strong problem-solving and debugging skills. Excellent communication and collaboration skills. Bachelors degree in Computer Science or a related field. Bonus Skills (Nice-to-Have) Experience with streaming technologies (eg, Kafka, Flink). Experience setting up and managing open-source data tools (eg, Superset, Redash, Airflow). Experience with monitoring and alerting tools (eg, Prometheus, Datadog). Contributions to open-source projects. What s in it for You A we'll-deserved compensation package that recognizes your skills and contributions. Opportunity to share in the companys success through equity ownership. Work with hand-picked individuals who are experts in their domains and passionate about the product. Contribute to a rapidly growing product used by thousands of businesses globally. Flexible work options, including in-office and remote work for optimal work-life balance. Comprehensive health insurance coverage for you and your family. Dedicated mental health support, fostering a nurturing workplace environment