Data Engineer

WHO WE ARE

Sapaad is a global leader in all-in-one unified commerce platforms, dedicated to delivering world-class software solutions. Its flagship product, Sapaad, has seen tremendous success in the last decade, with thousands of customers worldwide, and many more signing on.

Driven by a team of passionate developers and designers, Sapaad is constantly innovating, introducing cutting-edge features that reshape the industry. Headquartered in Singapore, with offices across five countries, Sapaad is backed by technology veterans with deep expertise in web, mobility, and e commerce, making it a key player in the tech landscape.

THE OPPORTUNITY

Sapaad PTE LTD is seeking a Data Engineer who will take charge of constructing our distributed processing and big data infrastructure, as well as the accompanying applications and tools. We're looking for someone with a fervent drive to tackle intricate data challenges and collaborate closely with the data team, all while staying abreast of the latest features and tools in Big Data and Data Science.

The successful candidate will play a pivotal role in supporting software developers, data architects, data analysts, and data scientists in various data initiatives. He/She will ensure the smooth and efficient delivery of data across ongoing projects. We require an individual who is self-directed and capable of adeptly managing the data requirements of multiple teams, systems, and products.

ROLES AND RESPONSIBILITIES

• Create and maintain optimal data pipeline architecture.
• Assemble large, complex data sets that meet functional / non-functional business requirements.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies.
• Build analytics tools that utilize the data pipeline to provide actionable insights into key business performance metrics.
• Work with stakeholders including the Executive, Product, Data Architects, and Design teams to assist with data-related technical issues and support their data infrastructure needs.
• To keep the data separated and secure.
• Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
• Work with data and analytics experts to strive for greater functionality in our data systems.

ROLE REQUIREMENTS

• Candidate with 2 to 7 years of experience in a Data Engineer role, who has attained a Graduate degree in Computer Science, IT or Statistics, or another quantitative field.
• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
• Experience building and optimizing ‘big data’ data pipelines, architectures, and data sets.
• Strong analytic skills related to working with unstructured datasets.
• Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
• Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
• Good communication skills and team player.
• Experience supporting and working with cross-functional teams in a dynamic environment.
• Preferred to have experience using the following software/tools:

Experience with big data tools: Hadoop, Spark, Kafka, etc.

Experience with relational SQL and NoSQL databases.

Experience with data pipeline / ETL tools like Informatica, DataStage, and with any cloud tool like Azure Data Factory (ADF), etc.

Experience with data engineering on cloud services like Azure, AWS, or GCP.

Experience with stream-processing systems: Storm, Spark-Streaming, etc.

Experience with object-oriented/object function scripting languages: Python, Java, Scala, etc.