Data Engineer

Job Role :

As a Data Engineer, you'll build and maintain data pipelines and architectures.Responsibilities include optimizing databases and ETL processes, using Python or SQL,and collaborating with data teams for informed decision-making.

Whats in it for you?

• You will work on diverse technology challenges like:
• A robust distributed platform to manage a self-healing swarm of bots onunreliable network / compute
• Large-scale Cloud-Native applications
• Document Comprehension Engine leveraging RNN and other latest OCR techniques
• Completely data-driven low-code platform
• You will leverage cutting-edge technologies like Blockchain, IoT, and Data Science as you work on projects for leading Silicon Valley startups.
• Your role does not start or end with just Java development; you will enjoy the freedom to share your suggestions on the choice of tech stacks across the length of the project
• If there is a certain technology you would like to explore, you can do your Technical PoCs
• Work in a culture that values capability over experience and continuous learning as a core tenet

Here’s what you’ll bring

• Proficiency in SQL and experience with database technologies (e.g., MySQL,  PostgreSQL, SQL Server).Experience in any one of the cloud environments – AWS, Azure
• Experience with data modeling, data warehousing, and building ETL pipelines.
• Experience building large-scale data pipelines and data-centric applications using any distributed storage platform
• Experience in data processing tools like Pandas, pyspark.
• Experience in cloud services like S3, Lambda, SQS, Redshift, Azure Data Factory, ADLS, Function Apps, etc.
• Expertise in one or more high-level languages (Python/Scala)
• Ability to handle large-scale structured and unstructured data from internal and third-party sources
• Ability to collaborate with analytics and business teams to improve data models that feed business intelligence tools, increase data accessibility, and foster data-driven decision-making across the organization
• Experience with data visualization tools like PowerBI, Tableau
• Experience in containerization technologies like Docker , Kubernetes