Posted:3 days ago|
Platform:
Work from Office
Full Time
Responsibilities
• Create, implement and operate the strategy for robust and scalable data pipelines for business intelligence and machine learning.
• Develop and maintain core data framework and key infrastructures
• Create and support the ETL pipeline to get the data flowing correctly from the existing and new sources to our data warehouse.
• Data Warehouse design and data modelling for efficient and cost effective reporting
• Collaborate with data analysts, data scientists, and other data consumers within the business to manage the data warehouse table structure and optimize it for reporting.
• Constantly striving to improve software development process and team productivity
• Define and implement Data Governance processes related to data discovery, lineage, access control and quality assurance
• Perform code reviews and QA data imported by various processes
• • Qualifications
• 3-5 years of experience.
• At least 2+ years of experience in data engineering and data infrastructure space on any of the big data technologies: Hive, Spark, Pyspark(Batch and Streaming), Airflow, Redshift and Delta Lake.
• Experience in product based companies or startups.
• Strong understanding of data warehousing concepts and the data ecosystem.
• Strong Design/Architecture experience architecting, developing, and maintaining solutions in AWS.
• Experience building data pipelines and managing the pipelines after theyre deployed.
• Experience with building data pipeline from business applications using APIs.
• Previous experience in Databricks is a big plus.
• Understanding of Dev Ops would be preferable though not a must
• Working knowledge of BI Tools like Metabase, Power BI is plus
• Experience of architecting systems for data access is a major plus.
Mobile Programming
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Instantly access job listings, apply easily, and track applications.
hyderabad, pune, bengaluru
15.0 - 30.0 Lacs P.A.
noida, hyderabad, chennai
7.5 - 17.5 Lacs P.A.
nagpur, pune, chennai
12.0 - 22.0 Lacs P.A.
hyderabad, bengaluru
11.0 - 21.0 Lacs P.A.
hyderabad, chennai, bengaluru
16.0 - 31.0 Lacs P.A.
chennai, bengaluru
20.0 - 35.0 Lacs P.A.
hyderabad
10.0 - 20.0 Lacs P.A.
hyderabad, chennai
14.0 - 24.0 Lacs P.A.
noida, new delhi, gurugram
10.0 - 14.0 Lacs P.A.
bengaluru
0.5 - 1.0 Lacs P.A.
