Data Engineer (AWS & Python) Clairvoyant India

5.0 - 10.0 years

10 - 20 Lacs

Hyderabad, Pune, Gurugram

Hybrid

Role: Data Engineer Experience: 5+ Years Location: Pune, Gurgaon & Bangalore Hybrid Shift Time: 12:00 PM - 10:00 PM Must have: Experience working in AWS, Redshift, Python Prior exposure to Data Ingestion and Curation work (such as working with Data Lakehouse) Knowledge in SQL for purpose of data analysis/investigation Help and support the Data Product Owner) to manage and deliver on the product technical roadmap Ability to digest and understand what the data is, how it is derived, meaning/context around the data itself and how the data fits into NFLs data model Working knowledge of Confluence and JIRA Good to have: Masters degree in computer science, statistics, or related discipline 5+ years as a data/business analyst or business intelligence developer/analytics engineer Proficiency and/or certification in Cloud Data Technologies Hands on experience on API Integration and One Trust Comfortable making decisions and leading Familiar with version control and relational databases Superior communication skills both oral and written Positive contributor, strong team member, loves to work with and empower others Collaborates with a team Time management skills Project management skills Responsibilities: Develop data pipeline using python, SQL on AWS platform. Document and capture the use cases, business logics/rules for the assigned data domains and also working with Data Analyst and Data Product Owners across domains to ensure alignment across the entire data platform. Gather and capture the technical specifications for the incorporation of a variety of data sources into the model and working with internal and external partners and vendor to understand and capture the integration method and pattern. Ensure Specifications covers various aspect of how to integrate the data including any transformations/logics required for data validation, standardizations, curations and reporting to fulfil the relevant use cases Work with internal stakeholders to define and capture any fulfilment requirements such as outbound data deliveries, reporting and metrics. Provide support during UAT and release management tasks such as smoke testing against requirements. Prioritize to manage ad-hoc requests in parallel with ongoing sprints Participate with the team to execute sound solutions and approaches to meet business expectations in an efficient manner; Work with Data Engineers, Data Architects, Data Governance and QA to create and review the pipelines, data ingestion, storage, wrangling, cataloguing, quality, curation of various data sources. Work with the Data Product Owners to help manage and deliver on the product technical roadmap for the data platform Experienced with Scrum and Agile Methodologies to coordinate global delivery teams, run scrum ceremonies, manage backlog items, and handle escalations Work with the Data Product Owners to help manage and deliver on the product technical roadmap for the data platform Education: BE/B.Tech/MS/M.Tech/ME from reputed institute. Every individual comes with a different set of skills and qualities so even if you dont tick all the boxes for the role today, we urge you to apply as there might be a suitable/unique role for you tomorrow!

Posted 2 weeks ago

Apply

Azure Data Engineer NTT DATA Business Solutions

8.0 - 12.0 years

18 - 27 Lacs

Hyderabad, Bengaluru, Delhi / NCR

Work from Office

Job Description: Design, implement, and maintain data pipelines and data integration solutions using Azure Synapse Develop and optimize data models and data storage solutions on Azure Collaborate with data scientists and analysts to implement data processing and data transformation tasks. Ensure data quality and integrity through data validation and cleansing methodologies. Monitor and troubleshoot data pipelines to identify and resolve performance issues Collaborate with cross-functional teams to understand and prioritize data requirements. Stay up-to-date with the latest trends and technologies in data engineering and Azure services. Skills & Qualifications: Bachelors degree in IT, computer science, computer engineering, or similar 8+ years of experience in Data Engineering. Microsoft Azure Synapse Analytics experience is essential. (Azure Data Factory, Dedicated SQL Pool, Lake Database, Azure Storage) Hands on experience in Spark notebooks(python or Scala) is mandatory End-to-end Data Warehouse experience: Ingestion, ETL, big data pipelines, data architecture, message queuing, BI/Reporting, and Data Security. Advanced SQL/relational database knowledge and query authoring. Demonstrated experience in design and delivering data platforms for Business Intelligence and Data Warehouse. Strong skills in handling and analysing complex, high volume data with excellent attention in details. Knowledge of data modelling and data warehousing concepts, such as DataVault or 3NF. Experience with Data Governance (Quality, Lineage, Data dictionary, and Security). Familiar with Agile methodology and Agile working environment. Ability to work alone with POs, BAs, Architects.

Posted 3 weeks ago

Apply

Data Engineer Talentico Consultancy Services

5.0 - 10.0 years

8 - 18 Lacs

Bengaluru

Work from Office

Data Engineers/ Analysts that can create the data models for Apromore Ingestion

Posted 1 month ago

Apply

Data Engineer-Palantir Infinityquest It Services

5.0 - 10.0 years

12 - 22 Lacs

Bengaluru

Remote

Role & responsibilities Technical Capability Foundry Certified (Data Engineering) Foundry Certified (Foundational) Microsoft Certified (Azure AI Fundamentals) Microsoft Certified: Azure Fundamentals Microsoft Certified: Azure Data Engineer Associate Ontology Manager Pipeline Builder Data Linerage Object Explorer SQL Python & Scala Good knowledge of Azure cloud & ADF & Databricks Spark (Pyspark & Scala Spark) Troubleshooting jobs & finding the root cause of the issue Advanced ETL pipeline design for data ingestion & egress for batch dataFoundry Certified (Data Engineering) Experience 4+ Soft Skills Good communication skills Good documentation skills for drafting problem definition and solution Ability to work independently with very little supervision, including engagement with product managers and technical/domain experts Ability to effectively gather requirements and propose solution design SFIA Score Preferred candidate profile

Posted 1 month ago

Apply

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.