17 Sparkpyspark Jobs

Role Overview: As a Data Engineer / Developer (Pipelines & Analytics) at NTT DATA in Bangalore, Karnataka, India, your role will involve implementing and supporting data ingestion, transformation, and serving components. You will contribute to batch/real-time analytics delivery with a focus on quality and compliance. Key Responsibilities: - Develop ETL/ELT code using Informatica or Spark/PySpark - Build ADF/Glue activities and jobs - Write robust SQL for cleansing, enrichment, and modeling - Assist with dimensional/Data Vault artifacts - Prepare and publish curated tables/datasets for Power BI, Tableau, SSRS/SSAS - Document lineage and data contracts - Implement data validation checks follow...

As a Senior Software Engineer or Senior Developer in the Data Team at Cerence AI, your role will be crucial in ensuring the accuracy and relevance of named entities such as artists, music, or movies for speech recognition, NLU, and AI models. You will be responsible for extracting content from databases, developing and maintaining data pipelines, and contributing to the advancement of research tools. Your work will have a direct impact on the performance and organization of data systems. **Key Responsibilities:** - Process text in multiple languages - Extract content from databases - Implement CI/CD for data pipelines - Develop web scrapers and spiders - Create research tools - Test and moni...

As an Azure Data Engineer Manager at EY GDS Data and Analytics, your role involves developing and deploying Azure Databricks in a cloud environment using Azure Cloud services. You will be responsible for ETL design, development, and deployment to Cloud Service, as well as interacting with Onshore to understand their business goals and contribute to the delivery of the workstreams. Additionally, you will design and optimize model codes for faster execution, lead and mentor a team of data engineers and analysts, and collaborate with cross-functional teams to manage project timelines and deliverables. **Key Responsibilities:** - Develop & deploy Azure Databricks in a cloud environment using Azu...

As an Azure Data Engineer - Manager at EY GDS Data and Analytics (D&A), your role involves developing and deploying Azure Databricks in a cloud environment using Azure Cloud services, ETL design, development, and deployment to Cloud Service, interacting with Onshore teams to understand their business goals, contributing to workstreams delivery, designing and optimizing model codes for faster execution, leading and mentoring a team of data engineers and analysts, ensuring high-quality delivery, and collaborating with cross-functional teams to manage project timelines and deliverables. Your key responsibilities include: - Develop & deploy Azure Databricks in a cloud environment using Azure Clo...

As an AI/ML Data Scientist in the Group Control Quantitative Analytics team at Barclays, you will play a crucial role in driving innovation and excellence in the digital landscape. Your main responsibilities will include: - Spearheading the evolution of digital offerings by harnessing cutting-edge technology. - Developing and managing AI/ML/GenAI models, including governance and regular model monitoring. - Providing analytical support across various areas such as Fraud, Financial Crime, Customer Due Diligence, Controls, and Security within Barclays. To be successful in this role, you should possess the following key skillsets: - Proficiency in Python Programming, SQL, Spark/PySpark, and Devo...

At EY, you'll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we're counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. Role Overview: As an EY GDS Data and Analytics (D&A) Snowflake Data Engineer- Senior, you will be part of a leading firm and a growing Data and Analytics team. You should have strong technology and data understanding in the data engineering space with proven delivery capability. Key Responsibilities: - 7+ years of experience in data engineeri...

As an AI/ML Data Scientist in Group Control Quantitative Analytics team at Barclays, you will play a vital role in driving innovation and excellence in the digital landscape. Your responsibilities will include harnessing cutting-edge technology to revolutionize digital offerings and ensure unparalleled customer experiences. **Key Responsibilities:** - Provide project specific leadership in building targeting solutions that integrate effectively into existing systems and processes while delivering strong and consistent performance. - Offer expertise in project design, predictive model development, validation, monitoring, tracking, and implementation. - Utilize Python Programming, knowledge of...

As a "Control Data Analytics and Reporting" at Barclays, you will play a crucial role in driving innovation and excellence in the digital landscape. Your primary responsibility will be to monitor predictive models developed using Machine Learning. To be successful in this role, you should have experience with: - Python Programming - SAS - Knowledge of Machine Learning algorithms - SQL - Spark/PySpark - Predictive Model development - Model lifecycle and model management including monitoring, governance, and implementation - Devops tools like Git/Bitbucket, JIRA Some additional skills that are highly valued include: - DevOps tools like Team City, Jenkins - Knowledge of Financial/Banking Domain...

As a Data Science Lead specializing in AI and Generative AI Solutions, your role will involve designing, developing, and deploying production-grade AI solutions leveraging modern ML pipelines, open-source LLMs, and cloud-based data platforms. Your responsibilities will include: - Designing and implementing end-to-end ML and GenAI solutions, covering data collection, model training, deployment, and monitoring. - Building production-grade ML pipelines for data preprocessing, feature engineering, model building, validation, and performance tuning. - Developing Generative AI applications using open-source LLMs and cloud-based platforms. - Working with Computer Vision and Core ML frameworks for r...

As a Senior Data Engineer at Novartis, you will play a crucial role in leading the technical foundation of AI-powered commercial solutions. Your work will contribute to driving more effective engagement, access, and performance globally and within local markets. **Roles and Responsibilities:** - Lead the design, development, and deployment of scalable, production-grade data pipelines for commercial AI products. - Manage technical delivery from vendor partners, ensuring high-quality output aligned with Novartis standards, timelines, and budgets. - Serve as a bridge between business stakeholders and engineering, translating business needs into actionable data solutions. - Integrate and harmoni...

As a Data Scientist AI/ML - AVP at Barclays in the Group Control Quantitative Analytics team, you will play a crucial role in driving innovation and excellence by spearheading the evolution of the digital landscape. Your primary focus will be on utilizing cutting-edge technology to revolutionize digital offerings, ensuring unparalleled customer experiences. Key Responsibilities: - Design analytics and modelling solutions to complex business problems using your domain expertise. - Collaborate with technology to specify any dependencies required for analytical solutions, such as data, development environments, and tools. - Develop high-performing, comprehensively documented analytics and model...

As a Senior Data Engineer at Novartis, you will play a pivotal role within the Data & Digital Commercial organization, leading the technical foundation of AI-powered commercial solutions. Your contributions will be instrumental in driving more effective engagement, access, and performance both globally and within local markets. Your responsibilities will include designing, developing, and deploying scalable, production-grade data pipelines for commercial AI products. You will oversee the technical delivery from vendor partners, ensuring high-quality output that aligns with Novartis standards, timelines, and budgets. Acting as a liaison between business stakeholders and engineering teams, you...

Embark on a transformative journey as a Vice President (VP) Data Scientist specializing in Artificial Intelligence (AI) and Machine Learning (ML) at Barclays within the Group Control Quantitative Analytics team. In this role, you will lead the advancement of the digital landscape, fostering innovation and ensuring exceptional customer experiences through the utilization of cutting-edge technology. The Group Control Quantitative Analytics (GCQA) team is a globally renowned organization comprising highly skilled data scientists dedicated to AI, ML, and Gen AI model development, management, governance, and monitoring. Under the leadership of Lee Gregory, the Chief Data and Analytics Officer (CD...

Embark on a transformative journey as a Data Scientist AI/ML - AVP at Barclays in the Group Control Quantitative Analytics team, where you'll spearhead the evolution of our digital landscape, driving innovation and excellence. You'll harness cutting-edge technology to revolutionize our digital offerings, ensuring unparalleled customer experiences. Group Control Quantitative Analytics (GCQA) is a global organization of highly specialized data scientists working on Artificial Intelligence, Machine Learning, and Gen AI model development and model management including governance and monitoring. GCQA is led by Remi Cuchillo under Lee Gregory, who is Chief Data and Analytics Officer (CDAO) in Grou...

As a Data Scientist AI/ML at Barclays in the Group Control Quantitative Analytics team, you will embark on a transformative journey driving innovation and excellence in our digital landscape. Your role will involve harnessing cutting-edge technology to revolutionize digital offerings, ensuring unparalleled customer experiences. Group Control Quantitative Analytics (GCQA) is a global organization of highly specialized data scientists focusing on Artificial Intelligence, Machine Learning, and Gen AI model development, governance, and monitoring. Led by Remi Cuchillo under Lee Gregory, the Chief Data and Analytics Officer (CDAO) in Group Control, GCQA is responsible for developing and managing ...

Embark on a transformative journey as a Data Scientist AI/ML at Barclays in the Group Control Quantitative Analytics team, where you'll spearhead the evolution of the digital landscape, driving innovation and excellence. You'll harness cutting-edge technology to revolutionize digital offerings, ensuring unparalleled customer experiences. Group Control Quantitative Analytics (GCQA) is a global organization of highly specialized data scientists working on Artificial Intelligence, Machine Learning, and Gen AI model development and model management, including governance and monitoring. GCQA, led by Remi Cuchillo under Lee Gregory, Chief Data and Analytics Officer (CDAO) in Group Control, is resp...

You have 10 to 18 years of relevant experience in Data Science. As a Data Scientist, your responsibilities will include modeling and data processing using Scala Spark/PySpark. You should have expert level knowledge of Python for data science purposes. Additionally, you will be required to work on data science concepts, model building using sklearn/PyTorch, and Graph Analytics using networkX, Neo4j, or similar graph databases. Experience in model deployment and monitoring (MLOps) is also desirable. The required skills for this Data Science position include: - Data Science - Python - Scala - Spark/PySpark - MLOps - GraphDB - Neo4j - NetworkX Our hiring process consists of the following steps: ...