62 Bigdata Frameworks Jobs

We await your innovation at TCS: Hiring | Data Engineer - Scala | Greetings from TCS!! We are Hiring for Data Engineer - Scala Required Experience: 5-10 years Work location: Chennai/Pune/Bangalore/Hyd/Delhi Responsibilities: 1) Should be able to design strategies and programs to collect, store, analyse and visualize data from various sources. 2) Should be able to develop big data solution recommendations and ensure implementation of the chosen big data solution. 3) Needs to be able to program, preferably in different programming/scripting languages such as Scala, Python, Java, Pig or SQL. 4) Proficient knowledge in Big data frameworks Spark, Map Reduce, 5) Should have an understanding of Had...

Roles and Responsibilities : Design, develop, test, deploy and maintain large-scale distributed systems using Scala/Spark/Hadoop technologies. Collaborate with cross-functional teams to identify business requirements and design scalable solutions that meet those needs. Develop high-quality code by following best practices in software development, testing, and debugging techniques. Troubleshoot complex issues related to system performance, reliability, and security. Job Requirements : 9-14 years of experience in backend development with expertise in Scala/Scala programming language. Strong understanding of Big Data frameworks such as Spark/Hive/Hadoop Distributed File System (HDFS). Experienc...

Mandatory Skills- Python Developer with 1. Experience with Big Data Environment 2. Hands on coding in Python, Spark, Hive. Interested candidates can share their update resume on JP00833298@techmahindra.com along with below details Total Experience- Relevant Experience- Current company - Notice period- Current Location - Preferred Location- Current CTC- Expected CTC- Regards, Talent Acquisition Group Noida JP00833298@TechMahindra.com

Main purpose: Act as the Data Architect to ensure the delivery of all commitments on time and in high quality. Manage the data model and schema Work closely with product and engineering teams to provide evaluation and recommendations of design patterns and solutions for data platforms with a focus on Graph based CDP, ETL and Lambda architectures Provide technical inputs to agile processes, such as epic, story, and task definition to resolve issues and remove barriers throughout the lifecycle of client engagements Work with the Marcels data, product and engineering teams to deliver on all requests pertaining to Data, Features, Graph Schema, Feeds and Integrations, Data Science Models and othe...

Basic Qualification 6+ years of related work experience. Strong hands-on programming experience in at least one modern language (Java, Python) and Big Data frameworks (Spark or Kafka) Strong hold on system design and ability to develop highly reliable, fault-tolerant distributed applications with a heavy emphasis on performance and scale in the Cloud. Demonstrated understanding of fast-paced Agile principles with technical designs, iterative development, and code reviews. Well-versed with building high quality software using the industry proven practices 12 factor app, reactive manifesto, and CI/CD. Building microservices using Spring/Spring-boot framework including Spring JPA, Spring Batch,...

POSITION: Java Technical Lead Java Technical Lead (Java 17 & Big Data Focus) Overview We are seeking a seasoned and hands-on Java Technical Lead to drive the development and architecture of our enterprise solutions, with a strong emphasis on Big Data processing and backend services. This role demands expertise in the latest Java ecosystem combined with extensive experience in Big Data frameworks and distributed systems. Java Technical Lead (Java 17 & Big Data Focus) Overview We are seeking a seasoned and hands-on Java Technical Lead to drive the development and architecture of our enterprise solutions, with a strong emphasis on Big Data processing and backend services. This role demands expe...

Basic Qualification : 5+ years of related work experience. Strong hands-on programming experience in at least one modern language (Java, Python) and Big Data frameworks (Spark or Kafka) Strong hold on system design and ability to develop highly reliable, fault-tolerant distributed applications with a heavy emphasis on performance and scale in the Cloud. Demonstrated understanding of fast-paced Agile principles with technical designs, iterative development, and code reviews. Well-versed with building high quality software using the industry proven practices 12 factor app, reactive manifesto, and CI/CD. Building microservices using Spring/Spring-boot framework including Spring JPA, Spring Batc...

Job Summary We are seeking a highly skilled Technical Architect with deep expertise in Big Data technologies and AWS Cloud services. The ideal candidate will lead the design and implementation of scalable, secure, and high-performance data solutions using Python, PySpark, Spark, Hive, AWS EMR, and AWS Glue. This role requires strong leadership, architectural vision, and hands-on technical proficiency. We are looking for immediate joiner or (Max 15 Day NP) Multiple Location - Indore/Pune/Hyderabad/Noida/Gurgaon/Bangalore Key Responsibilities Architect and design end-to-end Big Data solutions on AWS Cloud Lead development of scalable data pipelines using PySpark, Spark, and Hive Optimize perfo...

Job Summary: We are seeking a highly experienced and dynamic lead Oracle Database Administrator with a strong leadership presence and a passion for innovation. The ideal candidate will bring deep technical expertise in Oracle technologies, performance tuning( application and database), and modern data ecosystems, along with a forward-looking mindset toward AI and cloud-native architectures. Key Responsibilities: Lead the design, implementation, administration of Oracle Exadata Cloud@Customer (ExaCC), RAC, Data Guard, and GoldenGate environments. Drive performance tuning initiatives across databases and applications, ensuring optimal system performance and scalability. Develop and maintain co...

Title and Summary Sr Data Engineer (ML Knowledge)Our PurposeWe work to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart and accessible Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments and businesses realize their greatest potential Our decency quotient, or DQ, drives our culture and everything we do inside and outside of our company We cultivate a culture of inclusion for all employees that respects their individual strengths, views, and experiences We believe that our differences enable us to be a better team one that makes...

Overview: As a Sr Data Engineer of the AICOE team, you will develop analytical products and solutions that sit atop vast datasets gathered by retail stores, restaurants, banks, and other consumer-focused companies The challenge will be to create high-performance algorithms built on data sets measured in the billions of transactions that allow our users to derive insights from big data that in turn drive their businesses with a keen eye for data privacy and governance Role :- Leads talent acquisition efforts and initiatives, facilitates training programs and conducts performance management for team of direct reports Lead teams in the creation of portfolio robust ML solutions through effective...

Overview The Loyalty Offers team is looking for a Principal Software Engineer to drive our architecture design & strategy forward by consistently innovating and problem-solving. As a Principal Software Engineer, you will play a critical role in leading the design of our next generation regional and global solutions. You will have the opportunity to work on complex and innovative projects, collaborating with cross-functional teams to drive technical excellence & proactively adding scalability while continuing to add enhanced value to these products. Role: 1.Hands on designing Code, document, components subsystems to a high standard 2.Must be solutions oriented ultimately find and implement th...

Role & responsibilities Deliver high-quality technical solutions and guide the team through all phases of Test Automation. Collaborate with cross-functional teams to understand business requirements and translate them into technical deliverables. Ensure adherence to best practices in coding, testing, and deployment. Utilize AI tools like MCP Server and GitHub Copilot to enhance productivity and solution quality. Work closely with stakeholders to ensure timely delivery of project milestones. Design, develop and maintain automated test scripts for web UI, RESTful APIs and Data testing. Use Playwright with Python for end-to-end UI automation. Leverage Playwright/Requests for API test automation...

Project description We've been engaged by an Investment Banking client in the Corporate, Commercial and Institutional Banking (CCIB) potfolio to work on the projects for managing analytics support for all the key initiatives of all segments/products . Responsibilities Choosing the right technologies for our use cases, deploy and operate. Setting up Data stores structured, semi structured and non-structured. Secure data at rest via encryption Implement tool to access securely multiple data sources Implement solutions to run real-time analytics Use container technologies Skills Must have 6+ years of relevant technology experience Programming Skills: Strong proficiency in Java or Scala. Solid u...

Work on Apple Maps, developing tools to analyze, visualize, process, manage, and curate large-scale geospatial data. Build scalable, distributed systems that process geospatial data at scale. Collaborate with cross-functional teams to improve the Maps Platform. Key Responsibilities: Design and develop large-scale distributed systems for geospatial data processing. Analyze large datasets to identify and resolve map errors. Implement complex algorithms and integrate solutions into production pipelines. Work with engineering and analyst teams to ensure performance, scalability, and reliability. Key Qualifications: 3+ years of experience in software product development building modern, scalable ...

Role Description: We are looking for an Associate Data Engineer with deep expertise in writing data pipelines to build scalable, high-performance data solutions. The ideal candidate will be responsible for developing, optimizing and maintaining complex data pipelines, integration frameworks, and metadata-driven architectures that enable seamless access and analytics. This role prefers deep understanding of the big data processing, distributed computing, data modeling, and governance frameworks to support self-service analytics, AI-driven insights, and enterprise-wide data management. Roles & Responsibilities: Data Engineer who owns development of complex ETL/ELT data pipelines to process lar...

Overview: As a Sr Data Engineer of the AICOE team, you will develop analytical products and solutions that sit atop vast datasets gathered by retail stores, restaurants, banks, and other consumer-focused companies The challenge will be to create high-performance algorithms built on data sets measured in the billions of transactions that allow our users to derive insights from big data that in turn drive their businesses with a keen eye for data privacy and governance Role :- Leads talent acquisition efforts and initiatives, facilitates training programs and conducts performance management for team of direct reports Lead teams in the creation of portfolio robust ML solutions through effective...

C1X AdTech Pvt Ltd is a fast-growing, product and engineering-driven AdTech company building next-generation advertising and marketing technology platforms. Our mission is to empower enterprise clients with the smartest marketing solutions, enabling seamless integration with personalization engines and delivering cross-channel marketing capabilities. We are dedicated to enhancing customer engagement and experiences while focusing on increasing Lifetime Value (LTV) through consistent messaging across all channels. Our engineering team spans front end (UI), back end (Java/Node.js APIs), Big Data, and DevOps, working together to deliver scalable, high-performance products for the digital advert...

Job Description Summary As a member of the GE Aerospace Digital Technology organization aligned to the Technology & Operations High Performance Computing as a Service (HPCaaS) team, this role will focus on providing excellent service to Engineering stakeholders while operating a quality production simulation engineering infrastructure environment to deliver critical outcomes. You will work with a global team of like-minded HPC professionals to ensure the stable, reliable performance of our products and services while inspiring evolution and continuous improvement in how we build, operate, monitor, maintain and secure our infrastructure for a globally consistent user experience. You will driv...

Position Overview We are seeking a skilled and experienced Senior PySpark Developer with expertise in Apache spark, Spark Batch, and Spark Streaming to join our dynamic team. The ideal candidate will design, develop, and maintain high-performance, scalable applications for processing large-scale data in batch and real-time environments. Required Skills and Qualifications Experience : 7+ years of professional experience in PySpark development. Technical Skills : Strong proficiency in PySpark Deep understanding of Apache Spark architecture, distributed computing concepts and parallel processing. Proven experience in building and optimizing complex ETL pipeline using PySpark Experience with var...

Dear Aspirant, Please find the below mentioned job details and if you are suitable to the below role. please share me updated resume to smouni@deloitte.com along with the below details. Skill: Bigdata Developer with AWS Experience: 4 to 10 years Job Locations: Hyderabad only Notice Period: Immediate to 30 days Details Required Name Skill Current Company Name Total years of experience Relevant Exp Current Location Preferred Location Notice Period Current CTC Expected CTC Regards Mounika S

Strong exp in Big Data & Data AnalyticsExperience in building robust ETL pipelines for batch as well as streaming ingestion. Expwith Palantir Foundry ETL type work with databases and Hadoop platforms databases (e.g. Oracle, mySQL, Microsoft SQL).

5+ years of experience in BI and analytics, with specific expertise in Google Looker

Data Bricks and Python Engineer Job Responsibilities 1. Software Development: - Design, develop, test, and deploy high-performance and scalable data solutions using Python,PySpark, SQL - Collaborate with cross-functional teams to understand business requirements and translate them into technical specifications. - Implement efficient and maintainable code using best practices and coding standards. 2. Databricks Platform: - Work with Databricks platform for big data processing and analytics. - Develop and maintain ETL processes using Databricks notebooks. - Implement and optimize data pipelines for data transformation and integration. 3. Continuous Learning: - Stay updated on the latest indust...

About Oracle FSGIU - Finergy: The Finergy division within Oracle FSGIU is dedicated to the Banking, Financial Services, and Insurance (BFSI) sector. We offer deep industry knowledge and expertise to address the complex financial needs of our clients. With proven methodologies that accelerate deployment and personalization tools that create loyal customers, Finergy has established itself as a leading provider of end-to-end banking solutions. Our single platform for a wide range of banking services enhances operational efficiency, and our expert consulting services ensure technology aligns with our clients' business goals. Job Summary: We are seeking a skilled Senior Data Migration Engineer wi...