37 Apache Hadoop Jobs

Role Overview: As a Presales Specialist at Neysa, you will play a crucial role in engaging with customers to understand their technical requirements, design customized solutions, and drive successful technical engagements. Your responsibilities will include presenting complex technology solutions, creating compelling demonstrations, and assisting in converting sales opportunities. You will collaborate closely with the sales team to provide technical support, deliver presentations, conduct technical demonstrations, and facilitate workshops to uncover customer requirements. Key Responsibilities: - Work closely with customers to understand their business challenges and technical requirements, d...

You will be responsible for designing, developing, and supporting scalable ETL processes using open source tools and data frameworks such as AWS Glue, AWS Athena, Redshift, Apache Kafka, Apache Spark, Apache Airflow, and Pentaho Data Integration (PDI). Additionally, you will design, create, and maintain data lakes and data warehouse on the AWS cloud. Your role will involve maintaining and optimizing the data pipeline architecture, formulating complex SQL queries for big data processing, collaborating with product and engineering teams for designing a platform for data modeling and machine learning operations, implementing various data structures and algorithms, ensuring data privacy and comp...

As a Java developer at the company, your responsibilities will include: - Working with client developers & off-shore developers to deliver project tasks - Analyzing system domain and client requirements - Collaborating with the team to create and maintain a robust system supporting business with a focus on usability - Ensuring productivity and teamwork within the constraints of a planned project to complete necessary milestones - Solving challenging real-world problems using OOP & functional programming concepts - Writing production-grade backend code, SP, and upholding high code quality standards You must have the following qualifications: - Very strong knowledge in OOP and Core Java - Inhe...

As a Senior Data Engineer at Infogain, you will be responsible for leading the design and execution of the Dataproc to Databricks PySpark migration roadmap. Your role will involve defining a modernization strategy encompassing data ingestion, transformation, orchestration, and governance. Additionally, you will architect scalable solutions using Delta Lake and Unity Catalog, ensuring optimal performance and cost efficiency. Key Responsibilities: - Lead the design and execution of Dataproc to Databricks PySpark migration roadmap. - Define a modernization strategy for data ingestion, transformation, orchestration, and governance. - Architect scalable Delta Lake and Unity Catalog-based solution...

Scientific Innovation Senior Expert: Work with a team of AI researchers and SMEs with core domain expertise in applying AI to drug discovery. Work with AI modelers to ensure models are robust and performant Work with Engineering and Product Development resources to ensure delivery of AI solutions. Raise the awareness of AI applications to aid in answering key research questions across BR. Help position AI-aided drug discovery contributions to deliver and support progress of BRs portfolio, enable new kinds of therapeutic discoveries, shorten cycle times, and increase efficiency. Collaboration & partnership: Act as liaison of AICS for identification of research questions, solution design, and ...

Role & responsibilities •Strong expertise in Apache Spark (batch + streaming) and Hive. •Proficiency in Python, Scala, or Java. •Knowledge of orchestration tools (Airflow / Control-M) and SQL transformation frameworks (DBT preferred). •Experience working with Kafka, Solace, and object stores (S3, MinIO). •Exposure to Docker/Kubernetes for deployment. •Hands on experience of data Lakehouse formats (Iceberg, Delta Lake, Hudi). Thanks & Regards, Aziz Hussain Account Manager E: aziz.h@tekskills.in

• Experience on deploying shallow learning and deep learning models • Experience with Big Data Platform and cloud technologies • Building production grade Gen AI applications is a plus. • ML Design pattern, algorithm and the data structure skills

As a Senior Big Data Developer with expertise in PySpark and the Apache Big Data ecosystem, your role will involve designing, developing, and optimizing scalable data pipelines. You will collaborate with cross-functional teams to deliver reliable, high-performance data solutions. Your responsibilities will include: - Building and optimizing large-scale data processing pipelines using PySpark - Working with Apache Hadoop, Hive, HDFS, Spark, and other tools for managing big data workloads - Handling ETL development, data ingestion, transformation, and integration from various sources - Collaborating with Data Scientists, Analysts, and business stakeholders to deliver data-driven solutions - En...

Role Overview: As a Technology Practice Leader at our company, you will play a crucial role in enabling delivery scalability and leading the successful delivery of complex projects in the Application Performance Engineering, Application Performance Management, and Quality Assurance domain. You will be at the forefront of providing thought leadership and innovation to build a High-end Technology company that aims to be a Global leader in the P-A-S-S (performance, availability, scalability, and security) Assurance space. Your role will involve leading from the front, supporting the team, managing stakeholders, and ensuring successful account entry and downstream business with new customers. Ke...

Role Overview: At Improzo, we are looking for a highly skilled Data and Reporting Developer (Improzo Level - Associate) to join our dynamic team. As a Big Data Developer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using big data technologies. This exciting opportunity is suitable for an individual with a strong technical background and a passion for working with large datasets to deliver high-quality solutions. Key Responsibilities: - Design, develop, and maintain scalable data pipelines and big data applications. - Work with distributed processing frameworks (e.g., Apache Hadoop, Apache Spark) to process and analyze large datasets....

As a highly motivated and experienced data scientist, you will lead a team of Gen-Ai Engineers. Your responsibilities will include managing all processes from data extraction, cleaning, and pre-processing to training models and deploying them to production. The ideal candidate will be passionate about artificial intelligence and stay up-to-date with the latest developments in the field. Key Responsibilities: - Utilize frameworks like Langchain for developing scalable and efficient AI solutions. - Integrate vector databases such as Azure Cognitive Search, Weavite, or Pinecone to support AI model functionalities. - Work closely with cross-functional teams to define problem statements and proto...

As a software developer at our company, you will be responsible for the following: - Designing, coding, testing, documenting, and implementing application release projects as part of the development team. - Utilizing your experience in programming/debugging for business applications. - Demonstrating working knowledge of industry practices and standards. - Proactively notifying the Development Project Manager of risks, bottlenecks, problems, issues, and concerns. - Ensuring compliance with Citi's System Development Lifecycle and Information Security requirements. - Collaborating closely with Quality Control teams to deliver quality software within agreed project schedules. - Working with Busi...

Role Hadoop Sr. developer Preferred candidate profile exp-3-10years Mandate Skills:- Hadoop, Bigdata Pyspark, SQL, Python, Hadoop, Spark, AWS Database : MySQL, IBM DB2 OS: Windows.Linux,IBM Mainframes. Big data tools: Cloudera,Hive, Sqoop

As a Data Reporting Specialist at Infor, you will be responsible for delving deep into the data and consolidating multiple sources to develop robust reporting solutions. Your focus will be on assisting internals, partners, and customers in managing their operations, making informed business decisions, and shaping strategic plans and investments. Leading the architecture and development of interactive and user-friendly operational, strategic, KPI, and run-the-business reports and dashboards will be a key aspect of your role. Key Responsibilities: - Participate in business analysis activities to gather necessary reporting and dashboard requirements, translating them into specifications for imp...

Role & responsibilities Lead and mentor a team of full stack engineers, fostering a culture of technical excellence and collaboration. Architect, design, and develop scalable and robust full stack applications using Python and GoLang for backend services and React.js for front-end development. Manage the entire software development lifecycle, including planning, coding, testing, deployment, and maintenance. Design and manage databases using PostgreSQL , ensuring data integrity and performance. Utilize and manage services on AWS (Amazon Web Services) , including EC2, S3, RDS, and others, to deploy and scale applications. Implement and manage data processing pipelines using technologies like A...

As a Senior Engineer at Impetus Technologies, you will be responsible for designing, developing, and deploying scalable data processing applications using Java and Big Data technologies. Your role will involve collaborating with cross-functional teams to gather requirements, develop high-quality code, and optimize data processing workflows. Additionally, you will mentor junior engineers and contribute to architectural decisions to enhance system performance and scalability. Key Responsibilities: - Design, develop, and maintain high-performance applications using Java and Big Data technologies. - Implement data ingestion and processing workflows utilizing frameworks like Hadoop and Spark. - C...

As a [Job Title], your role is crucial in ensuring the success of the organization by [insert brief role overview here]. Key Responsibilities: - Develop user requirements for systems in production to ensure maximum usability - Utilize skills in SQL, Apache Spark, and Python for data pipeline development - Implement data modeling and ETL processes for efficient data processing - Work with Apache Hadoop and data warehousing technologies - Collaborate on projects related to cloud platforms and big data technologies - Communicate effectively with team members and stakeholders Qualifications: - Proficiency in SQL, Apache Spark, and Python - Experience with data modeling and ETL processes - Famili...

As a skilled Senior Engineer at Impetus Technologies, you will utilize your expertise in Java and Big Data technologies to design, develop, and deploy scalable data processing applications. Your responsibilities will include collaborating with cross-functional teams, developing high-quality code, and optimizing data processing workflows. Additionally, you will mentor junior engineers and contribute to architectural decisions to enhance system performance and scalability. Key Responsibilities: - Design, develop, and maintain high-performance applications using Java and Big Data technologies. - Implement data ingestion and processing workflows with frameworks like Hadoop and Spark. - Collabora...

In this role of QA with Data, ETL in Dubai, you will be responsible for the following: **Role Overview:** As a QA professional, you will be responsible for formulating test strategies for applications within the big data platform. You will create and maintain automated test scripts using tools like Apache Hadoop, Hive, or equivalents. Collaboration with cross-functional teams to understand product requirements and designing appropriate test cases will be a key aspect of your role. Furthermore, you will execute test cases, analyze results to identify defects and areas for improvement, and engage in agile development methodologies. **Key Responsibilities:** - Formulate test strategies for appl...

As a Presales Specialist at Neysa, a leading AI Acceleration Cloud System provider, your role will involve working closely with the sales teams to understand client requirements, design tailored solutions, and drive technical engagements. Your responsibilities will include: - **Solution Design & Customization**: Collaborate with customers to understand their business challenges and technical requirements. Design and propose customized solutions leveraging Cloud, Network, AI, and Machine Learning technologies. - **Sales Support & Enablement**: Provide technical support during the sales process, including delivering presentations, conducting technical demonstrations, and assisting in proposal ...

Role Overview: As a Pre-Sales Specialist at Neysa, you will play a crucial role in engaging with customers to understand their business challenges and technical requirements. You will design and propose customized solutions leveraging Cloud, Network, AI, and Machine Learning technologies to best fit their needs. Your responsibilities will include collaborating with the sales team to provide technical support, conducting product demos, leading Proof of Concept (PoC) engagements, and facilitating customer workshops and training sessions. Additionally, you will stay up-to-date on industry trends, provide feedback to product and engineering teams, and contribute to market and competitive analysi...

We are looking for a highly motivated and experienced data scientist to lead the team of Gen-Ai Engineers. As a data scientist, you will be responsible for managing all processes from data extraction, cleaning, and pre-processing to training models and deploying them to production. The ideal candidate will have a passion for artificial intelligence and stay updated on the latest developments in the field. You will be expected to utilize frameworks like Langchain for developing scalable and efficient AI solutions. Additionally, you will integrate vector databases such as Azure Cognitive Search, Weavite, or Pinecone to support AI model functionalities. Working closely with cross-functional tea...

You will be working at Paras Twin Tower, Gurgaon as a full-time employee for Falcon, a Series-A funded cloud-native, AI-first banking technology & processing platform. Falcon specializes in assisting banks, NBFCs, and PPIs to efficiently launch cutting-edge financial products like credit cards, credit lines on UPI, prepaid cards, fixed deposits, and loans. Since its inception in 2022, Falcon has processed over USD 1 billion in transactions, collaborated with 12 of India's top financial institutions, and generated revenue exceeding USD 15 million. The company is supported by prominent investors from Japan, the USA, and leading Indian ventures and banks. To gain more insights about Falcon, vis...

As an experienced Data Engineer with 6-12 years of experience, you will be responsible for working with Big Data technologies, programming languages, ETL & Data Engineering, Cloud Platforms, and various tools & frameworks. Your expertise in Scala, Spark, PySpark, Python, SQL, Hadoop, Hive, Pig, MapReduce, and other related skills will be crucial in this role. You must have a strong background in Data Warehouse Design, ETL, Data Analytics, Data Mining, Data Cleansing, and experience in creating data pipelines, optimization, troubleshooting, and data validation. Proficiency in cloud platforms such as GCP and Azure, along with tools like Apache Hadoop, Airflow, Kubernetes, and Containers, will ...

As a Technology Practice Leader, you will play a crucial role in enabling delivery scalability for our high-end technology company based in India, aiming to be a global leader in the P-A-S-S (performance, availability, scalability, and security) Assurance space. With an impressive track record of over 60+ Enterprise customers, you will lead and ensure the successful delivery of some of the world's most complex projects. Your role will require you to be a hands-on performance architect, adept at solving deep technical issues, while also providing innovative thought leadership. In this role, your responsibilities will include leading and successfully delivering new and complex projects in area...