2 - 5 years

8 - 14 Lacs

Posted:5 days ago| Platform: Foundit logo

Apply

Skills Required

Work Mode

On-site

Job Type

Full Time

Job Description

L3 Big data

developer:

1. Design, develop, and implement highly scalable and distributed big data

solutions using Hadoop ecosystem technologies such as HBase, Hive, Kudu, and

Spark.

2. Architect HBase schemas and data models to accommodate evolving business

requirements and ensure optimal performance for data storage and retrieval

operations.

3. Develop complex Hive queries and data processing pipelines to transform raw

data into structured formats suitable for analysis and reporting.

4. Implement data ingestion pipelines using Spark Streaming and Spark SQL for

real-time processing of streaming data sources, ensuring high throughput and

low latency.

5. Optimize Spark applications for performance and resource utilization,

including tuning RDD transformations, optimizing data partitioning strategies,

and leveraging in-memory caching.

6. Utilize advanced features of Spark MLlib for machine learning tasks such as

classification, regression, clustering, and collaborative filtering.

7. Design and deploy Kudu tables for fast analytical queries and real-time

analytics, leveraging Kudus unique combination of fast analytics and fast data

ingestion.

8. Collaborate with data scientists to integrate machine learning models into

Spark workflows and productionize them for real-time predictions and analytics.

9. Troubleshoot performance bottlenecks, data quality issues, and system

failures in big data applications and infrastructure, and implement solutions

to address them.

10. Stay abreast of emerging technologies and best practices in big data processing

and analytics, and evaluate their potential impact on our architecture and

solutions.

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
Pradeepit Consulting Services logo
Pradeepit Consulting Services

Information Technology

Townsville

RecommendedJobs for You

bangalore, chennai, hyderabad, mumbai city, delhi

Andhra Pradesh, India

Hyderabad, Telangana, India

Gurugram, Haryana, India

Pune, Maharashtra, India