Home
Jobs

Data Engineer

5 years

0 Lacs

Posted:1 day ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Job Title:

Experience:

Location:



We are seeking a skilled and detail-oriented Big Data Engineer with strong expertise in Apache Spark to join our dynamic data team. The ideal candidate will have proven experience in designing and implementing large-scale data processing solutions and a strong understanding of distributed computing concepts.


Key Responsibilities

  • Design and develop scalable data processing solutions using Apache Spark (Core, SQL, Streaming, MLlib).
  • Build, optimize, and maintain robust data pipelines and ETL processes for structured and unstructured data.
  • Collaborate with data scientists, analysts, and software engineers to integrate Spark-based data products into production workflows.
  • Ensure data quality, integrity, and security throughout the data lifecycle.
  • Monitor, troubleshoot, and improve the performance of Spark jobs in production environments.
  • Integrate Spark with cloud platforms such as AWS, Azure, or GCP for scalable deployment.


Required Skills and Qualifications:

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
  • 3+ years of hands-on experience with Apache Spark in a large-scale data environment.
  • Strong proficiency in Scala, Python, or Java (preference for Scala).
  • Experience with data storage technologies such as HDFS, Hive, HBase, S3, etc.
  • Familiarity with SQL, Kafka, Airflow, and NoSQL databases.
  • Understanding of distributed systems and parallel computing concepts.
  • Experience with containerization and orchestration tools (e.g., Docker, Kubernetes) is a plus.


Preferred Qualifications

  • Certification in Big Data or Spark (e.g., Databricks Certified Developer).
  • Experience working in a DevOps/CI-CD environment.
  • Knowledge of data warehousing concepts and tools like Snowflake or Redshift.

Mock Interview

Practice Video Interview with JobPe AI

Start Data Interview Now
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Ajackus
Ajackus

13 Jobs

RecommendedJobs for You

Gurugram, Haryana, India

Mumbai, Maharashtra, India

Ahmedabad, Gujarat, India

Mumbai, Maharashtra, India

Hyderabad, Telangana, India

Hyderabad, Telangana, India