Scala + AWS Professional

Skill:

Scala with AWS

Grade

-C2

Location:

Pan India

NP:

Immediate to 15 Days Joiners Only

We are seeking a skilled Big Data Engineer with strong hands-on experience in Apache Spark, Scala, and AWS cloud services. The ideal candidate will be responsible for developing scalable data pipelines, processing large datasets, and deploying efficient Spark-based solutions on the AWS ecosystem. Design and develop distributed data processing pipelines using Apache Spark and Scala. Optimize Spark jobs for performance and scalability on AWS infrastructure. Integrate Spark applications with AWS services such as S3, EMR, Lambda, Glue, RDS, Athena, and Redshift. Write clean, reusable, and production-grade Scala code. Work with large-scale structured and unstructured data in real-time and batch modes. Ensure data quality, reliability, and consistency through monitoring and validations. Collaborate with data scientists, analysts, and business teams to understand requirements and deliver insights. Implement best practices for data engineering in a cloud-native environment.

Required Skills:

Strong programming skills in Scala 3+ years of hands-on experience with Apache Spark (RDD/DataFrame/SQL APIs) Experience working on AWS services like EMR, S3, Glue, Lambda, EC2, etc. Proficient in writing and optimizing complex Spark transformations and actions. Experience in working with large-scale data processing and distributed systems.

Preferred Skills:

Experience with Kafka, Airflow, or similar orchestration tools. Working knowledge of Python Experience with containerized deployments (Docker, Kubernetes). AWS certification (e.g., AWS Certified Data Analytics Specialty) is a plus.