Big Data Developer

Roles and Responsibilities

• Design, develop, test, deploy, and maintain large-scale big data solutions using Scala programming language.
  
• Collaborate with cross-functional teams to identify business requirements and design scalable architectures for big data processing pipelines.
  
• Develop high-quality code that meets performance, security, and reliability standards.
  
• Troubleshoot complex issues related to big data processing workflows and provide timely resolutions.
  
• Stay up-to-date with industry trends and best practices in big data technologies such as AWS EMR/S3/EC2/RDS/Lambda/Kinesis etc.
  

Desired Candidate Profile

• 6-11 years of experience in Big Data Development with expertise in Scala programming language.
  
• Bachelor's degree (B.Sc) or Master's degree (M.Tech/B.E.) from a reputed institution.
  
• Strong understanding of Java programming language is an added advantage. Experience working on cloud platforms like AWS is essential. Knowledge of CI/CD tools like Jenkins is desirable.

• AWS (EMR, S3, Glue, Airflow, RDS, Dynamodb, similar)

• CICD (Jenkins or another)

• Relational Databases experience (any)

• No SQL databases experience (any)

• Microservices or Domain services or API gateways or similar

• Containers (Docker, K8s, similar)

• Preferred candidate profile

• 6 YEARS TO 16 YEARS,

• Contract to hire

• Mandatory Skills:

• "Pyspark,EMR

• Scala / Java

• AWS

• Jenkins"