Pyspark Developer

• In the role of Data Engineer you will interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle including Requirements Elicitation Application Architecture definition and Design
• You will play an important role in creating the high level design artifacts
• You will also deliver high quality code deliverables for a module lead validation for all types of testing and support activities related to implementation transition and warranty
• You will be part of a learning culture where teamwork and collaboration are encouraged excellence is rewarded and diversity is respected and valued

Key Responsibilities:

• Bachelor s degree or foreign equivalent required from an accredited institution
• Will also consider three years of progressive experience in the specialty in lieu of every year of education
• At least 5 years of experience in Pyspark Spark with Hadoop distributed frameworks while handling large amount of big data using Spark and Hadoop Ecosystems in Data Pipeline creation deployment Maintenance and debugging
• Experience in scheduling and monitoring Jobs and creating tools for automation
• At least 4 years of experience with Scala and Python required
• Proficient knowledge of SQL with any RDBMS
• Strong communication skills verbal and written with ability to communicate across teams internal and external at all levels
• Ability to work within deadlines and effectively prioritize and execute on tasks
• Preferred Qualifications
• At least 1 years of AWS development experience is preferred
• Experience in Drive automations
• DevOps Knowledge is an added advantage

Technical Requirements:

• Primary Skills Pyspark Spark and proficient in SQL
• Secondary Skills Scala and Python
• Experience 3 Yrs

Additional Responsibilities:

• Advanced conceptual understanding of at least one Programming Language
• Advanced conceptual understanding of one database and one Operating System
• Understanding of Software Engineering with practice in at least one project
• Ability to contribute in medium to complex tasks independently
• Exposure to Design Principles and ability to understand Design Specifications independently
• Ability to run Test Cases and scenarios as per the plan
• Ability to accept and respond to production issues and coordinate with stake holders
• Good understanding of SDLC
• Analytical abilities
• Logical thinking
• Awareness of latest technologies and trends

Preferred Skills: