Bigdata + Python Developer

NOTE: We are only looking for candidates who can join Immediately to available to join in 15 days

Experience level- 6+ years

Location: Bangalore, Hyderabad, Chennai (Candidates who are currently in one of these 3 locations can apply)

Job Summary:

Senior Big Data + Python Developer

Key Responsibilities:

• Design, develop, and maintain large-scale data processing pipelines using

  Python

  ,

  Spark

  , and

  Ray

  .
• Manage and optimize workflows with

  Airflow

  .
• Work with

  Apache Hive

  ,

  Iceberg

  , and

  Druid

  for efficient data storage, querying, and real-time analytics.
• Deploy, monitor, and manage containerized applications using

  Kubernetes

  .
• Develop dashboards and visualizations using

  Apache Superset

  or similar tools.
• Collaborate with architects and data scientists to design high-performance systems.
  
• Ensure data quality, scalability, and performance in all solutions delivered.
  
• Participate in code reviews and provide technical mentorship to junior team members.
  

Required Skill Set:

• Strong programming experience with

  Python

  .
• Hands-on experience with

  Ray

  ,

  Apache Spark

  , and

  Hive

  .
• Solid understanding of

  Apache Iceberg

  for data lake management.
• Experience working with

  Kubernetes

  for container orchestration.
• Workflow orchestration with

  Apache Airflow

  .
• Familiarity with

  Apache Druid

  for real-time analytics.
• Expertise in data visualization tools such as

  Superset

  .
• Strong knowledge of data architecture and design patterns.
  
• Proven track record of delivering scalable and production-grade systems.
  

Preferred Qualifications:

• Exposure to

  AI/ML

  workflows or platforms is a plus.
• Experience in system and data architecture design.
  
• Contributions to open-source or published technical blogs/articles.
  
• Excellent problem-solving and analytical skills.