Bigdata Developer

Big Data Developer

Key Responsibilities

• Big Data Ecosystem Management

  : Apply a

  good understanding of the Hadoop ecosystem

  and familiarity with

  Cloudera/Hortonworks distributions

  to manage and optimize big data environments.

• ETL Pipeline Development

  : Design and implement robust

  ETL pipelines

  , ensuring efficient data ingestion, transformation, and loading processes.

• Data Modeling & Reporting

  : Leverage

  excellent knowledge of database & reporting model design

  to create scalable and performant data structures for analytics and reporting.

• Big Data Tooling

  : Utilize

  in-depth & working knowledge of Spark, Hive, NiFi, Kafka, and Hadoop commands

  for data processing, streaming, and orchestration.

• DevOps Implementation

  : Contribute to and support

  DevOps implementation

  efforts for big data solutions, enhancing continuous integration and deployment.

• Programming & Scripting

  : Develop and maintain big data applications and scripts using

  Python, Scala, or Java

  .

• Troubleshooting & Optimization

  : Identify and resolve performance bottlenecks and technical issues within the big data ecosystem.

Skills

• Good understanding of the Hadoop ecosystem

  .
• Familiarity with

  Cloudera/Hortonworks distribution

  .

• Excellent knowledge of ETL pipelines

  ,

  Database & Reporting model design

  .

• In-depth & working knowledge of Spark, Hive, NiFi, Kafka, and Hadoop commands

  .
• Experience in

  DevOps implementation

  .
• Hands-on proficiency with

  Python/Scala/Java

  .

Qualifications

• Proven experience as a Big Data Developer.
• Demonstrable expertise across the specified big data technologies and concepts.
• Ability to design and implement complex data solutions.
• Strong problem-solving and analytical skills.