Apache NiFi Engineer

Job Title:

• Design, develop, and maintain scalable

  data pipelines

   using

  Apache NiFi

  .
• Work on

  ETL/ELT

   processes to ingest, transform, and deliver data from diverse sources (e.g., APIs, databases, files).
• Ensure data quality, governance, lineage, and security across all data flows.
• Collaborate with data analysts, supply chain operations, and other engineering teams to gather requirements and deliver robust solutions.
• Monitor and troubleshoot NiFi workflows, system performance, and job failures.
• Implement best practices for

  data integration

   and

  real-time/near real-time data processing

  .
• Leverage scripting (e.g., Bash, Python) on

  Linux systems

   for automation and orchestration.
• Document system architecture, flow designs, and data mappings.

Required Skills & Qualifications:

• 4+ years of professional experience in

  data engineering

   roles.
• Strong hands-on experience with

  Apache NiFi

   in a production environment.
• Proficient in

  ETL/ELT concepts

   and tools.
• Solid working knowledge of

  Linux/Unix

   environments and scripting.
• Familiarity with

  supply chain data

   (inventory, logistics, procurement, etc.) is a plus.
• Experience integrating data from

  relational databases

  ,

  flat files

  ,

  APIs

  , and

  cloud

   sources.
• Working knowledge of

  data formats

   such as JSON, XML, Avro, Parquet, etc.
• Ability to debug, optimize, and scale NiFi processors and flows.
• Strong problem-solving skills and attention to detail.
• Excellent communication and collaboration skills.

Preferred Qualifications:

• Experience with

  cloud platforms

   (AWS, Azure, GCP) and cloud-native data services.
• Knowledge of other integration tools like

  Kafka

  ,

  Airflow

  , or

  Informatica

  .
• Experience in

  data warehousing

   and

  BI tools

  .
• Familiarity with CI/CD and version control systems (Git, Jenkins, etc.).