Devops Consultant

Role & responsibilities

Direct Responsibilities

• Design and develop real-time and batch data pipelines using tools like Apache NiFi, Apache Kafka, and Apache Airflow.
• Implement and maintain ETL/ELT processes, ensuring data quality and integrity across various data sources.
• Integrate and manage data flows across diverse systems using NiFi and Kafka topics.
• Monitor and optimize the performance of data pipelines and troubleshoot issues proactively.
• Work with the ELK stack (Elasticsearch, Logstash, Kibana) for logging, monitoring, and real-time analytics.
• Write efficient and optimized SQL queries for data extraction, transformation, and reporting.
• Collaborate with data analysts and business stakeholders to develop meaningful Power BI dashboards and reports.
• Maintain documentation for data workflows, processes, and architecture.

Required Skills:

• Strong experience with Apache NiFi for data flow management.
• Expertise in Kafka (streaming data, Kafka Connect, schema management).
• Proficiency in Apache Airflow for orchestrating workflows.
• Solid understanding of SQL (writing complex queries, tuning, indexing).
• Experience working with the ELK stack Elasticsearch for search and analytics, Logstash for ingestion, Kibana for

visualization.

• Experience with Power BI data modeling, DAX, dashboard development.
• Knowledge of data warehousing concepts, data modeling, and data lake architecture.

Contributing Responsibilities

Transversal skills:

- Analytical capacity (Expert)

- Ability to lead a meeting, a seminar, a committee, a training session, etc. (Mastered)

- Ability to understand, explain and lead change (Mastered)

- Ability to define relevant performance indicators (Mastered)

- Ability to work with Agile methods (Mastered)

Behavioral skills:

Requirements [only in bullet points, technical & leadership & soft skills, nice to haves etc. on the same

place, no splits]. Example:

• English (mandatory)
• Eager to learn
• Analytical mind-set
• Ability to work well under pressure, ability to work autonomously and in team environment
• Good interpersonal and communication skills.

Preferred candidate profile