Home
Jobs

Principal Consultant - Big Data Admin

8 - 10 years

15 - 27 Lacs

Posted:4 days ago| Platform: Naukri logo

Apply

Work Mode

Hybrid

Job Type

Full Time

Job Description

Please find the below detailed JD for Bigdata Administrator

Key Responsibilities:

  • Lead

    CDP platform upgrades and migrations

    , with strong hands-on execution and documentation from planning to go-live.
  • Administer and tune Hadoop ecosystem services:
    • Core:

      HDFS, YARN, Hive, Hue, Impala, Sqoop, Oozie

    • Streaming:

      Apache Kafka (broker/topic ops), Apache Flink (streaming jobs)

    • NoSQL/Query:

      HBase, Phoenix

    • Security:

      Kerberos, Ranger, LDAP, TLS

  • Manage

    Cribl Stream

    deployments: build, configure, secure, and optimize data routing pipelines.
  • Monitor and optimize platform performance using

    Cloudera Manager, NewRelic, BigPanda, Prometheus, Grafana

    , or any other observability tools.
  • Design and implement

    backup, recovery, HA, and DR strategies

    for critical data infrastructure.
  • Automate platform operations using

    Python, Bash/Shell, Scala

    , and CI/CD workflows.
  • Work cross-functionally with Data Engineers, DevOps, InfoSec, and Cloud Engineering teams to support data pipeline reliability and scalability.
  • Manage deployments using

    Docker

    ,

    Kubernetes

    ,

    Jenkins

    ,

    Bitbucket

    , and optionally

    Ansible

    or

    GitOps

    practices.
  • Support and maintain cloud-native or hybrid deployments, especially in

    GCP (Anthos)

    environments.
  • Produce and maintain robust architecture documentation, runbooks, and operational SOPs.

Required Qualifications:

  • 7+ years of experience

    in Big Data infrastructure, administration, and operations.
  • Proven

    Cloudera CDP (7.x)

    experience, including

    production-grade migrations

    (7.1.6 to 7.1.9+).
  • Deep expertise in:
    • Apache Spark

      job tuning, executor/resource optimization
    • Apache Kafka

      – security (SASL_SSL, GSSAPI), scaling, topic lifecycle management
    • Apache Flink

      – real-time stream processing in HA environments
    • Cribl Stream

      – full-lifecycle management and observability integration
    • HBase & Phoenix

      – schema evolution, read/write tuning, replication
  • Scripting & Automation: Proficient in

    Python

    ,

    Shell (Bash)

    , and optionally

    Scala

  • Security-first mindset: Working knowledge of

    Kerberos

    ,

    Ranger policies

    ,

    LDAP

    integration, and

    TLS

    configuration.
  • DevOps Experience: Hands-on with

    Docker

    ,

    Kubernetes

    ,

    Jenkins

    ,

    Bitbucket

    , and monitoring tools like

    Grafana/Prometheus

    .
  • Comfortable supporting large-scale, multi-tenant environments and production on-call rotations.

Preferred Qualifications:

  • Cloudera Certified Administrator (CCA)

    or equivalent industry certification.
  • Experience with

    BD on-prem

    ,

    cloud and hybrid data infrastructure

    , particularly

    Google Cloud Platform (GCP)

    and

    Anthos

    clusters.

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
Genpact
Genpact

Business Consulting and Services

New York NY

RecommendedJobs for You

Mumbai, Maharashtra, India

Chennai, Bengaluru, Mumbai (All Areas)

Chennai, Tamil Nadu, India