Big Data Developer

Miamin Systems

7 years

0 Lacs

hyderabad telangana india

Posted:12 hours ago| Platform:

Apply

Skills Required

data developer design processing etl hadoop spark kafka scalability engineering security aws azure programming python scala apache hive databricks gcp dataflow sql containerization docker workflow learning

Work Mode

On-site

Job Type

Full Time

Job Description

About the Role

Big Data Engineer

Key Responsibilities

Design, develop, and maintain large-scale
data pipelines
and
ETL workflows
Work with
Hadoop, Spark, Kafka, Hive,
and other big data technologies
Optimize data processing jobs for
performance, scalability, and reliability
Build and manage
real-time and batch data processing systems
Collaborate with data scientists, analysts, and engineering teams to deliver high-quality data solutions
Ensure
data quality, security, and governance
across all pipelines
Deploy and manage data solutions on
cloud platforms
(AWS/Azure/GCP)
Monitor data infrastructure performance and troubleshoot issues

Required Skills & Experience

3–7 years of experience as a
Big Data Engineer
or related role
Strong programming skills in
Python/Scala/Java
Hands-on experience with
Apache Spark, Kafka, Hadoop, Hive, HBase,
etc.
Experience with
cloud data services
:
AWS (Glue, EMR, Redshift)
Azure (Databricks, Synapse)
GCP (Dataflow, BigQuery)
Solid understanding of
ETL, data warehousing, distributed systems
Experience with
SQL and NoSQL
databases
Familiarity with CI/CD and containerization (Docker, Kubernetes)

Nice to Have

Experience with
Databricks
Knowledge of
Airflow
or other workflow schedulers
Exposure to
machine learning data pipelines

More Jobs at Miamin Systems

Java Software Engineer

gurugram, haryana, india

Experience: Not specified

Salary: Not disclosed

Cyber Security Anti Hacker Lead

karnataka

3.0 - 7.0 yrs

Salary: Not disclosed

Associate Software Engineer

noida, uttar pradesh, india

Experience: Not specified

Salary: Not disclosed

Business Analyst

hyderabad, telangana, india

Experience: Not specified

Salary: Not disclosed

Human Resources Specialist

hyderabad, telangana, india

6.0 - 6.0 yrs

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.