Jobs
Interviews

Pyspark Developer

2 - 6 years

3 - 7 Lacs

Gurugram

Posted:2 days ago| Platform: Naukri logo

Apply

Skills Required

hive data management scala pyspark data pipeline parquet sql java postgresql data science spark linux json mysql hadoop data visualization etl big data hbase avro python oracle oozie python development elt sql scripting mapreduce kafka sqoop aws

Work Mode

Work from Office

Job Type

Full Time

Job Description

We are looking for a Pyspark Developer that loves solving complex problems across a full spectrum of technologies. You will help ensure our technological infrastructure operates seamlessly in support of our business objectives.
 
Responsibilities
  • Develop and maintain data pipelines implementing ETL processes.
  • Take responsibility for Hadoop development and implementation.
  • Work closely with a data science team implementing data analytic pipelines.
  • Help define data governance policies and support data versioning processes.
  • Maintain security and data privacy working closely with Data Protection Officer internally.
  • Analyse a vast number of data stores and uncover insights.
Skillset Required
  • Ability to design, build and unit test the applications in Pyspark.
  • Experience with Python development and Python data transformations.
  • Experience with SQL scripting on one or more platforms Hive, Oracle, PostgreSQL, MySQL etc.
  • In-depth knowledge of Hadoop, Spark, and similar frameworks.
  • Strong knowledge of Data Management principles.
  • Experience with normalizing/de-normalizing data structures, and developing tabular, dimensional and other data models.
  • Have knowledge about YARN, cluster, executor, cluster configuration.
  • Hands on working in different file formats like Json, parquet, csv etc.
  • Experience with CLI on Linux-based platforms.
  • Experience analysing current ETL/ELT processes, define and design new processes.
  • Experience analysing business requirements in BI/Analytics context and designing data models to transform raw data into meaningful insights.
  • Good to have knowledge on Data Visualization.
  • Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources.

More Jobs at Dgliger Consulting

Technical Lead

Gurugram

6.0 - 10.0 yrs
|

INR 10 - 14 Lacs

Pyspark Developer

Gurugram

2.0 - 6.0 yrs
|

INR 3 - 7 Lacs

Big Data Engineer

Gurugram

2.0 - 6.0 yrs
|

INR 6 - 10 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Google Play App Store
coding practice

Enhance Your Java Skills

Practice Java coding challenges to boost your skills

Start Practicing Java Now
Dgliger Consulting

RecommendedJobs for You

Infosys logo

Pyspark Developer

Infosys

Hyderabad, Telangana, India

Dgliger Consulting logo

Pyspark Developer

Dgliger Consulting

Gurugram

ARA Resources Pvt. Ltd. logo

Pyspark Developer

ARA Resources Pvt. Ltd.

Bhubaneshwar, Odisha, India

Infosys logo

Pyspark Developer

Infosys

Bengaluru

Pyspark Developer

VARKY Technology Solutions

India

Pyspark Developer

VARKY Technology Solutions

India

Tata Consultancy Services logo

Pyspark Developer

Tata Consultancy Services

Hyderabad, Telangana, India

Infosys Limited logo

Pyspark Developer

Infosys Limited

Bengaluru, Karnataka, India

Synechron logo

Pyspark Developer

Synechron

Pune

Infosys logo

Pyspark Developer

Infosys

Hyderabad