Pyspark Data Engineer

5 - 10 years

10 - 11 Lacs

Posted:5 days ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description

Minimum 5+ years of development and design experience in experience as Data Engineer
Experience on Big Data platforms and distributed computing

(e.g. Hadoop, Map/Reduce, Spark, HBase, Hive)

Experience in data pipeline software engineering and best practice in python (linting, unit tests, integration tests, git flow/pull request process, object-oriented development, data validation, algorithms and data structures, technical troubleshooting and debugging, bash scripting )

Experience in Data Quality Assessment (profiling, anomaly detection) and data documentation (schema, dictionaries)
Experience in data architecture, data warehousing and modelling techniques (Relational, ETL, OLTP) and consider performance alternatives
Used SQL, PL/SQL or T-SQL with RDBMSs production environments, no-SQL databases nice to have
Linux OS configuration and use, including shell scripting.
Well versed with Agile, DevOps and CI/CD principles (GitHub, Jenkins etc.), and actively involved in solving, troubleshooting issues in distributed services ecosystem

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Virtusa logo
Virtusa

Information Technology and Services

Southborough

RecommendedJobs for You

Hyderabad, Telangana, India

Hyderabad, Telangana, India