4 - 6 years
3 - 6 Lacs
Posted:1 week ago|
Platform:
On-site
Full Time
We are looking for a PySpark Developer with expertise in data ingestion, ETL processing, and big data cloud-based solutions . The ideal candidate will have hands-on experience in building scalable data pipelines and optimizing data processing performance . Key Responsibilities: Develop and implement data ingestion pipelines from various sources such as databases, S3, and files . Build and optimize ETL and Data Warehouse transformation processes . Develop enterprise-level Big Data solutions using PySpark, SparkSQL, and related frameworks . Create scalable, reusable, and self-service frameworks for data ingestion and processing . Ensure end-to-end integration of data pipelines , maintaining data quality and consistency . Conduct performance analysis and optimization for data processing. Apply best practices in design, automation (Pipelining, IaC), testing, monitoring, and documentation . Work with structured and unstructured data for comprehensive data management. Good to Have: Experience in cloud-based solutions (AWS, Azure, GCP). Knowledge of data management principles and best practices. If you have expertise in Big Data and ETL solutions and want to work on cutting-edge cloud-based data pipelines , apply now!
SP Staffing Services Private Limited
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Pune, Chennai, Bengaluru
0.5 - 0.5 Lacs P.A.
Hyderabad, Bengaluru, Mumbai (All Areas)
0.7 - 1.5 Lacs P.A.
Hyderabad, Chennai, Bengaluru
12.0 - 22.0 Lacs P.A.
Hyderabad, Gurugram, Bengaluru
0.5 - 1.0 Lacs P.A.
Chennai, Bengaluru
16.0 - 27.5 Lacs P.A.
Bengaluru
0.5 - 2.75 Lacs P.A.
Hyderabad, Chennai, Bengaluru
10.0 - 20.0 Lacs P.A.
Pune
9.0 - 19.0 Lacs P.A.
Bengaluru
12.0 - 22.0 Lacs P.A.
Bengaluru / Bangalore, Karnataka, India
3.5 - 6.5 Lacs P.A.