Posted:1 day ago|
Platform:
On-site
Full Time
Role Description We are looking for an Intermediate Data Engineer with 6 years of proven experience in building scalable data pipelines and managing large-scale data processing systems. The ideal candidate should have strong hands-on expertise in PySpark , SQL , and cloud platforms (preferably GCP ), along with experience working on big data technologies and orchestration tools. Key Responsibilities Design, implement, and optimize data pipelines for large-scale data processing. Develop and maintain ETL/ELT workflows using Spark, Hadoop, Hive, and Airflow. Collaborate with data scientists, analysts, and engineers to ensure data availability and quality. Write efficient and optimized SQL queries for data extraction, transformation, and analysis. Leverage PySpark and cloud tools (preferably Google Cloud Platform) to build reliable and scalable solutions. Monitor and troubleshoot data pipeline performance and reliability issues. Required Skills 4–6 years of experience in a Data Engineering role. Strong hands-on experience with PySpark and SQL. Good working knowledge of GCP or any major cloud platform (AWS, Azure). Experience with Hadoop, Hive, and distributed data systems. Proficiency in data orchestration tools such as Apache Airflow. Ability to work independently in a fast-paced, agile environment. Good To Have Experience with data modeling and data warehousing concepts. Exposure to DevOps and CI/CD practices for data pipelines. Familiarity with other programming/scripting languages (Python, Shell scripting). Educational Qualification Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a related field Skills PySpark,Hadoop,Hive,Gcp
UST
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Practice Python coding challenges to boost your skills
Start Practicing Python NowChennai, Tamil Nadu, India
Experience: Not specified
Salary: Not disclosed
Trivandrum, Kerala, India
Salary: Not disclosed
Bengaluru
5.0 - 5.5 Lacs P.A.
3.6875 - 8.49 Lacs P.A.
Chennai, Tamil Nadu, India
Salary: Not disclosed
Thiruvananthapuram
Salary: Not disclosed
Trivandrum, Kerala, India
Salary: Not disclosed
Thiruvananthapuram
4.4375 - 7.65 Lacs P.A.
Pune, Maharashtra, India
Experience: Not specified
Salary: Not disclosed
Trivandrum, Kerala, India
Salary: Not disclosed