5 - 8 years
15 - 20 Lacs
Posted:3 weeks ago|
Platform:
Hybrid
Full Time
Responsibilities Design, develop, and maintain scalable data pipelines using PySpark and other big data technologies -, Cloudera Data Platfrorm, Big data Hadoop, Hive, Kafka Implement data ingestion processes using Kafka for real-time data streaming and processing. Work with Hive to manage and query large datasets effectively. Optimize data storage and retrieval processes to improve performance and efficiency. Collaborate with data scientists and analysts to understand data requirements and deliver solutions that meet their needs. Monitor and troubleshoot data pipelines to ensure reliability and performance. Document data engineering processes, architectures, and workflows for future reference. Skills and Qualifications Bachelor's degree in Computer Science, Information Technology, or a related field. Ready for 6 months contract in Chennai/B'luru Hands on in Key Skill: Pyspark, Cloudera Data Platfrorm, Big data Hadoop, Hive, Kafka 3-6 years of experience in data engineering or a related role. Proficiency in PySpark for data processing and transformation. Hands-on experience with big data technologies such as Hadoop and Spark. Strong knowledge of Hive for data warehousing and querying. Experience with Kafka for building real-time data streaming applications. Familiarity with SQL and NoSQL databases. Understanding of data modeling and ETL processes. Ability to work with cloud platforms such as AWS, Azure, or Google Cloud. Strong problem-solving skills and attention to detail.
Axim Digitech
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Chennai, Bengaluru
15.0 - 20.0 Lacs P.A.
Pune, Chennai, Bengaluru
12.0 - 22.0 Lacs P.A.
Mumbai, Pune, Bengaluru
0.5 - 0.6 Lacs P.A.
Bengaluru
10.0 - 20.0 Lacs P.A.
Noida
30.0 - 37.5 Lacs P.A.
9.0 - 14.0 Lacs P.A.
Bengaluru
13.0 - 17.0 Lacs P.A.
Pune
13.0 - 17.0 Lacs P.A.
Hyderabad
13.0 - 17.0 Lacs P.A.
Noida, Uttar Pradesh, India
Salary: Not disclosed