Spark Developer

Job Description: As a Spark Expert, you will be expected to demonstrate expert proficiency in Spark and possess the ability to design and implement efficient data processing workflows. Your experience with Spark SQL and DataFrames will be crucial, as well as your good exposure to Big Data architectures and a solid understanding of the Big Data ecosystem. Additionally, your experience with framework building on Hadoop and strong DB knowledge with SQL tuning experience will be valuable. It would be beneficial if you have experience with Python APIs and exposure to Kafka. Key Responsibilities: - Demonstrate expert proficiency in Spark - Design and implement efficient data processing workflows - Utilize Spark SQL and DataFrames effectively - Understand and work with Big Data architectures - Build frameworks on Hadoop - Possess strong DB knowledge and experience in SQL tuning - Familiarity with Python APIs and exposure to Kafka Qualifications Required: - Expertise in Spark - Strong understanding of Spark SQL and DataFrames - Experience with Big Data architectures and the Big Data ecosystem - Proficiency in building frameworks on Hadoop - Good knowledge of databases and SQL tuning - Experience with Python APIs and exposure to Kafka Additional Details: The company values the ability to work with clients to identify business challenges and contribute to client deliverables by refining, analyzing, and structuring relevant data. They also appreciate awareness of the latest technologies and trends, logical thinking, problem-solving skills, and collaboration abilities. You should be able to assess current processes, identify improvement areas, and suggest technology solutions, while having knowledge in one or two industry domains. Preferred Skills: - Technology: Big Data - Data Processing: Spark,