9 Spark Scala Jobs

Guide Big Data Transformations:Implementation of comprehensive big data projects, including the development and deployment of innovative big data & AI applications. Ensure Best Practices:Guarantee that Databricks best practices are applied throughout Required Candidate profile 6+ years of experience as a Data Engineer, with proficiency in at least two major cloud platforms (AWS, Azure, GCP). Proven experience in designing, developing, and implementing comprehensive data.

Role Overview The role focuses on designing, developing, and optimizing large-scale data processing solutions using Spark Scala and Hadoop ecosystem technologies. The position requires strong expertise in big data components, distributed processing, SQL optimization, and end-to-end pipeline development in both batch and streaming environments. Key Responsibilities Create Spark Scala jobs for data transformation, aggregation, and large-scale data processing Design and implement data processing pipelines using Hadoop ecosystem tools such as HDFS, Hive, YARN, MapReduce, and Sqoop Write and optimize Spark jobs, Spark SQL queries, and streaming/batch data processing flows Develop and optimize com...

Key Responsibilities Design, develop, and maintain scalable data pipelines and architectures using cloud and on-premise platforms. Implement solutions across Azure Databricks, PySpark, Synapse, Snowflake, AWS, Google BigQuery, and other modern data platforms. Develop ETL/ELT workflows using tools such as Informatica IICS, Datastage, Ab Initio, and SAP MDG. Integrate and manage master data using Informatica MDM, Reltio MDM, and Stibo. Apply AI/ML, Gen AI, and MLOps techniques to enhance data-driven insights and automation. Optimize data warehouse performance, ensure data quality, and implement best practices in data management. Collaborate with cross-functional teams to translate business req...

Job Description: Job Description About Us At Bank of America, we are guided by a common purpose to help make financial lives better through the power of every connection. Responsible Growth is how we run our company and how we deliver for our clients, teammates, communities and shareholders every day. One of the keys to driving Responsible Growth is being a great place to work for our teammates around the world. We're devoted to being a diverse and inclusive workplace for everyone. We hire individuals with a broad range of backgrounds and experiences and invest heavily in our teammates and their families by offering competitive benefits to support their physical, emotional, and financial wel...

Key Accountabilities and main responsibilities Strategic Focus Contribute to the development of the data engineering capability. Apply software engineering best practices and database design to build scalable data pipelines, data integrations, and data models for use in applications and reports. Transform raw data into clean, accurate, and reusable datasets with combination of technical expertise and business acumen to seamlessly integrate data thus facilitating data-driven decision-making throughout the organization. Responsible for data curation - translating data needs from stakeholders into architecting, building, and maintaining efficient & reliable data models and pipelines. Determinin...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics techniques to help clients optimise their operations and achieve their strategic goals. In business intelligence at PwC, you will focus on leveraging data and analytics to provide strategic insights and drive informed decision-making for clients. You will develop and implement innovative solutions to optimise business performance and enhance competitive advantage. *Why PWC At PwC, you will be pa...

Position: Spark-Scala Work location : Bangalore , Chennai, Hyderabad, Pune, Chandigarh. Type: C2H (Convert into Full-Time Employment (FTE) within 90 days) Experience: 8-10 yrs. Skillsets: Mandatory skills - Spark & Scala Desired skills - Spark Streaming, Hadoop, Hive, SQL, Sqoop, Impala Joining: Immediate joiner or 15 to 30 days

Job description Scala Developer About this position We are eagerly seeking candidates with 5 to 9 years experience for a Spark & Scala Cloudera Developer to join our dynamic team. The ideal candidate will play a pivotal role for our business in delivering data and insights to our clients. Were driving the companys digital transformation and expanding business capabilities using industry best practices and advanced technologies such as cloud, artificial intelligence and robotics process automation. Role: Scala Developer Location: Pune, Chennai Experience: 5 to 11 years Job type: Full time Work type: Hybrid Impact you will realize: Job Responsibilities Extensive working knowledge and expertise...

Role & responsibilities Spark Scala 3 years Python 4 years MongoDB Hands on Relational databases SQLserver Mysql 3 AWS services S3Batch JobsEC2EMRDMSGlue 3 years GoLang Nodejs Basic knowledge not mandatory to know Apache Kafka1 year Airflow 3 years Spark SQL 3 years Git GitLab preferred Experience working in an Agile frameworkteam Role Responsibilities Develop Maintain improve the ETL streaming data pipeline for brandcom API team Add new features to the data if needed Resolve any Bugs or defect reported ASAP Do a backfilling or bulk load of data using scripts Technologies involved Languages Scala Python Databases PostgresDb Mongodb Big Data tools Spark Kafka SparkSql Airflow cloud Technologi...