16420 Spark Jobs - Page 35

We are currently seeking a highly accomplished Senior Data Software Engineer to enhance our team and engage in significant projects that will advance both your skillset and your career trajectory. As a Senior Engineer, your efforts will be essential in architecting and deploying Data solutions across diverse projects. The candidate that is best suited for this role brings extensive proficiency in Big Data and related technologies, emphasizing Apache Spark, Python, Azure, and AWS. Responsibilities Develop and implement end-to-end Data solutions to satisfy complex business demands Collaborate with interdisciplinary teams to understand project requirements and deliver top-tier software solutions Employ your deep knowledge of Apache Spark, Python, Azure, and AWS to construct scalable and effective data processing systems Maintain and augment the performance, security, and scalability of Data applications Stay updated on industry trends and technological breakthroughs to enhance our development methodologies continuously Requirements 5-8 years of hands-on experience in Data and related technologies Advanced understanding of Apache Spark High-level skills in Hadoop and Hive Proficiency in Python Experience with native Cloud data services on AWS and Azure

🌟 We're Hiring Creators at BettleByte! 🌟 Love crafting eye-catching designs or turning raw footage into scroll-stopping content? This one’s for you. BettleByte is on the hunt for a talented: 🎨 Graphic Designer 🎬 Video Editor Whether you're a pro with 1+ year of experience or an intern eager to prove your spark, we woud love to hear from you! 🛠️ What You Need to Know: ✔️ Proficiency in: – Adobe Photoshop – Adobe Illustrator – Adobe Premiere Pro 💼 What You’ll Work On: – Brand visuals, social media creatives, reels & shorts – Ad campaigns, product videos, motion graphics – Projects for startups, influencers, businesses & more 📍 Work Style: 3️⃣ Days Work From Office 3️⃣ Days Work From Home (Flexible, productive, and fun!) If you're passionate about visuals, vibes, and value-driven design, let’s build something brilliant at BettleByte 💥

We are seeking a highly experienced Senior Data Software Engineer to join our dynamic team and tackle challenging projects that will enhance your skills and career. As a Senior Engineer, your contributions will be critical in designing and implementing Data solutions across a variety of projects. The ideal candidate will possess deep experience in Big Data and associated technologies, with a strong emphasis on Apache Spark, Python, Azure and AWS. Responsibilities Develop and execute end-to-end Data solutions to meet complex business needs Work collaboratively with interdisciplinary teams to comprehend project needs and deliver superior software solutions Apply your expertise in Apache Spark, Python, Azure and AWS to create scalable and efficient data processing systems Maintain and enhance the performance, security, and scalability of Data applications Keep abreast of industry trends and technological advancements to foster continuous improvement in our development practices Requirements 5-8 years of direct experience in Data and related technologies Advanced knowledge and hands-on experience with Apache Spark High-level proficiency with Hadoop and Hive Proficiency in Python Prior experience with AWS and Azure native Cloud data services Technologies Hadoop Hive

Skill: Scala Grade -C2/D1 Location: Pune/Chennai & Bangalore NP: Immediate to 15 Days Joiners Only Strong analytical skills with experience of previously working within an area of Risk, Finance and Treasury. Good experience on SCALA and Apache Spark open-source data analytics cluster computing framework. Experience in working with different file formats like JSON, Parquet, AVRO, ORC and XML. Excellent inter-personal skills with experience of briefing, de-briefing and presenting to senior executives and having effective listening skills. Able to communicate effectively, both orally and in writing, with clients, colleagues and external vendors. Excellent time management and planning skills with experience of working under pressure. Ability to remain organized and able to prioritize multiple incident priorities. Highest standards of personal integrity, professional conduct and ethics. Incident, problem and change management skills Minimum qualification should be BE/BTech or Equivalent Scala, Spark

Skill: Scala with AWS Grade -C2 Location: Pan India NP: Immediate to 15 Days Joiners Only We are seeking a skilled Big Data Engineer with strong hands-on experience in Apache Spark, Scala, and AWS cloud services. The ideal candidate will be responsible for developing scalable data pipelines, processing large datasets, and deploying efficient Spark-based solutions on the AWS ecosystem. Design and develop distributed data processing pipelines using Apache Spark and Scala. Optimize Spark jobs for performance and scalability on AWS infrastructure. Integrate Spark applications with AWS services such as S3, EMR, Lambda, Glue, RDS, Athena, and Redshift. Write clean, reusable, and production-grade Scala code. Work with large-scale structured and unstructured data in real-time and batch modes. Ensure data quality, reliability, and consistency through monitoring and validations. Collaborate with data scientists, analysts, and business teams to understand requirements and deliver insights. Implement best practices for data engineering in a cloud-native environment. Required Skills: Strong programming skills in Scala 3+ years of hands-on experience with Apache Spark (RDD/DataFrame/SQL APIs) Experience working on AWS services like EMR, S3, Glue, Lambda, EC2, etc. Proficient in writing and optimizing complex Spark transformations and actions. Experience in working with large-scale data processing and distributed systems. Preferred Skills: Experience with Kafka, Airflow, or similar orchestration tools. Working knowledge of Python Experience with containerized deployments (Docker, Kubernetes). AWS certification (e.g., AWS Certified Data Analytics Specialty) is a plus. Aws, Scala, Spark

A Bachelors degree in Computer Science, Data Science, or a related field; a Master s is a plus 6 8 years of experience in data science with a strong track record of building and deploying ML solutions at scale Deep understanding of core ML techniques supervised, unsupervised, and semi-supervised learning along with strong foundations in statistics and linear algebra Exposure to deep learning concepts and architectures (e.g., CNNs, RNNs, Transformers) and their practical applications Proficiency in Python and SQL, with experience in building data pipelines and analytical workflows Hands-on experience with large-scale data processing using Apache Spark, Hadoop/Hive, or cloud platforms such as GCP Strong programming fundamentals and experience writing clean, maintainable, and production-ready code Excellent analytical and problem-solving skills the ability to extract actionable insights from messy and high-volume data Solid grasp of statistical testing, hypothesis validation, and common pitfalls in experimental design Experience designing and interpreting A/B tests, including uplift measurement and segmentation Ability to work closely with product and engineering teams to translate business goals into scalable ML or data solutions Bonus points for: Experience with reinforcement learning or sequence modeling techniques Contributions to ML libraries, internal tools, or research publications B2c, Cnn, Deploying, Fraud, Machine Learing, Network+, Search, Transformer

What You Will Need Bachelors/Masters degree in computer science (or similar degrees) 4-7 years of experience as a Data Scienti st in a fast-paced organizati on, preferably B2C Familiarity with Neural Networks, Machine Learning etc. Familiarity with tools like SQL, R, Python, etc. Strong understanding of Stati sti cs and Linear Algebra Strong understanding of hypothesis/model testi ng and ability to identi fy common modeltesti ng errors Experience designing and running A/B tests and drawing insights from them Profi ciency in machine learning algorithms Excellent analyti cal skills to fetch data from reliable sources to generate accurate insights Experience in tech and product teams is a plus Bonus points for: Experience in working on personalizati on or other ML problems Familiarity with Big Data tech stacks like Apache Spark, Hadoop, Redshift Algorithms, Apache Spark, Data Science, Etl, Large Scale, Linear Algebra, Ml, Neural Netwoks, Python, Sql

Content Creator - Mumbai - SoCheers : An end-to-end Marketing Agency Content Creator - Mumbai Content Creator / 1 years to 5 years / Mumbai Who You Are You re not just someone who watches shows and movies - you live them. Youre someone who always knows the hot take , the hidden reference , and the perfect meme for the moment. You: Can turn a scene, quote, or plot twist into content people want to share immediately. Know what s trending - not just what is , but what will be . Are obsessed with Instagram Reels, YouTube Shorts, and X (Twitter) - you scroll not just to consume, but to crack the code. Have a mind that thinks in formats - from 30-sec breakdowns to 5-moment recaps to this scene lives in my head rent-free. Are part pop-culture nerd, part content machine, and fully in love with storytelling. Understand that tone, timing, and thumb-stopping hooks make all the difference. Can spark emotion, FOMO, or LOLs - all within 30 seconds. What Youll Do Ideate, script, and execute content for the brand - covering shows, movies, creators, and pop-culture moments. Build formats that hook audiences - think review in 15 seconds, best scenes from episode 2, or why this dialogue broke the internet. Pitch reel ideas, trending hooks, and social-first series that make people share, save, and scream SO TRUE. Work closely with editors/designers to bring your concepts to life visually - and make sure it vibes right with the tone of the brand/page. Jump on trends - not just by following them, but reimagining them in your own way for your audience. Write scripts for reels, short-form video breakdowns, pop-culture explainers, and other fun formats. Keep an eye on analytics to understand what s working, what s flopping, and what needs a remix.

Summary: Looking for Experienced Databricks Resident consultants having prior working experience on Databricks Data Engineering. The candidate will be responsible for setting up Databricks Workspaces, creating Delta Lakes, Writing declarative ingestion pipelines & utilizing databricks data quality frameworks (constraints) to delivery high quality Data Pipelines. The role will be customer facing and will require unique problem solving, stakeholder management & thought leadership qualities. Roles and Responsibility: Proficient in data engineering, data platforms, and analytics with a strong track record of successful projects and in-depth knowledge of industry best practices. Should have worked on atleast 2 Datawarehouse Migration engagements in Past (Preferably one on Databricks, but can be non databricks migration also). Should have prior experience of Dimensional Data Modelling on tools like Erwin Modeller etc. 5+ years of hands-on experience in data engineering, with at least 2+ years in Databricks Architect and Apache Spark. Proficient in Cluster Management & Workspace Organisation. Proficient in Delta Lake Framework, Databricks Workspaces and Unity Catalog. Proficient in writing ETL Pipelines on Databricks by using Delta Live Tables for Streaming , Batch & Incremental Batch ingestion features. Comfortable architecting & writing code in either Python and SQL. Should have excellent understanding of Apache Spark Job Performance Tuning, Partitions Optimization etc. Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with expertise in at least one. Deep experience with distributed computing with Apache Spark and knowledge of Spark runtime internals. Familiarity with CI/CD for production deployments. Working knowledge of MLOps. Design and deployment of performant end-to-end data architectures. Experience with technical project delivery managing scope and timelines. Build skills in technical areas which support the deployment and integration of Databricks-based solutions to complete customer projects. Certifications: Databricks Certified Associate Developer for Apache Spark. Databricks Certified Professional Data Engineer. Cloud Certifications (AWS Certified Solutions Architect, Azure Solutions Architect Expert).

No of years experience 7+ Detailed job description - Skill Set: Should have 7+years of IT experience About 5+ yrs experience GCP(data proc,bigquery) Should have good communication Should be able to lead the team and coordinate with client. Mandatory Skills GCP, SPARK,PYTHON,

Xpetize Technology Solutions Private Limited is looking for Java Data Engineer to join our dynamic team and embark on a rewarding career journey. Liaising with coworkers and clients to elucidate the requirements for each task. Conceptualizing and generating infrastructure that allows big data to be accessed and analyzed. Reformulating existing frameworks to optimize their functioning. Testing such structures to ensure that they are fit for use. Preparing raw data for manipulation by data scientists. Detecting and correcting errors in your work. Ensuring that your work remains backed up and readily accessible to relevant coworkers. Remaining up - to - date with industry standards and technological advancements that will improve the quality of your outputs.

Detailed job description - Skill Set: Should have 7+years of IT experience About 5+ yrs experience GCP(data proc,bigquery) Should have good communication Should be able to lead the team and coordinate with client. Mandatory Skills GCP, SPARK,PYTHON,

The ideal candidate must possess strong communication skills, with an ability to listen, comprehend information, and share it with all the key stakeholders, highlighting opportunities for improvement and concerns, if any. He/she must be able to work collaboratively with teams to execute tasks within defined timeframes while maintaining high-quality standards and superior service levels. The ability to take proactive actions and willingness to take up responsibility beyond the assigned work area is a plus. Business Intelligence Specialist with 8 years of progressive experience in driving marketing & campaign performance analytics. Adept at developing and managing BI dashboards, automating reporting frameworks and delivering actionable insights to optimize campaign ROI, engagement and conversions. Senior Analyst Roles and responsibilities: Dashboarding & ReportingBuilt and maintained real-time dashboards and automated performance reports using Tableau / Power BI & SQL to ensure timely insights delivery. Performance Analytics & Insights Generation:Conducted funnel analysis, customer behavior modeling and trend identification to generate insights that enhanced marketing strategies. Cross-functional CollaborationWorked with marketing, product and data teams to align on KPIs and translate business needs into analytical solutions and presentations. Technical and Functional Skills: BI ToolsTableau / Power BI, LookerLanguagesSQL (Postgre SQL, MySQL), Python (Pandas, Matplotlib) / RData PlatformsGoogle BigQuery/ Snowflake / AWS RedshiftMarketing ToolsGoogle Analytics / Adobe Analytics / Salesforce Marketing Cloud / Adobe Analytics

We are seeking an experienced Lead Data Software Engineer to join our dynamic team and tackle rewarding challenges. As a Lead Engineer, you will be pivotal in creating and implementing Data solutions across various projects. The ideal candidate will possess deep experience in Data and associated technologies, strongly emphasizing Apache Spark, Python, Azure and AWS. Responsibilities Develop and execute end-to-end Data solutions for intricate business needs Work alongside cross-functional teams to comprehend project requirements and deliver superior software solutions Apply your knowledge in Apache Spark, Python, Azure and AWS to build scalable and effective data processing systems Maintain the performance, security, and scalability of Data applications Keep abreast of industry trends and advancements in Data technologies to enhance our development processes Requirements 8-12 years of hands-on experience in Data and Data-related technologies Expert-level knowledge and practical experience with Apache Spark Strong proficiency with Hadoop and Hive Proficiency in Python Experience working with native Cloud data services, specifically AWS and Azure Nice to have Background in machine learning algorithms and techniques Skills in data visualization tools such as Tableau or Power BI Knowledge of real-time data processing frameworks like Apache Flink or Apache Storm Understanding of containerization technologies like Docker or Kubernetes Technologies Hadoop Hive

We are seeking a highly experienced Senior Data Software Engineer to join our dynamic team and tackle challenging projects that will enhance your skills and career. As a Senior Engineer, your contributions will be critical in designing and implementing Data solutions across a variety of projects. The ideal candidate will possess deep experience in Big Data and associated technologies, with a strong emphasis on Apache Spark, Python, Azure and AWS. Responsibilities Develop and execute end-to-end Data solutions to meet complex business needs Work collaboratively with interdisciplinary teams to comprehend project needs and deliver superior software solutions Apply your expertise in Apache Spark, Python, Azure and AWS to create scalable and efficient data processing systems Maintain and enhance the performance, security, and scalability of Data applications Keep abreast of industry trends and technological advancements to foster continuous improvement in our development practices Requirements 5-8 years of direct experience in Data and related technologies Advanced knowledge and hands-on experience with Apache Spark High-level proficiency with Hadoop and Hive Proficiency in Python Prior experience with AWS and Azure native Cloud data services Technologies Hadoop Hive

The Applications Development Senior Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities. Responsibilities: Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems Ensure essential procedures are followed and help define operating standards and processes Serve as advisor or coach to new or lower level analysts Has the ability to operate with a limited level of direct supervision. Can exercise independence of judgement and autonomy. Acts as SME to senior stakeholders and /or other team members. Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency. Qualifications: 8 to 12 years of Application development experience with Java / J2EE technologies. The primary area of Experience with Core Java/J2EE Application with complete command over OOPs and Design Patterns. The candidate should be commendable in Data Structures and Algorithms. He should have worked on Core Application Development of complex size encompassing all areas of Java/J2EE. She/He should Thorough knowledge and hands on experience with one of among following technologies BIG data Hadoop knowledge with experience on Hive (or) Java based Spark Programming. She/He should have implemented or part complex project execution in Big Data Spark eco system, where processing volumes of data thorough understanding of distributed processing and integrated applications. Work in an agile environment following through the best practices of agile Scrum. Expertise in designing and optimizing the software solutions for performance and stability. Expertise in troubleshooting and problem solving. Expertise in Test driven development. Education: Bachelor’s degree/University degree or equivalent experience ------------------------------------------------------ Job Family Group: Technology ------------------------------------------------------ Job Family: Applications Development ------------------------------------------------------ Time Type: Full time ------------------------------------------------------ Most Relevant Skills Please see the requirements listed above. ------------------------------------------------------ Other Relevant Skills Java, Java Enterprise Edition. ------------------------------------------------------ Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law. If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi. View Citi’s EEO Policy Statement and the Know Your Rights poster.

We are seeking a highly experienced Senior Data Software Engineer to join our dynamic team and tackle challenging projects that will enhance your skills and career. As a Senior Engineer, your contributions will be critical in designing and implementing Data solutions across a variety of projects. The ideal candidate will possess deep experience in Big Data and associated technologies, with a strong emphasis on Apache Spark, Python, Azure and AWS. Responsibilities Develop and execute end-to-end Data solutions to meet complex business needs Work collaboratively with interdisciplinary teams to comprehend project needs and deliver superior software solutions Apply your expertise in Apache Spark, Python, Azure and AWS to create scalable and efficient data processing systems Maintain and enhance the performance, security, and scalability of Data applications Keep abreast of industry trends and technological advancements to foster continuous improvement in our development practices Requirements 5-8 years of direct experience in Data and related technologies Advanced knowledge and hands-on experience with Apache Spark High-level proficiency with Hadoop and Hive Proficiency in Python Prior experience with AWS and Azure native Cloud data services Technologies Hadoop Hive

Job Summary As a Software Engineer at NetApp India’s R&D division, you will be responsible for the design, development and validation of software for Big Data Engineering across both cloud and on-premises environments. You will be part of a highly skilled technical team named NetApp Active IQ. The Active IQ DataHub platform processes over 10 trillion data points per month that feeds a multi-Petabyte DataLake. The platform is built using Kafka, a serverless platform running on Kubernetes, Spark and various NoSQL databases. This platform enables the use of advanced AI and ML techniques to uncover opportunities to proactively protect and optimize NetApp storage, and then provides the insights and actions to make it happen. We call this “actionable intelligence”. Job Requirements Design and build our Big Data Platform, and understand scale, performance and fault-tolerance • Interact with Active IQ engineering teams across geographies to leverage expertise and contribute to the tech community. • Identify the right tools to deliver product features by performing research, POCs and interacting with various open-source forums • Work on technologies related to NoSQL, SQL and in-memory databases • Conduct code reviews to ensure code quality, consistency and best practices adherence. Technical Skills • Big Data hands-on development experience is required. • Demonstrate up-to-date expertise in Data Engineering, complex data pipeline development. • Design, develop, implement and tune distributed data processing pipelines that process large volumes of data; focusing on scalability, low -latency, and fault-tolerance in every system built. • Awareness of Data Governance (Data Quality, Metadata Management, Security, etc.) • Experience with one or more of Python/Java/Scala. • Knowledge and experience with Kafka, Storm, Druid, Cassandra or Presto is an added advantage. Education • A minimum of 5 years of experience is required. 5-8 years of experience is preferred. • A Bachelor of Science Degree in Electrical Engineering or Computer Science, or a Master Degree; or equivalent experience is required.

Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients acrossbanking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery. WHY JOIN CAPCO You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry. MAKE AN IMPACT Innovative thinking, delivery excellence and thought leadership to help our clients transform their business. Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services. #BEYOURSELFATWORK Capco has a tolerant, open culture that values diversity, inclusivity, and creativity. CAREER ADVANCEMENT With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands. DIVERSITY & INCLUSION We believe that diversity of people and perspective gives us a competitive advantage. Job TitleJava Developer LocationBangalore Experience5+ yrs Required Skill : Proficiency in Java, with a good understanding of its ecosystems Sound knowledge ofObject-Oriented Programming (OOP)Patterns and Concepts Familiarity with different design and architectural patterns Skill for writing reusable Java libraries Knowhow of Java concurrency patterns Basic Understanding of the concepts ofMVC (Model-View-Controller) Pattern, JDBC (Java Database Connectivity), and RESTful web services Experience in working with popular web application frameworks like Play and Spark Relevant Knowledge of Java GUI frameworks like Swing, SWT, AWT according to project requirements Ability to write clean, readable Java code Basic knowhow of class loading mechanism in Java Experience in handling external and embedded databases Understanding basic design principles behind a scalable application Skilled at creating database schemas that characterize and support business processes Basic knowledge of JVM (Java Virtual Machine), its drawbacks, weaknesses, and workarounds Implementing automated testing platforms and unit tests In-depth knowledge of code versioning tools, for instance, Git Understanding of building tools like Ant, Maven, Gradle, etc Expertise in continuous integration

Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount . With our presence across 32 cities across globe, we support 100+ clients acrossbanking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery. WHY JOIN CAPCO You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry. MAKE AN IMPACT Innovative thinking, delivery excellence and thought leadership to help our clients transform their business. Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services. #BEYOURSELFATWORK Capco has a tolerant, open culture that values diversity, inclusivity, and creativity. CAREER ADVANCEMENT With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands. DIVERSITY & INCLUSION We believe that diversity of people and perspective gives us a competitive advantage. MAKE AN IMPACT JOB SUMMARY: Position Sr Consultant Location Capco Locations (Bengaluru/ Chennai/ Hyderabad/ Pune/ Mumbai/ Gurugram) Band M3/M4 (8 to 14 years) Role Description: Job TitleSenior Consultant - Data Engineer Responsibilities Design, build and optimise data pipelines and ETL processes in Azure Databricks ensuring high performance, reliability, and scalability. Implement best practices for data ingestion, transformation, and cleansing to ensure data quality and integrity. Work within clients best practice guidelines as set out by the Data Engineering Lead Work with data modellers and testers to ensure pipelines are implemented correctly. Collaborate as part of a cross-functional team to understand business requirements and translate them into technical solutions. Role Requirements Strong Data Engineer with experience in Financial Services Knowledge of and experience building data pipelines in Azure Databricks Demonstrate a continual desire to implement strategic or optimal solutions and where possible, avoid workarounds or short term tactical solutions Work within an Agile team Experience/Skillset 8+ years experience in data engineering Good skills in SQL, Python and PySpark Good knowledge of Azure Databricks (understanding of delta tables, Apache Spark, Unity Catalog) Experience writing, optimizing, and analyzing SQL and PySpark code, with a robust capability to interpret complex data requirements and architect solutions Good knowledge of SDLC Familiar with Agile/Scrum ways of working Strong verbal and written communication skills Ability to manage multiple priorities and deliver to tight deadlines WHY JOIN CAPCO You will work on engaging projects with some of the largest banks in the world, on projects that will transform the financial services industry. We offer A work culture focused on innovation and creating lasting value for our clients and employees Ongoing learning opportunities to help you acquire new skills or deepen existing expertise A flat, non-hierarchical structure that will enable you to work with senior partners and directly with clients A diverse, inclusive, meritocratic culture We offer: A work culture focused on innovation and creating lasting value for our clients and employees Ongoing learning opportunities to help you acquire new skills or deepen existing expertise A flat, non-hierarchical structure that will enable you to work with senior partners and directly with clients #LI-Hybrid

: The Senior Data Engineer will be responsible for designing, developing, and maintaining scalable data pipelines and building out new API integrations to support continuing increases in data volume and complexity. They will collaborate with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization. Responsibilities: Design, construct, install, test and maintain highly scalable data management systems & Data Pipeline. Ensure systems meet business requirements and industry practices. Build high-performance algorithms, prototypes, predictive models, and proof of concepts. Research opportunities for data acquisition and new uses for existing data. Develop data set processes for data modeling, mining and production. Integrate new data management technologies and software engineering tools into existing structures. Create custom software components and analytics applications. Install and update disaster recovery procedures. Collaborate with data architects, modelers, and IT team members on project goals. Provide senior level technical consulting to peer data engineers during data application design and development for highly complex and critical data projects. Qualifications: Bachelor's degree in computer science, Engineering, or related field, or equivalent work experience. Proven 5-8 years of experienceas a Senior Data Engineer or similar role. Experience with big data toolsHadoop, Spark, Kafka, Ansible, chef, Terraform, Airflow, and Protobuf RPC etc. Expert level SQL skills for data manipulation (DML) and validation (DB2). Experience with data pipeline and workflow management tools. Experience with object-oriented/object function scripting languagesPython, Java, Go langetc. Strong problem solving and analytical skills. Excellent verbal communication skills. Good interpersonal skills. Ability to provide technical leadership for the team.

Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount . With our presence across 32 cities across globe, we support 100+ clients acrossbanking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery. WHY JOIN CAPCO You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry. MAKE AN IMPACT Innovative thinking, delivery excellence and thought leadership to help our clients transform their business. Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services. #BEYOURSELFATWORK Capco has a tolerant, open culture that values diversity, inclusivity, and creativity. CAREER ADVANCEMENT With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands. DIVERSITY & INCLUSION We believe that diversity of people and perspective gives us a competitive advantage. MAKE AN IMPACT JOB SUMMARY: Position Sr Consultant Location Pune / Bangalore Band M3/M4 (7 to 14 years) Role Description: Must Have Skills: Should have experience in PySpark and Scala + Spark for 4+ years (Min experience). Proficient in debugging and data analysis skills. Should have Spark experience of 4+ years Should have understanding of SDLC and Big Data Application Life Cycle Should have experience in GIT HUB and GIT commands Good to have experience in CICD tools such Jenkins and Ansible Fast problem solving and self-starter Should have experience in using Control-M and Service Now (for Incident management ) Positive attitude, good communication skills (written and verbal both), should not have mother tongue interference. WHY JOIN CAPCO You will work on engaging projects with some of the largest banks in the world, on projects that will transform the financial services industry. We offer A work culture focused on innovation and creating lasting value for our clients and employees Ongoing learning opportunities to help you acquire new skills or deepen existing expertise A flat, non-hierarchical structure that will enable you to work with senior partners and directly with clients A diverse, inclusive, meritocratic culture We offer: A work culture focused on innovation and creating lasting value for our clients and employees Ongoing learning opportunities to help you acquire new skills or deepen existing expertise A flat, non-hierarchical structure that will enable you to work with senior partners and directly with clients #LI-Hybrid

Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients acrossbanking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery. WHY JOIN CAPCO You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry. MAKE AN IMPACT Innovative thinking, delivery excellence and thought leadership to help our clients transform their business. Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services. #BEYOURSELFATWORK Capco has a tolerant, open culture that values diversity, inclusivity, and creativity. CAREER ADVANCEMENT With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands. DIVERSITY & INCLUSION We believe that diversity of people and perspective gives us a competitive advantage. MAKE AN IMPACT Big Data Tester LocationPune (for Mastercard) Experience Level5-9 years Minimum Skill Set Required / Must Have Python PySpark Testing skills and best practices for data validation SQL (hands-on experience, especially with complex queries) and ETL Good to Have Unix Big Data: Hadoop, Spark, Kafka, NoSQL databases (MongoDB, Cassandra), Hive, etc. Data Warehouse: TraditionalOracle, Teradata, SQL Server Modern CloudAmazon Redshift, Google BigQuery, Snowflake AWS development experience (not mandatory, but beneficial) Best Fit Python + PySpark + Testing + SQL (hands-on) and ETL + Good to Have skills

Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients acrossbanking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery. WHY JOIN CAPCO You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry. MAKE AN IMPACT Innovative thinking, delivery excellence and thought leadership to help our clients transform their business. Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services. #BEYOURSELFATWORK Capco has a tolerant, open culture that values diversity, inclusivity, and creativity. CAREER ADVANCEMENT With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands. DIVERSITY & INCLUSION We believe that diversity of people and perspective gives us a competitive advantage. MAKE AN IMPACT Job TitleBig Data Engineer : The Senior Data Engineer will be responsible for designing, developing, and maintaining scalable data pipelines and building out new API integrations to support continuing increases in data volume and complexity. They will collaborate with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization. Responsibilities: Design, construct, install, test and maintain highly scalable data management systems & Data Pipeline. Ensure systems meet business requirements and industry practices. Build high-performance algorithms, prototypes, predictive models, and proof of concepts. Research opportunities for data acquisition and new uses for existing data. Develop data set processes for data modeling, mining and production. Integrate new data management technologies and software engineering tools into existing structures. Create custom software components and analytics applications. Install and update disaster recovery procedures. Collaborate with data architects, modelers, and IT team members on project goals. Provide senior level technical consulting to peer data engineers during data application design and development for highly complex and critical data projects. Qualifications: Bachelor's degree in Computer Science, Engineering, or related field, or equivalent work experience. Proven 5-8 years of experienceas a Senior Data Engineer or similar role. Experience with big data toolsPyspark, Hadoop, Spark, Kafka, Ansible, chef, Terraform, Airflow, and Protobuf RPC etc.. Expert level SQL skills for data manipulation (DML) and validation (DB2). Experience with data pipeline and workflow management tools. Experience with object-oriented/object function scripting languagesPython, Java, Go langetc. Strong problem solving and analytical skills. Excellent verbal communication skills. Good interpersonal skills. Ability to provide technical leadership for the team.

Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients acrossbanking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery. WHY JOIN CAPCO You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry. MAKE AN IMPACT Innovative thinking, delivery excellence and thought leadership to help our clients transform their business. Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services. #BEYOURSELFATWORK Capco has a tolerant, open culture that values diversity, inclusivity, and creativity. CAREER ADVANCEMENT With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands. DIVERSITY & INCLUSION We believe that diversity of people and perspective gives us a competitive advantage. Location - Bangalore Skills and Qualifications : At least 6+ years' relevant experience would generally be expected to find the skills required for this role. 6+ years of being a practitioner in data engineering or a related field. Strong programming skills in Python, with experience in data manipulation and analysis libraries (e.g., Pandas, NumPy, Dask). Proficiency in SQL and experience with relational databases (e.g., Sybase, DB2, Snowflake, PostgreSQL, SQL Server). Experience with data warehousing concepts and technologies (e.g., dimensional modeling, star schema, data vault modeling, Kimball methodology, Inmon methodology, data lake design). Familiarity with ETL/ELT processes and tools (e.g., Informatica PowerCenter, IBM DataStage, Ab Initio) and open-source frameworks for data transformation (e.g., Apache Spark, Apache Airflow). Experience with message queues and streaming platforms (e.g., Kafka, RabbitMQ). Experience with version control systems (e.g., Git). Experience using Jupyter notebooks for data exploration, analysis, and visualization. Excellent communication and collaboration skills. Ability to work independently and as part of a geographically distributed team. Nice to have Understanding of any cloud-based application development & Dev Ops. Understanding of business intelligence tools - Tableau,PowerBI Understanding of Trade Lifecycle / Financial markets. If you are keen to join us, you will be part of an organization that values your contributions, recognizes your potential, and provides ample opportunities for growth. For more information, visit www.capco.com. Follow us on Twitter, Facebook, LinkedIn, and YouTube.