992 Dataflow Jobs - Page 15

We are seeking a skilled Data Engineer with over 6+ years of experience to design, build, and maintain scalable data pipelines and perform advanced data analysis to support business intelligence and data-driven decision-making. The ideal candidate will have a strong foundation in computer science principles, extensive experience with SQL and big data tools, and proficiency in cloud platforms and data visualization tools. Key Responsibilities: Design, develop, and maintain robust, scalable ETL pipelines using Apache Airflow, DBT, Composer, Control-M, Cron, Luigi, and similar tools. Build and optimize data architectures including data lakes and data warehouses. Integrate data from multiple sources ensuring data quality and consistency. Collaborate with data scientists, analysts, and stakeholders to translate business requirements into technical solutions. Analyze complex datasets to identify trends, generate actionable insights, and support decision-making. Develop and maintain dashboards and reports using Tableau, Power BI, and Jupyter Notebooks for visualization and pipeline validation. Manage and optimize relational and NoSQL databases such as MySQL, PostgreSQL, Oracle, MongoDB, and DynamoDB. Work with big data tools and frameworks including Hadoop, Spark, Hive, Kafka, Informatica, Talend, SSIS, and Dataflow. Utilize cloud data services and warehouses like AWS Glue, GCP Dataflow, Azure Data Factory, Snowflake, Redshift, and BigQuery. Support CI/CD pipelines and DevOps workflows using Git, Docker, Terraform, and related tools. Ensure data governance, security, and compliance standards are met. Participate in Agile and DevOps processes to enhance data engineering workflows. Required Qualifications: 6+ years of professional experience in data engineering and data analysis roles. Strong proficiency in SQL and experience with database management systems such as MySQL, PostgreSQL, Oracle, and MongoDB. Hands-on experience with big data tools like Hadoop and Apache Spark. Proficient in Python programming. Experience with data visualization tools such as Tableau, Power BI, and Jupyter Notebooks. Proven ability to design, build, and maintain scalable ETL pipelines using tools like Apache Airflow, DBT, Composer (GCP), Control-M, Cron, and Luigi. Familiarity with data engineering tools including Hive, Kafka, Informatica, Talend, SSIS, and Dataflow. Experience working with cloud data warehouses and services (Snowflake, Redshift, BigQuery, AWS Glue, GCP Dataflow, Azure Data Factory). Understanding of data modeling concepts and data lake/data warehouse architectures. Experience supporting CI/CD practices with Git, Docker, Terraform, and DevOps workflows. Knowledge of both relational and NoSQL databases, including PostgreSQL, BigQuery, MongoDB, and DynamoDB. Exposure to Agile and DevOps methodologies. Experience with Amazon Web Services (S3, Glue, Redshift, Lambda, Athena) Preferred Skills: Strong problem-solving and communication skills. Ability to work independently and collaboratively in a team environment. Experience with service development, REST APIs, and automation testing is a plus. Familiarity with version control systems and workflow automation.

General Skills & Experience: Minimum 10-18 yrs of Experience • Expertise in Spark (Scala/Python), Kafka, and cloud-native big data services (GCP, AWS, Azure) for ETL, batch, and stream processing. • Deep knowledge of cloud platforms (AWS, Azure, GCP), including certification (preferred). • Experience designing and managing advanced data warehousing and lakehouse architectures (e.g., Snowflake, Databricks, Delta Lake, BigQuery, Redshift, Synapse). • Proven experience with building, managing, and optimizing ETL/ELT pipelines and data workflows for large-scale systems. • Strong experience with data lakes, storage formats (Parquet, ORC, Delta, Iceberg), and data movement strategies (cloud and hybrid). • Advanced knowledge of data modeling, SQL development, data partitioning, optimization, and database administration. • Solid understanding and experience with Master Data Management (MDM) solutions and reference data frameworks. • Proficient in implementing Data Lineage, Data Cataloging, and Data Governance solutions (e.g., AWS Glue Data Catalog, Azure Purview). • Familiar with data privacy, data security, compliance regulations (GDPR, CCPA, HIPAA, etc.), and best practices for enterprise data protection. • Experience with data integration tools and technologies (e.g. AWS Glue, GCP Dataflow , Apache Nifi/Airflow, etc.). • Expertise in batch and real-time data processing architectures; familiarity with event-driven, microservices, and message-driven patterns. • Hands-on experience in Data Analytics, BI & visualization tools (PowerBI, Tableau, Looker, Qlik, etc.) and supporting complex reporting use-cases. • Demonstrated capability with data modernization projects: migrations from legacy/on-prem systems to cloud-native architectures. • Experience with data quality frameworks, monitoring, and observability (data validation, metrics, lineage, health checks). • Background in working with structured, semi-structured, unstructured, temporal, and time series data at large scale. • Familiarity with Data Science and ML pipeline integration (DevOps/MLOps, model monitoring, and deployment practices). • Experience defining and managing enterprise metadata strategies.

We are looking for a Google Cloud Data Engineer who will help us build a highly scalable and reliable platform to match our exponential growth. As a Google Cloud Data Engineer, you will be responsible for building a solid back end infrastructure which will enable data delivery in near real-time using next-gen technologies. Title : Google Cloud Data Engineer Location : Remote Work Employment Type : Full Time Work Timings : 2PM to 11 PM No of Openings : 3 We are looking for a candidate with Google Cloud Data Engineering experience only who can join us within 15 days or less. Applications not meeting this requirement will not be considered. Roles and Responsibilities: Design, develop, and maintain scalable data pipelines on Google Cloud Platform (GCP). Implement data processing solutions using GCP services such as BigQuery, Dataflow, Data Proc, Pub/Sub, and Cloud Storage. Optimize data processing and storage for performance, cost, and scalability. Ensure data quality and integrity by implementing best practices for data governance and monitoring. Develop and maintain documentation for data pipelines, architectures, and processes. Stay up-to-date with the latest advancements in data engineering and GCP technologies. Qualifications: Bachelor’s degree in Computer Science, Engineering, or a related field. Proven experience as a Data Engineer with a focus on Google Cloud Platform (GCP). Proficiency in GCP services such as BigQuery, Dataflow, Pub/Sub, Cloud Storage , and others. Strong programming skills in Python, Java, or similar languages. Experience with SQL and relational databases. Familiarity with data modeling, ETL processes, and data warehousing concepts. Knowledge of best practices in data security and privacy. Excellent problem-solving skills and attention to detail. Strong communication and collaboration skills. Preferred Skills : Google Cloud Data Engineer certification. About Techolution: Techolution is a leading innovation consulting company on track to become one of the most admired brands in the world for "innovation done right". Our purpose is to harness our expertise in novel technologies to deliver more profits for our enterprise clients while helping them deliver a better human experience for the communities they serve. With that, we are now fully committed to helping our clients build the enterprise of tomorrow by making the leap from Lab Grade AI to Real World AI. In 2019, we won the prestigious Inc. 500 Fastest-Growing Companies in America award, only 4 years after its formation. In 2022, Techolution was honored with the “Best-in-Business” title by Inc. for “Innovation Done Right”. Most recently, we received the “AIConics” trophy for being the Top AI Solution Provider of the Year at the AI Summit in New York. Let’s give you more insights! Some videos you wanna watch! Life at Techolution GoogleNext 2023 Ai4 - Artificial Intelligence Conferences 2023 WaWa - Solving Food Wastage Saving lives - Brooklyn Hospital Innovation Done Right on Google Cloud Techolution featured on Worldwide Business with KathyIreland Techolution presented by ION World’s Greatest Visit us @ www.techolution.com : To know more about our revolutionary core practices and getting to know in detail about how we enrich the human experience with technology.

Equifax is where you can power your possible. If you want to achieve your true potential, chart new paths, develop new skills, collaborate with bright minds, and make a meaningful impact, we want to hear from you. You are passionate about quality and how customers experience the products you test. You have the ability to create, maintain and execute test plans in order to verify requirements. As a Quality Engineer at Equifax, you will be a catalyst in both the development and the testing of high priority initiatives. You will develop and test new products to support technology operations while maintaining exemplary standards. As a collaborative member of the team, you will deliver QA services (code quality, testing services, performance engineering, development collaboration and continuous integration). You will conduct quality control tests in order to ensure full compliance with specified standards and end user requirements. You will execute tests using established plans and scripts; documents problems in an issues log and retest to ensure problems are resolved. You will create test files to thoroughly test program logic and verify system flow. You will identify, recommend and implement changes to enhance effectiveness of QA strategies. What You Will Do Independently develop scalable and reliable automated tests and frameworks for testing software solutions. Specify and automate test scenarios and test data for a highly complex business by analyzing integration points, data flows, personas, authorization schemes and environments Develop regression suites, develop automation scenarios, and move automation to an agile continuous testing model. Pro-actively and collaboratively taking part in all testing related activities while establishing partnerships with key stakeholders in Product, Development/Engineering, and Technology Operations. What Experience You Need Bachelor's degree in a STEM major or equivalent experience 5-7 years of software testing experience Able to create and review test automation according to specifications Ability to write, debug, and troubleshoot code in Java, Springboot, TypeScript/JavaScript, HTML, CSS Creation and use of big data processing solutions using Dataflow/Apache Beam, Bigtable, BigQuery, PubSub, GCS, Composer/Airflow, and others with respect to software validation Created test strategies and plans Led complex testing efforts or projects Participated in Sprint Planning as the Test Lead Collaborated with Product Owners, SREs, Technical Architects to define testing strategies and plans. Design and development of micro services using Java, Springboot, GCP SDKs, GKE/Kubeneties Deploy and release software using Jenkins CI/CD pipelines, understand infrastructure-as-code concepts, Helm Charts, and Terraform constructs Cloud Certification Strongly Preferred What Could Set You Apart An ability to demonstrate successful performance of our Success Profile skills, including: Attention to Detail - Define test case candidates for automation that are outside of product specifications. i.e. Negative Testing; Create thorough and accurate documentation of all work including status updates to summarize project highlights; validating that processes operate properly and conform to standards Automation - Automate defined test cases and test suites per project Collaboration - Collaborate with Product Owners and development team to plan and and assist with user acceptance testing; Collaborate with product owners, development leads and architects on functional and non-functional test strategies and plans Execution - Develop scalable and reliable automated tests; Develop performance testing scripts to assure products are adhering to the documented SLO/SLI/SLAs; Specify the need for Test Data types for automated testing; Create automated tests and tests data for projects; Develop automated regression suites; Integrate automated regression tests into the CI/CD pipeline; Work with teams on E2E testing strategies and plans against multiple product integration points Quality Control - Perform defect analysis, in-depth technical root cause analysis, identifying trends and recommendations to resolve complex functional issues and process improvements; Analyzes results of functional and non-functional tests and make recommendation for improvements; Performance / Resilience: Understanding application and network architecture as inputs to create performance and resilience test strategies and plans for each product and platform. Conducting the performance and resilience testing to ensure the products meet SLAs / SLOs Quality Focus - Review test cases for complete functional coverage; Review quality section of Production Readiness Review for completeness; Recommend changes to existing testing methodologies for effectiveness and efficiency of product validation; Ensure communications are thorough and accurate for all work documentation including status and project updates Risk Mitigation - Work with Product Owners, QE and development team leads to track and determine prioritization of defects fixes We offer a hybrid work setting, comprehensive compensation and healthcare packages, attractive paid time off, and organizational growth potential through our online learning platform with guided career tracks. Are you ready to power your possible? Apply today, and get started on a path toward an exciting new career at Equifax, where you can make a difference! Who is Equifax? At Equifax, we believe knowledge drives progress. As a global data, analytics and technology company, we play an essential role in the global economy by helping employers, employees, financial institutions and government agencies make critical decisions with greater confidence. We work to help create seamless and positive experiences during life’s pivotal moments: applying for jobs or a mortgage, financing an education or buying a car. Our impact is real and to accomplish our goals we focus on nurturing our people for career advancement and their learning and development, supporting our next generation of leaders, maintaining an inclusive and diverse work environment, and regularly engaging and recognizing our employees. Regardless of location or role, the individual and collective work of our employees makes a difference and we are looking for talented team players to join us as we help people live their financial best. Equifax is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

Area(s) of responsibility About Birlasoft Birlasoft, a global leader at the forefront of Cloud, AI, and Digital technologies, seamlessly blends domain expertise with enterprise solutions. The company’s consultative and design-thinking approach empowers societies worldwide, enhancing the efficiency and productivity of businesses. As part of the multibillion-dollar diversified CKA Birla Group, Birlasoft with its 12,000+ professionals, is committed to continuing the Group’s 170-year heritage of building sustainable communities. About the Job – Ability to relate the product functionality to business processes, and thus offer implementation advice to customers on how to meet their various business scenarios. Job Title – GCP BigQuery Engineer Location: Pune/Bangalore/Mumbai Educational Background – BE/Btech Key Responsibilities – Must Have Skills Should have 4-8 Years of Exp Data Quality Management (DQM) Specialist - Quick Base Location:** Mumbai, Pune, Bangalore We are seeking a highly skilled and experienced Data Quality Management (DQM) Specialist with expertise in Quick Base to join our team. Hands on experience in implementing and managing data quality initiatives, with a strong focus on utilizing Quick Base as a data quality management tool. As a DQM Specialist, you will be responsible for developing, implementing, and maintaining data quality processes and standards using Quick Base to ensure the accuracy, completeness, and consistency of our organization's data assets Experience with data modeling, schema design, and optimization techniques in BigQuery. Hands-on experience with GCP services such as Cloud Dataflow, Cloud Storage, Data Transfer Service, and Data Studio.

You are passionate about quality and how customers experience the products you test. You have the ability to create, maintain and execute test plans in order to verify requirements. As a Quality Engineer at Equifax, you will be a catalyst in both the development and the testing of high priority initiatives. You will develop and test new products to support technology operations while maintaining exemplary standards. As a collaborative member of the team, you will deliver QA services (code quality, testing services, performance engineering, development collaboration and continuous integration). You will conduct quality control tests in order to ensure full compliance with specified standards and end user requirements. You will execute tests using established plans and scripts; documents problems in an issues log and retest to ensure problems are resolved. You will create test files to thoroughly test program logic and verify system flow. You will identify, recommend and implement changes to enhance effectiveness of QA strategies. What You Will Do Independently develop scalable and reliable automated tests and frameworks for testing software solutions. Specify and automate test scenarios and test data for a highly complex business by analyzing integration points, data flows, personas, authorization schemes and environments Develop regression suites, develop automation scenarios, and move automation to an agile continuous testing model. Pro-actively and collaboratively taking part in all testing related activities while establishing partnerships with key stakeholders in Product, Development/Engineering, and Technology Operations. What Experience You Need Bachelor's degree in a STEM major or equivalent experience 5-7 years of software testing experience Able to create and review test automation according to specifications Ability to write, debug, and troubleshoot code in Java, Springboot, TypeScript/JavaScript, HTML, CSS Creation and use of big data processing solutions using Dataflow/Apache Beam, Bigtable, BigQuery, PubSub, GCS, Composer/Airflow, and others with respect to software validation Created test strategies and plans Led complex testing efforts or projects Participated in Sprint Planning as the Test Lead Collaborated with Product Owners, SREs, Technical Architects to define testing strategies and plans. Design and development of micro services using Java, Springboot, GCP SDKs, GKE/Kubeneties Deploy and release software using Jenkins CI/CD pipelines, understand infrastructure-as-code concepts, Helm Charts, and Terraform constructs Cloud Certification Strongly Preferred What Could Set You Apart An ability to demonstrate successful performance of our Success Profile skills, including: Attention to Detail - Define test case candidates for automation that are outside of product specifications. i.e. Negative Testing; Create thorough and accurate documentation of all work including status updates to summarize project highlights; validating that processes operate properly and conform to standards Automation - Automate defined test cases and test suites per project Collaboration - Collaborate with Product Owners and development team to plan and and assist with user acceptance testing; Collaborate with product owners, development leads and architects on functional and non-functional test strategies and plans Execution - Develop scalable and reliable automated tests; Develop performance testing scripts to assure products are adhering to the documented SLO/SLI/SLAs; Specify the need for Test Data types for automated testing; Create automated tests and tests data for projects; Develop automated regression suites; Integrate automated regression tests into the CI/CD pipeline; Work with teams on E2E testing strategies and plans against multiple product integration points Quality Control - Perform defect analysis, in-depth technical root cause analysis, identifying trends and recommendations to resolve complex functional issues and process improvements; Analyzes results of functional and non-functional tests and make recommendation for improvements; Performance / Resilience: Understanding application and network architecture as inputs to create performance and resilience test strategies and plans for each product and platform. Conducting the performance and resilience testing to ensure the products meet SLAs / SLOs Quality Focus - Review test cases for complete functional coverage; Review quality section of Production Readiness Review for completeness; Recommend changes to existing testing methodologies for effectiveness and efficiency of product validation; Ensure communications are thorough and accurate for all work documentation including status and project updates Risk Mitigation - Work with Product Owners, QE and development team leads to track and determine prioritization of defects fixes

The client is looking to hire Nursing & Healthcare Assistants for their Rehabilitation Centre in Oman. Candidates willing to relocate to Oman may apply. Below are the vacancies we have for this project: ✓ Nursing Assistants Qualification: GNM (or) BSc – Nursing Experience: 3 years Positive dataflow reports are Mandatory ✓ Healthcare Assistant Qualification: GNM (or) BSc – Nursing Experience: 3 years Positive dataflow reports are Mandatory Other benefits: • Free Joining Ticket (Will be reimbursed after the 3 months Probation period) • 30 Days paid Annual leave after 1 year of service completion • Yearly Up and Down Air Ticket • Medical Insurance • Life Insurance • Accommodation (Charged at a nominal fee)

M3J Technical Services is seeking a Data Integration & Reporting Analyst adept at automating reports, extracting and cleansing data, and crafting impactful visualizations for KPI’s using tools like Power BI and Excel. You'll develop data-driven applications for desktop, web, and mobile platforms, ensuring our business remains agile and poised for growth. If you're passionate about leveraging data to drive strategic solutions, join our team! Local candidates based in Vadodara, Gujarat preferred. Responsibilities: Collaborate with stakeholders to design and publish Power BI reports aligned with business goals. Analyze and understand business processes to develop reports tailored to specific operational needs. Prepare and transform data from sources such as SQL Server, Excel, and SharePoint using Microsoft Fabric tools, including Dataflow Gen 2, Power Query, Lakehouse, and other related tools. Develop data models and optimize report performance, including row-level security. Maintain clear documentation and provide user training and support for Power BI. Actively contribute to process improvement initiatives by leveraging the Microsoft Power Platform (Power Apps, Power Automate, SharePoint) to enhance data collection and workflow automation. Qualifications: Bachelor’s degree in Computer Science, Industrial Engineering, Data Science, or Related field; or equivalent work experience. Solid understanding of BI concepts and data visualization best practices. 3+ years of hands-on experience with Power BI development. Strong skills in DAX, Power Query (M), and data modeling. Proficient in SQL and working with relational databases. 5+ years of working experience with Excel and Power Query. Experience with Fabric and other data integration tools. High attention to detail and the ability to work independently. Strong analytical and organizational skills. Excellent written and verbal communication skills. Results-oriented, proactive, and possessing a high level of integrity. Microsoft Certified: Power BI Data Analyst Associate is a plus Preferred Qualifications: Experience with Power BI Service administration (fabric, dataflows, workspaces, security, and dataset refresh). Familiarity with Microsoft Fabric, Power Automate, or SharePoint. Able to work independently and take initiative to improve data collection and reporting using modern tools and best practices. Language Requirement: Fluent in English Schedule: Monday to Friday Working Hours: 8am to 5pm Central US Time, or must be available to work at least 4 hours of the day during 8am to 4pm US Central Time Zone. Work Location: Vadodara, Gujarat, India (Preference will be given to candidates located in Vadodara, Gujarat.) Job Types: Full-time, Permanent Benefits: Flexible schedule Paid sick time Paid time off Schedule: Monday to Friday Supplemental Pay: Yearly bonus Application Question(s): Please share with us your desired salary. Have you implemented reuse of dataflows across multiple reports or workspaces? Would you be open to presenting a Power BI report you developed professionally — and explaining your approach to data connection, transformation, and solving performance or business logic challenges? Work Location: In person

Role Description Hiring Locations: Chennai, Trivandrum, Kochi Experience Range: 3 to 6 years Role Description The L1 Data Ops Analyst / Data Pipeline Developer is responsible for developing, testing, and maintaining robust data pipelines and monitoring operational dashboards to ensure smooth data flow. This role demands proficiency in data engineering tools, SQL, and cloud platforms, with the ability to work independently and in 24x7 shift environments. The candidate should be capable of analyzing data, troubleshooting issues using SOPs, and collaborating effectively across support levels. Key Responsibilities Development & Engineering: Design, code, test, and implement scalable and efficient data pipelines. Develop features in accordance with requirements and low-level design. Write optimized, clean code using Python, PySpark, SQL, and ETL tools. Conduct unit testing and validate data integrity. Maintain comprehensive documentation of work. Monitoring & Support Monitor dashboards, pipelines, and databases across assigned shifts. Identify, escalate, and resolve anomalies using defined SOPs. Collaborate with L2/L3 teams to ensure timely issue resolution. Analyze trends and anomalies using SQL and Excel. Process Adherence & Contribution Follow configuration and release management processes. Participate in estimation, knowledge sharing, and defect management. Adhere to SLA and compliance standards. Contribute to internal documentation and knowledge bases. Mandatory Skills Strong command of SQL for data querying and analysis. Proficiency in Python or PySpark for data manipulation. Experience in ETL tools (any of the following): Informatica, Talend, Apache Airflow, AWS Glue, Azure ADF, GCP DataProc/DataFlow. Experience working with cloud platforms (AWS, Azure, or GCP). Hands-on experience with data validation and performance tuning. Working knowledge of data schemas and data modeling. Good To Have Skills Certification in Azure, AWS, or GCP (foundational or associate level). Familiarity with monitoring tools and dashboard platforms. Understanding of data warehouse concepts. Exposure to BigQuery, ADLS, or similar services. Soft Skills Excellent written and verbal communication in English. Strong attention to detail and analytical skills. Ability to work in a 24x7 shift model, including night shifts. Ability to follow SOPs precisely and escalate issues appropriately. Self-motivated with minimal supervision. Team player with good interpersonal skills. Outcomes Expected Timely and error-free code delivery. Consistent adherence to engineering processes and release cycles. Documented and trackable issue handling with minimal escalations. Certification and training compliance. High availability and uptime of monitored pipelines and dashboards. Skills Sql,Data Analysis,Ms Excel,Dashboards

Trivandrum India Technology Full time 6/23/2025 J00167993 Equifax is where you can power your possible. If you want to achieve your true potential, chart new paths, develop new skills, collaborate with bright minds, and make a meaningful impact, we want to hear from you. Equifax is seeking a Software Engineering Lead to spearhead innovative batch and data product development using Java and Google Cloud Platform. This exciting role offers the opportunity to lead cutting-edge projects, mentor a team of developers, and drive the implementation of high-impact data solutions. As a key player in Equifax's technology team, you'll leverage your expertise to shape the future of data engineering while working with the latest cloud and AI technologies. The position combines technical expertise with leadership skills to drive the development and deployment of advanced batch and data products. Key Responsibilities: Oversee the design, development, and deployment of innovative batch and data products Provide technical direction for Java and GCP implementations Lead and mentor a team of developers and engineers Collaborate with cross-functional teams to translate requirements into technical solutions Implement rigorous testing strategies and optimize performance Maintain documentation and ensure compliance with standards What experience you need: Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field Proficiency in Java and its ecosystems Extensive experience with Google Cloud Platform, including GKE, Cloud Storage, Dataflow, BigQuery Minimum of 7 years in software development, focusing on batch processing and data solutions Exceptional communication and teamwork skills Experience with securely handling sensitive data (PII / PHI) Proven track record of writing defect-free code At least 3 years in a lead role What could set you apart Ability to convey complex technical concepts to non-technical stakeholders Relevant certifications (e.g., Google Cloud Professional Developer, Professional Data Engineer) Experience with multiple cloud platforms (e.g., AWS, Azure) in addition to GCP Proficiency in both Java and Python for versatile development and capabilities Experience in optimizing performance and reducing costs in cloud environments We offer a hybrid work setting, comprehensive compensation and healthcare packages, attractive paid time off, and organizational growth potential through our online learning platform with guided career tracks. Are you ready to power your possible? Apply today, and get started on a path toward an exciting new career at Equifax, where you can make a difference! Who is Equifax? At Equifax, we believe knowledge drives progress. As a global data, analytics and technology company, we play an essential role in the global economy by helping employers, employees, financial institutions and government agencies make critical decisions with greater confidence. We work to help create seamless and positive experiences during life’s pivotal moments: applying for jobs or a mortgage, financing an education or buying a car. Our impact is real and to accomplish our goals we focus on nurturing our people for career advancement and their learning and development, supporting our next generation of leaders, maintaining an inclusive and diverse work environment, and regularly engaging and recognizing our employees. Regardless of location or role, the individual and collective work of our employees makes a difference and we are looking for talented team players to join us as we help people live their financial best. Equifax is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

Vacancy with a company focused on digital transformation, specializing in intelligent automation, digitalization, data science & analytics, and mobile enablement. They help businesses improve cost efficiency, productivity, and agility by reducing turnaround time and errors. The company provides services and solutions including operations digital transformation consulting, next-gen shared services setup consulting, cognitive RPA deployment, and AI-enabled CX enhancement. Founded in 2020 ;with HQ in Gurugram, India; the Company is now operating from Noida, Mumbai, Hyderabad, and Bengaluru as well. Job Role: Bigdata, GCP Years Of Experience 4 to 7 Years The candidate should have extensive production experience (1-2 Years ) in GCP, Other cloud experience would be a strong bonus. - Strong background in Data engineering 4-5 Years of exp in Big Data technologies including, Hadoop, NoSQL, Spark, Kafka etc. - Exposure to Production application is a must and Operating knowledge of cloud computing platforms (GCP, especially Big Query, Dataflow, Dataproc, Storage, VMs, Networking, Pub Sub, Cloud Functions, Composer servics) Job Types: Full-time, Permanent Pay: Up to ₹2,464,248.21 per year Benefits: Cell phone reimbursement Internet reimbursement Life insurance Paid sick time Paid time off Work from home Work Location: In person

Experience: 10 to 15 years Location: Bengaluru, Gurgaon, Pune About Us: AceNet Consulting is a fast-growing global business and technology consulting firm specializing in business strategy, digital transformation, technology consulting, product development, start-up advisory and fund-raising services to our global clients across banking & financial services, healthcare, supply chain & logistics, consumer retail, manufacturing, eGovernance and other industry sectors. We are looking for hungry, highly skilled and motivated individuals to join our dynamic team. If you’re passionate about technology and thrive in a fast-paced environment, we want to hear from you. Job Summary : The data architect is responsible for designing, creating, and managing an organization’s data architecture. This role is critical in establishing a solid foundation for data management within an organization, ensuring that data is organized, structured, accessible, secure, and aligned with business objectives. Key Responsibilities: *Interact & Influence business stakeholders to secure strong engagement and ensures that the data & analytical product delivery aligns with longer-term strategic roadmaps. *Design & contribute towards the structure and layout of lake house architecture optimizing data storage, and establishing data access controls and security measures. *Implement the long-term Data & Analytics strategy and deliver functional objectives. *Assess requirement feasibility, translates high-level business requirements into data requirements, appropriate metadata, test data, and data quality standards. *Explore Data Sources by working with Application owners to confirm datasets to be extracted. *Contribute to establishing and implementing database structure, including schema design, table definitions, column specifications, and naming conventions. *Design Data models for Source data products, Master data products & Insight data products. *Document Data Architecture artifacts for different Data Products and solutions and perform peer review across various functions. *Support Data Engineering and BI Engineering teams during the build phase. *Review Data models development, validate and provide deployment approval. *Work closely with data stewards and governance functions to continuously improve data quality and enhance the reliability of data model(s). *Simplify the existing data architecture, delivering reusable services and cost-saving opportunities in line with the policies and standards of the company. *Leads and participates in the peer review and quality assurance of project architectural artifacts across the Data Architecture group through governance forums. *Collaborate and contribute to the development and enhancement of standards, guidelines, and best practices within Data Architecture discipline. *Works with Product owners, Business stewards, Data Scientists and end users to understand data consumers’ needs and develop data products/ data solutions. *Evaluates and recommends emerging technologies for data management, storage, and analytics. Role Requirements and Qualifications: *A bachelor’s degree in computer science, data science, engineering, or related field. *At least five years of relevant experience in design and implementation of data models for enterprise data warehouse initiatives. *Translate business requirements and ability to guide solution design & architecture in developing Data Products. *Develop scalable, high-performance, and reusable data models that can be efficiently utilized across different data initiatives and help in generating actionable insights. *Work collaboratively with data stewardship and governance functions to continuously improve data quality and enhance the reliability of data models. *Ability to navigate and collaborate with cross-functional teams involving data scientists, business analysts, and stakeholders. *Strong Business Process and Functional understanding with an Analytical background. *CPG experience with knowledge in domain specific concepts is a plus. *Knowledge on Agile methodologies with experience working on tools such as Jira & Confluence. *Proficiency in the design and implementation of modern data architectures and concepts such as cloud services (AWS, Azure, GCP), real-time data distribution (Kafka, Dataflow), and modern data warehouse tools (Snowflake). *Experience with database technologies such as SQL, NoSQL, Snowflake, HANA. *Understanding of entity-relationship modeling, metadata systems, and data quality tools and techniques. *Experience building enterprise data models (Logical, Physical, Conceptual) and data modeling tool experience a plus (ERWIN, ER/STUDIO, etc.) *Strong Business Process and SAP functional understanding with an analytics background (preferred SAP ECC/S4, BW, HANA, BI, ARIBA experience) is a plus. *Expert-level SQL skills. *Experience with enterprise scale data engineering orchestration frameworks/ELT tools and common data engineering Python libraries (dbt, pandas, great expectations, etc.) is a plus. *Experience with business intelligence tools and technologies such as Power BI & Tableau. *Strong analytical and problem-solving skills. *Understanding of Data Governance principles and practices including Data Quality, Data Security and compliance. *Ability to think strategically on the use of data within the Organization that support both current and future needs. *Excellent communication and interpersonal skills for stakeholder management and cross-functional collaboration. Why Join Us: *Opportunities to work on transformative projects, cutting-edge technology and innovative solutions with leading global firms across industry sectors. *Continuous investment in employee growth and professional development with a strong focus on up & re-skilling. *Competitive compensation & benefits, ESOPs and international assignments. *Supportive environment with healthy work-life balance and a focus on employee well-being. *Open culture that values diverse perspectives, encourages transparent communication and rewards contributions.

Immediate Joiner Kindly share your CV here: joinus@amussoft.com Qualifications Expertise in Data Architecture and Data Modeling 10+ years of experience in data architecture, with at least 3 years in GCP environments. Expertise in BigQuery, Cloud Dataflow, Cloud Pub/Sub, Cloud Storage, and related GCP services. Strong experience in data warehousing, data lakes, and real-time data pipelines. Proficiency in SQL, Python, or other data processing languages. Experience with cloud security, data governance, and compliance frameworks. Google Cloud Certification (Professional Data Engineer, Professional Cloud Architect) preferred. Excellent communication and collaboration skills.

Equifax is where you can power your possible. If you want to achieve your true potential, chart new paths, develop new skills, collaborate with bright minds, and make a meaningful impact, we want to hear from you. Reporting to the A/NZ DSE Chapter Manager India PEC within Decision Sciences & Engineering, this role will own and be responsible for the data & analytic engineering chapter in India PEC. The Data Engineer is an essential part of the business that enables the team to support the ongoing acquisition and internal purposing of data, through to the fulfilment of products, insights and systems. As a Data Engineer, you will be responsible for working with our internal customers to ensure that data and systems are being designed and built to move and manipulate data in a scalable, reusable and efficient manner to suit the environment, project, security and requirements. What You’ll Do Design, architect, and implement scalable and secure data pipelines on GCP, utilizing services like Dataflow, Pub/Sub, and Cloud Storage. Develop and maintain data models, ensuring data quality, consistency, and accessibility for various internal stakeholders. Automate data processes and workflows using scripting languages like Python, leveraging technologies like Spark and Airflow. Monitor and troubleshoot data pipelines, identifying and resolving performance issues proactively. Stay up-to-date with the latest trends and advancements in GCP and related technologies, actively proposing and evaluating new solutions. Implement data governance best practices, including data security, access control, and lineage tracking. Lead security initiatives, design and implement security architecture. Lead data quality initiatives, design and implement monitoring dashboards. Mentor and guide junior data engineers, sharing knowledge and best practices to foster a high-performing team. Role requires a solid educational foundation and the ability to develop a strategic vision and roadmap for D&A’s transition to the cloud while balancing delivery of near-term results that are aligned with execution. What Experience You Need BS degree in a STEM major or equivalent discipline; Master’s Degree strongly preferred 8+ years of experience as a data engineer or related role, with experience demonstrating leadership capabilities Cloud certification strongly preferred Expert level skills using programming languages such as Python or SQL (Big Query) and advanced level experience with scripting languages. Demonstrated proficiency in all Google Cloud Services Experience building and maintaining complex data pipelines, troubleshooting complex issues, transforming and entering data into a data pipeline in order for the content to be digested and usable for future projects; Proficiency in Airflow strongly desired Experience designing and implementing advanced to complex data models and experience enabling advanced optimization to improve performance Experience leading a team with Git expertise strongly preferred Hands on Experience on Agile Methodoligies Working Knowledge of CI/CD What Could Set You Apart Self-starter that identifies/responds to priority shifts with minimal supervision. Strong communication and presentation skills Strong leadership qualities A well-balanced view of resource management, thinking creatively and effectively to deploy the team whilst building skills for the future Skilled in internal networking, negotiating and proactively developing individuals and teams to be the best they can be Strong communicator & presenter, bringing everyone on the journey. Knowledge of Big Data technology and tools with the ability to share ideas among a collaborative team and drive the team based on technical expertise and learning, sharing best practices Excellent communication skills to engage with senior management, internal customers and product management Sound understanding of regulations and security requirements governing access to data in Big Data systems Sound understanding of Insight delivery systems for batch and online Should be able to run Agile Scrum-based projects Demonstrated problem solving skills and the ability to resolve conflicts Experience creating and maintaining product and software roadmaps Experience overseeing yearly as well as product/project budgets Working in a highly regulated environment We offer a hybrid work setting, comprehensive compensation and healthcare packages, attractive paid time off, and organizational growth potential through our online learning platform with guided career tracks. Are you ready to power your possible? Apply today, and get started on a path toward an exciting new career at Equifax, where you can make a difference! Who is Equifax? At Equifax, we believe knowledge drives progress. As a global data, analytics and technology company, we play an essential role in the global economy by helping employers, employees, financial institutions and government agencies make critical decisions with greater confidence. We work to help create seamless and positive experiences during life’s pivotal moments: applying for jobs or a mortgage, financing an education or buying a car. Our impact is real and to accomplish our goals we focus on nurturing our people for career advancement and their learning and development, supporting our next generation of leaders, maintaining an inclusive and diverse work environment, and regularly engaging and recognizing our employees. Regardless of location or role, the individual and collective work of our employees makes a difference and we are looking for talented team players to join us as we help people live their financial best. Equifax is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

Job Title: GCP Data Engineer Location: Chennai (Hybrid Work Mode) Experience: 5+ Years with relevant 4 years in GCP Budget - 30+ LPA Joining: Immediate Joiners Preferred – July 1st or 2nd Week Employment Type: Full-Time Client Type: Product and Service-Based Clients Job Description: We are looking for an experienced GCP Data Engineer to join our team for an engagement with a leading product and service-based client. The position is based in Chennai with a hybrid work model (3 days WFO). The ideal candidate should be able to join by the first or second week of July . Key Responsibilities: Build, manage, and optimize robust data pipelines using GCP tools such as BigQuery, Dataflow, Composer, and Pub/Sub Design scalable and efficient data models to support analytics and reporting Develop data engineering solutions using SQL and Python Implement workflow orchestration using Airflow or similar tools Work closely with DevOps for CI/CD integration , version control, and cloud-native deployment Ensure data integrity, security, and performance across distributed systems Required Skills: Hands-on experience with GCP services : BigQuery, Dataflow, Composer, Pub/Sub Strong proficiency in SQL , Python , and data modeling Experience with Airflow or similar orchestration tools Familiarity with CI/CD pipelines , Git , and cloud-native architectures Nice to Have: Exposure to Terraform , Looker , or Kafka Experience with Docker and DevOps practices Background in MLOps or working with ML pipelines Educational Qualifications: Must have completed B.E / B.Tech If the candidate holds a Postgraduate degree (PG) , it should be in regular (full-time) mode only Additional Information: Location: Chennai (Hybrid – 3 days WFO) Client Type: Product and Service-Based Notice Period: Immediate joiners preferred (able to join by July 1st or 2nd week) If you're passionate about building cloud-based data solutions and meet the above criteria, we invite you to apply and be part of a forward-thinking team. 📩 Interested? Drop your resume at gomathi@reveilletechnologies.com 📢 Tag your connections or share this post if you know someone who fits! hashtag#DataEngineer hashtag#GCP hashtag#BigQuery hashtag#CloudJobs hashtag#Python hashtag#ETL hashtag#Dataflow hashtag#HiringNow

Greeting from Getronics! We have multiple opportunities for Senior GCP Data Engineers for our automotive client in Chennai Location. Position Description: Data Analytics team is seeking a GCP Data Engineer to create, deliver, and support custom data products, as well as enhance/expand team capabilities. They will work on analysing and manipulating large datasets supporting the enterprise by activating data assets to support Enabling Platforms and analytics. Google Cloud Data Engineers will be responsible for designing the transformation and modernization on Google Cloud Platform cloud . Experience with large scale solutioning and operationalization of data warehouses, data lakes and analytics platforms on Google Cloud Platform is a must. We are looking for candidates who have a broad set of technology skills across these areas and who can demonstrate an ability to design right solutions with appropriate combination of Google Cloud Platform and 3rd party technologies for deploying on Google Cloud Platform cloud. Skills Required: Work as part of an implementation team from concept to operations, providing deep technical subject matter expertise for successful deployment. Implement methods for automation of all parts of the pipeline to minimize labor in development and production. This includes designing and deploying a pipeline with automated data lineage. Identify, develop, evaluate and summarize Proof of Concepts to prove out solutions. Test and compare competing solutions and report out a point of view on the best solution. Integration between GCP Data Catalog and Informatica EDC. Design and build production data engineering solutions to deliver our pipeline patterns using Google Cloud Platform (Google Cloud Platform) services: BigQuery, DataFlow, Pub/Sub, BigTable, Data Fusion, DataProc, Cloud Compose, Cloud SQL, Compute Engine, Cloud Functions, and App Engine. Experience Required: 6+ Years of experience in Data Engineering and minimum 3+ years of Google Cloud Platform is a must. Education Required : Any Bachelor's degree (preferably Engineering Graduate) Additional Information: Willing to work in Hybrid mode (3 days a week) in Chennai - Client location. Looking for Immediate to 30 days' notice candidates only. Candidate should be willing to attend GCP coding assessment (1-hour online video coding) as 1st level of interview. Interested candidates, please share your resume to abirami.rsk@getronics.com

Skills: Python, Spark, Data Engineer, Cloudera, Onpremise, Azure, Snlowfow, Kafka, Overview Of The Company Jio Platforms Ltd. is a revolutionary Indian multinational tech company, often referred to as India's biggest startup, headquartered in Mumbai. Launched in 2019, it's the powerhouse behind Jio, India's largest mobile network with over 400 million users. But Jio Platforms is more than just telecom. It's a comprehensive digital ecosystem, developing cutting-edge solutions across media, entertainment, and enterprise services through popular brands like JioMart, JioFiber, and JioSaavn. Join us at Jio Platforms and be part of a fast-paced, dynamic environment at the forefront of India's digital transformation. Collaborate with brilliant minds to develop next-gen solutions that empower millions and revolutionize industries. Team Overview The Data Platforms Team is the launchpad for a data-driven future, empowering the Reliance Group of Companies. We're a passionate group of experts architecting an enterprise-scale data mesh to unlock the power of big data, generative AI, and ML modelling across various domains. We don't just manage data we transform it into intelligent actions that fuel strategic decision-making. Imagine crafting a platform that automates data flow, fuels intelligent insights, and empowers the organization that's what we do. Join our collaborative and innovative team, and be a part of shaping the future of data for India's biggest digital revolution! About the role. Title: Lead Data Engineer Location: Mumbai Responsibilities End-to-End Data Pipeline Development: Design, build, optimize, and maintain robust data pipelines across cloud, on-premises, or hybrid environments, ensuring performance, scalability, and seamless data flow. Reusable Components & Frameworks: Develop reusable data pipeline components and contribute to the team's data pipeline framework evolution. Data Architecture & Solutions: Contribute to data architecture design, applying data modelling, storage, and retrieval expertise. Data Governance & Automation: Champion data integrity, security, and efficiency through metadata management, automation, and data governance best practices. Collaborative Problem Solving: Partner with stakeholders, data teams, and engineers to define requirements, troubleshoot, optimize, and deliver data-driven insights. Mentorship & Knowledge Transfer: Guide and mentor junior data engineers, fostering knowledge sharing and professional growth. Qualification Details Education: Bachelor's degree or higher in Computer Science, Data Science, Engineering, or a related technical field. Core Programming: Excellent command of a primary data engineering language (Scala, Python, or Java) with a strong foundation in OOPS and functional programming concepts. Big Data Technologies: Hands-on experience with data processing frameworks (e.g., Hadoop, Spark, Apache Hive, NiFi, Ozone, Kudu), ideally including streaming technologies (Kafka, Spark Streaming, Flink, etc.). Database Expertise: Excellent querying skills (SQL) and strong understanding of relational databases (e.g., MySQL, PostgreSQL). Experience with NoSQL databases (e.g., MongoDB, Cassandra) is a plus. End-to-End Pipelines: Demonstrated experience in implementing, optimizing, and maintaining complete data pipelines, integrating varied sources and sinks including streaming real-time data. Cloud Expertise: Knowledge of Cloud Technologies like Azure HDInsights, Synapse, EventHub and GCP DataProc, Dataflow, BigQuery. CI/CD Expertise: Experience with CI/CD methodologies and tools, including strong Linux and shell scripting skills for automation. Desired Skills & Attributes Problem-Solving & Troubleshooting: Proven ability to analyze and solve complex data problems, troubleshoot data pipeline issues effectively. Communication & Collaboration: Excellent communication skills, both written and verbal, with the ability to collaborate across teams (data scientists, engineers, stakeholders). Continuous Learning & Adaptability: A demonstrated passion for staying up-to-date with emerging data technologies and a willingness to adapt to new tools.

Skills: Data Engineer, Spark, Scala, Python, Onpremise, Cloudera, Snowflake, kafka, Overview Of The Company Jio Platforms Ltd. is a revolutionary Indian multinational tech company, often referred to as India's biggest startup, headquartered in Mumbai. Launched in 2019, it's the powerhouse behind Jio, India's largest mobile network with over 400 million users. But Jio Platforms is more than just telecom. It's a comprehensive digital ecosystem, developing cutting-edge solutions across media, entertainment, and enterprise services through popular brands like JioMart, JioFiber, and JioSaavn. Join us at Jio Platforms and be part of a fast-paced, dynamic environment at the forefront of India's digital transformation. Collaborate with brilliant minds to develop next-gen solutions that empower millions and revolutionize industries. Team Overview The Data Platforms Team is the launchpad for a data-driven future, empowering the Reliance Group of Companies. We're a passionate group of experts architecting an enterprise-scale data mesh to unlock the power of big data, generative AI, and ML modelling across various domains. We don't just manage data we transform it into intelligent actions that fuel strategic decision-making. Imagine crafting a platform that automates data flow, fuels intelligent insights, and empowers the organization that's what we do. Join our collaborative and innovative team, and be a part of shaping the future of data for India's biggest digital revolution! About the role. Title : Senior Data Engineer Location : Mumbai Responsibilities End-to-End Data Pipeline Development: Design, build, optimize, and maintain robust data pipelines across cloud, on-premises, or hybrid environments, ensuring performance, scalability, and seamless data flow. Reusable Components & Frameworks: Develop reusable data pipeline components and contribute to the team's data pipeline framework evolution. Data Architecture & Solutions: Contribute to data architecture design, applying data modelling, storage, and retrieval expertise. Data Governance & Automation: Champion data integrity, security, and efficiency through metadata management, automation, and data governance best practices. Collaborative Problem Solving: Partner with stakeholders, data teams, and engineers to define requirements, troubleshoot, optimize, and deliver data-driven insights. Mentorship & Knowledge Transfer: Guide and mentor junior data engineers, fostering knowledge sharing and professional growth. Qualification Details Education: Bachelor's degree or higher in Computer Science, Data Science, Engineering, or a related technical field. Core Programming: Excellent command of a primary data engineering language (Scala, Python, or Java) with a strong foundation in OOPS and functional programming concepts. Big Data Technologies: Hands-on experience with data processing frameworks (e.g., Hadoop, Spark, Apache Hive, NiFi, Ozone, Kudu), ideally including streaming technologies (Kafka, Spark Streaming, Flink, etc.). Database Expertise: Excellent querying skills (SQL) and strong understanding of relational databases (e.g., MySQL, PostgreSQL). Experience with NoSQL databases (e.g., MongoDB, Cassandra) is a plus. End-to-End Pipelines: Demonstrated experience in implementing, optimizing, and maintaining complete data pipelines, integrating varied sources and sinks including streaming real-time data. Cloud Expertise: Knowledge of Cloud Technologies like Azure HDInsights, Synapse, EventHub and GCP DataProc, Dataflow, BigQuery. CI/CD Expertise: Experience with CI/CD methodologies and tools, including strong Linux and shell scripting skills for automation. Desired Skills & Attributes Problem-Solving & Troubleshooting: Proven ability to analyze and solve complex data problems, troubleshoot data pipeline issues effectively. Communication & Collaboration: Excellent communication skills, both written and verbal, with the ability to collaborate across teams (data scientists, engineers, stakeholders). Continuous Learning & Adaptability: A demonstrated passion for staying up-to-date with emerging data technologies and a willingness to adapt to new tools.

Equifax is where you can power your possible. If you want to achieve your true potential, chart new paths, develop new skills, collaborate with bright minds, and make a meaningful impact, we want to hear from you. Equifax is seeking a Software Engineering Lead to spearhead innovative batch and data product development using Java and Google Cloud Platform. This exciting role offers the opportunity to lead cutting-edge projects, mentor a team of developers, and drive the implementation of high-impact data solutions. As a key player in Equifax's technology team, you'll leverage your expertise to shape the future of data engineering while working with the latest cloud and AI technologies. The position combines technical expertise with leadership skills to drive the development and deployment of advanced batch and data products. Key Responsibilities Oversee the design, development, and deployment of innovative batch and data products Provide technical direction for Java and GCP implementations Lead and mentor a team of developers and engineers Collaborate with cross-functional teams to translate requirements into technical solutions Implement rigorous testing strategies and optimize performance Maintain documentation and ensure compliance with standards What Experience You Need Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field Proficiency in Java and its ecosystems Extensive experience with Google Cloud Platform, including GKE, Cloud Storage, Dataflow, BigQuery Minimum of 7 years in software development, focusing on batch processing and data solutions Exceptional communication and teamwork skills Experience with securely handling sensitive data (PII / PHI) Proven track record of writing defect-free code At least 3 years in a lead role What could set you apart Ability to convey complex technical concepts to non-technical stakeholders Relevant certifications (e.g., Google Cloud Professional Developer, Professional Data Engineer) Experience with multiple cloud platforms (e.g., AWS, Azure) in addition to GCP Proficiency in both Java and Python for versatile development and capabilities Experience in optimizing performance and reducing costs in cloud environments We offer a hybrid work setting, comprehensive compensation and healthcare packages, attractive paid time off, and organizational growth potential through our online learning platform with guided career tracks. Are you ready to power your possible? Apply today, and get started on a path toward an exciting new career at Equifax, where you can make a difference! Who is Equifax? At Equifax, we believe knowledge drives progress. As a global data, analytics and technology company, we play an essential role in the global economy by helping employers, employees, financial institutions and government agencies make critical decisions with greater confidence. We work to help create seamless and positive experiences during life’s pivotal moments: applying for jobs or a mortgage, financing an education or buying a car. Our impact is real and to accomplish our goals we focus on nurturing our people for career advancement and their learning and development, supporting our next generation of leaders, maintaining an inclusive and diverse work environment, and regularly engaging and recognizing our employees. Regardless of location or role, the individual and collective work of our employees makes a difference and we are looking for talented team players to join us as we help people live their financial best. Equifax is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

About the Role: We are seeking a talented and experienced GCP Data Engineer with 5–8 years of overall experience in data engineering and strong hands-on expertise with Google Cloud Platform services. The ideal candidate will be responsible for building, optimizing, and maintaining scalable, robust, and secure data pipelines that support advanced analytics and business intelligence initiatives. Key Responsibilities: Design, implement, and maintain scalable data pipelines and ETL/ELT workflows using GCP services like Dataflow , BigQuery , Pub/Sub , and Cloud Functions . Build and manage real-time and batch data processing pipelines with an emphasis on reliability, security, and performance. Leverage BigQuery for high-performance analytical queries and transformations. Implement streaming and event-driven architectures using Pub/Sub and Dataflow . Integrate data pipelines with third-party APIs, cloud storage, and internal systems. Collaborate with product teams, data analysts, and ML engineers to align data engineering solutions with business goals. Ensure data quality , governance , security , and compliance across the platform. Participate in code reviews, design sessions, and technical planning. Create and maintain clear technical documentation and operational guides. Required Skills & Experience: 5 to 8 years of experience in data engineering , with at least 2+ years of hands-on GCP experience . Proficient with key GCP data services : BigQuery Dataflow (Apache Beam) Pub/Sub Cloud Functions Strong coding skills in Python or Java , and advanced SQL skills. Experience with REST APIs , data ingestion , streaming , and batch processing . Strong understanding of data warehousing , data lake architecture , and data modeling principles . Familiarity with CI/CD tools (e.g., Jenkins, GitHub Actions) and DevOps practices . Exposure to Docker and cloud deployment workflows. Experience working with PostgreSQL , MongoDB , or other relational/NoSQL databases.

Equifax is seeking a Software Engineering Lead to spearhead innovative batch and data product development using Java and Google Cloud Platform. This exciting role offers the opportunity to lead cutting-edge projects, mentor a team of developers, and drive the implementation of high-impact data solutions. As a key player in Equifax's technology team, you'll leverage your expertise to shape the future of data engineering while working with the latest cloud and AI technologies. The position combines technical expertise with leadership skills to drive the development and deployment of advanced batch and data products. Key Responsibilities: Oversee the design, development, and deployment of innovative batch and data products Provide technical direction for Java and GCP implementations Lead and mentor a team of developers and engineers Collaborate with cross-functional teams to translate requirements into technical solutions Implement rigorous testing strategies and optimize performance Maintain documentation and ensure compliance with standards What experience you need: Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field Proficiency in Java and its ecosystems Extensive experience with Google Cloud Platform, including GKE, Cloud Storage, Dataflow, BigQuery Minimum of 7 years in software development, focusing on batch processing and data solutions Exceptional communication and teamwork skills Experience with securely handling sensitive data (PII / PHI) Proven track record of writing defect-free code At least 3 years in a lead role What could set you apart Ability to convey complex technical concepts to non-technical stakeholders Relevant certifications (e.g., Google Cloud Professional Developer, Professional Data Engineer) Experience with multiple cloud platforms (e.g., AWS, Azure) in addition to GCP Proficiency in both Java and Python for versatile development and capabilities Experience in optimizing performance and reducing costs in cloud environments

Introduction In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology Your Role And Responsibilities Skilled Multiple GCP services - GCS, BigQuery, Cloud SQL, Dataflow, Pub/Sub, Cloud Run, Workflow, Composer, Error reporting, Log explorer etc. Must have Python and SQL work experience & Proactive, collaborative and ability to respond to critical situation Ability to analyse data for functional business requirements & front face customer Preferred Education Master's Degree Required Technical And Professional Expertise 5 to 7 years of relevant experience working as technical analyst with Big Query on GCP platform. Skilled in multiple GCP services - GCS, Cloud SQL, Dataflow, Pub/Sub, Cloud Run, Workflow, Composer, Error reporting, Log explorer You love collaborative environments that use agile methodologies to encourage creative design thinking and find innovative ways to develop with cutting edge technologies Ambitious individual who can work under their own direction towards agreed targets/goals and with creative approach to work Preferred Technical And Professional Experience Create up to 3 bullets maxitive individual with an ability to manage change and proven time management Proven interpersonal skills while contributing to team effort by accomplishing related results as needed Up-to-date technical knowledge by attending educational workshops, reviewing publications (encouraging then to focus on required skills)

Responsibilities Lead and mentor a team of data engineers, providing technical guidance, setting best practices, and overseeing task execution for the migration project. Design, develop, and architect scalable ETL processes to extract, transform, and load petabytes of data from on-premises SQL Server to GCP Cloud SQL PostgreSQL. Oversee the comprehensive analysis of existing SQL Server schemas, data types, stored procedures, and complex data models, defining strategies for their optimal conversion and refactoring for PostgreSQL. Establish and enforce rigorous data validation, quality, and integrity frameworks throughout the migration lifecycle, ensuring accuracy and consistency. Collaborate strategically with Database Administrators, application architects, business stakeholders, and security teams to define migration scope, requirements, and cutover plans. Lead the development and maintenance of advanced scripts (primarily Python) for automating large-scale migration tasks, complex data transformations, and reconciliation processes. Proactively identify, troubleshoot, and lead the resolution of complex data discrepancies, performance bottlenecks, and technical challenges during migration. Define and maintain comprehensive documentation standards for migration strategies, data mapping, transformation rules, and post-migration validation procedures. Ensure data governance, security, and compliance standards are meticulously applied throughout the migration process, including data encryption and access controls within GCP. Implement Schema conversion or custom schema mapping strategy for SQL Server to PostgreSQL shift Refactor and translate complex stored procedures and T-SQL logic to PostgreSQL-compatible constructs while preserving functional equivalence. Develop and execute comprehensive data reconciliation strategies to ensure consistency and parity between legacy and migrated datasets post-cutover. Design fallback procedures and lead post-migration verification and support to ensure business continuity. Ensuring metadata cataloging and data lineage tracking using GCP-native or integrated tools. Must-Have Skills Expertise in data engineering, specifically for Google Cloud Platform (GCP). Deep understanding of relational database architecture, advanced schema design, data modeling, and performance tuning. Expert-level SQL proficiency, with extensive hands-on experience in both T-SQL (SQL Server) and PostgreSQL. Hands-on experience with data migration processes, including moving datasets from on-premises databases to cloud storage solutions. Proficiency in designing, implementing, and optimizing complex ETL/ELT pipelines for high-volume data movement, leveraging tools and custom scripting. Strong knowledge of GCP services: Cloud SQL, Dataflow, Pub/Sub, Cloud Storage, Dataproc, Cloud Composer, Cloud Functions, and Bigquery. Solid understanding of data governance, security, and compliance practices in the cloud, including the management of sensitive data during migration. Strong programming skills in Python or Java for building data pipelines and automating processes. Experience with real-time data processing using Pub/Sub, Dataflow, or similar GCP services. Experience with CI/CD practices and tools like Jenkins, GitLab, or Cloud Build for automating the data engineering pipeline. Knowledge of data modeling and best practices for structuring cloud data storage for optimal query performance and analytics in GCP. Familiarity with observability and monitoring tools in GCP (e.g., Stackdriver, Prometheus) for real-time data pipeline visibility and alerting. Good-to-Have Skills Direct experience with GCP Database Migration Service, Storage Transfer Service, or similar cloud-native migration tools. Familiarity with data orchestration using tools like Cloud Composer (based on Apache Airflow) for managing workflows. Experience with containerization tools like Docker and Kubernetes for deploying data pipelines in a scalable manner. Exposure to DataOps tools and methodologies for managing data workflows. Experience with machine learning platforms like AI Platform in GCP to integrate with data pipelines. Familiarity with data lake architecture and the integration of BigQuery with Google Cloud Storage or Dataproc.

Req ID: 327059 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a GCP Python Pyspark Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN). Strong hands-on experience in designing and building data pipelines using Google Cloud Platform (GCP) services like BigQuery, Dataflow, and Cloud Composer. Proficient in Python for data processing, scripting, and automation in cloud and distributed environments. Solid working knowledge of Apache Spark / PySpark, with experience in large-scale data transformation and performance tuning. Familiar with CI/CD processes, version control (Git), and workflow orchestration tools such as Airflow or Composer. Ability to work independently in fast-paced Agile environments with strong problem-solving and communication skills. Exposure to modern data architectures and real-time/streaming data solutions is an added advantage. About NTT DATA NTT DATA is a $30 billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long term success. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies. Our services include business and technology consulting, data and artificial intelligence, industry solutions, as well as the development, implementation and management of applications, infrastructure and connectivity. We are one of the leading providers of digital and AI infrastructure in the world. NTT DATA is a part of NTT Group, which invests over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the digital future. Visit us at us.nttdata.com NTT DATA endeavors to make https://us.nttdata.com accessible to any and all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please contact us at https://us.nttdata.com/en/contact-us. This contact information is for accommodation requests only and cannot be used to inquire about the status of applications. NTT DATA is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or protected veteran status. For our EEO Policy Statement, please click here. If you'd like more information on your EEO rights under the law, please click here. For Pay Transparency information, please click here.

Equifax is seeking creative, high-energy and driven software engineers with hands-on development skills to work on a variety of meaningful projects. Our software engineering positions provide you the opportunity to join a team of talented engineers working with leading-edge technology. You are ideal for this position if you are a forward-thinking, committed, and enthusiastic software engineer who is passionate about technology. What you’ll do Design, develop, and operate high scale applications across the full engineering stack Design, develop, test, deploy, maintain, and improve software. Apply modern software development practices (serverless computing, microservices architecture, CI/CD, infrastructure-as-code, etc.) Work across teams to integrate our systems with existing internal systems, Data Fabric, CSA Toolset. Participate in technology roadmap and architecture discussions to turn business requirements and vision into reality. Participate in a tight-knit, globally distributed engineering team. Triage product or system issues and debug/track/resolve by analyzing the sources of issues and the impact on network, or service operations and quality. Manage sole project priorities, deadlines, and deliverables. Research, create, and develop software applications to extend and improve on Equifax Solutions Collaborate on scalability issues involving access to data and information. Actively participate in Sprint planning, Sprint Retrospectives, and other team activity What experience you need Bachelor's degree or equivalent experience 5+ years of software engineering experience 5+ years experience writing, debugging, and troubleshooting code in mainstream Java, SpringBoot, TypeScript/JavaScript, HTML, CSS 5+ years experience with Cloud technology: GCP, AWS, or Azure 5+ years experience designing and developing cloud-native solutions 5+ years experience designing and developing microservices using Java, SpringBoot, GCP SDKs, GKE/Kubernetes 5+ years experience deploying and releasing software using Jenkins CI/CD pipelines, understand infrastructure-as-code concepts, Helm Charts, and Terraform constructs What could set you apart Self-starter that identifies/responds to priority shifts with minimal supervision. Experience designing and developing big data processing solutions using Dataflow/Apache Beam, Bigtable, BigQuery, PubSub, GCS, Composer/Airflow, and others UI development (e.g. HTML, JavaScript, Angular and Bootstrap) Experience with backend technologies such as JAVA/J2EE, SpringBoot, SOA and Microservices Source code control management systems (e.g. SVN/Git, Github) and build tools like Maven & Gradle. Agile environments (e.g. Scrum, XP) Relational databases (e.g. SQL Server, MySQL) Atlassian tooling (e.g. JIRA, Confluence, and Github) Developing with modern JDK (v1.7+) Automated Testing: JUnit, Selenium, LoadRunner, SoapUI