Data Processing Engineer (Java, Apache Flink/Storm/Beam)

Job Summary
Synechron is seeking an experienced Data Processing Engineer to lead the development of large-scale data processing solutions using Java, Apache Flink/Storm/Beam, and Google Cloud Platform (GCP). In this role, you will collaborate across teams to design, develop, and optimize data-intensive applications that support strategic business objectives. Your expertise will help evolve our data architecture, improve processing efficiency, and ensure the delivery of reliable, scalable solutions in an Agile environment.Software RequirementsRequired:Java (version 8 or higher)Apache Flink, Storm, or Beam for streaming data processingGoogle Cloud Platform (GCP) services, especially BigQuery and related data toolsExperience with databases such as BigQuery, Oracle, or equivalentFamiliarity with version control tools such as GitPreferred:Cloud deployment experience with GCP in particularAdditional familiarity with containerization (Docker/Kubernetes)Knowledge of CI/CD pipelines and DevOps practicesOverall ResponsibilitiesCollaborate closely with cross-functional teams to understand data and system requirements, then design scalable solutions aligned with business needs.Develop detailed technical specifications, implementation plans, and documentation for new features and enhancements.Implement, test, and deploy data processing applications using Java and Apache Flink/Storm/Beam within GCP environments.Conduct code reviews to ensure quality, security, and maintainability, supporting team members' growth and best practices.Troubleshoot technical issues, resolve bottlenecks, and optimize application performance and resource utilization.Stay current with advancements in data processing, cloud technology, and Java development to continuously improve solutions.Support testing teams to verify data workflows and validation processes, ensuring reliability and accuracy.Participate in Agile ceremonies, including sprint planning, stand-ups, and retrospectives to ensure continuous delivery and process improvement.Technical Skills (By Category)Programming Languages:Required: Java (8+)Preferred: Python, Scala, or Node.js for scripting or auxiliary processingDatabases/Data Management:Experience with BigQuery, Oracle, or similar relational data storesCloud Technologies:GCP (BigQuery, Cloud Storage, Dataflow etc.) with hands-on experience in cloud data solutionsFrameworks and Libraries:Apache Flink, Storm, or Beam for stream processingJava SDKs, APIs, and data integration librariesDevelopment Tools and Methodologies:Git, Jenkins, JIRA, and Agile/Scrum practicesFamiliarity with containerization (Docker, Kubernetes) is a plusSecurity and Compliance:Understanding of data security principles in cloud environmentsExperience Requirements4+ years of experience in software development, with a focus on data processing and Java-based backend developmentProven experience working with Apache Flink, Storm, or Beam in production environmentsStrong background in managing large data workflows and pipeline optimizationExperience with GCP data services and cloud-native developmentDemonstrated success in Agile projects, including collaboration with cross-functional teamsPrevious leadership or mentorship experience is a plusDay-to-Day ActivitiesDesign, develop, and deploy scalable data processing applications in Java using Flink/Storm/Beam on GCPCollaborate with data engineers, analysts, and architects to translate business needs into technical solutionsConduct code reviews, optimize data pipelines, and troubleshoot system issues swiftlyDocument technical specifications, data schemas, and process workflowsParticipate actively in Agile ceremonies, provide updates on task progress, and suggest process improvementsSupport continuous integration and deployment of data applicationsMentor junior team members, sharing best practices and technical insightsQualificationsBachelors or Masters degree in Computer Science, Information Technology, or equivalentRelevant certifications in cloud technologies or data processing (preferred)Evidence of continuous professional development and staying current with industry trendsProfessional CompetenciesStrong analytical and problem-solving skills focused on data processing challengesLeadership abilities to guide, mentor, and develop team membersExcellent communication skills for technical documentation and stakeholder engagementAdaptability to rapidly changing technologies and project prioritiesCapacity to prioritize tasks and manage time efficiently under tight deadlinesInnovative mindset to leverage new tools and techniques for performance improvements