Data Integration Lead/Developer

As a Data Integration Lead or Developer with experience in Talend and Hive, you will be responsible for working in an Azure-based Big Data environment, specifically with ADLS, Azure SQL DB, and Datawarehouse. Your primary tasks will include utilizing Hive HiveQL for design and optimization, as well as SQL scripting and programming. Additionally, you will be expected to work with the Spark framework within Talend to develop and configure Big Data batch jobs, troubleshoot ETL processes, and perform performance tuning and administration to support end-to-end solutions. To excel in this role, you should have a proven track record of designing, developing, and implementing ELT/ETL solutions for data extraction, transformation, and loading into target systems such as Hadoop or Cloud Native environments. Your experience with Talend components, context management, Git deployment, and connecting data sources to reporting layers will be crucial. Ideally, you have worked on at least two real-world projects in the relevant technical areas and possess the skills to analyze business requirements, design complex jobs, and deploy data into a data lake effectively. Moreover, you should have a good understanding of cloud deployments of BI solutions within the Azure ecosystem, familiarity with Agile project methodologies, and knowledge of DevOps practices, including GitHub integration. Experience with migration projects and expertise in testing, reconciling data between systems, and working effectively in a team environment are also key requirements for this role. This position offers the opportunity to work remotely from home and cater to global clients, including those based in North America. The ideal candidate will have 4-8 years of relevant experience, a strong work ethic, and the ability to work independently with minimum supervision. If you are a self-motivated individual with a passion for data integration and a commitment to delivering high-quality solutions, we encourage you to apply for this exciting opportunity.,