Data Integration Engineer

Skillsoft is seeking an experienced Data Integration Engineer to support and modernize our data integration processes.  This role is responsible for managing the traditional ETL lifecycle while driving the transition to event-driven, API- based solutions. The ideal candidate will support existing systems while driving operational excellence and modernization initiatives.

Opportunity Highlights:

• ETL Development & Data Management
  • Design, develop, and optimize ETL processes to integrate data from multiple sources.
  • Ensure the data integrity, accuracy, and security across all integration workflows.
  • Troubleshoot and resolve ETL job failures, optimizing performance and throughput.

• Database Administration & Support:
  • Support schema design, indexing strategies, and query optimization for efficient data retrieval .
  • Provide database administration support for ETL workflows and integration projects.

• Modernization & Innovation:
  • Drive the transition from traditional ETL processes to modern, event-driven, API-based data integration solutions.
  • Develop and implement strategies for data process modernization.
  • Explore and implement AI/ML-driven automation for API-based integration workflows.
  • Stay updated with the latest trends and technologies in data integration and apply them to improve existing systems.
• Operational Excellence:
  • Support and maintain existing data integration systems.
  • Optimize data pipelines for performance and efficiency.
  • Collaborate with cross-functional teams to understand data needs and deliver effective solutions.
  • Define and monitor KPIs for data integration and database performance.

Skills & Qualifications

• Proven experience in managing traditional ETL lifecycles.
• Strong knowledge of event-driven architectures and API-based data integration.
• Proficiency in SQL and experience with database management systems.
• Ability to create and modify C# scripts within SSIS for custom API integrations.
• Experience with cloud-based data integration tools and platforms.
• Experience in working with Agile/Scrum environments. 

• Effective communication and collaboration skills.
• Ability to manage multiple priorities and deliver in a fast-paced environment.
• A passion for innovation and continuous improvement.
• 5-10 years of experience in ETL development, data integration, and database administration.