Lead Data Scraping

As a Lead Data Scraping Engineer, you will be a vital part of our team in Ahmedabad/WFO, bringing your senior-level expertise with over 4 years in the IT scraping industry. Your role will involve not only hands-on data scraping using tools like Scrapy and Python libraries but also leading and mentoring a team of 5+ developers to deliver successful projects within set timelines. Your primary responsibilities will include designing and implementing scalable data scraping solutions, managing project timelines, and ensuring the team's success through effective leadership. You will be expected to utilize advanced scraping techniques, reverse engineering, and automation to overcome scraping restrictions and automate interactions effectively. In addition to overseeing proxies, IP rotation, and SSL unpinning for efficient scraping, you will also be responsible for maintaining API integrations, data pipelines, and ensuring code quality through version control, error handling, and documentation. Collaboration with cross-functional teams, performance monitoring, and providing solutions under high-pressure environments will also be key aspects of your role. To excel in this position, you should have a minimum of 4 years of experience in data scraping, with at least 2 years of leadership experience managing a team of developers. Proficiency in tools like Scrapy, Threading, requests, and web automation, along with advanced Python skills, is essential. Additionally, strong technical skills in captcha solving, blocking handling, source reverse engineering, and API management are required. Your leadership skills should include basic project management, moderate documentation, team handling, pressure management, flexibility, adaptability, and high accountability. Experience with Linux, as well as knowledge of tools like Appium, Fiddler, and Burp Suite, would be considered a plus. If you are passionate about data scraping, possess strong technical expertise, and thrive in a leadership role, we encourage you to apply and be part of our dynamic team.,