4.0 - 8.0 years

0 Lacs

ahmedabad, gujarat

On-site

As a Lead Data Scraping Engineer, you will be a vital part of our team in Ahmedabad/WFO, bringing your senior-level expertise with over 4 years in the IT scraping industry. Your role will involve not only hands-on data scraping using tools like Scrapy and Python libraries but also leading and mentoring a team of 5+ developers to deliver successful projects within set timelines. Your primary responsibilities will include designing and implementing scalable data scraping solutions, managing project timelines, and ensuring the team's success through effective leadership. You will be expected to utilize advanced scraping techniques, reverse engineering, and automation to overcome scraping restrictions and automate interactions effectively. In addition to overseeing proxies, IP rotation, and SSL unpinning for efficient scraping, you will also be responsible for maintaining API integrations, data pipelines, and ensuring code quality through version control, error handling, and documentation. Collaboration with cross-functional teams, performance monitoring, and providing solutions under high-pressure environments will also be key aspects of your role. To excel in this position, you should have a minimum of 4 years of experience in data scraping, with at least 2 years of leadership experience managing a team of developers. Proficiency in tools like Scrapy, Threading, requests, and web automation, along with advanced Python skills, is essential. Additionally, strong technical skills in captcha solving, blocking handling, source reverse engineering, and API management are required. Your leadership skills should include basic project management, moderate documentation, team handling, pressure management, flexibility, adaptability, and high accountability. Experience with Linux, as well as knowledge of tools like Appium, Fiddler, and Burp Suite, would be considered a plus. If you are passionate about data scraping, possess strong technical expertise, and thrive in a leadership role, we encourage you to apply and be part of our dynamic team.,

Posted 2 days ago

Apply

Social Media Data Scraping Specialist Brand Threat Analytics

2.0 - 3.0 years

6 - 8 Lacs

Noida

Work from Office

About Us: LdotR is an online brand protection service company, offering businesses the right solution and services to protect, manage and benefit from their digital assets in the online space. We work across all digital platforms - Domains, Website, Social Media, Online Marketplaces, and App Stores to identify, assess and nullify brand infringements. About the Role: We are looking for an experienced Data Scraping Specialist to help us extract and structure data from leading social media platforms at scale. The ideal candidate will have hands-on expertise with scraping tools, APIs, and large-scale data processing. Key Responsibilities: Design and develop custom scraping solutions to extract public data from platforms like Instagram, Facebook, X (Twitter), LinkedIn, YouTube, etc. Handle large-scale scraping tasks with efficiency and resilience against rate-limiting and platform-specific restrictions. Clean, normalize, and structure the scraped data for analysis or downstream applications. Maintain scraping scripts to adapt to frequent platform changes. Ensure compliance with data protection policies and terms of service. Required Skills: Proficiency in Python and scraping libraries (e.g., Scrapy, BeautifulSoup, Selenium, Playwright). Experience with API integration (official or unofficial social media APIs). Familiarity with rotating proxies, headless browsers, and CAPTCHA-solving techniques. Strong understanding of data structuring formats like JSON, CSV, and databases (MongoDB, PostgreSQL, etc.). Experience with cloud-based scraping and storage solutions (AWS/GCP preferred). Good to Have: Knowledge of NLP or data analytics for social media sentiment or trend analysis. Understanding of GDPR and CCPA compliance. Prior work with third-party scraping platforms or browser automation tools. What We Offer: Opportunity to work on impactful, large-scale data projects. Flexible work arrangements. Competitive compensation based on experience and delivery.

Posted 2 months ago

Apply

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.