22 Data Scraping Jobs

Position description: We are looking for a Python developer to automate various tasks and processes. You should have knowledge of web scraping, data transformation and you possess an analytical mindset. Primary Responsibilities: Develop scripts or applications to implement process automation and efficiency. Works independently under minimal direction with strong work ethics. Self-motivated, willing to take initiative, learn new methodologies/technologies, pragmatic and results-oriented. Oversee the project execution and project resources. Providing automation support for products. Read and understand the project requirement and communicate with respective project owners to clarify data required to complete the project. Responsible for micro project planning & timely submission of work allocated to you. Ensure deliverables are correct and aligning to the requirement. Completion of suitable tasks as defined by your immediate senior, other than your routine tasks. Communicate effectively with stakeholders about project deadlines and status.

About Velocity : - Velocity is building the future of financial services for new-age businesses in India. Our vision is to build products that empower new age businesses by solving multiple growth problems for them. Velocity is Indias largest Revenue Based Financing (RBF) platform. RBF is a new kind of financing where businesses can raise funds based on the ongoing and future revenues. We work directly with over 5000 brands in the country and have currently 1000+ brands live on our portal benefiting and growing with RBF capital. Founders are IIT-IIM alumni, with prior experience across management consulting, venture capital and fintech startups. We are driven by the mission to empower small business owners with technology and dramatically improve their access to financial services. We have raised a total of $30M across 2 rounds of funding and are backed by some of the most marquee global investors including Peter Thiel's Valar Ventures. Job Overview A highly impactful and high visibility role for a potential leader with strong business acumen, cross-functional aptitude, and sharp execution DNA; working directly with the co-founders and functional heads to drive key initiatives that directly impact the top-line. The Growth Strategy Manager will drive strategic initiatives focused on revenue growth. You will be responsible for identifying, driving and tracking new initiatives that accelerate growth, across partnerships, funnel optimization etc.. This individual should have at least 1 years of experience in operations, growth, strategy, lending, or analytics, preferably at a startup and at least 2 years of experience at a consulting firm. About the role: Identification of Growth levers (B2B)across top of the funnel, funnel optimization and partnerships Driving initiatives end to end from conceptualization to execution to tracking, and constantly building feedback loop from implementation to solutioning Develop and execute Go-To-Market strategies for Velocity in various geographies Carry out competitive analysis and be on top of market dynamics Coordinate with different functions within the organization - growth, product, engineering among, credit and others in the deployment of the business initiatives identified While this role works on strategically central problem statements, it is not a gyaan role where the output is a powerpoint. It requires quick understanding of the problem context, developing an approach for resolution, and hands on execution either independently or with relevant stakeholders Stay updated with the fast-changing fintech landscape Here’s what you require: Bachelors/ masters degree from Tier 1 college – IIT/ IIM (MBA not mandatory) or qualified CAs (either this or a very strong proof of work in scaling a startup) 2-4 years of experience in either top tier consulting firms (MBB) or Strategy/ CEO’s Office in high growth tech startups Experience of having worked across strategy and execution pieces Exceptional analytical and quantitative problem-solving skills Excellent verbal and written communication with interpersonal skills Go getter attitude with creative thinking abilities Ability to work collaboratively in a team environment High-level proficiency in Excel Benefits: Comprehensive Medical Insurance Coverage Significant ESOPs Free Lunch and Snacks Sports reimbursements Relocation allowances Free Lunch and Snacks

Hello, Greetings from GlobalData!!! Hope you are doing good. Urgent job openings for Python - (Web scraping/crawling) for below roles @ GD-Hyderabad :- Senior Software Engineer - 5+ yrs experience Team Lead - 7+ yrs exp Assistant Manager - 10+ yrs exp Job Description given below please go through to understand requirement. If interested to apply please share your updated resume @ mail id (m.salim@globaldata.com). Mention Subject Line :-Applying for Python - (Web Scraping) @ GlobalData(Hyd) Share your details in the mail :- Full Name : Mobile # : Qualification : Company Name : Designation : Total Work Experience Years : Current CTC : Expected CTC : Notice Period : Current Location/willing to relocate to Hyd? : Job Description: We are seeking a highly skilled and motivated Python Web Crawling Developer with 3 to 8+ years of hands-on experience in web scraping and data extraction. The ideal candidate should have a solid background in Python-based scraping tools and libraries, and a proven track record of working on dynamic websites. Key Responsibilities: Design, develop, and maintain scalable web crawlers and scrapers. Extract and process data from various static and dynamic websites. Work with tools and libraries like Scrapy , Requests , BeautifulSoup , and Selenium . Maintain and optimize existing full-stack web scraping applications. Write and maintain automation scripts for data gathering and processing. Ensure data quality, performance, and reliability of scraping solutions. Collaborate with cross-functional teams for integration and analytics use cases. Required Skills: Strong proficiency in Python programming. In-depth experience with web scraping frameworks (Scrapy, Requests, BeautifulSoup, Selenium). Experience in handling dynamic content scraping (JavaScript-rendered pages). Working knowledge of SQL and database programming. Good analytical and problem-solving skills. Strong verbal and written communication skills. Experience in Python automation scripting. Good to Have: Exposure to Natural Language Processing (NLP) tools like NLTK . Basic understanding or hands-on experience with Machine Learning . Experience with Python web frameworks like Django , Flask , or FastAPI . Thanks & Regards, Salim (Human Resources)

Responsibilities & Duties Conduct email marketing and LinkedIn marketing for business development. Draft and respond to emails professionally on behalf of the company. Manage and schedule meetings with potential clients. Handle LinkedIn account management for business outreach and networking. Perform data scraping for lead generation and reporting. Prepare reports related to marketing and lead conversion. Maintain effective communication with clients and internal teams. Skill-set we are looking for Soft Skills: Strong written and verbal communication skills in English to draft proposals and engage effectively with clients. Adaptability Time Management Initiator and Collaborative Technical Skills & Qualifications: A bachelors degree in computer science, Marketing or a related field. Email Drafting LinkedIn Pitching English Communication Ability to create professional presentations using PowerPoint, Google Slides, or Canva to pitch ideas and business strategies. Able to work in tools like Slack, Microsoft Teams, and Zoom for internal communication and virtual meetings.

Job Title: Email Marketing Specialist Responsibilities: Plan, design, and execute targeted email marketing campaigns. Generate relevant content for email campaigns, including subject lines, copy, and calls to action, tailored to the target audience's needs and preferences. Manage and segment email lists to ensure effective targeting, engagement, and compliance with email marketing regulations. (e.g., GDPR, CAN-SPAM) Monitor and analyse campaign performance metrics to identify areas for improvement and implement necessary changes. Manage email databases for accuracy and segmentation purposes to maximize targeting effectiveness. Generate data from specified sources and Data extraction from different resources Conduct A/B testing on various email campaigns to optimize open click-through and conversion rates. Should be running Global email marketing campaigns. Qualifications Proven track record in email marketing with a strong understanding of email best practices. Proficiency in HTML, CSS, and email marketing platforms (e.g., Mailchimp, HubSpot, Marketo, zoominfo) will be a plus Excellent writing and communication skills. Skills Required: Experience in the events and exhibitions industry or any B2B email marketing would be a plus. Contact: +91 8169054726 Amruta Sawant, HR Manager, AARS Designs Address: E-110, Crystal Plaza, Link Road, Opposite Infinity Mall, Andheri West, Mumbai Suburban, Maharashtra, India If you are passionate about creating impactful exhibition experiences and thrive in a collaborative environment, we would love to hear from you!

Note: Please don't apply if you do not have at least 3 years of Scrapy experience. We are seeking a highly experienced Web Scraping Expert specialising in Scrapy-based web scraping and large-scale data extraction. This role is focused on building and optimizing web crawlers, handling anti-scraping measures, and ensuring efficient data pipelines for structured data collection. The ideal candidate will have 5+ years of hands-on experience developing Scrapy-based scraping solutions, implementing advanced evasion techniques, and managing high-volume web data extraction. You will collaborate with a cross-functional team to design, implement, and optimize scalable scraping systems that deliver high-quality, structured data for critical business needs. Key Responsibilities Scrapy-based Web Scraping Development Develop and maintain scalable web crawlers using Scrapy to extract structured data from diverse sources. Optimize Scrapy spiders for efficiency, reliability, and speed while minimizing detection risks. Handle dynamic content using middlewares, browser-based scraping (Playwright/Selenium), and API integrations. Implement proxy rotation, user-agent switching, and CAPTCHA solving techniques to bypass anti-bot measures. Advanced Anti-Scraping Evasion Techniques Utilize AI-driven approaches to adapt to bot detection and prevent blocks. Implement headless browser automation and request-mimicking strategies to mimic human behavior. Data Processing & Pipeline Management Extract, clean, and structure large-scale web data into structured formats like JSON, CSV, and databases. Optimize Scrapy pipelines for high-speed data processing and storage in MongoDB, PostgreSQL, or cloud storage (AWS S3). Code Quality & Performance Optimization Write clean, well-structured, and maintainable Python code for scraping solutions. Implement automated testing for data accuracy and scraper reliability. Continuously improve crawler efficiency by minimizing IP bans, request delays, and resource consumption. Required Skills and Experience Technical Expertise 5+ years of professional experience in Python development with a focus on web scraping. Proficiency in using Scrapy based scraping Strong understanding of HTML, CSS, JavaScript, and browser behavior. Experience with Docker will be a plus Expertise in handling APIs (RESTful and GraphQL) for data extraction. Proficiency in database systems like MongoDB, PostgreSQL Strong knowledge of version control systems like Git and collaboration platforms like GitHub. Key Attributes Strong problem-solving and analytical skills, with a focus on efficient solutions for complex scraping challenges. Excellent communication skills, both written and verbal. A passion for data and a keen eye for detail Why Join Us? Work on cutting-edge scraping technologies and AI-driven solutions. Collaborate with a team of talented professionals in a growth-driven environment. Opportunity to influence the development of data-driven business strategies through advanced scraping techniques. Competitive compensation and benefits.

Summary To enhance user profiling and risk assessment, we are building web crawlers to collect relevant user data from third-party sources, forums, and the dark web. We are seeking a Senior Web Crawler & Data Extraction Engineer to design and implement these data collection solutions. Job Responsibilities Design, develop, and maintain web crawlers and scrapers to extract data from open web sources, forums, marketplaces, and the dark web. Implement data extraction pipelines that aggregate, clean, and structure data for fraud detection and risk profiling. Use Tor, VPNs, and other anonymization techniques to safely crawl the dark web while avoiding detection. Develop real-time monitoring solutions for tracking fraudulent activities, data breaches, and cybercrime discussions. Optimize crawling speed and ensure compliance with website terms of service, ethical standards, and legal frameworks. Integrate extracted data with fraud detection models, risk scoring algorithms, and cybersecurity intelligence tools. Work with data scientists and security analysts to develop threat intelligence dashboards from collected data. Implement anti-bot detection evasion techniques and handle CAPTCHAs using AI-driven solvers where necessary. Stay updated on OSINT (Open-Source Intelligence) techniques, web scraping best practices, and cybersecurity trends. Requirements 5+ years of experience in web crawling, data scraping, or cybersecurity data extraction. Strong proficiency in Python, Scrapy, Selenium, BeautifulSoup, Puppeteer, or similar frameworks. Experience working with Tor, proxies, and VPNs for anonymous web scraping. Deep understanding of HTTP protocols, web security, and bot detection mechanisms. Experience parsing structured and unstructured data from JSON, XML, and web pages. Strong knowledge of database management (SQL, NoSQL) for storing large-scale crawled data. Familiarity with AI/ML-based fraud detection techniques and data classification methods. Experience working with cybersecurity intelligence sources, dark web monitoring, and OSINT tools. Ability to implement scalable, distributed web crawling architectures. Knowledge of data privacy regulations (GDPR, CCPA) and ethical data collection practices. Nice to Have Experience in fintech, fraud detection, or threat intelligence. Knowledge of natural language processing (NLP) for analyzing cybercrime discussions. Familiarity with machine learning-driven anomaly detection for fraud prevention. Hands-on experience with cloud-based big data solutions (AWS, GCP, Azure, Elasticsearch, Kafka).

Senior Engineer-NLP: Elevate Your Impact Through learning Evalueserve is a global leader in delivering innovative and sustainable solutions to a diverse range of clients, including over 30% of Fortune 500 companies. With a presence in more than 45 countries across five continents, we excel in leveraging state-of-the-art technology, artificial intelligence, and unparalleled subject matter expertise to elevate our clients' business impact and strategic decision-making. Our team of over 4, 500 talented professionals operates in countries such as India, China, Chile, Romania, the US, and Canada. Our global network also extends to emerging markets like Colombia, the Middle East, and the rest of Asia-Pacific. Recognized by Great Place to Work in India, Chile, Romania, the US, and the UK in 2022, we offer a dynamic, growth-oriented, and meritocracy-based culture that prioritizes continuous learning and skill development, work-life balance, and equal opportunity for all. A bout Innovation and Technology Centre (ITC) Our Innovation and Technology Centre specializes in creating modular solutions to meet clients' specific needs. As a member of the team, you will have the opportunity to develop and implement digital products, platforms, and tools specifically designed for research, analytics, and data management domains. We are at the forefront of technological advancements, and our AI efforts rely on our larger platform called AI for Research and Analytics (AIRA). What you will be doing at Evalueserve Building and implementing advanced machine learning (ML) and deep learning (DL) algorithms and models Applying different natural language processing (NLP) techniques to problems such as text classification, text summarization, questions and answers, information retrieval, knowledge extraction, and design of conversational bots by using traditional and generative AI techniques Contributing to the design and development of enterprise-grade generative AI applications, including but not limited to advanced RAG, VDB optimization, LLM evaluation, and finetuning Designing and developing a practical and analytical approach while maintaining a focus on aspects such as data quality and availability, feasibility, scalability, and turnaround time What were Looking for At least a bachelors /master`s degree in computer science, information systems, statistics, mathematics, or a related field Strong understanding of data science processes, such as data investigation, cleaning, minimal viable models, and nuances related to the deployment and enhancement About 38 years of experience in NLP, ML, and DL More than one year of experience in generative AI application development at the production level Demonstrated ability in developing NLP / ML / DL / generative AI project solutions here Hands-on experience and deep theoretical expertise in NLU, NLP, NLG, and common NLP algorithms and DL architectures such as Transformers, BERT, word2vec, FastText, and ELMO Hands-on experience in building and handling product-level delivery of knowledge graphs, ranking algorithms, recommendation engines, etc In-depth knowledge and experience in handling open-source frameworks, such as TensorFlow, PyTorch, and Huggingface Transformers Expert-level programming experience in Python / C++ Familiarity with general software design concepts, product development lifecycles, and ML model deployment best practices Experience in analyzing large amounts of user-generated content and process data in large-scale environments by using cloud infrastructure Proficiency in scraping data from external sources and developing architectures to store and organize the information for generating insights Experience in contributing to open-source software projects Experience and tenacity to go beyond available tools / techniques to design solutions in line with product requirements Ability to communicate with internal and external stakeholders and convey complex information clearly and concisely Understanding of the cultural differences and work styles in a global environment Want to learn more about our culture and what its like to work with us? Write to us at: careers@evalueserve.com Disclaimer: The following job description serves as an informative referencefor the tasks you may be required to perform. However, it does not constitutean integral component of your employment agreement and is subject to periodicmodifications to align with evolving circumstances.

HEAD FIELD SOLUTIONS PVT LTD. Job Description Email Marketing Required Skills: Candidate should minimum have 100-400 email ids Candidate should have experience in particular industry (Example:-Staffing. Healthcare) 0-10 years experience in the email marketing profile Candidate should be comfortable working with target based Job(Lead generation) We work on domain leads We work for only US Clients Required Candidate Profile: Ability to work in a team and with different personalities. Ability to work under pressure and to strict deadlines Proactive Benefits: Employee friendly Corporate Work culture Excellent Salary structure Timings are fixed (9:00 AM to 6:00 PM) with Saturday and Sunday Off. Best in class infrastructure In-House Meals are available(Lunch and Tea) Strong recognition for our employees, giving them excellent career path. Company Website links: www.headfield.com www.glocalrpo.com

Build and run scripts to scrape emails, phone numbers, and business data, clean and organize it, analyze insights using Python/Excel, automate workflows, and support lead generation for import-export operations.

Responsibilities:As a Data Engineer focused on web crawling and platform data acquisition, you will design, develop, and maintain large-scale web scraping pipelines to extract valuable platform data. Annual bonus Health insurance Provident fund

Hi, We are seeking a detail-oriented and analytical Data Scrapper to join our team. In this role, you will collect, process, and analyze data to help inform business decisions, uncover trends, and identify opportunities for growth and optimization. CANDIDATE BASED OUT OF NOIDA CAN ONLY APPLY Key Responsibilities: Collect and clean data from various sources to ensure accuracy and consistency Analyze complex datasets to identify trends, patterns, and insights Develop dashboards and reports using tools like Tableau, Power BI, or Excel Collaborate with cross-functional teams (product, marketing, operations, etc.) to understand data needs and provide actionable insights Create and maintain documentation for data models, processes, and reports Assist in A/B testing and other statistical analysis to support business decisions Monitor performance metrics and make recommendations for improvements

We're seeking a sharp Sales Executive with experience in Digital Marketing Agency (1-2 years) to turn leads into loyal clients. Master outreach, data scraping, and end-to-end sales in a fast-paced, growth-focused agency.

Role & responsibilities 1. Cold Calling 2.Communication Skill 3. Should know Automation tools. 4. Should know sales navigator tools. 5. Data scraping tools ( Apollo, Lusha) Preferred candidate profile Who has experience in IT Sales .

About the Role We re looking for a Lead Researcher/Lead Generation Specialist to join our sales team. Your main job will be to find and organize potential leads, ensuring our sales team always has great opportunities to pursue. If you enjoy researching, working with data, and helping teams succeed, this role is for you! What You will Do 1. Research and Find Leads Look for potential customers using online tools like LinkedIn, Google, and other lead generation platforms. Collect important information, such as company name, contact person, email, phone number, and more. 2. Organize Lead Information Keep all lead details accurate and well-organized in databases or spreadsheets. Regularly update and check the information to make sure it is correct. 3. Qualify Leads Check if the leads match our ideal customer profile. Rank leads based on their potential to work with us, so the sales team can focus on the best opportunities. 4. Work with the Sales Team Share your findings with the sales team to help them target the right customers. Understand the team needs and adjust your research accordingly. 5. Use Tools and Technology Use tools like Excel, Google Sheets, and CRM software (e.g., HubSpot, Salesforce) to make your work easier. Learn and use new tools to improve the lead generation process. 6. Track and Report Progress Keep track of how many leads you have found and how well they are performing. Share reports and suggest ways to improve lead generation efforts. What We are Looking For Someone who loves researching and working with data. Basic knowledge of tools like LinkedIn, Excel, and CRMs (e.g., HubSpot, Salesforce). Organized, detail-oriented, and able to manage multiple tasks. Strong communication skills and a team player. Bonus: Experience with B2B sales or lead generation. Bottom of Form

1. Data Scraping 2. Advanced Excel 3. Communicating with clients, understanding project requirements, and providing training to the team accordingly. 4. Strong communication skills (English) in both written and verbal 5. Provident fund Annual bonus

Data scraping from the mentioned property in the case ETL knowledge will be added advantage Basic knowledge of photoshop Good knowledge of excel Basic understanding of computers Browsing knowledge. Good communication skills

Python Developer Location: Sector-1, Noida (Work from Office) Experience: Minimum 3 years Education: B.E./B.Tech Primary Role: Responsible for performing web scraping and crawling to extract and structure data from various websites. Handle data cleaning, transformation, and storage in structured formats. Write efficient and scalable Python scripts to manage high-volume data extraction tasks. Monitor and manage log files using automation scripts. Key Skills: Proficiency in Python with hands-on experience in web scraping and crawling . Strong working knowledge of BeautifulSoup , Selenium , NumPy , Pandas , and Pytest . Good understanding of JavaScript , HTML , and SQL (preferably MS SQL ). Experience with MongoDB is an added advantage. Ability to integrate multiple data sources and databases into a single pipeline. Solid understanding of: Python threading and multiprocessing Event-driven programming Scalable and modular application design Preferred Skills: Practical experience in writing and maintaining web crawlers and scrapers . Familiarity with anti-bot mechanisms and techniques to bypass them responsibly. Exposure to handling large datasets and ensuring data accuracy and completeness. Experience with automated testing using Pytest .

What we are looking for The ideal candidate will possess hands-on expertise in designing and deploying advanced web scraping solutions, leveraging Node.js and other technologies. A significant focus will be on overcoming bot detection challenges, building scalable and resilient scraping systems, and ensuring the efficiency and scalability of data acquisition pipelines. This is a highly technical, hands-on role ideal for someone passionate about solving complex scraping and infrastructure challenges. Things you will be doing Advanced Web Scraping: Develop and maintain high-performance scraping systems using Node.js, Python, or other relevant technologies. Handle JavaScript-heavy and asynchronous content using tools like Puppeteer, Playwright, or custom solutions in Node.js. Implement advanced bot detection bypass techniques, including: CAPTCHA solving using automation, AI/ML, or third-party services. Advanced proxy management and IP rotation strategies. User-agent, cookie, and header spoofing. Build robust error-handling mechanisms to adapt to changes in website structures or anti-scraping measures. Bot Detection and Anti-Scraping Expertise: Analyze and reverse-engineer advanced bot detection systems and anti-scraping mechanisms, including rate-limiting, behavioral analysis, and fingerprinting. Design and implement techniques to bypass WAFs (Web Application Firewalls) and server-side protections using Node.js libraries and tools. Monitor, log, and analyze bot detection patterns to ensure system adaptability. Create innovative solutions to blend scraping traffic with legitimate user behavior. Infrastructure and Networking: Architect and maintain scalable infrastructure using containerization tools like Docker and orchestration platforms such as Kubernetes. Leverage cloud platforms (AWS, GCP, Azure) for distributed scraping and data acquisition. Utilize Node.js and related tools to optimize network configurations for high-throughput scraping, including proxy and load balancer configurations. Automate deployment and scaling of scraping systems using CI/CD pipelines. Performance and Optimization: Ensure optimal performance of scraping systems by reducing latency and optimizing resource utilization. Develop robust monitoring and logging systems to track and troubleshoot issues in real time. Optimize pipelines for scalability, fault tolerance, and high availability. Compliance and Security: Ensure adherence to legal, ethical, and regulatory standards (e.g., GDPR, CCPA) for all scraping activities. Safeguard data acquisition systems from detection, blocking, and external threats. Respect website terms of service while implementing efficient scraping solutions. Skills you need in order to succeed in this role Technical Skills: 3+ years of hands-on experience in web scraping or data engineering. Expertise in Node.js for building and optimizing scraping systems. Deep expertise in handling advanced bot detection systems and anti-scraping mechanisms. Strong knowledge of programming languages such as Python and JavaScript. Advanced understanding of networking concepts, including HTTP/HTTPS protocols, WebSockets, DNS, and API integrations. Experience with containerization tools (Docker) and orchestration platforms (Kubernetes). Proficiency in cloud platforms (AWS, GCP, Azure) for scalable data acquisition pipelines. Familiarity with tools like Puppeteer, Playwright, Scrapy, or Selenium. Problem-Solving Expertise: Proven ability to reverse-engineer anti-bot measures such as CAPTCHA, IP blocks, and fingerprinting. Strong debugging and optimization skills for network and scraping pipelines.

Data scraping from the mentioned property in the case ETL knowledge will be added advantage Basic knowledge of photoshop Good knowledge of excel Basic understanding of computers Browsing knowledge. Good communication skills

Data scraping from the mentioned property in the case ETL knowledge will be added advantage Basic knowledge of photoshop Good knowledge of excel Basic understanding of computers Browsing knowledge. Good communication skills Required Candidate profile FRESHER CAN APPLY

Responsibilities: * Manage data, execute email campaigns, scrap leads, oversee social media presence, generate online leads through mass mailings & social media for international clients. Data extraction, Instagram posting & linkedin postings.