332 Web Scraping Jobs

As a MERN Stack Developer (ElectronJS + Web Scraping/Puppeteer), you will be responsible for developing and maintaining desktop applications using ElectronJS. You will also have the opportunity to build and optimize web scraping modules using Puppeteer, Cheerio, or similar tools. Additionally, you will design and develop REST APIs and backend services using Node.js & Express, work on MongoDB database design and performance optimization, and integrate third-party APIs and automation workflows. Your role will involve troubleshooting, debugging, and improving existing applications, as well as collaborating with cross-functional teams for requirement gathering and delivery. Key Responsibilities:...

As a BI Architect and Developer, your role will involve designing and developing scalable BI and Data Warehouse (DWH) solutions using tools like Power BI, Tableau, and Azure Databricks. You will be responsible for overseeing ETL processes using SSIS, creating efficient data models, and writing complex SQL queries to transform data. Additionally, you will design interactive dashboards and reports, collaborating closely with stakeholders to translate requirements into actionable insights. Key Responsibilities: - Oversee ETL processes using SSIS - Create efficient data models - Write complex SQL queries for data transformation - Design interactive dashboards and reports - Collaborate with stake...

**Role Overview:** You will be responsible for developing the Policies and Next Gen Rule Engine for Digital Lending. Additionally, you will develop various RestFul APIs and integrate them with different data sources. Your role will also involve developing various reports and automating tasks required for the Business. **Key Responsibilities:** - Develop the Policies and Next Gen Rule Engine for Digital Lending - Develop various RestFul APIs and integrate them with various data sources - Develop various reports and automate tasks required for Business **Qualifications Required:** - Good Programming Skills using Python and DB - Good Experience in Numpy and Pandas - AWS or Other Cloud Platform ...

Hiring for: Must Have-skills: Generative AI, Azure Open AI, Azure Foundry, Copilot Studio, Prompt Engineering, Python, Data Scientist Other Reqd. Skills: AI/ML, NLP, LLMs, GPT, LangGraph, LangChain, Web Scraping, Data Extraction, Azure Web Apps Perks and benefits Excellent Perks & Benefits

Role Overview: As a Python Developer with web scraping expertise, your main responsibility will be to design, develop, and maintain web scraping scripts using Python. You will be using web scraping libraries like Beautiful Soup, Scrapy, Selenium, and other tools to extract data from various websites. Your role will involve writing reusable, testable, and efficient code to extract both structured and unstructured data. Additionally, you will need to collaborate with software developers, data scientists, and other stakeholders to plan, design, develop, and launch new web scraping projects. Troubleshooting, debugging, and optimizing web scraping scripts will also be part of your responsibilitie...

You will be responsible for building and maintaining scrapers for 24-30 websites (initially starting with 6), handling authenticated sites, sessions, cookies, tokens, etc. Additionally, you will work with search endpoints and dynamic content, architect the data ingestion pipeline, implement caching, retries, and queues, and ensure the stability and resilience of the scrapers even as websites evolve. Collaborating closely with the backend team to define and utilize APIs, you will also manage scaling, rate limits, and performance. Qualifications Required: - 5 - 7+ years of experience in building production-grade web scrapers - Strong proficiency in API-based scraping and browser automation, pa...

As a Software Engineer Data Scientist, you will be responsible for the following: - Big Data experience, - 3 years of experience in Java, Python, Scala, Spark, and Machine Learning, - Data mining and Data analysis. Desirable Skills: - Gather and process raw data at scale (including writing scripts, web scraping, calling APIs, writing SQL queries, etc.), - Work closely with the engineering team to integrate and build algorithms, - Process unstructured data into a form suitable for analysis and then perform the analysis, - Support business decisions with ad hoc analysis as needed, - Extract data from a variety of relational databases, manipulate and explore data using quantitative, statistical...

**About the Role** As a BI Architect at Thoucentric, your role will involve advising the BI Lead of a global CPG organization and architecting an intelligent, scalable Business Intelligence ecosystem. This includes designing an enterprise-wide KPI dashboard suite enhanced with a GenAI-driven natural language interface for insight discovery. Your responsibilities will encompass end-to-end architecture, from creating scalable data models and dashboards to implementing a conversational interface powered by Retrieval-Augmented Generation (RAG) and/or Knowledge Graphs. The solution you design must integrate internal BI data with external (web-scraped and competitor) data to deliver intelligent, c...

We are seeking a skilled Web Scraping Developer with strong expertise in building scrapers, crawlers, and data extraction pipelines for e-commerce and quick-commerce platforms. The ideal candidate will have hands-on experience in large-scale product data extraction, including pricing, rankings, product descriptions, and catalog details. Key Responsibilities Design, develop, and maintain scalable scrapers/crawlers for e-commerce websites. Extract structured data such as product listings, pricing, descriptions, reviews, and rankings. Handle dynamic content, cookies, pagination, AJAX, and anti-bot challenges efficiently. Ensure data accuracy, integrity, and scalability of scraping pipelines. Op...

Role Overview: As a Consultant in the ASU - Audit - Standards and Methodologies team at EY, you will play a vital role in ensuring clients" accounts comply with requisite audit standards, providing clear perspectives to audit committees, and furnishing critical information for stakeholders. Your primary focus will be on technical excellence in audit analytics, including sector-specific analytics, visualization, and automated analytics model development. You will work on data extraction from client ERPs, review and rectify algorithms, and implement them using various tools and technologies. Key Responsibilities: - Demonstrate technical excellence in audit analytics - Conduct sector-specific a...

Role & responsibilities Application Development: Design and build web-scale applications using Python (Django/Flask/FastAPI) and modern frontend frameworks (React / Angular / Vue). API Development: Develop and integrate RESTful and GraphQL APIs. Implement responsive, intuitive, and interactive user interfaces. Build scalable and secure backend systems with optimized database queries and caching strategies. Create and manage relational (PostgreSQL/MySQL) and NoSQL (MongoDB/Redis) databases. Deploy applications on AWS / Azure / GCP, including containerization (Docker, Kubernetes). Write clean, reusable, and maintainable code following industry best practices. Ensure system performance, securit...

About the Role We are looking for a skilled Python Developer to design, develop, and maintain server-side applications and backend systems. You will collaborate with cross-functional teams to build scalable, efficient, and secure software solutions. Key Responsibilities Develop and maintain backend applications using Python and relevant frameworks. Write clean, reusable, and optimized code. Build and integrate RESTful APIs and microservices. Develop server-side logic, handle data storage, and ensure high application performance. Work closely with front-end developers, product managers, and QA teams. Debug, troubleshoot, and resolve application issues. Maintain technical documentation for fea...

About the Role We are looking for a detail-oriented Quality Analyst (QA) to ensure the delivery of high-quality software products. You will be responsible for creating test plans, executing manual/automated tests, identifying bugs, and collaborating with development teams to ensure smooth and bug-free releases. Key Responsibilities Develop and execute test plans, test cases, and test scripts . Perform manual testing (functional, regression, integration, UAT) across web/mobile applications. Identify, document, and track defects using tools like Jira, Bugzilla, or Azure DevOps . Collaborate with developers and product teams to diagnose and resolve issues. Validate new features and enhancements...

As a Data Analyst at our company, your role will involve scraping, collecting, and organizing business data from various online sources such as Google My Business, directories, and social platforms. The extracted data will be used as high-quality leads for our Sales & Business Development team to enhance our IT services. This entry-level position is perfect for individuals who are analytical, tech-savvy, and looking to kickstart their career in data and market research. Key Responsibilities: - Conduct web scraping and data collection from online sources like Google My Business, directories, and social platforms. - Ensure accuracy, relevance, and up-to-date nature of all collected data. - Org...

You will be working at Rysysth Technologies, a growing IT company specializing in Microsoft technologies and digital solutions. They focus on SharePoint SPFx development, Power Automate solutions, Azure cloud services, Copilot Studio implementations, and custom web development. The company is striving to become the preferred technology partner for digital transformation. As a Python Developer AI & Web Scraper, your main responsibilities will include: - Developing reliable web scraping scripts and automation tools using Python and related frameworks. - Building scalable data extraction systems for structured and unstructured data. - Integrating AI/ML models for advanced text/data parsing. - H...

Extracting data from various sources, including web scraping, API requests, etc. Building complex data pipelines that automate data sourcing and processing. Develop programs to synchronize technology and human-powered processes. Design and maintain database and data warehousing solutions. Develop automated reports to monitor and track data pipelines (Power BI, Tableau) Work alongside Data Operations teams to augment core technologies. Play a key role in continuing to build out a newly formed data engineering function in the department. Serve as a data and engineering SME on cross-functional Data Operations initiatives. Mentor and assist Associate Data Engineers in building out pipeline archi...

About the Role: We are looking for a talented and detail-oriented Python Engineer to join our development team. In this role, you will design, build, and maintain Python-based applications, APIs, and services. You will collaborate closely with product, QA, design, and other engineering teams to deliver efficient, scalable, and reliable software that meets business and user needs. Key Responsibilities: Develop, test, and deploy high-quality software and services using Python. Design and implement scalable APIs, microservices, and application components. Write clean, efficient, reusable, and maintainable code following best practices. Collaborate with cross-functional teams to gather requireme...

About the Role: We are looking for a skilled and detail-oriented Python Software Developer to design, develop, and maintain high-quality software applications. The ideal candidate will have strong coding skills, experience with Python frameworks, and the ability to work collaboratively in an agile development environment. Key Responsibilities: 1. Software Development Develop, test, and maintain Python-based applications, tools, and services. Write clean, efficient, and reusable code following best practices. Build RESTful APIs and integrate third-party services. 2. Framework & Backend Development Work with Python frameworks such as Django, Flask, or FastAPI. Develop backend logic, data model...

Data Engineer As a Data Engineer, you will work across a global team of analysts and data operation associates to develop new data technologies for Data Operations at PitchBook. We’re looking for a person who can combine proficiency in data engineering technologies (SQL, Python, Data Warehousing & ETL tools, Power BI) with an operational mindset and deliver powerful new data sourcing, automation and efficiency tools to the team. You will become a master PitchBook’s data operations processes and methodologies, establishing the process knowledge necessary to develop effective data solutions. What you'll do: Extracting data from various sources, including web scraping, API requests, etc. Buildi...

About the Role: We are seeking a talented Python Software Developer to design, develop, and maintain high-quality software applications. The ideal candidate will have strong expertise in Python programming, web frameworks, and application development principles. You will collaborate with cross-functional teams to deliver robust, scalable, and efficient software solutions that meet business and technical requirements. Key Responsibilities: Develop, test, and maintain Python-based applications and backend systems. Write clean, maintainable, and efficient code following best practices. Collaborate with product owners, designers, and other developers to translate requirements into functional sof...

You are looking for a highly motivated and tech-savvy intern to join 1-2-Taste India's team. As an intern, your role will involve assisting the team in generating leads from various platforms by utilizing web scraping techniques. **Responsibilities:** - Research and identify potential leads from designated platforms - Utilize web scraping techniques to collect and extract relevant data - Process and organize data for future use - Collaborate with the team to develop and implement lead generation strategies - Meet project deadlines and deliver high-quality results **Requirements:** - Bachelor's degree - Knowledge of web scraping techniques and tools - Familiarity with programming languages su...

Job Description: You will be responsible for data related activities and data management. This includes researching the required data and storing it in Google sheet, processing data and information according to the guidelines, supporting sales, recruitment and projects team with enough data, extracting data through web scraping and using the latest tools, data verification, maintaining databases, finding new tools and working methods to acquire data, and conducting client outreach as necessary or when required. Qualifications: - Any degree - Proficient in MS Excel - Good communication skills - Good internet searching capabilities - Ability to work independently - Strong interest in learning ...

As a Senior Data Engineer at Gramener, you will be responsible for designing and building data models to meet the organization's strategic data needs. You will collaborate with technical and business stakeholders to analyze requirements, develop solutions, and identify operational issues. Communication with business users to explain technical solutions and ensure alignment with corporate standards will be a key part of your role. Additionally, you will be creating technical design specifications and assessing the impacts of proposed solutions. Key Responsibilities: - Designing and building data models to meet strategic data needs - Collaborating with technical and business stakeholders - Per...

You are seeking a skilled Power BI Developer with strong expertise in data Analytics, data Science, SQL, database management, and Python to join the team. You will be responsible for designing and developing interactive dashboards, reports, conducting advanced analytics, and data models, while also contributing to data automation, transformation, data-driver decision making and integration tasks. - Design, develop, and maintain Power BI dashboards and reports with focus on storytelling, performance, and usability to deliver actionable insights. - Work with client/Program Managers to gather requirements and transform them into analytics solutions by collecting, transforming, and analyzing lar...

Role Overview: As a Data Scraper / Lead Generator in our fast-growing team based in Mumbai, your primary responsibility will be to generate leads through web scraping and online research, focusing on Europe, UK, USA, and other international markets. Key Responsibilities: - Conduct detailed online research to identify potential leads in targeted geographies. - Utilize advanced web scraping tools and techniques to extract accurate contact and business data from various sources. - Validate and verify collected data to maintain quality and relevance. - Manage a structured database of leads for outreach and tracking purposes. - Collaborate closely with the sales and marketing teams to provide a c...