Get alerts for new jobs matching your selected skills, preferred locations, and experience range. Manage Job Alerts
3.0 - 7.0 years
0 Lacs
haryana
On-site
About Us: Our data and research teams at YipitData transform raw data into strategic intelligence, delivering accurate, timely, and deeply contextualized analysis that our customers, ranging from the world's top investment funds to Fortune 500 companies, depend on to drive high-stakes decisions. From sourcing and licensing novel datasets to rigorous analysis and expert narrative framing, our teams ensure clients get not just data, but clarity and confidence. We operate globally with offices in the US (NYC, Austin, Miami, Mountain View), APAC (Hong Kong, Shanghai, Beijing, Guangzhou, Singapore), and India. Our award-winning, people-centric culture recognized by Inc. as a Best Workplace for three consecutive years emphasizes transparency, ownership, and continuous mastery. What It's Like to Work at YipitData: YipitData isn't a place for coastingit's a launchpad for ambitious, impact-driven professionals. From day one, you'll take the lead on meaningful work, accelerate your growth, and gain exposure that shapes careers. Why Top Talent Chooses YipitData: - Ownership That Matters: You'll lead high-impact projects with real business outcomes. - Rapid Growth: We compress years of learning into months. - Merit Over Titles: Trust and responsibility are earned through execution, not tenure. - Velocity with Purpose: We move fast, support each other, and aim highalways with purpose and intention. If your ambition is matched by your work ethic and you're hungry for a place where growth, impact, and ownership are the norm, YipitData might be the opportunity you've been waiting for. About The Role: We are seeking a Web Scraping Engineer to join our growing engineering team. In this hands-on role, you'll take ownership of designing, building, and maintaining robust web scrapers that power critical reports and customer experiences across our organization. You will work on complex, high-impact scraping challenges and collaborate closely with cross-functional teams to ensure our data ingestion processes are resilient, efficient, and scalable, while delivering high-quality data to our products and stakeholders. As Our Web Scraping Engineer You Will: - Refactor and Maintain Web Scrapers: Overhaul existing scraping scripts to improve reliability, maintainability, and efficiency. Implement best coding practices (clean code, modular architecture, code reviews, etc.) to ensure quality and sustainability. - Implement Advanced Scraping Techniques: Utilize sophisticated fingerprinting methods (cookies, headers, user-agent rotation, proxies) to avoid detection and blocking. Handle dynamic content, navigate complex DOM structures, and manage session/cookie lifecycles effectively. - Collaborate with Cross-Functional Teams: Work closely with analysts and other stakeholders to gather requirements, align on targets, and ensure data quality. Provide support, documentation, and best practices to internal stakeholders to ensure effective use of our web scraped data in critical reporting workflows. - Monitor and Troubleshoot: Develop robust monitoring solutions, alerting frameworks to quickly identify and address failures. Continuously evaluate scraper performance, proactively diagnosing bottlenecks and scaling issues. - Drive Continuous Improvement: Propose new tooling, methodologies, and technologies to enhance our scraping capabilities and processes. Stay up to date with industry trends, evolving bot-detection tactics, and novel approaches to web data extraction. This is a fully-remote opportunity based in India. Standard work hours are from 11am to 8pm IST, but there is flexibility here. You Are Likely To Succeed If: - Effective communication in English with both technical and non-technical stakeholders. - You have a track record of mentoring engineers and managing performance in a fast-paced environment. - 3+ years of experience with web scraping frameworks (e.g., Selenium, Playwright, or Puppeteer). - Strong understanding of HTTP, RESTful APIs, HTML parsing, browser rendering, and TLS/SSL mechanics. - Expertise in advanced fingerprinting and evasion strategies (e.g., browser fingerprint spoofing, request signature manipulation). - Deep experience managing cookies, headers, session states, and proxy rotations, including the deployment of both residential and data center proxies. - Experience with logging, metrics, and alerting to ensure high availability. - Troubleshooting skills to optimize scraper performance for efficiency, reliability, and scalability. What We Offer: Our compensation package includes comprehensive benefits, perks, and a competitive salary. We care about your personal life, and we mean it. We offer flexible work hours, flexible vacation, a generous 401K match, parental leave, team events, wellness budget, learning reimbursement, and more! Your growth at YipitData is determined by the impact that you are making, not by tenure, unnecessary facetime, or office politics. Everyone at YipitData is empowered to learn, self-improve, and master their skills in an environment focused on ownership, respect, and trust. See more on our high-impact, high-opportunity work environment above! Job Applicant Privacy Notice,
Posted 1 week ago
4.0 - 8.0 years
0 Lacs
hyderabad, telangana
On-site
YipitData is a leading market research and analytics firm in the disruptive economy that has recently secured up to $475M from The Carlyle Group, valuing over $1B. For three consecutive years, YipitData has been recognized as one of Inc's Best Workplaces, fostering a people-centric culture centered around mastery, ownership, and transparency. As a fast-growing technology company with offices in various locations worldwide, including NYC, Austin, Miami, and others, we offer exciting opportunities for individuals looking to make a significant impact. As a Web Scraping Specialist at YipitData, you will be part of the Data Solutions team, reporting directly to the Data Solutions Engineering Manager. Your role will involve designing, refactoring, and maintaining web scrapers crucial for generating key reports across the organization. By ensuring the efficiency, reliability, and scalability of our data ingestion processes, you will directly support multiple business units and products. Key Responsibilities: - Refactor and maintain web scrapers to enhance reliability, maintainability, and efficiency. - Implement advanced scraping techniques using fingerprinting methods to evade detection and blocking. - Collaborate with cross-functional teams to gather requirements, align on targets, and ensure data quality. - Monitor, troubleshoot, and optimize scraper performance to address failures and bottlenecks. - Drive continuous improvement by proposing new methodologies and technologies to enhance scraping capabilities. To succeed in this role, effective communication skills in English, a minimum of 4 years of experience with web scraping frameworks, and a strong understanding of HTTP, RESTful APIs, and HTML parsing are essential. Additionally, expertise in advanced fingerprinting and evasion strategies, managing cookies, headers, and proxies, as well as troubleshooting skills for optimizing scraper performance, are required. This is a fully-remote position based in India with flexible working hours from 11am to 8pm IST. At YipitData, we offer a competitive compensation package, comprehensive benefits, and a supportive work environment focused on personal growth and skill mastery. Your impact and contributions are what drive your growth at YipitData, where learning, self-improvement, and skill development are encouraged and valued.,
Posted 3 weeks ago
4.0 - 8.0 years
0 Lacs
ahmedabad, gujarat
On-site
YipitData is the leading market research and analytics firm for the disruptive economy, having recently raised up to $475M from The Carlyle Group at a valuation over $1B. For three years and counting, YipitData has been recognized as one of Inc's Best Workplaces. As a fast-growing technology company with offices in various locations including NYC, Austin, Miami, and more, we cultivate a people-centric culture focused on mastery, ownership, and transparency. As a Web Crawling Specialist [Official, Internal Title: Data Solutions Engineer] at YipitData, you will play a pivotal role in designing, refactoring, and maintaining web scrapers that power critical reports across the organization. Reporting directly to the Data Solutions Engineering Manager, your contributions will ensure that data ingestion processes are resilient, efficient, and scalable, directly supporting multiple business units and products. In this role, you will be responsible for overhauling existing scraping scripts to improve reliability, maintainability, and efficiency. You will implement best coding practices to ensure quality and sustainability. Additionally, you will utilize sophisticated fingerprinting methods to avoid detection and blocking, handle dynamic content, navigate complex DOM structures, and manage session/cookie lifecycles effectively. Collaborating with cross-functional teams, you will work closely with analysts and stakeholders to gather requirements, align on targets, and ensure data quality. You will provide support to internal users of web scraping tooling by offering troubleshooting, documentation, and best practices to ensure efficient data usage for critical reporting. Your responsibilities will also include developing monitoring solutions, alerting frameworks to identify and address failures, evaluating scraper performance, diagnosing bottlenecks, and scaling issues. You will propose new tooling, methodologies, and technologies to enhance scraping capabilities and processes, staying up to date with industry trends and evolving bot-detection tactics. This fully-remote opportunity based in India offers standard work hours from 11am to 8pm IST with flexibility. Effective communication in English, 4+ years of experience with web scraping frameworks, a strong understanding of HTTP, RESTful APIs, HTML parsing, browser rendering, and TLS/SSL mechanics, expertise in advanced fingerprinting and evasion strategies, and troubleshooting skills are key to succeeding in this role. At YipitData, we offer a comprehensive compensation package, including benefits, perks, and a competitive salary. We prioritize your personal life with offerings such as vacation time, parental leave, team events, and learning reimbursement. Your growth at YipitData is determined by the impact you make, fostering an environment focused on ownership, respect, and trust.,
Posted 3 weeks ago
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Accenture
54024 Jobs | Dublin
Wipro
24262 Jobs | Bengaluru
Accenture in India
18733 Jobs | Dublin 2
EY
17079 Jobs | London
Uplers
12548 Jobs | Ahmedabad
IBM
11704 Jobs | Armonk
Amazon
11059 Jobs | Seattle,WA
Bajaj Finserv
10656 Jobs |
Accenture services Pvt Ltd
10587 Jobs |
Oracle
10506 Jobs | Redwood City