Senior Adversarial Infrastructure Engineer

Related keywords: data engineer remote jobdata science remote jobremote job python

Overview

The position of Senior Adversarial Infrastructure Engineer is offered by RevenueBase Inc, a company focused on developing data infrastructure that prioritizes the reliability of AI agents. The organization's goal is to make AI trustworthy by employing techniques that enhance the credibility of the input data.

Opportunity and Responsibilities

This role is on a contract basis and represents a unique opportunity to lead high-scale data enumeration initiatives. Unlike traditional jobs that revolve around simple scripting, this position is classified as a sophisticated engineering challenge. Candidates will be tasked with the responsibility of constructing and scaling systems capable of processing over 1 million records per hour. This involves working with highly secure enterprise platforms on the Internet.

The ideal candidate will thrive in an environment where conventional browser automation methods are deemed insufficient. Preference is given to those who enjoy exploring undocumented mobile APIs, reverse-engineering private endpoints, and staying ahead of accomplished anti-bot teams.

Key responsibilities include:

• Architecting Distributed Stealth Systems: Designing and deploying horizontally scalable scraping nodes using technologies like Go or Python/Asyncio on platforms such as AWS Lambda/Fargate or Kubernetes.
• Hidden API Discovery: Utilizing tools like Charles Proxy, Fiddler, or Burp Suite to uncover undocumented APIs and find alternative pathways that can bypass complex front-end obfuscation.
• Fingerprint Evasion: Applying advanced techniques to navigate enterprise-grade bot detection, particularly concentrating on TLS fingerprinting techniques like JA3 and evading HTTP/2 headers.
• Orchestrating Large Infrastructure: Managing extensive residential and mobile proxy pools to sustain high request rates (over 1 million requests per hour) while optimizing for both cost and success.
• Building for Resilience: Creating real-time monitoring systems to observe the success and burn rates of the proxy infrastructure, ensuring that systems can recover automatically against updated defenses.

Required Skills

To be successful in this role, candidates should possess specific skills and experiences:

• The Stealth Toolkit: In-depth expertise with tools like Playwright or Puppeteer, as well as custom HTTP clients for efficient data extraction processes.
• Massive Scale Experience: Experience managing data pipelines that handle millions of requests daily, demonstrating a clear understanding of rate-limiting nuances at different levels.
• Reverse Engineering Mastery: Proficiency in breaking down mobile applications or complex JavaScript bundles to locate data endpoints.
• Builder Mindset: A desire to create “ghost” architectures that function smoothly in the background and can be transitioned to the core team for ongoing maintenance.

Why Join RevenueBase?

• Technical Sovereignty: Team members have the autonomy to determine how data is collected, as long as it remains efficient and reliable.
• High-Stakes Challenges: Employees face some of the highest levels of web security challenges.
• Elite Peer Group: The company comprises a focused, technical team dedicated to creating a robust data foundation suitable for the AI era.

Additional Information

This exciting position is set within the United States and fosters a dynamic work environment where creativity in problem-solving is crucial. As the company is relatively lean, employees often find themselves collaborating closely with skilled professionals in the field, making this an ideal time to join a forward-thinking organization that emphasizes the critical importance of reliable data for AI development.

The job listing highlights the organization's mission, expected deliverables, and desired qualifications, offering candidates a clear understanding of their responsibilities and the thrilling challenges they will face. Understanding the evolution of adversarial data infrastructure is essential for candidates aspiring to take on this role, as this position will define the landscape of data reliability for the AI future.

This job offer was originally published on himalayas.app