Backend Infrastructure Engineer, Anti-Bot

About the Role

Join the infrastructure team at a growing AI-focused web data extraction company. You will build and operate the systems that help high-volume extraction remain reliable against websites that actively resist automated access.

What You'll Do

• Architect and manage proxy rotation, IP and session management, and isolated egress nodes at scale.

• Improve extraction success against anti-bot and anti-scraping defenses.

• Build and maintain browser and TLS fingerprinting, CAPTCHA, and challenge-handling infrastructure.

• Monitor the reliability and cost efficiency of the proxy layer.

• Investigate intermittent failures across the stack, resolve root causes, and maintain production systems.

What We're Looking For

• More than 3 years of experience in adversarial web infrastructure or proxy-layer engineering, with recent hands-on work in web extraction against active defenses.

• Production experience designing proxy rotation, IP and session management, egress isolation, and proxy economics for third-party web extraction.

• Experience bypassing major anti-bot systems in production and owning associated success-rate metrics.

• Hands-on experience with browser and TLS fingerprinting and CAPTCHA or challenge handling at production scale.

• Proficiency in Go and/or Python, plus networking fundamentals including TCP/IP, HTTP/2, connection pooling, and proxy orchestration.

• Experience owning end-to-end production systems, including on-call responsibilities and observability tools such as Prometheus and Grafana.

• Comfort working in complex, adversarial problem spaces and shipping, measuring, and iterating quickly.

Compensation & Benefits

Base salary: $235,000 to $260,000 annually. Visa sponsorship is available.

Location

Hybrid in San Francisco, California.