ShortlistFox
← Back to results

Backend Infrastructure Engineer, Anti-Bot

true-talent-solutions-partners

San Francisco

  • $235,000–$260,000 per year
  • Onsite
  • Full Time
Apply

About the role

About the Role

Join the infrastructure team at a growing AI-focused web data extraction company. You will build and operate the systems that help high-volume extraction remain reliable against websites that actively resist automated access.

What You'll Do

  • Architect and manage proxy rotation, IP and session management, and isolated egress nodes at scale.

  • Improve extraction success against anti-bot and anti-scraping defenses.

  • Build and maintain browser and TLS fingerprinting, CAPTCHA, and challenge-handling infrastructure.

  • Monitor the reliability and cost efficiency of the proxy layer.

  • Investigate intermittent failures across the stack, resolve root causes, and maintain production systems.

What We're Looking For

  • More than 3 years of experience in adversarial web infrastructure or proxy-layer engineering, with recent hands-on work in web extraction against active defenses.

  • Production experience designing proxy rotation, IP and session management, egress isolation, and proxy economics for third-party web extraction.

  • Experience bypassing major anti-bot systems in production and owning associated success-rate metrics.

  • Hands-on experience with browser and TLS fingerprinting and CAPTCHA or challenge handling at production scale.

  • Proficiency in Go and/or Python, plus networking fundamentals including TCP/IP, HTTP/2, connection pooling, and proxy orchestration.

  • Experience owning end-to-end production systems, including on-call responsibilities and observability tools such as Prometheus and Grafana.

  • Comfort working in complex, adversarial problem spaces and shipping, measuring, and iterating quickly.

Compensation & Benefits

Base salary: $235,000 to $260,000 annually. Visa sponsorship is available.

Location

Hybrid in San Francisco, California.