ShortlistFox
← Back to results

Backend Infrastructure Engineer, Anti-Bot

true-talent-solutions-partners

San Francisco

  • $235,000–$260,000 per year
  • Onsite
  • Full Time
Apply

About the role

About the Role

Join an infrastructure team building reliable web data extraction systems for a B2B SaaS platform. You will own production systems that keep extraction working against websites with actively changing anti-bot defenses.

What You'll Do

  • Architect and operate proxy rotation, IP and session management, and isolated egress infrastructure at scale.

  • Improve extraction success rates against aggressive anti-bot and anti-scraping defenses.

  • Build and maintain browser and TLS fingerprinting, CAPTCHA handling, and challenge-solving systems.

  • Manage proxy-layer reliability, cost efficiency, and operating economics.

  • Investigate intermittent production failures across the stack and implement durable fixes.

  • Own systems end to end, including production health and on-call responsibilities.

What We're Looking For

  • More than 3 years of experience in adversarial web infrastructure or proxy-layer engineering, with recent hands-on work in web extraction.

  • Production experience building proxy infrastructure and extraction systems that operate against aggressive anti-bot defenses, and ownership of related success-rate metrics.

  • Experience bypassing major commercial anti-bot platforms in production, and managing browser or TLS fingerprints and CAPTCHA or challenge-solving infrastructure.

  • Proficiency in Go and/or Python, with networking fundamentals including TCP/IP, HTTP/2, connection pooling, and proxy orchestration.

  • Experience with observability and on-call tooling such as Prometheus and Grafana.

Compensation & Benefits

Base salary: $235,000 to $260,000 annually. Visa sponsorship is available.

Location

Hybrid in San Francisco, California, United States.