Babelstreet
Software Engineer III
Reston, VA, United States · Mid
Sponsorship not specified$85k-$100kDetected 63 days ago
JavaScriptPythonSQLPostgreSQLData AnalysisSeleniumPlaywrightTCP/IPResearchCollaborationProblem Solving
About the role
- Babel Street empower s government and commercial organizations to transform high-stakes identity and risk operations into a strategic advantage.
- Babel Street is headquartered in Reston, Virginia, with regional offices in Boston, MA and Cleveland, OH, and international offices in Australia, Canada, Israel, Japan, and the U.K. For more information, visit www. babelstreet.com.
Responsibilities
- Spider Development: Design and deploy robust, distributed spiders and crawlers to extract data from a variety of web architectures (SPAs, SSR, etc.).
- Bot Evasion Engineering: Research and implement strategies to bypass anti-scraping technologies, including proxy rotation, browser fingerprinting, and CAPTCHA solving.
- Database Management: Create and optimize SQL schemas for large-scale data storage and perform complex data transformations and validation.
- Design and deploy robust, distributed spiders and crawlers to extract data from a variety of web architectures (SPAs, SSR, etc.).
- We trust our employees to manage their own time and balance their personal and work lives.
Requirements
- Advanced Python: Mastery of Python 3.x with deep experience in extraction frameworks (Scrapy, Playwright, Selenium, or Puppeteer).
- Technical Resilience: Proven ability to bypass high-level bot detection (e.g., Cloudflare, Akamai, or PerimeterX).
- Network Proficiency: Expert understanding of HTTP/S, TCP/IP, TLS fingerprinting, and browser-header manipulation.
- Problem Solving: A specialized ability to reverse-engineer JavaScript-heavy websites and hidden API endpoints.
- Must be able to analyze and interpret complex web structures and network traffic using browser developer tools.
- Bachelor's degree in Computer Science, Information Systems, or a related field (or equivalent professional experience).
- Minimum of 5+ years of experience in Software Engineering, with at least 2-3 years focused specifically on large-scale web scraping or data extraction.
- Proven ability to bypass high-level bot detection (e.g., Cloudflare, Akamai, or PerimeterX).
Nice to have
- This role ensures the continuous, reliable flow of high-quality data into our internal databases by engineering solutions to overcome sophisticated technical barriers and anti-bot security measures.
- As a Software Engineer III specializing in data extraction, you will be responsible for the end- to- end lifecycle of web-based data collection.
- This includes designing scalable crawling architectures, reverse-engineering web applications to identify data points, and implementing evasion techniques to bypass IP rate-limiting and bot detection.
- This role is dedicated to large-scale web scraping and data harvesting.
- If you have deep experience with Scrapy or Playwright, know how to defeat Cloudflare or DataDome, and can write high-performance SQL to manage millions of records, we want to hear from you.
- This is a specialized role for an engineer who enjoys reverse-engineering the web to unlock data.
Skills
- Mastery of Python 3.x with deep experience in extraction frameworks (Scrapy, Playwright, Selenium, or Puppeteer).
- Expert-level SQL skills and experience managing relational databases like PostgreSQL or MySQL.
Compensation
- $85k-$100k
Benefits
- Babel Street covers 85-100% monthly premium costs for Medical, Dental, Vision, Life & Disability insurances - for you and your family!
- Retirement Plans: Babel Street offers both a Traditional and Roth 401(K) with a very competitive match.
- Unlimited Flexible Leave: We trust our employees to manage their own time and balance their personal and work lives.
- Tuition Reimbursement: We are committed to investing in our employees.
- One way we do that is with our Tuition Reimbursement Program for continuing education.
- Proactively monitor the health of extraction agents and refactor code quickly in response to target website updates or layout changes.
Company info
- We are committed to investing in our employees.
- Babel Street is an equal opportunity/affirmative action employer.
- All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by law.
- Further, Babel Street will not discriminate against applicants for inquiring about, discussing or disclosing their pay or, in certain circumstances, the pay of their co‐worker, Pay Transparency Nondiscrimination.
- In addition, Babel Street's policy is to provide reasonable accommodation to qualified employees who ha
Equal opportunity
- equal opportunity/affirmative action employer.
Apply directly at Babelstreet →Create a free account for alerts like thisView Babelstreet immigration profile
This listing is sourced directly from Babelstreet's careers page and normalized into a canonical job model.