Make a Hostname-Limited Crawler Concurrent
Company: Anthropic
Role: Software Engineer
Category: Software Engineering Fundamentals
Difficulty: medium
Interview Round: Technical Screen
Overview: Build a concurrent hostname-limited crawler that removes fragments before deduplication, prevents duplicate fetches, and detects crawl completion correctly.