Implement a web crawler using a provided API

Quick Overview

This question evaluates understanding of web crawling mechanics, URL/hostname filtering, graph traversal concepts, and concurrent fetching, assessing skills in reachability determination, duplicate detection, and thread-safety.

Implement a web crawler using a provided API

Company: Anthropic

Role: Machine Learning Engineer

Category: Coding & Algorithms

Difficulty: medium

Interview Round: Onsite

Overview: This question evaluates understanding of web crawling mechanics, URL/hostname filtering, graph traversal concepts, and concurrent fetching, assessing skills in reachability determination, duplicate detection, and thread-safety.

Anthropic logo
Anthropic
Feb 11, 2026
mediumMachine Learning EngineerOnsiteCoding & Algorithms
Loading...