Anthropic System Design Interview Questions

Review this list of 8 Anthropic System Design interview questions and answers verified by hiring managers and candidates.

+ Share interview

Share interview

Asked at Anthropic • 3 months ago
Design an inference batching system for a single GPU that can handle up to 100 inputs per batch while users wait synchronously, maximizing utilization under compute constraints.
Software Engineer
System Design
+4 more
1 answer I was asked this
"Functional requirements: user can send an input and wait for the result Group up to 100 individual requests in to single GPU The system should should send results back to the user who requested it when done Non functional requirements: Minimize the waiting between two batches of execution/ reduce idle time error message if a batch faiils Scale to support multiple GPUs Core Entities: Request Batch Result API Design: POST /predict -> {requestid: "", response: ""} req"
Alok S. - "Functional requirements: user can send an input and wait for the result Group up to 100 individual requests in to single GPU The system should should send results back to the user who requested it when done Non functional requirements: Minimize the waiting between two batches of execution/ reduce idle time error message if a batch faiils Scale to support multiple GPUs Core Entities: Request Batch Result API Design: POST /predict -> {requestid: "", response: ""} req"See full answer
Software Engineer
System Design
+4 more
Asked at Anthropic • 5 months ago
Design a file cache system.
Software Engineer
System Design
Add answer I was asked this
Software Engineer
System Design
Asked at Anthropic • 5 months ago
Design an agentic AI system that can autonomously adapt to new tasks.
Machine Learning Engineer
System Design
+2 more
Add answer I was asked this
Machine Learning Engineer
System Design
+2 more
Asked at Anthropic • 3 months ago
Design a peer-to-peer file distribution system that spreads a 10GB file from a single bandwidth-constrained source to thousands of interconnected hosts, each with limited input/output bandwidth, un...
Hardware Engineer
System Design
+1 more
Add answer I was asked this
Hardware Engineer
System Design
+1 more
Asked at Anthropic • 2 months ago
Design an end-to-end batching system for LLM queries.
Software Engineer
System Design
+1 more
Add answer I was asked this
Software Engineer
System Design
+1 more

🧠 Want an expert answer to a question? Saving questions lets us know what content to make next.

Asked at Anthropic, Google, Meta + 1 more • 6 months ago
Design a web crawler.
Engineering Manager
System Design
+1 more
10 answers I was asked this
+7
"I think, robots.txt file is provided by websites which web-crawler is crawling. Am I wrong somewhere or missing some context?"
S V. - "I think, robots.txt file is provided by websites which web-crawler is crawling. Am I wrong somewhere or missing some context?"See full answer
Engineering Manager
System Design
+1 more
Asked at Anthropic • 6 months ago
Design a scalable system for a token-generation service used by an LLM that needs to handle up to 100,000 requests per second.
Software Engineer
System Design
+1 more
Add answer I was asked this
Software Engineer
System Design
+1 more
Asked at Anthropic, Canva, Google + 3 more • 6 months ago
Design a key-value store.
Software Engineer
System Design
+2 more
2 answers I was asked this
"Simple file system ( Hash Map , LSM trees), and consistent hashing. I failed to discuss about conflicts ( Versioning)"
V V. - "Simple file system ( Hash Map , LSM trees), and consistent hashing. I failed to discuss about conflicts ( Versioning)"See full answer
Software Engineer
System Design
+2 more