Skip to main content
All Questions

Design a scalable system for a token-generation service used by an LLM that needs to handle up to 100,000 requests per second.

Unlock detailed company stats for this questionUpgrade

Community answers

No answers contributed by the community yet.

Related questions

Design a system to deny services to requests from banned IPs, as per information provided by security.gov.x.Design a queuing system for a call center with N representatives to handle more than N requests, where each request takes between 2 and 4 seconds to complete.

Related courses

Course

Software Engineering Interview Prep

Land your dream software engineering role at Google, Amazon, Microsoft, Meta, Apple, and other top companies. Learn from mock interviews, frameworks, and advice from senior candidates—practice data structures, algorithms, system design, people management, behavioral interviews, and more.

Course

System Design Interviews

Learn how to answer the latest system design questions across product, infrastructure, and AI domains. Features in-depth video examples, written breakdowns, and helpful reference patterns. Watch senior engineers and managers answer these questions in mock interview videos.