"@Jacob, your videos are really good and helpful.
I want to know about the tool, you use for explaining the design in the videos."
anush - "@Jacob, your videos are really good and helpful.
I want to know about the tool, you use for explaining the design in the videos."See full answer
"Rate Limiter is to limit the number of request from a particular IP Address. Rate limiter will block the IP address to reduce the load on server. It should be highly available and handle concurrent requests. Blocked IP addresses should be kept in a pool which is present in shared cache. We need to keep threshold value after it reaches threshold value it should start blocking IP address.
All these ip address to be kept in No SQL DB. Batch will run that will clear the cache and delete all the bloc"
Ashish G. - "Rate Limiter is to limit the number of request from a particular IP Address. Rate limiter will block the IP address to reduce the load on server. It should be highly available and handle concurrent requests. Blocked IP addresses should be kept in a pool which is present in shared cache. We need to keep threshold value after it reaches threshold value it should start blocking IP address.
All these ip address to be kept in No SQL DB. Batch will run that will clear the cache and delete all the bloc"See full answer
"First thing the interviewee did wrong is not asking clarifying questions. This is the most vague problem I have every heard, and the interviewee just made assumptions and started programming."
Nicholas S. - "First thing the interviewee did wrong is not asking clarifying questions. This is the most vague problem I have every heard, and the interviewee just made assumptions and started programming."See full answer
"Functional Requirement
Monitor health, metrics
Alert in case of failure/anomaly
Visualize the live health
Analyse machines on periodic basis
Non Functional
Should not exert load on machines
low latency
Highly scalable
Logs/Metrics Gathering
push - machine gather and send to system and low priority background thread along with batching
pull - heart beat check (for offline machines)
Processing
Real time streaming using Kafka/kinesis + Flink
TimeSeries database for stor"
Sourabh G. - "Functional Requirement
Monitor health, metrics
Alert in case of failure/anomaly
Visualize the live health
Analyse machines on periodic basis
Non Functional
Should not exert load on machines
low latency
Highly scalable
Logs/Metrics Gathering
push - machine gather and send to system and low priority background thread along with batching
pull - heart beat check (for offline machines)
Processing
Real time streaming using Kafka/kinesis + Flink
TimeSeries database for stor"See full answer
"
Situation
In the derivatives trading domain, timely and accurate data is crucial for making informed trading decisions. Our existing data processing system was facing challenges with latency and scalability, which hindered our ability to react swiftly to market changes. To address these issues, we designed a new real-time market data processing platform.
Task
The task was to develop a low-latency data processing platform that could handle real-time market data ingestion, processing, an"
Scott S. - "
Situation
In the derivatives trading domain, timely and accurate data is crucial for making informed trading decisions. Our existing data processing system was facing challenges with latency and scalability, which hindered our ability to react swiftly to market changes. To address these issues, we designed a new real-time market data processing platform.
Task
The task was to develop a low-latency data processing platform that could handle real-time market data ingestion, processing, an"See full answer
"I did a design similar to one of the videos you have about designing youtube, but feedback said that I failed on discussions on key details of the design, also failed on the gathering requirements phase."
Emilio T. - "I did a design similar to one of the videos you have about designing youtube, but feedback said that I failed on discussions on key details of the design, also failed on the gathering requirements phase."See full answer
"Imagine you have a friend from France that speaks French, and you only speak English. You and your friend want to play a talking game. So, for your friend to understand you and for you to understand what your friend is saying you would need an API between the two of you. The api has its own language called api language. You and your friend will both get a small book that tells you how to speak api language. The api in between you and your friend would allow both of you to speak API language to"
Musonda C. - "Imagine you have a friend from France that speaks French, and you only speak English. You and your friend want to play a talking game. So, for your friend to understand you and for you to understand what your friend is saying you would need an API between the two of you. The api has its own language called api language. You and your friend will both get a small book that tells you how to speak api language. The api in between you and your friend would allow both of you to speak API language to"See full answer
"Blocking Queue's with multiple threads enqueuing and dequeuing calls. Follow-ups included refactoring to add a finite list of priorities for some types of calls"
Faraz A. - "Blocking Queue's with multiple threads enqueuing and dequeuing calls. Follow-ups included refactoring to add a finite list of priorities for some types of calls"See full answer