"There are 2 main methods
Intrinsic Evaluation
i) Preplexity
ii) BLEU
Extrinsic Evaluation
i) Response consistency/ Correctness / Factual score/ Security
However, this question requires a follow-up question and clarification about where we are going to use the LLM models."
Mayank M. - "There are 2 main methods
Intrinsic Evaluation
i) Preplexity
ii) BLEU
Extrinsic Evaluation
i) Response consistency/ Correctness / Factual score/ Security
However, this question requires a follow-up question and clarification about where we are going to use the LLM models."See full answer
"Imagine you're a PM at YouTube and you've made the decision to ban videos with explicit language from monetization; take me through your decision process.
Clarifying questions:
Was the decision made, to ban videos in general from the platform, or only for monetization?
Answer: Ban for Monetization only, the videos would still be available on the platform.
Considering highly offensive, vulgar, sexual or graphical language are already considered violations of Youtube'"
Tulio G. - "Imagine you're a PM at YouTube and you've made the decision to ban videos with explicit language from monetization; take me through your decision process.
Clarifying questions:
Was the decision made, to ban videos in general from the platform, or only for monetization?
Answer: Ban for Monetization only, the videos would still be available on the platform.
Considering highly offensive, vulgar, sexual or graphical language are already considered violations of Youtube'"See full answer
"I first clarified what he needed for the leaderboard meaning did he need a gaming leaderboard system, a stock market leaderboard system where the trades placed would be ranked in terms of values or a coding platform leaderboard where the users are ranked as per the points earned by solving the problem?
He answered that he wanted a multipurpose leaderboard system
He was specifically interested in the design of the api part
Explained him that assuming we had a flask api there would be a get re"
GalacticInterviewer - "I first clarified what he needed for the leaderboard meaning did he need a gaming leaderboard system, a stock market leaderboard system where the trades placed would be ranked in terms of values or a coding platform leaderboard where the users are ranked as per the points earned by solving the problem?
He answered that he wanted a multipurpose leaderboard system
He was specifically interested in the design of the api part
Explained him that assuming we had a flask api there would be a get re"See full answer
"For data distribution drift: DL Divergence or PSI (Population Stability Index)
performance: two categories: 1st operational metrics: runtime. 2nd model performance: loss function, MAE (regression), business metrics: overall watch time, DAU, revenue lift etc
Outlier: data distribution"
L B. - "For data distribution drift: DL Divergence or PSI (Population Stability Index)
performance: two categories: 1st operational metrics: runtime. 2nd model performance: loss function, MAE (regression), business metrics: overall watch time, DAU, revenue lift etc
Outlier: data distribution"See full answer
Machine Learning Engineer
System Design
+1 more
🧠 Want an expert answer to a question? Saving questions lets us know what content to make next.
"Imagine there's a new toy you've always wanted, but it's not quite perfect. Maybe it's missing a feature you'd love, or it's a bit too complex to use. That's where a product manager, or PM, comes in!
Think of a PM like the captain of a shipbuilding this amazing toy. They work with different teams, like the designers who make it look cool, the engineers who build it, and the marketers who tell everyone about it. They listen to people like you, who use the toy, to understand what they like and wha"
Deepak M. - "Imagine there's a new toy you've always wanted, but it's not quite perfect. Maybe it's missing a feature you'd love, or it's a bit too complex to use. That's where a product manager, or PM, comes in!
Think of a PM like the captain of a shipbuilding this amazing toy. They work with different teams, like the designers who make it look cool, the engineers who build it, and the marketers who tell everyone about it. They listen to people like you, who use the toy, to understand what they like and wha"See full answer
"DFD, data flow diagram or Information flow diagram helps a business user clearly understand technical concepts as it links use cases with technical concepts.
While feature document along with user stories (with acceptance criteria) works best for technical user to understand business concepts."
Bhuvan D. - "DFD, data flow diagram or Information flow diagram helps a business user clearly understand technical concepts as it links use cases with technical concepts.
While feature document along with user stories (with acceptance criteria) works best for technical user to understand business concepts."See full answer
"To determine which features go into a Minimum Viable Product (MVP), I focus on balancing user needs with business goals, while keeping technical feasibility in mind. My approach usually includes these key steps:
1. Understand the problem deeply:
I start by identifying the core user problem we’re solving—whether that’s through user interviews, support tickets, usage data, or stakeholder input. The goal is to figure out what success looks like for the user in the most basic but valuable form."
Aniruddha N. - "To determine which features go into a Minimum Viable Product (MVP), I focus on balancing user needs with business goals, while keeping technical feasibility in mind. My approach usually includes these key steps:
1. Understand the problem deeply:
I start by identifying the core user problem we’re solving—whether that’s through user interviews, support tickets, usage data, or stakeholder input. The goal is to figure out what success looks like for the user in the most basic but valuable form."See full answer
"Clarifying
Slack is a mature product in markets with millions of users B2B platform
Expand customer base to school boards
SWOT
Technology is mature and well reputed
Good privacy practices
Threats
Google school
Microsoft learning education
Zoom
Journeys User
Users for slack - for - school
School boards 12 school boards
Primary
Secondary
High
Universities -
Remote learning / Distant educations - Incumbents
MooCs - Existing platform
End Users:
Students
Teachers
Administrators
Ed"
Hl M. - "Clarifying
Slack is a mature product in markets with millions of users B2B platform
Expand customer base to school boards
SWOT
Technology is mature and well reputed
Good privacy practices
Threats
Google school
Microsoft learning education
Zoom
Journeys User
Users for slack - for - school
School boards 12 school boards
Primary
Secondary
High
Universities -
Remote learning / Distant educations - Incumbents
MooCs - Existing platform
End Users:
Students
Teachers
Administrators
Ed"See full answer
"You should be able to identify this as a Strategy Question, which asks you to justify high-level business decisions and strategy. Be concise and to the point.
> The underlying theme I can see in these services is that they all encourage people to start online businesses. This helps Stripe since their main product is the ability to handle online transactions. Stripe takes a percentage fee from each transaction, so it's in their best interest to encourage the growth of internet-enabled busines"
Exponent - "You should be able to identify this as a Strategy Question, which asks you to justify high-level business decisions and strategy. Be concise and to the point.
> The underlying theme I can see in these services is that they all encourage people to start online businesses. This helps Stripe since their main product is the ability to handle online transactions. Stripe takes a percentage fee from each transaction, so it's in their best interest to encourage the growth of internet-enabled busines"See full answer
"Identify the constraints
AR - definition
College tour - definition (purpose - college application/college selection)
Users
College applicant/parents
Tour guide
Use Cases
How does the college experience feel like in different seasons
College experience in events, festivals, educational fairs
Stimulate college sports events
Mission statement - Sell the college to candidate in the best possible way
Solutions
At sports center, I can view the past games and experien"
Parag - "Identify the constraints
AR - definition
College tour - definition (purpose - college application/college selection)
Users
College applicant/parents
Tour guide
Use Cases
How does the college experience feel like in different seasons
College experience in events, festivals, educational fairs
Stimulate college sports events
Mission statement - Sell the college to candidate in the best possible way
Solutions
At sports center, I can view the past games and experien"See full answer
"First, why are we building the system? What are the requirements we must meet - Do customers care about data being read/written from a single set of tables or multiple tables, do they care about cost allocation, do they need backups/storage to happen slow or fast, do they foresee a lot of data movement from one table to another?
Based on this, there are a few options using some common design choices. Shared disk, or Shared nothing. Both have pros and cons. Based on latency, performance, and cos"
Glados - "First, why are we building the system? What are the requirements we must meet - Do customers care about data being read/written from a single set of tables or multiple tables, do they care about cost allocation, do they need backups/storage to happen slow or fast, do they foresee a lot of data movement from one table to another?
Based on this, there are a few options using some common design choices. Shared disk, or Shared nothing. Both have pros and cons. Based on latency, performance, and cos"See full answer