Artificial Intelligence Interview Questions

Debajyoti B. - "As per my understanding, Success of the AI product/feature has to be measured in 2 aspects: success of the problem it solves success of the model used Success of the problem- start with the overall business goal of the problem(acquisition, retention etc) & the high level metric(essentially north star) then comes the product/feature level goals & metrics(conversion, engagement, clicks etc) Success of the model used- general: precision, recall, latency ethical: bias, safety busine"See full answer

Alex N. - "Perplexity - the measure LLM is surprised when it predicts next word. For example: I love to eat --- if LLM selects as next word "fruits" it will be less surprising than if LLM selects as next word "metal". It is better to have lower perplexity score. Cross Entropy is the measure how well model match true labels. So if the next word is "cat" and LLM assigns 0.5 to it then cross entropy value is -log(0.5) = 0.69 and if it assigns 0.9 probability to word cat then cross entropy value is - log(0.9"See full answer

Sumit P. - "CQs: Content moderation system finds Inappropriate contents - profanity, violence, privacy concerning. Misinformation - false info, false claim, fomenting wrong views PII Misinformation → Wrong info Twisted info Incomplete info Goal - reliability and trust on the platform Long term increased engagement on informational content RAG system - what and why? RAG system has 3 components Brain - reasoning models Tool"See full answer

Alex N. - "The adjusting context window size in LLM change trade off between reasoning capability, accuracy, computation cost. It influence how attention mechanist allocate resources across the input. Longer context window let it you input greater number of words and have more context to generate proper next token. However llms have lost in the middle issue. They remember the beginning of text and end of text but lost information located in the middle of long input. Another problem is Attention Dilution."See full answer

Anonymous Partridge - "We will have to use a second more powerful LLM Model to validate the answers. LLM as a judge"See full answer