Machine Learning Engineer Artificial Intelligence Interview Questions

Alok S. - "Functional requirements: user can send an input and wait for the result Group up to 100 individual requests in to single GPU The system should should send results back to the user who requested it when done Non functional requirements: Minimize the waiting between two batches of execution/ reduce idle time error message if a batch faiils Scale to support multiple GPUs Core Entities: Request Batch Result API Design: POST /predict -> {requestid: "", response: ""} req"See full answer

Alex N. - "Perplexity - the measure LLM is surprised when it predicts next word. For example: I love to eat --- if LLM selects as next word "fruits" it will be less surprising than if LLM selects as next word "metal". It is better to have lower perplexity score. Cross Entropy is the measure how well model match true labels. So if the next word is "cat" and LLM assigns 0.5 to it then cross entropy value is -log(0.5) = 0.69 and if it assigns 0.9 probability to word cat then cross entropy value is - log(0.9"See full answer

Nathan B. - "There are many good answers to this that AI scientists around the world, I and my coworkers have tried over the years. For one, RAG is a great option to fact-check and enforce citation generation, update the data in the knowledge base of the generative AI, etc. "See full answer

Alex N. - "The adjusting context window size in LLM change trade off between reasoning capability, accuracy, computation cost. It influence how attention mechanist allocate resources across the input. Longer context window let it you input greater number of words and have more context to generate proper next token. However llms have lost in the middle issue. They remember the beginning of text and end of text but lost information located in the middle of long input. Another problem is Attention Dilution."See full answer

Hardik saurabh G. - "Hallucinations are evaluated by measuring how often generated outputs contain information that is not supported by trusted sources. what hallucination means in context: Intrinsic hallucination: contradicts provided context Extrinsic hallucination: introduces unsupported facts Fabrication: confidently incorrect answers"See full answer