How can we better understand how a chatbot works in the real world, especially around tool use, hallucinations, and inappropriate responses?

"I had a warm intro, so the front of the process was pretty light: a recruiter logistics call and then a very casual hiring manager conversation. After that it got serious fast with a four-interview skills loop that was much more AI-specific than a normal PM process. The hardest parts were the rounds on LLM evals, high-stakes tool use, post-launch diagnosis, and designing for net-new form factors like smart glasses. The final step was a director-level interview plus a people and culture chat. The whole thing felt less like generic PM interviewing and more like, 'Can you ship useful AI in the real world even when the model is still unreliable?'"