In Software Finder's survey, 75% of job seekers used AI during the application process. A question about the actual job gives you something more useful to read than another polished CV. It can also give you a starting point for the interview.
Questions about a specific task, decision or experience give candidates room to explain their approach. None of these questions is AI-proof. Use the answer to decide what you want to discuss further, rather than treating it as proof of authorship.
Why most assessment questions fail
Here's the problem. Most assessment questions are some variation of:
- "Describe a time when you demonstrated leadership"
- "What are your greatest strengths and weaknesses?"
- "Why do you want to work for our company?"
These questions have two fatal flaws. First, they're so common that AI has been trained on millions of "perfect" answers. Second, they're vague enough that a generic response can sound plausible for any candidate.
Generic behavioral questions get generic AI answers that are nearly impossible to distinguish from authentic responses without additional signals.
The solution isn't to make questions harder. It's to make them more specific, more personal, and more grounded in the actual work you need done.
10 question frameworks that work
Here are ten ways to ask candidates about their approach to the work. Adapt them to your role and keep the task short.
1. The specific constraint question
Give candidates a realistic limit, such as a budget or deadline, and ask them to explain the trade-offs they'd make.
Why it helps: You can discuss what they chose to leave out, why they chose it and whether that choice fits your role.
2. The "what would you change" question
Ask candidates to critique something specific about your product, process or industry, and explain what they would change.
Why it helps: You get a recommendation and the reasoning behind it, both of which you can explore in an interview.
3. The failure reflection question
Ask about something that went wrong and what they learned. Authentic failure stories have specific, uncomfortable details that AI tends to smooth over.
Why it works: AI gives sanitized failure stories with neat lessons. Real failures are messier, more specific, and often reveal more about judgment than successes do.
4. The unpopular opinion question
Ask for a view that goes against conventional wisdom in your industry. Genuine candidates have developed their own perspectives through experience.
Why it helps: You can ask what led them to that view, what evidence supports it and whether anything would change their mind.
5. The micro-detail question
Zoom in on a tiny, specific aspect of the work. People who've actually done the job know the small things; people who haven't (including AI) speak in generalities.
Why it works: This level of operational detail is rarely documented online. Only people who've dealt with real project chaos have opinions about folder naming.
6. The honest assessment question
Ask candidates to evaluate their own fit, including areas where they might struggle. Self-awareness is hard to fake.
Why it helps: You can see how candidates assess their own experience and what support they might need in the role.
7. The disagreement question
Present a decision or approach and ask them to argue against it. The ability to steelman opposing views reveals depth of understanding.
Why it helps: You can discuss how they handle disagreement and whether they understand the other side of a decision.
8. The "show your work" question
Ask for the reasoning behind the answer. What did they check, which options did they consider and why did they choose this approach?
Why it works: Requires actual analysis, not just pattern-matching to common answers. The reasoning process reveals genuine capability.
9. The personal context question
Connect the question to their specific background or previous experience. This makes generic answers obviously wrong.
Why it helps: You can ask about the details of their example and how they would apply that experience to your role.
10. The priority question
Give a list of tasks and ask what they'd do first, last, and not at all. Resource allocation reveals values and judgment.
Why it works: There's no objectively correct order. The answer reveals how candidates think about impact, urgency, and stakeholder management.
See how the answer was written
Even the best question can be gamed with enough effort. It helps to see both the response and how it was written. When you combine thoughtful questions with behavioral signals like time spent, editing patterns, and paste detection, you get more context for your own judgement.
A candidate who spends 12 minutes crafting a response, making multiple edits and revisions, is showing you something different than one who pastes a polished paragraph in 30 seconds.
The goal isn't to trick candidates or make things harder. It's to give authentic candidates a chance to show who they really are, instead of losing them in a sea of identical AI-generated responses.
Putting it together
The best assessments combine two or three of these frameworks. A specific constraint question followed by a reflection on trade-offs. An opinion question paired with a request to argue the other side.
Keep the question specific enough to start a useful conversation. Read the answer, weigh the effort signals and follow up on the reasoning in the interview.
In a world where anyone can generate a "perfect" answer in seconds, the candidates who take time to give a real answer are exactly the ones you want to hire.
Ready to see authentic candidates?
FirstLook gives you more context about responses with questions relevant to the role and signals that show effort.
Start for free