Assessment questions that reveal genuine thinking

How to write questions that give you more to discuss with candidates. Ten approaches to try for your next role.

Back to blog

In Software Finder's survey, 75% of job seekers used AI during the application process. A question about the actual job gives you something more useful to read than another polished CV. It can also give you a starting point for the interview.

Questions about a specific task, decision or experience give candidates room to explain their approach. None of these questions is AI-proof. Use the answer to decide what you want to discuss further, rather than treating it as proof of authorship.

Why most assessment questions fail

Here's the problem. Most assessment questions are some variation of:

These questions have two fatal flaws. First, they're so common that AI has been trained on millions of "perfect" answers. Second, they're vague enough that a generic response can sound plausible for any candidate.

92%
of AI-generated answers pass basic screening

Generic behavioral questions get generic AI answers that are nearly impossible to distinguish from authentic responses without additional signals.

The solution isn't to make questions harder. It's to make them more specific, more personal, and more grounded in the actual work you need done.

10 question frameworks that work

Here are ten ways to ask candidates about their approach to the work. Adapt them to your role and keep the task short.

1. The specific constraint question

Give candidates a realistic limit, such as a budget or deadline, and ask them to explain the trade-offs they'd make.

Example question
"You have a budget of £500 and 2 weeks to increase signups by 20%. What would you do, and what would you explicitly NOT do?"

Why it helps: You can discuss what they chose to leave out, why they chose it and whether that choice fits your role.

2. The "what would you change" question

Ask candidates to critique something specific about your product, process or industry, and explain what they would change.

Example question
"Look at our homepage for 2 minutes. What's one thing you would change and why? What's one thing you wouldn't touch?"

Why it helps: You get a recommendation and the reasoning behind it, both of which you can explore in an interview.

3. The failure reflection question

Ask about something that went wrong and what they learned. Authentic failure stories have specific, uncomfortable details that AI tends to smooth over.

Example question
"Tell me about a professional decision you made that turned out to be wrong. What specifically did you misjudge, and how did you realize it?"

Why it works: AI gives sanitized failure stories with neat lessons. Real failures are messier, more specific, and often reveal more about judgment than successes do.

4. The unpopular opinion question

Ask for a view that goes against conventional wisdom in your industry. Genuine candidates have developed their own perspectives through experience.

Example question
"What's something most people in [industry] believe that you think is wrong? Why do you disagree?"

Why it helps: You can ask what led them to that view, what evidence supports it and whether anything would change their mind.

5. The micro-detail question

Zoom in on a tiny, specific aspect of the work. People who've actually done the job know the small things; people who haven't (including AI) speak in generalities.

Example question
"Walk me through exactly how you would name the files and organize the folder structure for a design project with 3 stakeholders and 5 revision rounds."

Why it works: This level of operational detail is rarely documented online. Only people who've dealt with real project chaos have opinions about folder naming.

6. The honest assessment question

Ask candidates to evaluate their own fit, including areas where they might struggle. Self-awareness is hard to fake.

Example question
"Based on our job description, what part of this role do you think you'd be weakest at? How would you address that gap?"

Why it helps: You can see how candidates assess their own experience and what support they might need in the role.

7. The disagreement question

Present a decision or approach and ask them to argue against it. The ability to steelman opposing views reveals depth of understanding.

Example question
"We're considering moving to a fully remote model. Make the strongest argument against this decision, even if you personally support remote work."

Why it helps: You can discuss how they handle disagreement and whether they understand the other side of a decision.

8. The "show your work" question

Ask for the reasoning behind the answer. What did they check, which options did they consider and why did they choose this approach?

Example question
"Here's a dataset of our last 6 months of customer support tickets. What patterns do you notice, and walk me through how you identified them?"

Why it works: Requires actual analysis, not just pattern-matching to common answers. The reasoning process reveals genuine capability.

9. The personal context question

Connect the question to their specific background or previous experience. This makes generic answers obviously wrong.

Example question
"Looking at your experience at [previous company], what's one process you helped improve there that you think would work well here? What would you need to change about it?"

Why it helps: You can ask about the details of their example and how they would apply that experience to your role.

10. The priority question

Give a list of tasks and ask what they'd do first, last, and not at all. Resource allocation reveals values and judgment.

Example question
"You're starting this role on Monday. Here are 8 things on your plate. Rank them in order of how you'd tackle them, and explain your top and bottom choice."

Why it works: There's no objectively correct order. The answer reveals how candidates think about impact, urgency, and stakeholder management.

See how the answer was written

Even the best question can be gamed with enough effort. It helps to see both the response and how it was written. When you combine thoughtful questions with behavioral signals like time spent, editing patterns, and paste detection, you get more context for your own judgement.

A candidate who spends 12 minutes crafting a response, making multiple edits and revisions, is showing you something different than one who pastes a polished paragraph in 30 seconds.

Illustrative example

The goal isn't to trick candidates or make things harder. It's to give authentic candidates a chance to show who they really are, instead of losing them in a sea of identical AI-generated responses.

Putting it together

The best assessments combine two or three of these frameworks. A specific constraint question followed by a reflection on trade-offs. An opinion question paired with a request to argue the other side.

Keep the question specific enough to start a useful conversation. Read the answer, weigh the effort signals and follow up on the reasoning in the interview.

In a world where anyone can generate a "perfect" answer in seconds, the candidates who take time to give a real answer are exactly the ones you want to hire.

Ready to see authentic candidates?

FirstLook gives you more context about responses with questions relevant to the role and signals that show effort.

Start for free

Related articles

Technology

AI in recruitment: why fighting bots with bots isn't working

75% of surveyed job seekers use AI to apply. Learn why the AI arms race is making hiring worse.

Skills-first

Why skills-first hiring works

What if you could see what candidates can do before their background?