AI phone screening vs traditional phone screens — when each one wins

TL;DR

We ran 1,200 phone screens — 600 by a senior recruiter, 600 by Raffi (AI conversational screening). Same roles, same JDs, same hiring bar. Here's what we found:

• AI screened all 600 in 4 days. Recruiter screened 600 in 11 weeks. Bottleneck wasn't talent, it was calendar.
• Candidate completion rate: 71% for AI, 48% for recruiter. The 23-point gap is almost entirely about self-scheduling — candidates picked AI slots at 8pm and weekends; recruiters offered 9-5 business hours.
• Hire rate of screened candidates: 9.1% for AI shortlist, 7.4% for recruiter shortlist. Within statistical noise.
• Quality of the top 3 (rated by hiring managers): AI 4.2/5, recruiter 4.4/5. Slight edge to humans on intangibles.

The honest answer: AI screening doesn't replace a senior recruiter at the top — but it makes the funnel work at a scale and speed that no human can match.

Where AI wins clearly

Volume. A recruiter doing thoughtful phone screens does 6-8 per day, max. After that the calls all blur together and quality drops. AI does unlimited parallel calls. For roles getting 200+ applicants, this is the dominant factor.

Speed. First call within 24 hours vs first call within 2-3 weeks. Time-to-shortlist drops from 6 weeks to 6 days. Applicant ghosting plummets.

Consistency. Every candidate gets the same questions in the same order. Comparing them is fair. No recall bias on candidate #18 vs candidate #3.

Self-scheduling. Candidates pick a slot 24/7 in any timezone. No coordinator emails, no missed-call ping-pong.

Cost. ~$5 per completed screening on AI vs ~$50-80 of senior recruiter time per call.

Where recruiters win clearly

Read between the lines. A great recruiter picks up on a candidate's tone — they sound checked out, they got laid off recently and are anxious, they're using language that suggests they're underqualified but smart. AI can score on transcript but it can't fully replicate that pattern-match.

Selling the role. Phone screens aren't one-way. A recruiter can sell — make a candidate fall in love with the company in 10 minutes, close the candidate who was about to take a competing offer. AI is okay at this but not great.

Edge cases. The candidate who's a brilliant atypical fit. The career-changer who looks weak on paper. The senior person taking a perceived demotion to get into your industry. Recruiters catch these. AI scores them down because the rubric doesn't have a column for "exception."

The pattern that actually works

Don't pick one. Use both, with AI at the top and recruiter at the strategic candidates layer.

1. AI screens every applicant. Top of funnel. 200 → ~80 who pass.
2. Recruiter reviews the AI shortlist. Spends 15 minutes per top-10 candidate looking at transcripts, salary signals, anti-cheat flags.
3. Recruiter does a 20-minute "deep" call with the top 5. This is where they sell, dig into edge cases, get the candidate excited.
4. Hiring manager meets the top 3. Standard final.

This stack does what neither does alone: covers the volume problem AND keeps the human judgement at the moments it matters.

When you should skip AI screening

• High-volume manual labor roles where applicants don't have email
• Senior executive roles (VP+) where the recruiter relationship is the product
• Tiny funnels (<20 applicants) where a recruiter doing each by hand is faster than configuring the AI

What to look for in an AI phone screening tool

Read How does AI phone screening work for the full breakdown, but the short version:

• Voice-first, real-time conversational AI (NOT chatbot-with-voice)
• CV-aware before the call starts
• Role-specific behavioral questions (not generic "tell me about yourself")
• Full transcript + recording + structured scorecard
• Anti-cheat scoring on every transcript
• 30+ language support
• Self-scheduling 24/7

Want to try one on a fictional role? Step into a room with Raffi — 5 minutes, no signup, no card.