AI Agent (Auto Shortlist and Auto Outreach)
7 min
putting your recruiting on autopilot with the pin ai agent the pin ai agent automates your top of funnel recruiting it sources, evaluates, and qualifies candidates against your criteria, then automatically routes the qualified ones to either your shortlist (for you to review later) or outreach (to be contacted on your behalf) this guide walks you through setting up the agent from scratch how it works pin handles four stages of your funnel automatically โ source , evaluate , qualify , and outreach โ so you can focus on interviewing candidates who are already qualified, pre vetted, and interested after you calibrate the ai agent on a few candidates, you decide what it does with everyone it qualifies set them aside on a shortlist, or reach out to them directly the ai agent works per job you'll set it up for each search you want to automate step 1 create your ai agent open the job you want to automate from the left sidebar, select ai agent (or click create ai agent from the banner on your sourcing view) review the four stages the agent will handle โ source, evaluate, qualify, and outreach โ then click create my ai agent step 2 set your qualifying questions before the ai agent can qualify candidates, it needs to know what to look for on the qualifying questions screen, you'll define the yes/no questions pin answers about each candidate review the suggested questions (pin pre fills these based on your job criteria) edit any question by clicking into its text field add your own by typing into the add qualifying question field remove a question with the trash icon, or drag the handle to reorder click qualify candidates when you're done phrase questions so a clear yes/no answer is possible, e g "have they explicitly mentioned writing sql queries to investigate data or troubleshoot application errors?" specific questions produce more accurate qualification step 3 calibrate by reviewing candidates pin presents a small set of candidates (typically 5) so you can confirm its judgment matches yours this calibration step trains the ai agent on your preferences for each candidate, you'll see their evaluation (how they answered your qualifying questions), criteria matches, and scores like talent score, estimated salary, and acceptance likelihood review the candidate's evaluation and criteria optionally share your feedback into the give pin feedback on this candidate field to sharpen future matching click approve or decline repeat for each candidate in the calibration set use the feedback field when a candidate is close but not quite right telling pin why you're declining improves accuracy more than the decline alone you can also click edit questions here if your review reveals your qualifying questions need adjusting step 4 choose what pin does with qualified candidates once pin is trained, you'll decide how qualified candidates are routed you'll see two options add to shortlist โ pin sets candidates aside for you to review later you can find them under sourcing โ shortlist add to outreach โ pin reaches out to candidates on your behalf candidates who reply are added to your pipeline select either add to shortlist or add to outreach set the daily volume using the new candidates stepper (the default is 10 per day and the maximum limit is 100 per day) if you chose outreach, click preview outreach sequence to review the messages pin will send before enabling click continue (shortlist) or enable outreach sequence (outreach) outreach sends real messages to candidates on your behalf always use preview outreach sequence to review the messaging before enabling, and start with a low daily cap until you're confident managing a running agent once your agent is live, you can monitor and control it from the job's left sidebar sourcing โ shortlist โ review candidates pin has shortlisted outreach โ view and manage the outreach sequence the sidebar shows a paused label when outreach is stopped pipeline โ candidates who replied to outreach land here inbox โ candidate replies reports โ performance of your agent over time edge cases and troubleshooting how is the ai agent qualifying candidates? the ai agent uses a combination of fit score, which is an estimate based on how well a candidate matches your questions and criteria, and how many ai questions they matched they should either be a fit score of 7 or greater or match all ai questions outreach shows "paused" in the sidebar your outreach sequence is currently stopped, so no new messages are going out open outreach to review and resume it agents may pause automatically if a sending issue is detected or if you paused it manually the agent qualified fewer candidates than my daily number the daily figure is a cap, not a quota pin only routes candidates that genuinely match your criteria, so on days with fewer strong matches you'll see fewer candidates candidates are being qualified that don't fit return to your calibration reviews and use the feedback field when declining, or click edit questions to tighten your qualifying questions the more specific your questions and feedback, the more accurate the matching i want to review before any outreach goes out choose add to shortlist instead of add to outreach candidates wait under sourcing โ shortlist for your manual review, and nothing is sent automatically my existing candidates weren't sorted the agent works on candidates it sources and qualifies going forward use the calibration and ongoing sourcing flow rather than expecting a retroactive sort of your full candidate list i want to change questions after setup use edit questions (available on the review candidates screen) to revise your qualifying questions and recalibrate i want to change the number of candidates to shortlist/outreach use edit ai agent on the top right, then select change ai agent action and you can change the number of candidates you originally set to shortlist/outreach best practices write specific, yes/no qualifying questions โ they drive everything downstream use the feedback field during calibration, especially on declines, to train pin faster start with add to shortlist to confirm match quality before letting pin do outreach always preview outreach sequence before enabling outreach keep the daily cap modest at first, then raise it once you trust the results check reports periodically to see how your agent is performing


