Ask at the moment, not at the end.
A survey nobody answers is worse than no survey: it produces a number that looks like evidence and is not.
Visatory · · updated · 4 min read
Agencies survey students because they are asked to demonstrate that they measure satisfaction. So a long questionnaire goes out once a year to everyone on the list, a small fraction respond, and the responses come overwhelmingly from the delighted and the furious. The resulting number is then reported as though it described the whole cohort.
It does not, and everybody involved half-knows it. The fix is not a better questionnaire. It is a different shape of asking.
Ask at four moments.
Tie each question to something that just happened, while the student still remembers it and while you can still do something about it.
- After the first counselling session. Did you understand what happens next, and did you understand what it will cost?
- After the application is submitted. Were you kept informed while it was being prepared?
- After the visa decision, whatever the decision was. Were you prepared for what actually happened?
- Six to eight weeks after arrival, when the student knows whether the advice was true.
The fourth is the most valuable and the least collected, because by then the commercial relationship is over. It is also the only one that tells you whether the institution you recommended was the right recommendation.
Two or three questions, never twenty.
One rating, one specific yes-or-no, and one open box. That is enough. The rating gives you a trend, the yes-or-no gives you something actionable, and the open box gives you the sentence you will actually quote in a team meeting.
Make the yes-or-no about a behaviour you control rather than about feelings. "Did you receive a written list of costs before you paid anything?" is worth a hundred satisfaction ratings, because a no is a specific failure with a specific owner.
In the language they were counselled in.
A survey in English sent to families advised in Korean or Portuguese measures English comprehension. Send it in the counselling language, and let the answer come back in that language too — a translated open comment is still worth more than an empty box.
Reading the results honestly.
- Report the response rate next to every figure. A high score from a low response rate is not a high score.
- Split by counsellor, by destination and by source. The aggregate hides everything worth knowing.
- Watch the trend rather than the level. A drop of a point across one intake is a signal; the absolute number mostly measures how the question was worded.
- Read every open comment. There are fewer than you fear and they are where the actual information is.
- Never publish a satisfaction figure without saying it is self-reported and saying what period and what response rate it covers.
Keep it short enough to answer on a phone.
Almost every student will answer on a phone, often on a slow connection, often in a queue somewhere. Three questions on one screen with no login gets answered. A form that asks them to sign in, scroll through a progress bar and pick from a matrix of statements gets abandoned halfway, and an abandoned response is worse than none — it looks like indifference when it was friction.
Send it once and send one reminder. Beyond that you are not measuring satisfaction, you are measuring persistence, and you are training students to ignore messages from your agency at exactly the point in the journey when they most need to read them.
Close the loop visibly.
Once a term, tell students and staff what changed because of the answers. "You told us you did not know what was happening while applications were being prepared, so you now get a status update at each stage" costs one paragraph and doubles the credibility of the next survey.
The point is not the score. The score is a by-product, and a fragile one. The point is a steady, low-effort flow of specific statements from the people you serve, arriving early enough in the journey that you can still act on them for that student rather than only for the next one.
Filed under
Immigration and institutional requirements change between intakes. Check the current official guidance for the destination before advising a family, and note the date you checked.