Can a VA trial task predict performance after the first month?

Overview

Research question and scope

This is a proposed research protocol, not a report of completed findings. It asks whether a paid trial task predicts the quality and independence of a virtual assistant's work after the first month. The result would describe the relationship between the exercise and later performance in a stated role. Write the deadline as a date and a local time.

The protocol does not test whether a candidate is a good person or a good fit for every client. It tests one bounded claim about the exercise. The sponsor should name the hiring decision the result could inform before collection begins. Test the rule on one real task before applying it to the queue.

Population and unit of analysis

Define the population as candidates who completed the same trial exercise for the same role during a stated window. The unit is one candidate, with the exercise score, the first-month review score, and the role context recorded. Candidates who withdrew before the first month should be counted separately. Keep the boundary visible in the place where the work is assigned.

Freeze the inclusion rule before looking at outcomes. A candidate who completed the exercise but was hired into a different role is not part of the same comparison. Record the reason for every exclusion so the denominator can be rebuilt. Record the exception and the person who approved it.

Philippines evidence beside global context

The table keeps national indicators separate from the checks a buyer must run on one candidate. Values come from the direct sources listed below, and each year stays visible so unlike periods are not presented as the same measurement.

Definitions and measures

Define the exercise score as the sum of the rubric dimensions, with the weights fixed before the first candidate. Define first-month performance as the review score from the same rubric applied to real work. Define independence as the share of tasks completed without a follow-up question that the brief should have answered. Write the deadline as a date and a local time.

Report the exercise and performance scores separately as well as together. A candidate can score well on the exercise and struggle with real volume, or the reverse. The measures should let the reader see both patterns. Name the owner in the same line as the action.

Evidence standard

Link each score to the completed exercise, the rubric, and the reviewer who assigned it. For the first-month score, link to the actual work sample and the review date. A score without the underlying evidence is not usable. Keep the evidence with the record rather than in a separate log.

Where the reviewer changed or the rubric was revised, record the version. A comparison across versions may be misleading. Keep the original score and the revised score separate rather than overwriting one with the other. Update the template when the same question appears twice.

Sampling and collection

Use all candidates in the window if the number is manageable. If the number is large, select a sample before reviewing performance and keep a log of replacements. Do not replace a candidate because the first-month data is hard to find. Use the same format for every handover so the next reader can scan it.

Pilot the data collection on a few candidates and compare how reviewers apply the rubric. Clarify what counts as a follow-up question and how a task that was reassigned is scored. Record the rule used to resolve disagreements. Review the first few notes together before the process expands.

Analysis and reporting

Report the distribution of exercise scores and first-month scores, then describe the relationship between them. Avoid claiming that the exercise causes better performance. A correlation may reflect the candidate pool, the role, or the reviewer. A short note with four fields is easier to use than a long narrative.

Show the cases that do not fit the pattern. A candidate with a high exercise score and a low first-month score is useful evidence about what the exercise misses. The report should name the possible explanations and the records that would test them. Record the observation time so the next reviewer can tell when the evidence was checked.

Limits and sources of error

The first-month review is not an independent measure if the same manager who hired the candidate also scores the work. Reviewer expectations can influence both scores. The study should record who scored each stage and whether the reviewer knew the exercise result. A control that depends on memory is not yet a control.

The sample may be small and the role may change during the month. State the population and period clearly and avoid generalizing to other roles. A trial exercise is a signal, not a guarantee. Record the observation time so the next reviewer can tell when the evidence was checked.

Review cadence

Repeat the review after a rubric change or at the same interval each year. Compare the same measures and explain any change in the candidate pool or the role. A second review can test whether the exercise still predicts the work. A short note with four fields is easier to use than a long narrative.

Assign the follow-up to the hiring owner and set a date. The protocol should end with a specific decision about whether to keep, change, or retire the exercise. Test the rule on one real task before applying it to the queue. Record the exception and the person who approved it.

For the operating context behind this protocol, review the services page and the boundaries it describes. Use the contact page when the study design needs a written approval or a scoped review. The references below support the definitions and the recordkeeping approach rather than a performance claim. Keep this protocol with the data so a later reviewer can repeat the method.