Assessment should occur at each stage of the application process. There is no obligation to continue assessment beyond shortlisting (or interview, or reference checking) if it becomes evident that a candidate does not possess the required skills and/or potential for development. At that point, the assessment is complete, and the external candidates can be considered and assessed.
Hiring managers should be in a position to justify why any unsuccessful candidates were not progressed.