<p dir="ltr">Ultrasonic testing (UT) is a commonly used inspection method for buildings and bridges, yet variability in inspector performance has brought the validity of the UT process into question. While practical tests and performance testing are required as part of most UT certification processes and some industry standards, the building and bridge industries currently have no standardized testing body to verify the qualification of UT technicians. This research aimed to develop and implement a possible standardized testing protocol based on the American Welding Society (AWS) structural welding codes. Results from performance tests conducted in this research demonstrated high variability and low precision in UT measurements and generally poor performance amongst the 20 technicians that took part in the tests. It is clear from this research that certification from the existing certification programs do not always indicate qualification. Therefore, standardized performance testing would add value and increase the reliability of UT inspections by identifying those technicians that are clearly unqualified.</p>