An IP based set-top box (STB) is essentially a lightweight computer used to receive video over the Internet and convert it to analog or digital signals understood by the television. During this transformation from a digital image to an analog video signal many different types of distortions can occur. Some of these distortions will affect the image quality in a negative way. If these distortions could be measured they might be corrected and give the system a better image quality. This thesis is a continuation of two previous theses where a custom hardware for sampling analog component video signals was created. A software used to communicatewith the sampling hardware and perform several different measurementson the samples collected has been created in this thesis. The analog video signal quality measurement system has been compared to a similar commercial product and it was found that all except two measurement methods gave very good results. The remaining two measurement methods gave acceptable result. However the differences might be due to differences in implementation. The most important thing for the measurement system is to have consistency. If a system has consistency then any changes leading to worse videoquality can be found.