A Mandarin phrase recognition system based on MFCC, LPC scaled excitation, vowel model, hidden Markov model (HMM) and Viterbi algorithm is proposed in this thesis. HMM, which is broadly used in speech recognition at present, is adopted in the main structure of recognition. In order to speed up the recognition time, we take advantage of stability of vowels in Mandarin and incorporate with vowel class recognition in our system. For the speaker-dependent case, a single Mandarin phrase recognition can be accomplished within 1 seconds on average in the laboratory environment.