Human-Computer Interaction (HCI) in tradition is narrow defined the communication of information between human and machines. Because the limited of the HCI's speed and the natural level, it needs to use the medium form such as symbol instructions and buttons to express the intent of human. In recent year, the trend of HCI development will be focused on human, with directly computing, determining, and displaying technologies progress, and constantly innovation. Somatosensory equipment not only breaks through the limit of HCI but also the mode of interaction of traditional equipment. Somatosensory equipment can retrieve images through the infrared projector or visible camera, capture the human motion and action, and increase its interaction for natural and intuition. But unfortunately, most of systems are limited to a unique application for special areas, and only detected specific sequences of actions. Once changing the interaction of applications then users have to rewrite the action sequences recognition program to satisfy the somatosensory demands. System cannot be defined human action sequences flexible according the applications request of users, the production process is complex and the scope of application is narrow. This thesis presents an Authoring Tool of Vision-based Somatosensory Action (ATVISA) to improve the drawback. Users can define the human action sequences by the graphical interface, customize the visual detection quickly and recognize correspond to the Somatosensory Action. Till the Somatosensory equipment detects the defined action sequences, triggering the correspond event and dealing with the event request. This thesis employs ATVISA applied to the action sequences and three rehabilitation projects, that with the flexibility and diversification. Users also can compile human action sequences with professional expertise to application to area of education, game, rehabilitation, and so on.