As a result of everlasting developments in multimedia technologies, all kinds of objects tracking theory using machine vision or image process methods have been proposed. Most of the methods are based on shape of the object. For this reason, the profile of the tracked object must be known in advance. In many situations, we expect to track the object whose shape is unknown but speed or direction is explicit. For instance, speed or moving direction of the object is known. This thesis presents a spatio-temporal tracking technique, which extracts image information depending on speed of the moving object regardless of its shape. Furthermore, combination of the proposed method in spatio-temporal domain and the optical flow scheme makes the whole tracking system even more robust.