網際網路搜尋是很重要的工具，可用以蒐集或尋找資訊。然而搜尋結果有時無法完全符合使用者的原意，所以網際網路搜尋引擎公司致力於發展更好的搜尋演算法，是為了增進搜尋結果的準確性並提高使用者對搜尋引擎的使用率，我們從探討的文獻中發現目前並沒有一個較彈性、開放的工具來評量網路搜尋的效能。本研究的目的就是希望能發展出一個較具彈性的負載量模型以針對網路搜尋進行效能評量。本研究著重在效能評量的負載量模型及測試套組的設計，我們希望透過以學名結構為基礎的方法擴展負載量模型的彈性，我們蒐集及研討幾個具代表性的網路搜尋演算法，並找出這些主要演算法的學名結構，以這些學名結構為基礎進行負載量模型的設計，負載量模型包含網頁模型、查詢模型與控制模型。最後，我們利用雛形實作來驗證本研究所提出的研究方法。 / Web search service is a vital way to find information on the web. However, not every piece of information found is relevant or useful. In order to improve search accuracy, most designers of the web search engines devote to working on search algorithms development and optimization. From literature, we realize that there are few open or flexible performance evaluation methods for web search service. The objective of this research is to develop a more flexible workload model based on generic construct for web search benchmarking and build an automated benchmarking environment of performance evaluation. Generic constructs are major components which can represent the web search algorithm. We collect and review literature related to web search algorithms and benchmarking. And we identify the generic constructs of key web search algorithms. The workload model consists of a page model, query model and control model. The page model describes the web page structure in web search. The query model defines some important criteria to query the web search engines. The control model defines the variables that used to set up the benchmark environment. Finally, we validate the research model through the prototype implementation.

隨著網際網路的發達以及資料庫技術的成熟，人們取得資料變得非常的容易，再加上許多網際網路的應用其實就是一個自動化的資料收集工具，資料量之大已幾近爆炸的程度。資料倉儲便是一種用來儲存大量歷史資料的資料庫，提供彙整或是統計的資訊，以提供決策使用的資訊技術。而資料探勘是從大量的資料當中把對於決策過程中有幫助的規則找出來，提供給管理人員做為決策的參考，開創新的商業契機。資料倉儲的效能表現對於使用者的工作效率有著深遠的影響。因此有些用以衡量與預測資料倉儲之效能與效率之工作量模式便孕育而生，一般稱之為績效評估工具，然而目前所公佈的一般資料倉儲績效評估工具是針對特定範圍領域建構出某些典型的領域規格，並沒有一個使用者需求導向的資料倉儲績效評估工具。在資料探勘方面，探勘結果的準確度比起資料探勘所花費的時間來得重要，目前卻沒有一個有效、使用者需求導向的工具來評估資料探勘結果的準確度。我們針對資料倉儲的效能評估以及資料探勘準確度評估，設計一個以使用者需求為導向的工作量模型，來評估資料倉儲與資料探勘工具。 / As growth of Internet and mature of database technology, people can get the data much easily than before. Many applications on Internet, in fact, are the tools of gather data automatically so that the amount of data is growing bigger and bigger. Data warehouse is one kind of database to store lots of historical data to offer statistical information for the information technology of decisions. Data mining is to find the useful rules for decisions from the amount of data to help the managers make decisions and create the new opportunities of business. The performance of data warehouse is import to user’s work efficiency. Therefore, there are some workload model arise to evaluate and predict the performance and efficiency of data warehouse called benchmark. However, the data warehouse specification announced these days are constructed to some typical domain specific, and the performance evaluation stand on synthetic workload. But, when the difference between the domain of data warehouse user applied and domain of performance evaluation tool is very large, the performance metric may different a lot to the result of benchmark tool. In data mining, the accuracy of mining result is important to business. The accuracy of mining result is more important than the time spend on data mining. However, there is no any useful tool to evaluate the accuracy of mining result and there is no any standard of performance criteria for data mining, either. We design a user requirement-oriented workload to evaluate performance of data warehouse and precision of data mining.

本研究之主要目標在於建構一個能評估分散式關聯資料庫中之特色的需求導向績效評估方法。在過去的績效評估研究中，已經有許多人對於關聯式資料庫績效評估做了多方面的努力。但是，過去的關聯式資料庫資效評估方法如：Wisconsin、AS3AP、TPC系列的Benchmarks都有著一些限制及不足的地方。 過去的關聯式資料庫績效評估方法並無法完全的評估出分散式資料庫的特殊需求及其表現。所以本研究嘗試要建立出一個能專門適用於分散式資料庫導向的績效評估方法。為了要作出此績效評估方法，本研究採用了工作量模式的研究方法。先建出分散式資料庫績效評估的工作量模式，再以其來實作出績效評估方法。工作量模式分成三部分：資料模式、交易模式、控制模式。 / This thesis is intended to design a requirements-centric database benchmark, which can evaluate the general performance of the distributed relational database systems. In the past, there are many relational database benchmarks. But the relational database benchmarks like Wisconsin, AS3AP, TPC, TP1 have some constraints. In this study, we aim to design a general-purpose distributed database workload model and implement it. To design this benchmark, we need to build our workload model. The workload model consists of three components：data model, transaction model, control model. Each model has the requirement specification language to accommodate user's workloads.

XML (eXtensible Markup Language)是今日新興在網路上所使用的延伸性的標記語言。它具有豐富的語意表達及與展現方式獨立的資料獨立性。由於這些特性，使得XML成為新的資料交換標準並且其應用在資料庫中產生了許多新的研究議題在資料儲存和查詢處理上。在本篇研究中，將研究XML資料庫中的績效評估的議題並且發展一個可適用於不同應用領域及各種平台上的使用者導向且開放型工作量模式以評估XML資料庫績效。此XML開放型的工作量模型包含三個子模型─XML資料模型、查詢模型以及控制模型。XML資料模型將模式化XML文件中階層式的結構概念；查詢模型包含了一連串查詢模組以供測試XML資料庫的處理查詢能力以及一個開放型的查詢輸入介面以供使用者依照需求設定所需的測試查詢；控制模型中定義了一連串變數以供設定績效評估系統中的執行環境。我們發展此系統化且具開放型的工作量方法可以幫助各種不同應用領域的使用者預測及展現XML資料庫系統的績效。 / XML (eXtensible Markup Language) is the emerging data format for data processing on the Internet. XML provides a rich data semantics and data independence from the presentation. Thanks to these features, XML becomes a new data exchange standard and leads new storage and query processing issues on database research communities. In this paper, the performance evaluation issues on XML databases have been studied and a generic and requirement-driven XML workload model that is applicable to any application scenario or movable on various platforms is developed. There are three sub-models in this generic workload model, the XML data model, the query model, and the control model. The XML data model formulates the generic hierarchy structure of XML documents and supports a flexible document structure of the test database. The XML query model contains a flexible classical query module selector and an open query input to define the requirement-driven test query model to challenge the XML query processing ability of the XML database. The control model defines variables that are used to set up the implementation of a benchmark. This open, flexible, and systematic workload method permits users in various application domains to predicate or profile the performance of the XML database systems.

隨著網際網路和企業內部網路的盛行，異質資訊整合成為電子化企業中一個重要的議題，在網路上進行異質資訊整合涉及許多不同新的資訊技術，目前已經有些研究試圖利用延伸標記語言以及本體論當作中介技術來整合異質資訊，為了有效管理企業內的資訊，我們需要一個績效評估模型來衡量異質資訊整合的效能。在本研究中，我們提出了一個在異質資訊整合中運用延伸標記語言及本體論的績效評估工作量模型，並且建立了一個工作量產生器雛形；本研究的目標是希望發展出一個結合延伸標記語言及本體論的工作量模型，以測試在電子化企業中的異質資訊整合是否能整合不同的資訊模型，並且從這些資訊模型中衍生出語意，此工作量模型包含了延伸標記語言與本體論的資料模型與查詢模型，它們是依照延伸標記語言與本體論學名式的資料結構與查詢功能所制訂的，此外，控制模型則定義了績效評估執行環境中所需設定的變數，為了讓此工作量模型能具可攜性和延展性，以便輕易地應用在不同的領域情境中，本研究採取學名結構式且使用者定義、領域獨立的設計方法，最後，我們利用雛形實作來驗證本研究所提出的研究方法。 / With the popularity of Internet/Intranet, heterogeneous information integration becomes a hot IT topic in electronic business (EB) field. Heterogeneous information integration on the Web involves a number of new techniques. There have been research projects applying XML and ontology as mediated techniques to consolidate heterogeneous information. In order to manage and use information more effectively within the enterprise, a benchmark used to evaluate the mechanism of heterogeneous information integration is needed. In this research, we develop a XML and ontology benchmark workload model in heterogeneous information integration, and build a workload generation prototype. The objective of this research is to develop a workload model combines XML and ontology to test whether the heterogeneous information integration system under EB environment can overcome the diverse formats of content and derive meaning from this content. The workload model consists of XML and ontology data model and query model according to the generic data structure and query functionality. Also, a control model is created to set up the benchmark environment. In order to apply the workload model to different scenarios easier, this workload model is designed to be domain independent and generic-construct-based. Finally, we validate the research model through the prototype implementation.

網際網路超媒體資訊系統讓使用者能透過各種媒體共享資訊。每個超媒體資訊系統都擁有其後端資料庫。超媒體資料庫是用來儲存各種形式的資料。在近幾年來，超媒體資料庫有愈來愈多的趨勢。但我們無法知道哪種超媒體資料庫的績效較佳。績效評估是個重要的工具，它可以用來衡量和評估超媒體資料庫的效能。現今有許多績效評估的工作量模型可用來測試一般的資料庫，但卻沒有適合用來測試超媒體資料庫的工作量模型。在這情況下，我們發展了更一般化、由四個元件組成的工作量模型，用來作超媒體資料庫的績效評估。這四個元件分別為物件模型(Object Model)、應用模型(Application Model)、導覽模型(Navigation Model)及控制模型(Control Model)。每一個元件是用來建立每一面向的超媒體資料庫工作量需求。之後，我們建立此工作量模型的系統雛形，以證明此超媒體工作量模型是可行的。發展此正規且系統化的工作量方法可以幫助使用者預測及表示超媒體資料庫系統的績效。最後我們討論並解釋我們的工作量模型及和其它物件導向資料庫績效評估的關係。 / Web-based Hypermedia information systems (WHIS) enable users to share the information through a variety of media. Every Hypermedia information system has its own backend databases. The Hypermedia database is used to store a variety of data. Hypermedia databases are created more and more in the recent years. But we cannot find out which Hypermedia database provides higher performance. Benchmark gives a vital tool to measure and evaluate the performance of the Hypermedia databases. There are many benchmark workload models used to test the general databases. However, there is few benchmark workload model to test the Hypermedia databases. With this scenario, we have developed a more generalized four-component workload model for Hypermedia database benchmark. These components are the object model, the application model, the navigation model, and the control model. Each models one key aspect of the Hypermedia database workload requirements. And then, we build the prototype of this workload model to showht the Hypermedia benchmark workload model is feasible. A formal and systematic workload method is developed that can help users predict and profile the performance of the Hypermedia databases. Finally, we discuss and explain our workload model and the relationships with other object-oriented database benchmarks.

資訊檢索(Information Retrieval)一直是資訊學界的重要研究領域，但長久以來並未能在其它的學門中發揮其重要性，然而藉由Internet的普及與網路資源的激增，以資訊檢索為基礎的網路搜尋技術，已逐漸成為Internet上相當受到重視的技術之一。雖然全文資訊檢索的技術已存在多時，然而電腦產業一直缺乏一廣泛標準的績效評估，來評估全文資訊檢索系統的產出及價格/效能比，1990年代對全文資訊檢索軟體的大量需求，極需要一個標準、一致的方法，來比較各系統間效能的差異。本研究即針對傳播中文全文資訊檢索資料庫系統為探討的主題，試圖以關連式資料庫績效評估的理論及方法，來建構其工作量模式以進行績效評估。 / Information Retrieval has been a important research domain in Information academic. But it does not play in the other domain for a long time. However the Internet search technology based on Information Retrieval has been an one of the important technologies in the Internet by the spreading of Internet and the growth of network resources. Although the Full-Text Information Retrieval or Free-Text Information Retrieval technology has existed for a long time, the computer industry was lack of a wide, standard benchmark to evaluate the throughput and price/performance of the Full-Text Information Retrieval System. The large demand for Full-Text Information Retrieval System or Free-Text Information Retrieval System software needs a standard method to compare the performance of each system in 90s. This research is focused on the Communication Free-Text Information Retrieval Database System in Chinese, and construct it’s workload model to evaluate by using the theory and method of Relational Database Benchmark.