Multi-tenancy in relational databases has been a topic of interest for a couple of years. On the one hand, ever increasing capabilities and capacities of modern hardware easily allow for multiple database applications to share one system. On the other hand, cloud computing leads to outsourcing of many applications to service architectures, which in turn leads to offerings for relational databases in the cloud, as well. The ability to benchmark multi-tenancy database systems (MT-DBMSs) is imperative to evaluate and compare systems and helps to reveal otherwise unnoticed shortcomings. With several tenants sharing a MT-DBMS, a benchmark is considerably different compared to classic database benchmarks and calls for new benchmarking methods and performance metrics. Unfortunately, there is no single, well-accepted multi-tenancy benchmark for MT-DBMSs available and few efforts have been made regarding the methodology and general tooling of the process. We propose a method to benchmark MT-DBMSs and provide a framework for building such benchmarks. To support the cumbersome process of defining and generating tenants, loading and querying their data, and analyzing the results we propose and provide MULTE, an open-source framework that helps with all these steps.

本研究以使用者需求導向為設計原則，提出了建構物件與物件關聯資料庫工作量產生器的發展方式，以解決(1)一般績效評估標準規格因只針對特定應用領域，而無法周詳考慮到使用者的特定需求問題；(2)廠商所發展的工作量產生器則因為可能針對其產品的特定領域作設計與測試，而失去了公正性之問題。我們的目地就是希望能以此資料庫工作量產生器的設計方式使測試資料庫效能的工作量，對使用者而言更具一致性、代表性與正確性，如此測試之結果對使用者而言才能更具意義。 我們首先分析SQL3與ODMG標準，以此構成物件關聯與物件導向資料庫之一般化的工作量模式。然後，再著手以使用者需求導向為原則，設計工作量產生器的運作方式。最後，我們實際發展了工作量產生器的雛形系統，以讓使用者能真正依其需求建立工作量並實際作績效測試，並提供給欲建構物件與物件關聯資料庫工作量產生器的人員作參考。 / This thesis provides a method of establishing Object-Oriented and Object-Relational Database Workload Generator, and this method is designed from the perspective of the user's requirements for addressing two problems: (1) the benchmark standards are generally designed to specific domains, so they are unable think comprehensively users' special requirements. (2) the database workload generators that developed by database providers may lose justice, because they might be designed to their products' special domain. Our purpose is that hope this method can make the Workload more consistent, more representative and more accurate and the test result will be more meaningful to users. Firstly, we analyze the SQL3 and ODMG standards to compose the ORDBs' and OODBs' generalized Workload Models. Then, we design our Workload Generator form the perspective of the user's requirements. Finally, we develop the Workload Generator's prototype system, it can allow users to create Workload according to their actual requirements and really do the benchmark test, and furthermore can provide a reference resource to the people who want to develop ORDB and OODB Workload Generator.

由於網路科技的進步 ,導致系統所需的資料不再只儲存於同一地點 , 面對分散式和主從式資料庫系統的使用日益頻繁 ,再加上現今的物件導向資料庫績效評估存在著許多的缺失包括 : 1.針對特定的應用領域 2. 針對特定的資料模型 3.測試資料庫綱目變得複雜 , 運算變得繁多 4.無法真實測出使用者應用領域的效能 .為了解決以上的問題 ,本研究擬使用物件導向系統分析方法作為使用者建構工作量模型的工具 , 發展出一個使用者需求導向的物件導向資料庫績效評估工作量模式。 另一方面 , 為了驗證所提出理論的可行性 , 我們發展了工作量模型規格書產生器的雛型系統 , 使用者只須使用視覺化的圖形符號來編輯其工作量模型 , 系統即會產生工作量模型的規格描述 , 作為建構績效評估系統之進一步開發 .在網路科技與物件導向資料庫的應用範圍愈來愈廣 , 資料日益龐大與型態日益複雜的未來 , 以使用者需求為導向的績效評估將是未來物件導向資料庫的績效評估之發展方向。 / As the improving of network technology, the data of database is no more stored on the same site. So the distributed database system is more and more popular. Existing object-oriented database benchmarks have the following drawbacks:1.They are designed to the specific domains , so the workload models of theirs are unable to fully reprent user requirements . 2. They are designed to the specific data models , and their intentions are to measure the techniques and performance of database design . 3.As the database schemes are more complicated and test operations are more myriad , it will be harder and harder for users to implement the benchmark. 4.They can not really measure the performance on the specific domains of users. In order to resolve the above problems , this thesis tries to model user's requirements workload using system analysis method . Because our database benchmark schemes and operations are derived from the user's requirements , the workload will be more consistent , more representative and more accurate and the result will be useful and meaningful to user . In order to apply the model we propose , we develop the prototype of the workload specification generator . After users have finished editing their workload model with the visual graphic notations , the system will generate workload specifications which will be used in the later phase . As the application domain of OODBMS are diverse and databases are huge , the trend of benchmarks is toward user requirement orientation in the future .

網路開放商業化以來，各式各樣的商機在網際網路上浮現，大小商家紛在網路上設立據點，或從事廣告、宣傳公司形象，或展示產品內容與產品功能，有的更進一步的設計能與消費者在網路上直接交易，我們概括性的稱之為電子商務。在電子商務的背後，各網站必須要有資料庫作支撐，才能有好的效率和服務。本研究以網際網路資料庫為探討主體，績效為探討目的。並主要以績效評估(Benchmark)理論為貫穿整個研究的基礎理論，一步步地建立適合網際網路資料庫及運算作績效評估的模型。並於模型完成後，予以程式化實作，並以所得數據作測試。 / A lot of business opportunity springs after commercial activities are officially allowed on Internet. The power and the potential of this market is represented by lots of web sites being set up. "Electronic Commerce" is coming to the whole world. However, it is the database supporting business web sites running that counts. Based upon the theory of benchmarking, we want to find out ways that we can know the performance of web database. After the model is set up and the workload is ready, an implementation is being made.

資訊檢索(Information Retrieval)一直是資訊學界的重要研究領域，但長久以來並未能在其它的學門中發揮其重要性，然而藉由Internet的普及與網路資源的激增，以資訊檢索為基礎的網路搜尋技術，已逐漸成為Internet上相當受到重視的技術之一。雖然全文資訊檢索的技術已存在多時，然而電腦產業一直缺乏一廣泛標準的績效評估，來評估全文資訊檢索系統的產出及價格/效能比，1990年代對全文資訊檢索軟體的大量需求，極需要一個標準、一致的方法，來比較各系統間效能的差異。本研究即針對傳播中文全文資訊檢索資料庫系統為探討的主題，試圖以關連式資料庫績效評估的理論及方法，來建構其工作量模式以進行績效評估。 / Information Retrieval has been a important research domain in Information academic. But it does not play in the other domain for a long time. However the Internet search technology based on Information Retrieval has been an one of the important technologies in the Internet by the spreading of Internet and the growth of network resources. Although the Full-Text Information Retrieval or Free-Text Information Retrieval technology has existed for a long time, the computer industry was lack of a wide, standard benchmark to evaluate the throughput and price/performance of the Full-Text Information Retrieval System. The large demand for Full-Text Information Retrieval System or Free-Text Information Retrieval System software needs a standard method to compare the performance of each system in 90s. This research is focused on the Communication Free-Text Information Retrieval Database System in Chinese, and construct it’s workload model to evaluate by using the theory and method of Relational Database Benchmark.