在網路資訊爆炸的年代，資料的分析整理日趨重要，本論文之研究目標正是針對資料做標題生成的處理，為資料自動生成標題，進而將資料加值化，轉化為資訊。研究者首先閱讀英文相關文獻，分析整理後，認為中文的處理方式與英文有所差異，因此，在本論文中，提出與英文不同之中文前置作業與自動標題生成之方法。
研究者針對標題的自動生成提出了幾種特徵值考量，包括候選詞權重值，訓練標題-文本詞彙，標題長度的關係及詞組間距。本論文之研究分為兩階段，第一階段為訓練階段，將文件做前置處理與斷詞，接著訓練標題-文本詞彙與統計文件標題長度的機率。第二階段為執行階段，分析新文件之候選詞權重值，並參照訓練階段之標題-文本詞彙與標題長度之機率值參考表，考量詞組間距後自動為文件產生標題。本論文所採用的訓練文件集來源為1998年至1999年五種報紙，涵蓋不同主題，共84,211篇文件，而測試文件的實驗分為Outside Test與Inside Test兩部分。
研究者為實驗結果進行兩種評估，一為電腦評估，將自動生成之標題與記者所擬訂的標題比對後，計算出求準率、求全率與F1。Outside Test求準率為14.21%、求全率為11.43%、F1為12.67%。Inside Test求準率為15.84%、求全率為12.94%、F1為14.21%。實驗結果顯示，正確率方面與其他文獻之英文文件標題的生成結果(F1=3.2%~24%)相近，但與實際標題仍有差距，因此，在未來工作上，仍有很大的發展空間。二為人為評估，讓使用者在閱讀自動生成之標題後，加以評分。自動生成之標題的流暢度還算不錯。然總結來說，本論文之研究尚屬初始階段，盼未來能更加成熟，並可有更進一步的創新與改進。 / As the number of digital documents on internet is growing up, analysis and organization of documents become quite important. In this thesis, we propose an approach for headline generation of documents. We can try our best to transfer the document data into information in some sense using the proposed approach. We review literature about the related topics, and present a different approach to deal with Chinese documents rather than English documents.
We propose some approach to Chinese documents headline generation. The thesis is separate two steps, one is training step, and the other is execution step. On the first step, the documents were preprocessed. Secondly, we trained the probability of headline-text words, and headline’s length. And on the execution step, we analyzed scores of headline candidates and gap, then referred to the probability of headline-text words, and headline’s length, finally we automatically generate headline for documents. The training documents are selected from a test collection for information retrieval, CIRB. Totally 84,211 Chinese news articles published between 1998 and 1999 are selected. Testing documents has two parts, one is for outside test, and the other is for inside test.
We conducted two evaluations, one is the automatic evaluation using metrics of presicion, recall and F1; the other is the human assessment. The precision of outside test is 14.21%、recall is 11.43%、F1 is 12.67%. And the precision of inside test is 15.84%、recall is 12.94%、F1 is 14.21%。The automatic evaluation result shows the accruacy is still not good enough, and the human assessment evaluation shows our approach can produce human-readable headlines.
| Identifer | oai:union.ndltd.org:CHENGCHI/G0089753004 |
| Creators | 江珮翎, Chiang, Pei-ling |
| Publisher | 國立政治大學 |
| Source Sets | National Chengchi University Libraries |
| Language | 中文 |
| Detected Language | English |
| Type | text |
| Rights | Copyright © nccu library on behalf of the copyright holders |
Page generated in 0.0021 seconds