English  |  正體中文  |  简体中文  |  全文筆數/總筆數 : 96218/96218 (100%)
造訪人次 : 93571758      線上人數 : 196
RC Version 7.0 © Powered By DSPACE, MIT. Enhanced by NTU Library IR team.
搜尋範圍 查詢小技巧:
  • 您可在西文檢索詞彙前後加上"雙引號",以獲取較精準的檢索結果
  • 若欲以作者姓名搜尋,建議至進階搜尋限定作者欄位,可獲得較完整資料
  • 進階搜尋


    請使用永久網址來引用或連結此文件: https://ir.lib.ncu.edu.tw/handle/987654321/111225


    題名: Continued Pre-Training and Retrieval-Augmented Generation Methods for Low-Resource Legal-Question Answering;Continued Pre-Training and Retrieval-Augmented Generation Methods for Low-Resource Legal-Question Answering
    作者: 陳秉綸;Chen, Bing-Lun
    貢獻者: 數學系
    關鍵詞: 大型語言模型;法律問答;持續預訓練;檢索增強生成;監督式微調;代理式 RAG;知識圖譜輔助 RAG;台灣刑法;large language models;legal question answering;continued pre-training;retrieval-augmented generation;agentic RAG;knowledge graphs;Supervised Fine-Tuning
    日期: 2026-07-27
    上傳時間: 2026-10-20 17:05:54 (UTC+8)
    出版者: 國立中央大學
    摘要: 大型語言模型雖具良好的自然語言理解與生成能力,但法律問答同時要求法律概念、法條依據、構成要件與推論結果正確。對低資源繁體中文法律任務而言,如何在有限資料與計算資源下提升開源模型的法律回答品質,並降低法條幻覺與錯誤推論,仍是重要課題。

    本研究以台灣刑法一般概念問答為場景,從模型內部能力調整與外部法律知識補強兩條路徑進行三階段比較。實驗一比較 Base、SFT、Base+Naive RAG 與 SFT+Naive RAG;實驗二比較混合檢索、重排序、查詢轉換、RSE、代理式 RAG 與知識圖譜輔助 structured hints;實驗三則比較 Base、CPT、CPT+SFT 及其 RAG 版本,以分析不同訓練階段對獨立作答與外部證據使用能力的影響。

    本研究結合 LLM-as-a-Judge、RAG 上下文指標、程式化檢索指標與人工檢測進行評估。結果顯示,低資源 SFT 與 Naive RAG 並不必然帶來增益;CPT 較能提升法律語境適應能力,而 CPT+SFT 在無 RAG 條件下未必優於 CPT,但結合 RAG 後可改善人工檢測表現。RAG 消融結果顯示,查詢轉換與重排序較能穩定提升檢索品質,RSE 主要提供上下文整理,代理式與知識圖譜輔助方法之效果則取決於法律爭點辨識、查詢規劃與證據組織能力。整體而言,訓練與 RAG 並非單純相加,其效益取決於語料品質、檢索精準度及模型整合外部證據的能力。本研究據此建立一套低資源中文法律問答的分層比較與評估框架。;Large language models can generate fluent text, but legal question answering additionally requires accurate legal concepts, statutory citations, constituent elements, and conclusions. For low-resource Traditional Chinese legal tasks, improving the reliability of open-source models under limited data and computational resources remains challenging.

    This study investigates general-concept question answering in Taiwan criminal law through internal model adaptation and external legal knowledge augmentation. Experiment 1 compares Base, SFT, Base+Naive RAG, and SFT+Naive RAG. Experiment 2 evaluates hybrid retrieval, reranking, query transformation, Relevant Segment Extraction (RSE), agentic RAG, and knowledge-graph-assisted structured hints. Experiment 3 compares Base, continued pre-training (CPT), CPT+SFT, and their RAG variants to examine how training affects independent answering and the use of retrieved legal evidence.

    Evaluation combines LLM-as-a-Judge, RAG context metrics, programmatic retrieval metrics, and manual legal assessment. Results show that low-resource SFT and Naive RAG do not necessarily improve performance. CPT more consistently enhances legal-domain adaptation, while CPT+SFT does not always outperform CPT without RAG but performs better in manual assessment when combined with RAG. Query transformation and reranking provide relatively stable retrieval gains, whereas RSE mainly improves context organization. Agentic and knowledge-graph-assisted methods depend strongly on legal-issue identification, query planning, and evidence organization. Overall, training and RAG are not simply additive; their effectiveness depends on corpus quality, retrieval precision, and the model′s ability to integrate external legal evidence.
    顯示於類別:[數學研究所] 博碩士論文

    文件中的檔案:

    檔案 描述 大小格式瀏覽次數
    index.html0KbHTML5檢視/開啟


    在NCUIR中所有的資料項目都受到原著作權保護.

    社群 sharing

    ::: Copyright National Central University. | 國立中央大學圖書館版權所有 | 收藏本站 | 設為首頁 | 最佳瀏覽畫面: 1024*768 | 建站日期:8-24-2009 :::
    DSpace Software Copyright © 2002-2004  MIT &  Hewlett-Packard  /   Enhanced by   NTU Library IR team Copyright ©   - 隱私權政策聲明