Do Open Language Models Invent Scripture? BILAL-BENCH: Benchmarking Islamic-Source Fabrication in Bengali
arXiv:2610.40996v1 Announce Type: new Abstract: When a language model invents a Qur'anic verse or hadith, it gives false authority to text that readers may treat as sacred. Existing Islamic hallucination benchmarks are largely Arabic and often closed-ended, while Bengali resources mainly study general-domain hallucination or factual knowledge. We introduce BILAL-BENCH, a 240-question expert-verified benchmark for open-ended Islamic-source fabrication in Bengali. It covers Qur'anic attribution, h
阅读原始来源
来源记录
研究分析
研究主张
论文标识：2610.40996。 来源描述：arXiv:2610.40996v1 Announce Type: new Abstract: When a language model invents a Qur'anic verse or hadith, it gives false authority to text that readers may treat as sacred. Existing Islamic hallucination benchmarks are largely Arabic and often closed-ended, while Bengali resources mainly study general-domain hallucination or factual knowledge. We introduce BILAL-BENCH, a 240-question expert-verified benchmark for open-ended Islamic-source fabrication in Bengali. It covers Qur'anic attribution, h
评测与比较记录
可供比较的近期同类记录：“Overview of the NTCIR-19 SciClaimEval Task: Cross-modal Claim Verification in Scientific Papers” (arXiv, 2026年11月5日)；“Self-Supervised Pretraining for Label-Efficient Facial Expression Recognition using Smart Glasses” (arXiv, 2026年11月5日)。主题相近仅用于导航，未核验其是否属于同一需求或独立证据。
结论适用范围
结论只能在所述模型版本、任务、数据与推理预算内解释。社区票数、下载量或榜单位置不能证明另一工作流中的可靠性。
有效性与复现缺口
需核对样本选择、基线配置、不确定性、数据污染风险、负面结果以及代码或权重可获取性；此处没有本站复现实验记录。
复核路线
阅读论文或模型卡及评测附录，针对明确基线复现一个有限结论，再测试代表性用户任务并记录结论失效的场景。