Cross entropy and log likelihood ratio cost as performance measures for multi-conclusion categorical outcomes scales.

 0 Người đánh giá. Xếp hạng trung bình 0

Tác giả: John C Handley, H David Sheets, Eric M Warren

Ngôn ngữ: eng

Ký hiệu phân loại: 552.8 Microscopic petrology

Thông tin xuất bản: United States : Journal of forensic sciences , 2025

Mô tả vật lý:

Bộ sưu tập: NCBI

ID: 736401

The inconclusive category in forensics reporting is the appropriate response in many cases, but it poses challenges in estimating an "error rate". We discuss the use of a class of information-theoretic measures related to cross entropy as an alternative set of metrics that allows for performance evaluation of results presented using multi-category reporting scales. This paper shows how this class of performance metrics, and in particular the log likelihood ratio cost, which is already in use with likelihood ratio forensic reporting methods and in machine learning communities, can be readily adapted for use with the widely used multiple category conclusions scales. Bayesian credible intervals on these metrics can be estimated using numerical methods. The application of these metrics to published test results is shown. It is demonstrated, using these test results, that reducing the number of categories used in a proficiency test from five or six to three increases the cross entropy, indicating that the higher number of categories was justified, as it they increased the level of agreement with ground truth.
1. Cross
2. Entropy
3. And
Tạo bộ sưu tập với mã QR

THƯ VIỆN - TRƯỜNG ĐẠI HỌC CÔNG NGHỆ TP.HCM

ĐT: (028) 36225755 | Email: tt.thuvien@hutech.edu.vn

Copyright @2024 THƯ VIỆN HUTECH