TOP
英國出版界指標大獎肯定!A.F. Steadman 獲年度作家,《史坎德》系列帶你踏上熱血奇幻旅程
The AI Safety Measurement Problem: What We Can't Test, We Can't Trust

The AI Safety Measurement Problem: What We Can't Test, We Can't Trust

商品資訊

定價
:NT$ 998 元
無庫存,下單後進貨(到貨天數約30-45天)
下單可得紅利積點 :29 點
商品簡介

商品簡介

A safety claim about an AI system is only as credible as the measurement that backs it. Everything else in this book follows from that sentence. If a developer says a model is "safe enough to deploy," a regulator says it is "low-risk," or a buyer says it is "fit for purpose," each of those statements is a load-bearing claim about behavior under conditions that have not yet happened. Without a measurement program - without tests that were specified before the system was built, executed by people who can be honest about the results, and reported in a form that outsiders can interrogate - those claims are aspirations dressed up as findings. This book is about how to tell the difference. AI governance discussions in 2026 are crowded with rules, principles, and voluntary commitments. The substance of those commitments, however, almost always reduces to a claim about what an AI system will or will not do. "We will not deploy a model that meaningfully uplifts the creation of biological weapons." "Our system does not exhibit unacceptable bias in hiring contexts." "The model refuses to generate child sexual abuse material." Each of these claims is a measurement claim. Each requires that someone - the developer, an independent lab, a government body - define what the dangerous behavior looks like, design a probe that can elicit it if it is present, run that probe under conditions representative of real use, and report the result. The NIST AI Risk Management Framework treats this measurement function as one of four continuous functions - Govern, Map, Measure, and Manage (National Institute of Standards and Technology, 2023). The framework does not tell organizations what to measure; it tells them that measurement is a precondition for trustworthy AI rather than a downstream activity. The 2024 Generative AI Profile sharpened this for foundation-model systems, calling out evaluation, documentation, and disclosure controls that have to be in place before generative systems are deployed at scale (National Institute of Standards and Technology, 2024). The framework's posture, read carefully, is that without measurement infrastructure there is no risk management - only assertion. The case for treating measurement as infrastructure, not as ornament, has three parts. First, the systems themselves are now too capable and too widely deployed for narrative assurance to substitute for evidence. External evaluators including METR and its ARC Evals predecessor program have published public materials on frontier capability evaluation and dangerous-capability framing (METR, 2023; METR, 2025); the existence of those public evaluation efforts, whatever one thinks of their methodology, implies that the relevant questions cannot be answered by inspection alone. Second, governments have started to build state evaluation capacity - most visibly the UK AI Security Institute, which has positioned itself as a public-facing evaluation body for advanced AI safety and security (UK AI Security Institute, 2025). Third, the academic and open-source community has produced standing benchmark infrastructure, with Stanford's Holistic Evaluation of Language Models (HELM) project running multi-dimensional evaluations across many models and a broad range of scenarios on a continuing basis (Stanford Center for Research on Foundation Models, 2025). Each of these efforts is partial. Each is contested. Together they constitute the first generation of what it would mean to have actual measurement infrastructure for AI - and they make visible how far that infrastructure still has to go.

購物須知

外文書商品之書封,為出版社提供之樣本。實際出貨商品,以出版社所提供之現有版本為主。部份書籍,因出版社供應狀況特殊,匯率將依實際狀況做調整。

無庫存之商品,在您完成訂單程序之後,將以空運的方式為你下單調貨。為了縮短等待的時間,建議您將外文書與其他商品分開下單,以獲得最快的取貨速度,平均調貨時間為1~2個月。

為了保護您的權益,「三民網路書店」提供會員七日商品鑑賞期(收到商品為起始日)。

若要辦理退貨,請在商品鑑賞期內寄回,且商品必須是全新狀態與完整包裝(商品、附件、發票、隨貨贈品等)否則恕不接受退貨。

定價:100 998
無庫存,下單後進貨
(到貨天數約30-45天)

暢銷榜

客服中心

收藏

會員專區