# U.S. GAO: a state regulator recounted an insurer unable to explain a factor in its AI-built risk model

Page: https://flyvolo.ai/en/changes/ev-20190607-actuary-3
Date: 2019-06-07 · Stage: Constraint
Can this record move a task judgement? yes
Occupation: https://flyvolo.ai/en/careers/actuary

## Scope

A June 7, 2019 U.S. Government Accountability Office report (GAO-19-423, Insurance Markets: Benefits and Challenges Presented by Innovative Uses of Technology), based on GAO's own interviews with more than 35 stakeholders: federal and state insurance regulators, insurers, technology companies and consumer groups. It reports that industry stakeholders GAO interviewed said insurance rating models using AI and machine learning are often now built by data scientists rather than actuaries, who may not fully understand insurance-specific requirements, may struggle to measure a new variable's impact, and may not know how to communicate their work to state regulators. It quotes one state regulator's account of an unnamed insurance company that could not explain how a factor it had entered into its risk model, proximity of a home to a day care center, related to a consumer's risk, and notes that an actuarial group called for closer actuary-data-scientist collaboration to give regulators more assurance. This establishes that explaining an AI-built model's factors to a regulator is a task a person does, and can fail at, in a documented case; it does not name the insurer or regulator, does not say how often such failures occur, and is GAO's account of what stakeholders told it, not GAO's own direct examination of the company.

## Source

- U.S. Government Accountability Office — Insurance Markets: Benefits and Challenges Presented by Innovative Uses of Technology (GAO-19-423) — https://www.gao.gov/assets/gao-19-423.pdf (primary source)

## What this means

A government watchdog's own interviews found that explaining an AI-built model to a regulator is work a person does, and that a company lost that argument at least once when the people who built the model were not actuaries.

## What it does not show yet

It does not name the insurer, the regulator, or how common this failure is, and it does not say that actuaries always do this explaining at other insurers — only that this is a job someone must do well, or risk the same outcome.

## How to verify it yourself

If your work includes defending a model's factors to a regulator or a board, ask whether you — or whoever built the model — could explain every input in it on the spot, the way this regulator asked an insurer to.


More: https://flyvolo.ai/llms.txt