Exam AIGP topic 1 question 77 discussion

Actual exam question from IAPP's AIGP

Question #: 77
Topic #: 1

CASE STUDY -
Please use the following to answer the next question:
A local police department in the United States procured an AI system to monitor and analyze social media feeds, online marketplaces and other sources of public information to detect evidence of illegal activities (e.g., sale of drugs or stolen goods). The AI system works by surveying the public sites in order to identify individuals that are likely to have committed a crime. It cross-references the individuals against data maintained by law enforcement and then assigns a percentage score of the likelihood of criminal activity based on certain factors like previous criminal history, location, time, race and gender.
The police department retained a third-party consultant to assist in the procurement process, specifically to evaluate two finalists. Each of the vendors provided information about their system’s accuracy rates, the diversity of their training data and how their system works. The consultant determined that the first vendor’s system has a higher accuracy rate and based on this information, recommended this vendor to the police department.
The police department chose the first vendor and implemented its AI system. As part of the implementation, the department and consultant created a usage policy for the system, which includes training police officers on how the system works and how to incorporate it into their investigation process.
The police department has now been using the AI system for a year. An internal review has found that every time the system scored a likelihood of criminal activity at or above 90%, the police investigation subsequently confirmed that the individual had, in fact, committed a crime. Based on these results, the police department wants to forego investigations for cases where the AI system gives a score of at least 90% and proceed directly with an arrest.
The best human oversight mechanism for the police department to implement is that a police officer should?

A. Explain to the accused how the AI system works.
B. Confirm the AI recommendation prior to sentencing.
C. Ensure an accused is given notice that the AI system was used.
D. Consider the AI recommendation as part of the criminal investigation.

Show Suggested Answer

Suggested Answer: D 🗳️

by Ecommail at June 12, 2025, 7:41 p.m.

Comments

Submit Cancel

Ecommail

3 days, 21 hours ago

Selected Answer: D

The best human oversight mechanism for the police department to implement is: D. Consider the AI recommendation as part of the criminal investigation. This option ensures that the AI system's recommendation is not treated as conclusive evidence but is instead used as one component of a broader investigative process. It maintains human judgment and oversight, allowing police officers to evaluate the AI's score alongside other evidence, context, and legal considerations before taking action. This approach helps mitigate risks of over-reliance on the AI system, potential biases (e.g., from factors like race or gender used in scoring), and ensures due process is followed. Explanation of other options: A. Explain to the accused how the AI system works: Explaining the system's inner workings to the accused is not a practical oversight mechanism and does not address the need to validate the AI's recommendations before action. B. Confirm the AI recommendation prior to sentencing:Oversight should occur earlier, during the investigation or before an arrest. C. Ensure an accused is given notice that the AI system was used: Providing notice is a transparency measure.

upvoted 1 times

...