Independent Oversight Methodology

Analysis Main Page »   Independent Oversight Overview »

Find out how your locality compares in a cross-city analysis of policing practices

Use of Force Methodology | Independent Oversight Methodology | Co-optation by Immigration Enforcement Methodology | Budget Priorities Methodology

Center for Popular Democracy researchers evaluated each jurisdiction based on a full set of policy criteria as developed in the Reform/Transform toolkit in collaboration with policy experts and advocates. Because the original tool is lengthy and the questions are numerous, we organized the full list of questions into a smaller number of thematic groupings. This process yielded 14 broad groupings of questions (which encompassed all of the sub-questions from the original, full-length tool). Finally, we developed a ranking system to differentiate jurisdictions’ performance based on how successfully the authorizing legislation and/or other written policies governing their civilian review boards and/or other external oversight agencies fulfill these 14 broad criteria. Because not all questions should be weighted equally (some criteria are more essential to giving a policy teeth than others), our ranking system reflects researchers’ judgements about what components are critical to real accountability based on research and previous conversations with policy experts.

It should also be noted that some jurisdictions have multiple oversight bodies, including a civilian review board and other external oversight agencies. The toolkit separates questions for civilian review boards and other external oversight agencies. For the purposes of scoring, we grouped all questions together. As the below scoring indicates, we did not require a jurisdiction to have multiple oversight agencies in order to be placed in the top category, “On Track to a Strong Policy.” However, jurisdictions that did have multiple agencies had more opportunity to be placed in the top or middle category. 

  On Track to a Strong Policy

To be placed in the top category, “On Track to a Strong Policy,” a jurisdiction’s civilian review board and/or other external oversight agency must, as authorized through legislation or written policy:

• Conduct investigations independently of the police department
• Have all necessary investigatory powers, including either subpoena power or administrative powers that enable direct and unfettered access and the power to compel witnesses, testimony, and documents
• Have independent disciplinary authority
• Offer public access that allows residents to file complaints through a variety of methods, in multiple languages, and during non-business hours
• Have broad jurisdiction to investigate police department policies and practices and/or issue or recommend policy changes (this authority could be for the civilian review board and/or another external oversight agency, if a jurisdiction had both)

In addition, a jurisdiction in this category must strongly or moderately fulfill at least one of the other criteria. 

  Making Progress With Need for Improvement

To be placed in the middle category, “Making Progress with Need for Improvement,” a jurisdiction’s civilian review board and/or other external oversight agency must, as authorized through legislation or written policy:

• Conduct investigations independently of the police department
• Have some investigatory powers, such as either subpoena power or administrative powers that enable direct and unfettered access and/or the power to compel witnesses, testimony, and/or documents
• Offer public access that allows residents to file complaints through a variety of methods and during non-business hours

In addition, a jurisdiction in this category must strongly or moderately fulfill at least one other criteria (but does not meet the criteria for “On Track to a Strong Policy”).

  Significant Room for Improvement

To be placed in the bottom category, “Significant Room for Improvement,” a jurisdiction’s civilian review board and/or other external oversight agency would fit any of the following:

• Does not conduct investigations independently of the police department
• Does not have investigatory power
• Does not offer public access that allows residents to file complaints through a variety of methods and during non-business hours
• Does not otherwise meet the above criteria for “On Track to a Strong Policy” or “Making Progress with Room for Improvement”