State Watchdogs Plan to Monitor Covid Data Accuracy

A woman is tested for Covid-19 at a walk-up testing site in Seattle. Auditors from nearly a dozen states are planning to review how pandemic data is being tracked.

A woman is tested for Covid-19 at a walk-up testing site in Seattle. Auditors from nearly a dozen states are planning to review how pandemic data is being tracked. AP Photo/Elaine Thompson

 

Connecting state and local government leaders

Data presented to the public has often been confusing.

Concerned about the accuracy and uniformity of Covid-19 data, a bipartisan coalition of fiscal watchdogs have banded together to try to help make sure states are compiling and tracking information the same way.

The state auditors will take a close look at how health officials in their own states are collecting, reporting and monitoring data. The goals are to ensure that information presented to the public is consistent and accurate, to allow apples-to-apples comparisons among states and to help officials get a better handle on the issue if the pandemic gets worse in the coming months or there is another disaster in the future.

“This is an audit for the people. I believe it can save lives,” said Delaware State Auditor Kathy McGuiness, who came up with the idea and organized the effort. “This can help us understand the pandemic’s progression and how to better guide public health actions. And it’s a real opportunity for transparency.”

So far, auditors from the District of Columbia, Puerto Rico and 11 states—from Hawaii to Louisiana—have joined the effort. The auditors plan to release the findings from their states to the public as soon as their work is completed.

In many states, Covid-19 data presented to the public has been conflicting and confusing.

In North Carolina, for example, lagging lab test results gave a distorted view of how many tests were performed and how many people tested positive. Last month, for example, the state health department announced that a discrepancy between electronic and manual reporting of testing data from a private lab resulted in an overcounting of tests by more than 200,000.

In Florida, the state health department counted as Covid-19 deaths only people who claimed residency in Florida, whereas medical examiners included anyone who visited or lived there part-time and had died in the state.

And in Washington state, officials have blamed an overwhelmed disease reporting system, software issues and changes in methodology for creating hurdles to providing timely, accurate data, including the coronavirus positivity rate.

State and local health officials admit they’ve had problems providing up-to-date, accurate information. They say insufficient budgets, technology glitches and disjointed state and local reporting systems can make it difficult to standardize data.

Janet Hamilton, executive director of the Council of State and Territorial Epidemiologists, applauded the state auditor coalition’s effort.

“I think public health is always interested in improving our processes and ensuring we are able to have the best data and information possible,” she said. “From that standpoint, it’s wonderful.”

But Hamilton cautioned that it’s important for auditors not only to focus on health departments, but also to “look downstream as to what’s coming in.”

“It’s not uncommon that reports will be received with missing or incomplete information,” she said. “The health department gets what they get. They’re left sorting things out.”

Although physicians are required to report detailed Covid-19 information to state health departments, they often don’t, according to Hamilton. Labs, which are also required to, generally send it, though information often is missing, such as a patient’s address, phone number, race and ethnicity. And labs new to Covid-19 reporting either don’t send the information, or they get it to the state late or in batches.

Another problem is with testing locations outside of labs, such as mobile units and urgent care centers, Hamilton added. Those sites focus more on returning results than collecting information for public health officials. “They are plagued with some of the largest volume of missing information.”

And rapid testing, which delivers Covid-19 results fast, also poses a challenge when it comes to data collection and reporting, she said.

“It’s like a toaster,” she said. “Fifteen minutes later, the results come out and they don’t often get sent to public health.”

Better Data

Delaware’s McGuiness, a Democrat, said she became interested in Covid-19 data after noticing major inconsistencies being reported nationwide. After sending out a quick survey to her colleagues in other states and getting more than two dozen responses, she convened in May a national task force of five state auditors’ offices, including her own. She asked them to designate staff to be part of a working group.

The groups met virtually once or twice a week. By July, they had developed a template that auditors could use to determine how states were reporting and monitoring coronavirus data.

Auditors who use the framework will try to find out whether states collected information such as the type of tests used, the results and case information such as gender, race, exposure source and outcome. They also will look into guidance states give testing entities, how information is to be reported and whether it is timely.

Auditors also would try to determine whether results include information such as the number of positive and negative tests, recoveries and deaths and the source of exposure. They also will ask whether states monitored or sampled testing procedures and data to ensure accuracy and how they contacted and monitored people who tested positive.

Government and media reports played a role in how the groups developed the questions, said McGuiness, who also is a pharmacist. One team member has done extensive research in epidemiology and another has a health policy background, and they helped distill information and get input from other states, she added.

“Not only is it good for states but eventually, we’ll be able to compare and contrast and maybe get some great ideas from another state rather than reinvent the wheel,” McGuiness said. “Knowledge is power. It can be useful for policymakers and any health officials. I can’t tell you one state that hasn’t seen room for improvement.”

Several state auditors’ offices involved in the project, including McGuiness’, already have started their reviews. Some are doing a special report, which presents and summarizes information. Others are ordering a more formal “performance audit,” which is a systemic examination of evidence to assess how well an entity is performing.

Ohio has a new portal for the public to send in tips if they have gotten notices with erroneous test results, such as those that were later reversed or were for tests the person didn’t take.

“It is important that Ohioans have confidence in the data used for making Covid-19 policies,” Republican State Auditor Keith Faber said in a statement to Stateline. He also has launched a general performance audit for the state’s data. 

Some state auditors are starting smaller, asking health officials questions from the coalition’s template more informally.

That’s what Mississippi will be doing, said State Auditor Shad White, a Republican. Right now, his office is focusing its attention on how the state is spending its $1.25 billion in CARES Act money. That doesn’t mean he won’t order a full-fledged performance audit of Covid-19 data collection down the road, he added.

“You keep an eye on answers to these questions,” he said, “and see if you get satisfactory ones and the documentation.”

In Iowa, Auditor of State Rob Sand had already issued an audit that dealt with Covid-19 response issues when he learned about the coalition. He quickly joined, he said.

“Oversight is always important, but it is even more important in the middle of a pandemic,” Sand said. “Whether it’s hospitalization or test-taking or the kind of tests being used, the systems we create should be focused on serving people, not on politics or anything else.”

Given that so much of the coronavirus debate has become political, Sand, a Democrat, said he was particularly impressed that the coalition included Democratic and Republican state auditors. “The fact that it was bipartisan was really important,” he said.

Having state auditors take a close look at how health officials are collecting and reporting Covid-19 data is essential for the public, he said. “You have to have an independent body that comes in and calls balls and strikes. Who better than state auditors?”

But the auditors’ project isn’t just about paperwork and process, he added.

“When we talk about positivity rates, every number going into that calculation is a human being who took a test and then waited anxiously for its results,” he said. “There are a lot of people behind every number.”

Jenni Bergal is a veteran journalist who covers transportation, infrastructure, and cybersecurity for Stateline.

FEATURED CASE STUDIES
Powered By The Atlas
Expanding broadband access with small cell deployment in City of Ontario
Ontario, CA, USA
Laguna Beach open 24/7/365 for business license renewals!
Laguna Beach, CA, USA
Scottsdale tracks strategic plan to better share progress with City Council, staff and residents
Scottsdale, AZ, USA

NEXT STORY: Covid Lockdowns Expose the Digital Have-Nots in Rural Areas—These Policies Can Get Them Connected

X
This website uses cookies to enhance user experience and to analyze performance and traffic on our website. We also share information about your use of our site with our social media, advertising and analytics partners. Learn More / Do Not Sell My Personal Information
Accept Cookies
X
Cookie Preferences Cookie List

Do Not Sell My Personal Information

When you visit our website, we store cookies on your browser to collect information. The information collected might relate to you, your preferences or your device, and is mostly used to make the site work as you expect it to and to provide a more personalized web experience. However, you can choose not to allow certain types of cookies, which may impact your experience of the site and the services we are able to offer. Click on the different category headings to find out more and change our default settings according to your preference. You cannot opt-out of our First Party Strictly Necessary Cookies as they are deployed in order to ensure the proper functioning of our website (such as prompting the cookie banner and remembering your settings, to log into your account, to redirect you when you log out, etc.). For more information about the First and Third Party Cookies used please follow this link.

Allow All Cookies

Manage Consent Preferences

Strictly Necessary Cookies - Always Active

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Sale of Personal Data, Targeting & Social Media Cookies

Under the California Consumer Privacy Act, you have the right to opt-out of the sale of your personal information to third parties. These cookies collect information for analytics and to personalize your experience with targeted ads. You may exercise your right to opt out of the sale of personal information by using this toggle switch. If you opt out we will not be able to offer you personalised ads and will not hand over your personal information to any third parties. Additionally, you may contact our legal department for further clarification about your rights as a California consumer by using this Exercise My Rights link

If you have enabled privacy controls on your browser (such as a plugin), we have to take that as a valid request to opt-out. Therefore we would not be able to track your activity through the web. This may affect our ability to personalize ads according to your preferences.

Targeting cookies may be set through our site by our advertising partners. They may be used by those companies to build a profile of your interests and show you relevant adverts on other sites. They do not store directly personal information, but are based on uniquely identifying your browser and internet device. If you do not allow these cookies, you will experience less targeted advertising.

Social media cookies are set by a range of social media services that we have added to the site to enable you to share our content with your friends and networks. They are capable of tracking your browser across other sites and building up a profile of your interests. This may impact the content and messages you see on other websites you visit. If you do not allow these cookies you may not be able to use or see these sharing tools.

If you want to opt out of all of our lead reports and lists, please submit a privacy request at our Do Not Sell page.

Save Settings
Cookie Preferences Cookie List

Cookie List

A cookie is a small piece of data (text file) that a website – when visited by a user – asks your browser to store on your device in order to remember information about you, such as your language preference or login information. Those cookies are set by us and called first-party cookies. We also use third-party cookies – which are cookies from a domain different than the domain of the website you are visiting – for our advertising and marketing efforts. More specifically, we use cookies and other tracking technologies for the following purposes:

Strictly Necessary Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Functional Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Performance Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Sale of Personal Data

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.

Social Media Cookies

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.

Targeting Cookies

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.