Government's shadow AI problem is also a product problem

Vithun Khamsong via Getty Images

COMMENTARY | Cyber rules can block unapproved tools, but cannot erase the incentive to use them when sanctioned AI falls materially behind.

Recent Route Fifty coverage captures where public-sector cybersecurity is heading. Cyber ranges are being used to build trust in AI; the White House and Texas have launched Project Watershed 250 to stress-test water utilities; and the case for whole-of-state cyber defense is that governments cannot protect one agency at a time.

All of those efforts depend on a quieter assumption: public employees will actually use the secure tools their organizations approve.

When an approved artificial intelligence system is slower, less capable, or poorly integrated compared with a public alternative one browser tab away, government creates an incentive for shadow AI. A deadline, a difficult document and a better public tool may be enough. The employee may be trying to help the mission, not evade it.

The federal government has already named part of the problem. In June, National Security Presidential Memorandum 11 directed national-security agencies to close the capability gap between public AI and the tools available to their workforce. Usually read as an adoption policy, it also contains a security lesson: a persistent capability gap is a control weakness.

The Insider Risk May Begin With Good Intentions

Traditional insider-threat programs look for motives such as coercion, grievance, financial pressure, or deliberate rule evasion. Shadow AI can begin with none of them.

Picture a county analyst, state employee, contractor, or utility worker facing a long document and a short deadline. The approved environment can summarize it, but the public model is faster or produces better work. If sensitive information moves with the task, the security failure occurs when the data leaves the governed environment.

That is why punishment and annual awareness training are incomplete answers. Governments can tell employees not to use unapproved tools. They should also ask why the shortcut remains attractive.

A Useful Tool is a Security Control

The State Department offers a useful federal example. Its Generative AI Playbook says StateChat, an enterprise system approved for sensitive-but-unclassified work, had more than 62,000 users by June and had reached 98% of U.S. diplomatic posts.

The scale matters more than the brand. Secure adoption works best when the governed option is useful enough to become the default.

State's own user feedback is equally instructive: employees who reported little or no time savings cited response quality, verification burden and weak workflow integration. Those sound like product issues. In a security program, they are leading indicators. Friction pushes work elsewhere.

A secure AI tool that employees routinely route around is not a successful security deployment. It is a security policy with an escape hatch.

Cyber Ranges Can Measure the Gap, Not Just the Attack

Cyber ranges are already used to rehearse attacks and understand how AI changes cyber operations. The same environments can test whether approved AI is good enough to keep real work inside the boundary.

Give users representative tasks with synthetic or sanitized data and compare the governed system with leading commercial alternatives. Measure completion time, answer quality, verification burden, workflow friction and the steps required to finish the job. Then test the controls around the workflow: what happens when a user tries to move restricted material into an unapproved service, or when a new model materially outperforms the approved one?

That turns shadow AI from a vague policy concern into something an agency can observe before a real incident.

States Can Make This a Shared Service

For state and local governments, the problem is especially practical. A large federal department may have staff to evaluate several frontier models. A small city, school district, water utility, or county health department often does not.

Whole-of-state cyber programs should add shared AI evaluation to the services they provide. A state cyber range or central security office could maintain representative benchmarks, controlled sandboxes, model-risk findings, approved data-use patterns and rapid evaluation procedures that local entities can reuse.

That would not require every jurisdiction to adopt the same model. It would give smaller organizations a way to answer the questions they otherwise struggle to staff: Is this tool materially better? What data can it handle? What controls are required? Can it be approved quickly enough that employees are not pushed toward an ungoverned workaround?

States should also treat product friction as security telemetry. Help-desk requests, blocked uploads to public AI sites, requests for new models, repeated manual workarounds and complaints about response quality can reveal where the control is losing credibility.

Do Not Choose Between Adoption and Control

The wrong response is to frame this as a choice between fast AI adoption and strong cybersecurity. The two reinforce each other when the approved environment is capable, data boundaries are clear and better models can be evaluated at commercial speed.

Technical controls still matter: managed browsers, data-loss prevention, endpoint policy, network telemetry and application-layer controls can block or detect unauthorized transfers. But they work better when compliance does not require employees to accept a large productivity penalty.

The public sector is already learning to stress-test infrastructure and rehearse AI-enabled cyber incidents. It should apply the same discipline to the tools inside the workforce.

The question for the next AI program review should not be only, "Is the approved tool secure?" It should also be: "How far behind is it, who is measuring that distance and what will employees do if the gap gets wider?"

In the AI era, usefulness is not separate from security. It is part of the control.

Burak Oktenli is an independent researcher based in Washington, D.C., focusing on AI assurance, cybersecurity, critical-infrastructure resilience and autonomous-systems governance. He holds a bachelor's degree in Computer Science and Engineering from the University of South Florida and an MBA, and is completing a Master of Professional Studies in Applied Intelligence at Georgetown University.

X
This website uses cookies to enhance user experience and to analyze performance and traffic on our website. We also share information about your use of our site with our social media, advertising and analytics partners. Learn More / Do Not Sell My Personal Information
Accept Cookies
X
Cookie Preferences Cookie List

Do Not Sell My Personal Information

When you visit our website, we store cookies on your browser to collect information. The information collected might relate to you, your preferences or your device, and is mostly used to make the site work as you expect it to and to provide a more personalized web experience. However, you can choose not to allow certain types of cookies, which may impact your experience of the site and the services we are able to offer. Click on the different category headings to find out more and change our default settings according to your preference. You cannot opt-out of our First Party Strictly Necessary Cookies as they are deployed in order to ensure the proper functioning of our website (such as prompting the cookie banner and remembering your settings, to log into your account, to redirect you when you log out, etc.). For more information about the First and Third Party Cookies used please follow this link.

Allow All Cookies

Manage Consent Preferences

Strictly Necessary Cookies - Always Active

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Sale of Personal Data, Targeting & Social Media Cookies

Under the California Consumer Privacy Act, you have the right to opt-out of the sale of your personal information to third parties. These cookies collect information for analytics and to personalize your experience with targeted ads. You may exercise your right to opt out of the sale of personal information by using this toggle switch. If you opt out we will not be able to offer you personalised ads and will not hand over your personal information to any third parties. Additionally, you may contact our legal department for further clarification about your rights as a California consumer by using this Exercise My Rights link

If you have enabled privacy controls on your browser (such as a plugin), we have to take that as a valid request to opt-out. Therefore we would not be able to track your activity through the web. This may affect our ability to personalize ads according to your preferences.

Targeting cookies may be set through our site by our advertising partners. They may be used by those companies to build a profile of your interests and show you relevant adverts on other sites. They do not store directly personal information, but are based on uniquely identifying your browser and internet device. If you do not allow these cookies, you will experience less targeted advertising.

Social media cookies are set by a range of social media services that we have added to the site to enable you to share our content with your friends and networks. They are capable of tracking your browser across other sites and building up a profile of your interests. This may impact the content and messages you see on other websites you visit. If you do not allow these cookies you may not be able to use or see these sharing tools.

If you want to opt out of all of our lead reports and lists, please submit a privacy request at our Do Not Sell page.

Save Settings
Cookie Preferences Cookie List

Cookie List

A cookie is a small piece of data (text file) that a website – when visited by a user – asks your browser to store on your device in order to remember information about you, such as your language preference or login information. Those cookies are set by us and called first-party cookies. We also use third-party cookies – which are cookies from a domain different than the domain of the website you are visiting – for our advertising and marketing efforts. More specifically, we use cookies and other tracking technologies for the following purposes:

Strictly Necessary Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Functional Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Performance Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Sale of Personal Data

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.

Social Media Cookies

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.

Targeting Cookies

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.