OpsLevel Logo
Product

Visibility

Catalog

Keep an automated record of truth

Integrations

Unify your entire tech stack

AI Engine

Restoring knowledge & generating insight

Standards

Scorecards

Measure and improve software health

Campaigns

Action on cross-cutting initiatives with ease

Checks

Get actionable insights

Developer Autonomy

Service Templates

Spin up new services within guardrails

Self-service Actions

Empower devs to do more on their own

Knowledge Center

Tap into API & Tech Docs in one single place

Featured Resource

Click-through Tour: OpsLevel Overview
Click-through Tour: OpsLevel Overview
Read more
Use Cases

Use cases

Improve Standards

Set and rollout best practices for your software

Drive Ownership

Build accountability and clarity into your catalog

Developer Experience

Free up your team to focus on high-impact work

Featured Resource

The Ultimate Guide to Microservices Versioning Best Practices
The Ultimate Guide to Microservices Versioning Best Practices
Read more
Customers
Our customers

We support leading engineering teams to deliver high-quality software, faster.

More customers
Hudl
Hudl goes from Rookie to MVP with OpsLevel
Read more
Hudl
Keller Williams
Keller Williams’ software catalog becomes a vital source of truth
Read more
Keller Williams
Duolingo
How Duolingo automates service creation and maintenance to tackle more impactful infra work
Read more
Duolingo
Resources
Our resources

Explore our library of helpful resources and learn what your team can do with OpsLevel.

All resources

Resource types

Blog

Resources, tips, and the latest in engineering insights

Guide

Practical resources to roll out new programs and features

Demo

Videos of our product and features

Events

Live and on-demand conversations

Interactive Demo

See OpsLevel in action

Pricing

Flexible and designed for your unique needs

Docs
Log In
Book a demo
Log In
Book a demo
No items found.
Share this
Get a tour
Table of contents
 link
 
Resources
Blog

Fast code, firm control: A leadership report on AI coding adoption

AI
Automation
Campaigns
Catalog
Checks
Developer
Engineering leadership
Platform engineer
Visibility
Fast code, firm control: A leadership report on AI coding adoption
Megan Dorcey
|
May 9, 2025

AI-assisted coding has gone from hype to habit. Today, 76% of developers report using AI coding tools like GitHub Copilot, ChatGPT, or Replit to write, refactor, or review code. Yet with great power comes a quiet crisis: engineering leaders are losing visibility and control over what’s being shipped.

This post presents new insights based on our own research (150 engineering leaders took our survey) from engineering teams actively adopting AI tools. It maps out the risks, maturity gaps, and, most importantly, the metrics and systems that can help you embrace AI without letting risk run rampant.

Whether you’re just starting to roll out AI coding assistants or already knee-deep in adoption, this guide will help you:

  • Identify invisible risks introduced by AI-generated code
  • Benchmark your team's current maturity
  • Launch safe, standards-based AI adoption programs
  • Use automation to stay fast and in control

The AI code boom: What’s really happening

AI tools are no longer experimental but embedded in modern software development. According to our recent AI coding tools survey where we asked engineering leaders about their AI coding journey:

  • 96% of respondents say at least one team is using an AI coding tool
  • 52% say usage is organization-wide
  • 41% report that AI-generated code now appears in production weekly

Beyond GitHub Copilot, tools like Cursor, Claude, ChatGPT, and even IDE-native assistants are now part of daily workflows. While these tools help developers move faster, they also introduce a new problem: bypassing traditional oversight gates.

What’s driving this shift?

  • Pressure to ship faster and reduce toil
  • Perceived individual productivity gains
  • Low barrier to entry—most tools work out of the box

But the organizational implications are significant.

When one developer uses Copilot, it's fast. When 200 developers do, and you don't know what it's writing—that’s when risk compounds.

Risk in plain sight: What most teams miss

AI-generated code is not inherently dangerous, but the way it’s being used often is. The problem isn’t just the code—it’s the lack of visibility, ownership, and standardization.

Here are three common risks AI adoption introduces:

Security and compliance gaps

  • AI tools can unknowingly copy insecure patterns, outdated libraries, or even copyrighted code
  • Code reviews aren’t always happening, especially in fast-moving teams
  • Security teams often don’t know what AI-generated code has entered production

Orphaned or unregistered services

  • Developers using AI can create new microservices or scripts that never get registered in your service catalog
  • These become "invisible" to platform teams, making them difficult to monitor or govern

Standards drift

  • Scorecards and reliability checks are often skipped or loosely enforced
  • AI accelerates code generation, but without maturity guardrails, teams ship code that violates internal standards or SLAs

In dozens of conversations, the most common theme wasn’t speed—it was uncertainty. Few leaders can say with confidence which services in their stack contain AI-generated code.

A lack of control doesn’t just slow you down—it leaves you exposed.

The maturity gap: Where most orgs actually stand

To understand where engineering orgs are on the AI adoption curve, we mapped respondents to four maturity stages:

Based on our survey from ~150 engineering leaders these are the stages of AI coding adoption.

The maturity gap is clear: most teams are flying blind.

Without automation, it’s hard to:

  • Detect where AI-generated code lives
  • Understand who owns it
  • Ensure it meets compliance or reliability criteria

Metrics that matter: How to track AI code risk

If you can’t measure it, you can’t manage it. These five KPIs will help you establish visibility and begin governing your AI adoption with confidence:

This graph is a guide for engineering leaders looking to start measuring the impact of AI coding on their software ecosystem.

Start tracking these monthly. Visibility is your first lever.

The safe adoption playbook: What to do next

To adopt AI safely, leaders need to blend developer autonomy with guardrails. Here's a phased approach that balances speed with governance:

Catalog everything

Use automated discovery to uncover all services, scripts, and components—especially those that may have been introduced through AI.

  • Tools: OpsLevel's Catalog Engine, Git integration, Snyk
  • Quick win: Tag and surface services missing ownership or maturity data

Define and enforce standards

Create Scorecards that specifically monitor for AI-related risks:

  • Required PR reviews
  • No secrets or credentials in code
  • Up-to-date dependencies
  • Documented ownership and team metadata

Roll out safely with Campaigns

OpsLevel Campaigns allow you to launch org-wide initiatives like "Add ownership to all services" or "Enforce secure AI usage practices"—with trackable progress.

  • Phase adoption by team or service tier
  • Measure compliance in real time

Monitor and iterate

Track adoption metrics and maturity scores monthly. Conduct periodic audits on:

  • AI-generated code hotspots
  • Services missing standards coverage
  • Engineering teams with low participation rates

How OpsLevel helps

OpsLevel is built to help engineering leaders gain control without slowing down development. Here’s how:

  • Catalog Engine: Automatically detects and surfaces services, including those added by AI-generated code.
  • Scorecards: Lightweight policies that enforce maturity and standards in real time.
  • Campaigns: Run adoption programs across the org—track progress, unblock teams, and ensure follow-through.
  • AI-powered enrichment: Helps auto-assign ownership, detect duplicate services, and enrich metadata for context.

The result? Fast visibility, low-effort governance, and safe AI adoption at scale.

Takeaways

AI coding tools are here to stay—but so are the risks they introduce. The difference between chaos and control lies in what leaders do after adoption.

You don’t need to say no to AI. You need to say yes to standards, automation, and visibility.

Engineering velocity and code safety are not mutually exclusive. With the right system in place, you can accelerate development and enforce best practices.

If you're ready to regain control of your software architecture in the age of AI, OpsLevel is here to help.

Request a demo or experience OpsLevel in this clickable demo to see how OpsLevel surfaces risk and drives adoption—fast.

‍

‍

‍

‍

‍

‍

‍

‍

‍

Take the AI readiness assessment by clicking the image above.

More resources

March Product Updates
Blog
March Product Updates

Some of the big releases from the month of March.

Read more
How Generative AI Is Changing Software Development: Key Insights from the DORA Report
Blog
How Generative AI Is Changing Software Development: Key Insights from the DORA Report

Discover the key findings from the 2024 DORA Report on Generative AI in Software Development. Learn how OpsLevel’s AI-powered tools enhance productivity, improve code quality, and simplify documentation, while helping developers avoid common pitfalls of AI adoption.

Read more
Introducing OpsLevel AI: Finding Your Lost Engineering Knowledge
Blog
Introducing OpsLevel AI: Finding Your Lost Engineering Knowledge

Read more
Product
Software catalogMaturityIntegrationsSelf-serviceKnowledge CenterBook a meeting
Company
About usCareersContact usCustomersPartnersSecurity
Resources
DocsEventsBlogPricingDemoGuide to Internal Developer PortalsGuide to Production Readiness
Comparisons
OpsLevel vs BackstageOpsLevel vs CortexOpsLevel vs Atlassian CompassOpsLevel vs Port
Subscribe
Join our newsletter to stay up to date on features and releases.
By subscribing you agree to with our Privacy Policy and provide consent to receive updates from our company.
SOC 2AICPA SOC
© 2024 J/K Labs Inc. All rights reserved.
Terms of Use
Privacy Policy
Responsible Disclosure
By using this website, you agree to the storing of cookies on your device to enhance site navigation, analyze site usage, and assist in our marketing efforts. View our Data Processing Agreement for more information.
Okay!