Back to Blog

AI, collaboration & responsibility

The Understanding Bottleneck

Useful work can now arrive faster than the shared understanding needed to judge it responsibly.

Hanbo Xie  ·  Georgia Institute of Technology  ·  August 17, 2026

AI、协作与责任

理解的瓶颈

有用的工作产出得越来越快,但形成负责任判断所需的共同理解却没有同步加速。

Hanbo Xie  ·  Georgia Institute of Technology  ·  2026 年 8 月 17 日

A while ago, I asked Codex to help me run code submitted by participants in an automated evaluation. Because the code was untrusted, Codex warned me that it should not be allowed to access the internet.

That sounded reasonable. I assumed it would run the submitted code inside a sandbox and block network access there. So when Codex asked for permission, I approved it.

Instead, it disabled the internet connection for my entire computer.

The submitted code still did not run. Worse, I could no longer connect to Codex to ask what had happened or to have it undo the change. I spent the next part of the day figuring out how to restore the connection myself.

What bothered me was not simply that an AI tool had made a mistake. In a literal sense, Codex had done something close to what it said it would do: remove network access. The problem was that the action I thought I had approved was not the action it understood itself to be taking.

We had agreement without shared understanding.

I have started noticing the same pattern in much less absurd situations.

I use AI heavily in research. An idea can sometimes turn into an analysis, an implementation, and even a short paper over a weekend. During that process I may have dozens or hundreds of interactions with AI: trying alternatives, checking assumptions, fixing implementation details, discarding failed approaches, and updating my own view of the problem.

But before a paper is submitted, someone else may still need to understand and approve it. That can require long conversations about background, methods, implementation details, and why certain choices were made. The paper itself may be short. The context required to judge it responsibly is not.

This is not because the other person is slow. If we had accumulated the same context along the way, the conversation would be much easier. The problem is that AI can compress the path from idea to output without equally compressing the path by which another human reconstructs the context needed to understand that output.

The work moves faster than shared understanding.

I think this is becoming a distinct bottleneck in AI-assisted work.

When the output arrives before the understanding

In the past, producing complex work usually forced someone to move through much of the reasoning required to construct it. Writing code meant deciding how the pieces fit together. Running an analysis meant making a sequence of choices. Building an argument meant working through intermediate steps.

AI weakens that coupling.

Many intermediate steps can now be delegated, compressed, or traversed so quickly that the final artifact appears before the corresponding human understanding has fully formed.

Sometimes the understanding catches up later. Sometimes it remains partial. Sometimes the artifact is already being reviewed, approved, deployed, or built upon while the people responsible for the next step are still reconstructing what happened.

The artifact arrives before the understanding does.

I call the resulting gap the understanding bottleneck:

The understanding bottleneck appears when useful actions or artifacts can be produced faster than the people responsible for them can understand them well enough to take the next step.

The important phrase is well enough. Nobody needs to understand every detail of every system they use. What matters is whether a person has an understanding sufficient for the judgment or action they are responsible for.

More information is not necessarily more understanding

This is not simply information overload.

Information overload is a problem of quantity: there is too much to read, inspect, or remember. The understanding bottleneck can happen even when there is only one thing in front of us.

In my Codex example, the critical message was only a sentence or two. I had access to it. I had read it. I had approved it. What was missing was a sufficiently aligned picture of what the action actually meant.

The same can happen with more complex artifacts. A short proof may be easy to follow line by line while its central idea remains unclear. A piece of code may pass every test while the person maintaining it still lacks the understanding needed to change it safely.

The bottleneck is not just access to information. It is building enough of the right context to act reliably.

Correctness is not always enough

Better verification helps, but it does not remove the bottleneck.

A program can pass every test. A proof can be formally verified. An analysis can reproduce exactly. In many situations, that may be enough.

But when someone must review, modify, explain, approve, or take responsibility for an artifact, correctness alone may not provide the understanding required for that role.

A system can be correct enough to use and still poorly understood by the person responsible for what happens next.

Individual acceleration, collective delay

The problem becomes especially visible in collaborative work.

AI can make one person dramatically faster without making everyone around that person equally faster at understanding what has been done. The faster one person accumulates context through repeated interaction with AI, the larger the gap can become between that person and everyone else.

Individual productivity can rise while coordination becomes harder.

The researcher finishes the analysis faster, but approval becomes the slow step. The engineer generates more code, but review becomes the bottleneck. A team produces more experiments and documents while maintaining a shared picture of what has been done and why becomes increasingly difficult.

As production gets cheaper, shared context can become more expensive.

The bottleneck has not disappeared. It has moved downstream—from producing the work to reviewing it, aligning around it, and deciding who can responsibly act on it.

AI is making the production of complex intellectual work dramatically faster. It is much less clear that it is making the human understanding required to review, communicate, and take responsibility for that work equally fast.

The work is getting faster. Understanding is becoming the slow step.

前段时间,我让 Codex 帮我运行自动化评估中参与者提交的代码。因为这些代码并不可信,Codex 提醒我,不应该允许它们访问互联网。

这听起来很合理。我以为它会把提交的代码放进沙箱,并在那里阻断网络访问。所以,当 Codex 请求权限时,我批准了。

结果,它关闭了我整台电脑的网络连接。

提交的代码依然没有运行。更糟的是,我已经无法连接 Codex,既问不了发生了什么,也无法让它撤销这个改动。接下来的大半天,我都在自己摸索如何恢复网络。

真正让我在意的,不只是一个 AI 工具犯了错。从字面上说,Codex 做的事情与它声称要做的很接近:移除网络访问。问题在于,我以为自己批准的操作,并不是它所理解的那个操作。

我们达成了一致,却没有形成共同理解。

后来我开始在许多没有这么荒诞的场景里注意到同样的模式。

我在研究中大量使用 AI。一个想法有时可以在一个周末内变成分析、实现,甚至一篇短论文。在这个过程中,我可能会与 AI 交互几十次乃至几百次:尝试不同方案、检查假设、修正实现细节、放弃失败的路径,并不断更新自己对问题的看法。

但在论文提交之前,往往仍需要另一个人理解并批准它。这可能意味着围绕背景、方法、实现细节,以及某些选择背后的原因进行长时间讨论。论文也许很短,但要负责任地判断它,所需要的上下文并不短。

这不是因为对方理解得慢。如果我们一路积累了相同的上下文,沟通就会容易得多。问题在于,AI 可以压缩从想法到产出的路径,却没有同样压缩另一个人重建上下文、进而理解这个产出的路径。

工作的推进速度,超过了共同理解形成的速度。

我认为,这正逐渐成为 AI 辅助工作中一种独立的瓶颈。

当产出先于理解到达

过去,完成复杂工作通常会迫使人经历构建它所需要的大部分推理。写代码意味着决定各个部分如何配合;做分析意味着依次作出许多选择;搭建论证意味着走过中间的思考步骤。

AI 削弱了这种耦合。

现在,许多中间步骤可以被委托、压缩,或以极快的速度走完。于是,最终产物出现时,相应的人类理解可能还没有完全形成。

有时,理解会在之后赶上来;有时,它始终是不完整的;还有些时候,产物已经在被审阅、批准、部署或继续使用,而负责下一步的人仍在努力还原之前发生了什么。

产物已经抵达,理解却还在路上。

我把由此产生的缺口称为 理解的瓶颈

当有用的行动或产物生成得如此之快,以至于对它们负责的人无法及时形成足以推进下一步的理解时,理解的瓶颈就出现了。

这里重要的是“足以”。没有人需要理解自己使用的每个系统的全部细节。真正重要的是,一个人的理解是否足以支撑他所负责的判断或行动。

更多信息不一定带来更多理解

这并不只是信息过载。

信息过载是数量问题:要读、要检查、要记住的东西太多。而理解的瓶颈,即使眼前只有一件事,也可能发生。

在我的 Codex 例子里,关键提示只有一两句话。我看到了,也读过了,还批准了。缺少的不是信息,而是双方对这个操作究竟意味着什么,有一幅足够一致的图景。

更复杂的产物也一样。一份简短的证明可能逐行都能读懂,中心思想却仍不清晰;一段代码可能通过所有测试,但维护它的人依然不具备安全修改它所需的理解。

瓶颈不只是能不能接触信息,而是能否建立足够多、足够正确的上下文,从而可靠地行动。

正确并不总是足够

更好的验证会有帮助,但它不能消除这个瓶颈。

一个程序可以通过所有测试,一个证明可以被形式化验证,一项分析也可以精确复现。在许多场景里,这也许已经足够。

但当一个人必须审阅、修改、解释、批准某个产物,或为它承担责任时,仅仅正确,未必能提供这一角色所需要的理解。

一个系统可以正确到足以使用,却仍没有被负责下一步的人充分理解。

个体加速,集体延迟

这个问题在协作中尤其明显。

AI 可以让一个人快很多,却不会让他周围的每个人都同样更快地理解已经完成的工作。一个人通过反复与 AI 互动而积累上下文的速度越快,他与其他人之间的差距就可能越大。

个体生产力可以上升,而协调却变得更困难。

研究者更快完成分析,但审批成了缓慢的一环;工程师生成更多代码,但评审成了瓶颈;团队产出更多实验和文档,却越来越难维持一幅关于“做了什么、为什么这样做”的共同图景。

当生产变得更廉价,共享上下文反而可能变得更昂贵。

瓶颈并没有消失。它只是移到了下游——从产出工作,移到审阅它、围绕它达成一致,以及决定谁能够负责任地采取行动。

AI 正在显著加快复杂智力工作的生产速度。但它是否也以同样的速度,提升了人类审阅、沟通并为这些工作承担责任所需的理解,还远不清楚。

工作越来越快。理解正在成为最慢的那一步。