News · OpenAI's company knowledge makes the retrieval process a visible frontend surface
OpenAI's company knowledge makes the retrieval process a visible frontend surface
A manual toggle, a live sidebar, and clickable citation snippets turn cross-app search into something the user watches happen inside ChatGPT.
The toggle is the tell
Company knowledge is not always on. To use it, you "tap 'Company knowledge' under the message composer," and OpenAI is explicit that this is a manual step you take when you start a new conversation.
That single design choice carries weight. OpenAI acknowledges that when the toggle is off, "ChatGPT may still use your connected apps to help answer questions, but its responses won't include the same depth or detailed citations." So the same connected data produces two different experiences depending on a button state—one shallow, one deep with sources.
For a frontend, that's a hard thing to explain to users. The company says it is "working to bring these experiences together in the coming months," which is a fair admission that the current state asks people to remember a mode switch to get the good version.
Mode exclusivity is the current cost
The toggle also gates capabilities against each other. OpenAI states plainly: "When company knowledge is on, ChatGPT can't search the web or create charts and images."
The escape hatch is designed into the conversation: "You can turn it off and continue working in the same conversation to use these capabilities, while keeping your existing context." Context persists across the mode flip, which softens the friction, but the user still has to know to do it.
So a request like "report on customer feedback from the mobile launch and chart the sentiment" can't happen in one pass today. The interface asks the user to sequence the work manually across two states.
Permissions render invisibly, and that's the point
One thing the frontend deliberately does not show is data the user isn't allowed to see. "Company knowledge respects your existing company permissions, so ChatGPT only has access to what each user is already authorized to view."
This means two people in the same company can ask "Where did we land on company goals for next year?" and get answers drawn from different underlying sources. The interface never signals what was filtered out—by design—because surfacing the existence of restricted content would itself leak information.
OpenAI pairs this with admin controls: custom roles, group-level permissions, SSO, SCIM, IP allowlisting, and conversation logs via the Enterprise Compliance API. The user-facing surface stays clean precisely because the access boundary is enforced upstream.
Find this story relevant to you?
Contact us to find a unique solution
Brauchen Sie einen KI-Engineering-Partner, der auch liefern kann?
Wir helfen Unternehmen dabei, KI in Produkte und Prozesse zu integrieren, wertvolle Workflows zu automatisieren und die zugrunde liegenden Softwaresysteme zu modernisieren.
Weiterführende Beiträge
Weitere Analysen rund um Produktbereitstellung, operative KI und die Systemarbeit, die dafür sorgt, dass der Einsatz in der Praxis Bestand hat.