Skip to main content

Graph Copilot

Graph Copilot is a CodefyUI plugin that adds a chat panel to the editor. Describe the graph in plain language and the AI generates operations to add nodes, connect ports, and set parameters. It applies the operations as one batch, so each AI edit creates one undo step. You can stop a streaming response, retry a failed request, and continue a conversation across sessions.

:::note Availability Graph Copilot is built on two CodefyUI features: the plugin frontend extension API and the unified LLM proxy endpoint (/api/llm/chat). Both are in CodefyUI 1.3.0 and later. If cdui --version reports an older version, run cdui update before installing. :::

Installation​

cdui plugin install graph-copilot

You can also open the Plugin Center in the editor and install graph-copilot from the catalog. Installation through the Plugin Center loads the panel immediately. After installing from a terminal, reload the editor by pressing F5. The Graph Copilot panel appears as a floating widget in the editor.

Plugin source and issues: github.com/CodefyUI/CodefyUI-Plugin-Graph-Copilot

Quick start​

  1. Install the plugin (above).
  2. Click the round Graph Copilot button in the bottom-right corner of the canvas to open the chat panel.
  3. Click the Settings (gear) icon, choose a provider, and paste your API key. To use OpenAI Codex, click Sign in and approve access in the tab that opens. Select a model; use Refresh to fetch the provider's model list.
  4. Type a request such as Build a small MLP classifier and press Enter.
  5. The AI streams its plan while adding and connecting nodes on the canvas. Press Ctrl+Z once to undo the entire edit, or send another message to refine it.

The browser stores the provider and key, so you only need to configure them once. The following sections describe each feature.

Choosing an LLM provider​

Click the Settings (gear) icon in the Graph Copilot panel to configure the provider and key.

ProviderNotes
OpenAI APIStandard https://api.openai.com/v1 endpoint. Requires an OpenAI API key. Billed per token.
OpenAI Codex (ChatGPT sign-in)Uses OAuth with your ChatGPT account through the Codex CLI PKCE flow and client ID. It uses ChatGPT subscription quota rather than API credits and remains subject to ChatGPT usage limits and OpenAI's terms. Tokens are stored on the server in llm/codex_auth.json under the user-data directory. Everyone who uses that server shares one signed-in account, and Sign out clears the tokens for everyone. The OAuth callback listens on localhost:1455 (or 1457) in the server process. Complete sign-in within 5 minutes in a browser on the machine that runs the server.
OpenRouterAggregates many providers under one key. The proxy sends requests to https://openrouter.ai/api/v1; select your preferred model.
Claude APIAnthropic's API, accessed through CodefyUI's proxy. The proxy translates the OpenAI-compatible request format. Requires an Anthropic API key.
Custom (OpenAI-compatible)Any server that implements the OpenAI /chat/completions endpoint. For example, you can use a local Ollama instance at http://localhost:11434/v1. Set the base URL and, if required, a key.

The proxy also provides POST /api/llm/models, which lists a provider's models for Refresh. POST /api/llm/codex/login, GET /api/llm/codex/status, and POST /api/llm/codex/logout support ChatGPT sign-in. The same controls are available under Settings → LLM Providers. Only OpenAI API and OpenAI Codex use reasoning_effort; the proxy rejects ultra for OpenAI Codex (400) and forwards any value unchanged for OpenAI API. The editor supplies the session token required by the POST routes.

Key handling​

API keys are stored in localStorage under a namespace private to Graph Copilot. Each request sends the selected key to the local CodefyUI backend. /api/llm/chat forwards the key and messages to the configured provider and streams the response back. It does not log or persist the key or messages. Each provider has fixed upstream hosts; only Custom uses a base URL that you supply. These keys are separate from CODEFYUI_OPENAI_API_KEY and CODEFYUI_ANTHROPIC_API_KEY. Only the LLMChat node reads those environment variables; the proxy does not read them.

Usage​

Sending a request​

Type your request in the chat input and press Enter (or click Send). Examples:

  • "Add a two-layer MLP with ReLU activations"
  • "Connect the CrossEntropy node to the output of the last Linear"
  • "Set the hidden size on Linear-1 to 512"

The AI returns a plan and then a list of operations. A chip for each operation, such as "add Linear", "add ReLU", or "connect", appears while the operation is applied.

Conversation history​

The current graph's chat history is stored in localStorage. Graph Copilot restores that conversation when you reopen or reload the editor.

Stop and retry​

Click Stop during a stream to cancel the in-flight request. The partial response is discarded. Click Retry on any AI message to resend that turn with the same context.

Undoing AI edits​

Every AI edit is a single undo snapshot. Press Ctrl+Z (or Cmd+Z on macOS) once to undo the entire batch of operations from the last AI response.

Tips​

  • Give context about what you are building: "I am building a vision classifier with a ResNet backbone" helps the AI make better choices.
  • If the AI adds a node type that does not exist in your palette, it will be skipped and reported — use cdui plugin install to add the required pack first.
  • Graph Copilot reads the current graph state and the full node palette before each request, so it knows what types are available and what is already on the canvas.

See also​