Azure OpenAI Setup

Deploy a GPT model in your Azure account to power AI question-answering.

Used in: Arion Chordium Cadenzium
About 10 minutes (plus Microsoft's access approval, if required)

? What is Azure OpenAI?

Azure OpenAI is Microsoft's hosted version of OpenAI's GPT models (GPT-4o, GPT-4o-mini, etc.). Chordalia products send relevant document excerpts plus your question to Azure OpenAI, which returns a written answer with citations.

Crucially, the traffic goes to your own Azure account, not a shared Chordalia endpoint. Your documents and queries never touch our servers, and Microsoft's enterprise privacy terms apply to the content.

Don't have an Azure account yet? Start with Azure Account Setup → — that guide gets you a free trial with $200 credit. Come back here once you have the portal open.

What will it cost?

Azure OpenAI charges per token (~750 words of input or output). For a typical Chordalia user asking a few questions a day:

The $200 free-trial credit only applies for your first 30 days. Microsoft charges your credit card from month two onward even if you haven't used the full $200 — the credit does not roll over. Use the first month to explore, then set a budget alert in the Azure portal's Cost Management before your second month starts so there are no surprises.

1 Check if you need to request access

In the past, Azure OpenAI was gated behind an application form. Microsoft has removed that requirement for most accounts — you can now create the resource directly. But if you're using a brand-new subscription, an Enterprise Agreement, or an account in certain regions, you may still hit a one-time access-request form.

If prompted, fill in the form honestly (intended use: "private document search and Q&A with my own data"). Approvals are usually granted within a day.

2 Create an Azure OpenAI resource

In the Azure portal, use the search bar at the top and type Azure OpenAI. Click the result.

Finding Azure OpenAI in the Azure portal

Steps

  1. Click + Create.
  2. Choose Foundry.
  3. Pick your Subscription (the free trial, unless you have more than one).
  4. Pick the Resource group you created earlier (e.g. chordalia-rg).
  5. Give the resource a Name — this becomes part of the endpoint URL, so pick something you'll recognise (e.g. chordalia-openai).
  6. Pick a Region — not every region offers every model. East US, East US 2, and Sweden Central currently have the widest model selection.
  7. Enter a Default project name — Azure suggests one based on your resource name. Accept the suggestion or pick something simple (e.g. chordalia-openai-project). This is the AI Foundry project the resource gets linked to.
  8. Click Review + Create.
  9. Click Create.
Create Azure OpenAI resource

Provisioning takes a minute or two. When it's done, the portal shows a Go to resource button — click it.

3 Deploy a model

Creating the Azure OpenAI resource is only half the work. The resource is a container; the actual models (GPT-4o, GPT-4o-mini, etc.) have to be explicitly deployed inside it before you can use them.

From the resource overview page, click Go to Foundry portal (also called Azure AI Studio). This opens a new tab.

Go to Foundry portal

Deployment steps

  1. In Azure AI Foundry, click Model catalog in the left sidebar.
  2. Search for and select the model you want to deploy. GPT-4o-mini is the recommended default: cheap, fast, quality is plenty good for document Q&A. Upgrade to GPT-4o if you want richer answers.
  3. Click Use this model.
  4. Give the deployment a Deployment name — this is what Chordalia products use to select this model. Keep it simple: gpt-4o-mini or chordalia-gpt.
  5. Leave the rest at defaults and click Create resource and deploy.
Deploy Azure OpenAI model
The Deployment name matters. Chordalia products reference the deployment name you typed, not the model name. If you name the deployment my-gpt but try to use gpt-4o-mini in Arion's settings, you'll get a "deployment not found" error. Copy your deployment name exactly when you configure the product.

4 Copy the endpoint and API key

Back in the Azure portal, open your Azure OpenAI resource. In the left sidebar, click Keys and Endpoint.

Keys and Endpoint

You'll see three things you need to copy:

Treat the API key like a password. Anyone with this key can spend money on your Azure account. Don't paste it into chat messages, emails, or screenshots. If you suspect it's been exposed, click Regenerate on the Keys and Endpoint page — the old key stops working immediately. Chordalia products store the key in your operating system's credential manager (Windows Credential Manager / macOS Keychain), not in plain config files.

Using Azure OpenAI in your Chordalia product

Arion — Tier 2

Open Settings → Azure (Tier 2). Scroll to the Azure OpenAI group box (lower half of the tab) — not the Azure AI Search group above it, which is for a different service. Paste:

  • Endpoint → OpenAI Endpoint
  • KEY 1 → API Key
  • Deployment name → Deployment Name

Also set Arion's tier to Tier 2 on the Search Tier tab.

Chordium

Edit chordium.yml or use the admin UI:

  • azure.openai.endpoint
  • azure.openai.api_key
  • azure.openai.deployment

Cadenzium

Open Settings → AI, pick Azure OpenAI as the provider, and paste the three values above.

! Troubleshooting

"The API deployment for this resource does not exist"

You're referring to a deployment name that doesn't match anything deployed in the resource. Open Azure AI Foundry → Deployments and copy the exact name shown there — it's case-sensitive.

"401 Unauthorized" or "Invalid authorization header"

The API key is wrong, expired, or was regenerated. Go back to Keys and Endpoint, copy KEY 1 freshly (the eye icon shows it, the copy icon puts it on your clipboard), and paste it into the product settings again.

"The specified model is not supported in the selected region"

Not every Azure region offers every model. GPT-4o variants are usually available in East US, East US 2, and Sweden Central; newer or preview models may be in only one region at a time. Either pick a different model, or create a new Azure OpenAI resource in a region that offers what you want.

Deployment is blocked because "Tokens per minute" is locked at 0

Common on free-trial subscriptions: the model you picked has 0 TPM allocated to your subscription in that region, so the deployment slider is stuck at zero and the Deploy button is disabled.

To diagnose and resolve, in priority order:

  1. Confirm with the Quotas page. Search the portal for QuotasAzure OpenAI (or Cognitive Services), filter by your subscription and region. If Limit is 0 for the model you tried, that's it.
  2. Try a different model in the same region. GPT-4o (full) and GPT-4o-mini have separate quota pools — one may be allocated even when the other is at zero. This is the cheapest experiment and resolves the issue most of the time.
  3. Try a different region. Delete the resource and create a new one in East US 2 or Sweden Central (typically less saturated than East US for new accounts).
  4. Request a quota increase. From the Quotas page, click Request quota increase on the relevant row. Ask for 30K TPM — that's plenty for Chordalia-product usage. Small bumps are usually auto-approved within an hour.

Answers are cut off mid-sentence

The model hit its output-token limit. Chordalia products set sensible defaults (~1000 tokens), enough for a page or two of prose. If you need longer answers, raise the limit in the product's settings (Arion: Settings → AI Prompt → tuning options, when available).

Unexpected charges on my bill

Most "surprise" Azure OpenAI bills come from applications left running in a loop by mistake. In the Azure portal, go to Cost Management + BillingCost analysis to see which resource is spending the most, and set a Budget with an email alert at 80% of your monthly cap.

How do I delete an Azure OpenAI resource?

Open the resource in the portal, click Delete at the top. To remove everything at once (OpenAI resource, deployments, logs), delete the whole resource group instead — that's why we used a dedicated chordalia-rg.