All Azure services

Azure · AI / ML

Azure OpenAI Service

Enterprise GPT/Embeddings on Azure.

Official docs

Overview

Azure OpenAI provides GPT, embedding, and reasoning models behind your VNet with content filters and managed identity auth.

When to use it

  • LLM features in apps
  • Auto-triage of test failures
  • Test-case generation from PRDs

Setup

  1. Create Azure OpenAI resource.
  2. Deploy a model (e.g. gpt-4o-mini).
  3. Grant role + use endpoint + key/MSI.

How to use

Chat completion
curl $ENDPOINT/openai/deployments/gpt-4o-mini/chat/completions?api-version=2024-08-01-preview \
 -H 'api-key: '$KEY -H 'content-type: application/json' \
 -d '{"messages":[{"role":"user","content":"Cluster these failures..."}]}'

QA use cases

  • Group similar failure logs and propose owners.