Ai Foundry model GPT-5-nano returns Empty response from model.

Luis TOBIAS 20 Reputation points
2025-10-20T08:40:00.0766667+00:00

I have deployed a GPT-5-nano model on AI foundry. The model seems to go on and do long reasonings then return and empty response. The answer for a simple promtp like: hi this is a test, returns more than 800 tokens output for reasoning and an empty message output.

Is this a bug? Should i rather try to get the reasoning output, although i am not sure i should as it may be some unorgonized model "thoughts"

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
{count} votes

Answer accepted by question author
  1. Sridhar M 1,220 Reputation points Microsoft External Staff Moderator
    2025-10-20T09:40:07.9066667+00:00

    Hi Luis TOBIAS,

    Behavior, not necessarily a bug: With the Responses API, GPT‑5‑nano/mini may emit only a reasoning item and no message item, so output_text is empty even when the call succeeds. This happens more often when token budgets are tight or reasoning effort is high. [github.com], [community.openai.com]

    Wrong token parameter: Using max_tokens (legacy) with GPT‑5 models can cause invalid/ignored limits; use max_output_tokens (SDK) or max_completion_tokens (REST). [github.com]

    High reasoning effort on “nano”: Default reasoning can consume hundreds of tokens before producing a message, sometimes exhausting the budget. For simple prompts, use minimal/low effort—or pick a non‑reasoning model for snappy chat. [free.blessedness.top], [platform.openai.com]

    Safety & schema constraints: Azure’s content filters may strip completions (yielding empty content); structured outputs with invalid or incompatible schemas can also suppress responses. [free.blessedness.top], [free.blessedness.top], [free.blessedness.top]

    Thank you!

    1 person found this answer helpful.

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.