Share via

Want to use Grounding in openAI Chat Completions API

Ashutosh Dwivedi 10 Reputation points
2025-10-22T17:35:27.3+00:00

I use Azure AI Foundry Agentic Service along with Bing Grounding tool subscription, for my Grounding and AI Retrieval application.

I have an Open AI gpt-4o model deployed. and authenticate to azure using workload identity federation from my main cloud provider.

However, the grounding supplied by Bing is in this configuration is beyond pathetic and borderline laughable. I mean I use Gemini's 2.5 flash grounding services in the same tool, and the quality of grounding is much, much, much, much superior. Also there is no way to force my agent to always use grounding for every query, but chat.completions api has this feature.

I actually wanted to use the client.chat.completions API for my grounding implementation instead of the agentic service format, since the latter involves creation and deletion of agents in every new query in order to avoid context mix-up and mismatch. with chat completions API, I could also use Structured Output which would really help my data processing pipelines. I'm not really sure if the agentic service provides structured output as i couldn't find the documentation.

Also, Since the openAI's openAPI proprietary commercial models provide grounding with google search, would that be possible in my azure openAI model ?

Also, how to figure out the latest API Version available for my deployed 40 model ?

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.