Enable results to be grounded in Bing Search Snippets

[tonybaloney]

Purpose

This extends the Chat Read Retrieve Read approach to optionally prepare a web search, search on Bing using the V7 API then include the snippets from the results in the combined prompt.

The AI is told that the actual sources from AI Search take precedence, so it should only use the web snippets where the information from the AI Search did not answer the question.

Here is a simple example:

The thought process has been extended to include the web search. Once provisioned, the web search grounding can be turned on or off per request.

TODO :

• Create test cases
• Link the sources back to the original URLs
• Test mixed scenarios (where the data on the web is more relevant and vice versa)
• Change the UI to match the web result to a citation and link to the page

Implements #1496 #1632 and #1931

[cforce]

This is great but even better would be if this could be activated per Chat cmd understanding for a Single user Chat Message instead statically via global settings for all messages. User shall ask to search or pull information from web (eg Bing)

[tonybaloney]

This is great but even better would be if this could be activated per Chat cmd understanding for a Single user Chat Message instead statically via global settings for all messages. User shall ask to search or pull information from web (eg Bing)

Maybe it's not obvious from the PR but it's a per-chat toggle.
There's an extension to the UI to turn this on or off. But that toggle is only enabled if the backend has a Bing API key.

[zedhaque]

This is cool :)

How about citation? (using the bing title/url - and citation opens in a new window)

Many thanks for this PR!!

[cforce]

backend

want to ensure I've understood correctly. If I were to ask:

"Is the use of open-source software allowed in production systems?"

In Bing:
The response might reflect public knowledge, for example:
"Yes, many large enterprises use open-source software in production systems, as it is often cost-effective and flexible. However, its use is typically governed by strict compliance and security guidelines."

In an enterprise RAG system:
The system could retrieve an internal policy, such as:
"No, open-source software is prohibited in production systems unless explicitly approved by the legal and compliance team, as per internal IT governance policies."

How can I explicitly request responses from either Bing, the enterprise system, or even a comparison between the two using only a chat message, without the system defaulting to web searches when no internal answers are found?

[tonybaloney]

How about citation? (using the bing title/url - and citation opens in a new window)

The PR will include citation links in the same manner as the AI search ones.

[zedhaque]

@tonybaloney – Will the PR cover these use cases?

• From your YouTube video, it seems Bing Search Grounding works differently than the original Bing Search API. Can we add a label in the UI to indicate "Bing Grounded Results"?
• I have a use case for a RAG that uses only Bing Grounded Results (e.g., a chatbot for enterprise competitive insights like stocks, news, and business sites). (Maybe it's a New PR)

Given that "Bing Grounding Truth" serves as a source (IMHO), it would be ideal for this repo to allow enabling, disabling, or combining sources example:

1. Azure AI Search + Bing Grounding Truth
2. Azure AI Search only
3. Bing Grounding Truth only

[zedhaque]

FYI - there is a legal display requirement.

[rajatkofficial]

As of now, Bing Search v7 api server is not working even Microsoft folks are not responding on this issue.
{"code":"DeploymentFailed","target":"/subscriptions/XXXXXXXX/resourceGroups/bing-search/providers/Microsoft.Resources/deployments/Microsoft.BingSearch-XXXX","message":"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.","details":[{"code":"ApiSetDisabledForCreation","message":"Your account is not approved for this resource. Contact [email protected] with any questions."}]}

Microsoft has responding with this below message when contacted:
"Thanks for reaching out to us. We are evaluating our sign-up process for Bing APIs. New customers will be unable to add a Bing resource to their subscriptions. Exceptions or ETA are not available."

[rajatkofficial]

This is not working

[pamelafox]

Anthony changed this PR to use the Bing grounding API that's part of the Agents SDK, since its no longer possible to provision new Bing Search APIs. We aren't planning to merge this PR due to the complexity required by the agents SDK addition, but you can look at it to see how Anthony integrated it.