Class MiddlewareStreamingAgent
public class MiddlewareStreamingAgent : IMiddlewareStreamAgent, IStreamingAgent, IAgent, IAgentMetaInformation
- Inheritance
-
Middleware
Streaming Agent
- Implements
- Derived
- Inherited Members
- Extension Methods
Constructors
MiddlewareStreamingAgent(IStreamingAgent, string?, IEnumerable<IStreamingMiddleware>?)
public MiddlewareStreamingAgent(IStreamingAgent agent, string? name = null, IEnumerable<IStreamingMiddleware>? streamingMiddlewares = null)
Parameters
agent
IStreamingAgent name
stringstreamingMiddlewares
IEnumerable<IStreamingMiddleware >
Properties
Name
Property Value
StreamingAgent
Get the inner agent.
Property Value
StreamingMiddlewares
Get the streaming middlewares.
Property Value
Methods
GenerateReplyAsync(IEnumerable<IMessage>, GenerateReplyOptions?, CancellationToken)
Generate reply
public Task<IMessage> GenerateReplyAsync(IEnumerable<IMessage> messages, GenerateReplyOptions? options = null, CancellationToken cancellationToken = default)
Parameters
messages
IEnumerable<IMessage>conversation history
options
GenerateReply Options completion option. If provided, it should override existing option if there's any
cancellationToken
CancellationToken
Returns
GenerateStreamingReplyAsync(IEnumerable<IMessage>, GenerateReplyOptions?, CancellationToken)
public IAsyncEnumerable<IMessage> GenerateStreamingReplyAsync(IEnumerable<IMessage> messages, GenerateReplyOptions? options = null, CancellationToken cancellationToken = default)
Parameters
messages
IEnumerable<IMessage>options
GenerateReply Options cancellationToken
CancellationToken
Returns
UseStreaming(IStreamingMiddleware)
Parameters
middleware
IStreamingMiddleware