Skip to content

[Feature] Add streaming ability in chat page using Azure SignalR service #383

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 16 commits into from
Jan 13, 2025
Merged

[Feature] Add streaming ability in chat page using Azure SignalR service #383

Show file tree
Hide file tree
Changes from 11 commits
Commits
Show all changes
16 commits
Select commit Hold shift + click to select a range
58f6724
First working version
phanthaiduong22 Nov 23, 2024
10d3c21
message type
phanthaiduong22 Nov 23, 2024
bbac342
distinguish type
phanthaiduong22 Nov 23, 2024
71d6bb3
Display followup questions
phanthaiduong22 Nov 24, 2024
55ea9c7
citationUrl
phanthaiduong22 Nov 24, 2024
21c046d
Remove logger
phanthaiduong22 Nov 24, 2024
764c5c4
isStream default true
phanthaiduong22 Nov 24, 2024
f632049
signalr bicep
phanthaiduong22 Nov 25, 2024
c1360ff
rollback replyAsync
phanthaiduong22 Nov 25, 2024
ab4ccdb
rollback chat.razor
phanthaiduong22 Nov 25, 2024
331181f
small fix: log
phanthaiduong22 Nov 25, 2024
798224a
resolve revies
phanthaiduong22 Nov 25, 2024
c5a36ee
resolve review
phanthaiduong22 Nov 25, 2024
d58652d
fix test
phanthaiduong22 Dec 10, 2024
1137cdd
Update README
phanthaiduong22 Dec 10, 2024
11935f3
Update infra/main.bicep
phanthaiduong22 Dec 16, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions app/Directory.Packages.props
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -52,5 +52,7 @@
<PackageVersion Include="xunit" Version="2.9.0" />
<PackageVersion Include="FluentAssertions" Version="6.12.0" />
<PackageVersion Include="NSubstitute" Version="5.1.0" />
<PackageVersion Include="Microsoft.Azure.SignalR" Version="1.27.0" />
<PackageVersion Include="Microsoft.AspNetCore.SignalR.Client" Version="8.0.8" />
</ItemGroup>
</Project>
4 changes: 2 additions & 2 deletions app/SharedWebComponents/Components/Answer.razor
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -28,11 +28,11 @@
}
</div>
}
@if (answer is { FollowupQuestions.Count: > 0 })
@if (Retort?.Context?.FollowupQuestions is { Length: > 0 })
{
<div class="pt-4">
<MudText Typo="Typo.subtitle2" Class="pb-2">Follow-up questions:</MudText>
@foreach (var followup in answer.FollowupQuestions)
@foreach (var followup in Retort.Context.FollowupQuestions)
{
<MudChip Variant="Variant.Text" Color="Color.Tertiary"
OnClick="@(_ => OnAskFollowupAsync(followup))">
Expand Down
4 changes: 4 additions & 0 deletions app/SharedWebComponents/Components/SettingsPanel.razor
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -41,6 +41,10 @@
Color="Color.Primary"
Label="Use query-contextual summaries instead of whole documents" />

<MudCheckBox @bind-Checked="@Settings.Overrides.UseStreaming" Size="Size.Large"
Color="Color.Primary"
Label="Use streaming responses" />

<MudCheckBox @bind-Checked="@Settings.Overrides.SuggestFollowupQuestions" Size="Size.Large"
Color="Color.Primary" Label="Suggest follow-up questions"
aria-label="Suggest follow-up questions checkbox." />
Expand Down
4 changes: 4 additions & 0 deletions app/SharedWebComponents/Pages/Chat.razor
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -88,6 +88,10 @@
OnClick="@OnClearChat" Disabled=@(_isReceivingResponse || _questionAndAnswerMap is { Count: 0 }) />
</MudTooltip>
</MudItem>
<MudItem xs="12" Class="pa-2">
<MudCheckBox @bind-Checked="_useStreaming" Label="Use streaming mode" Color="Color.Secondary"
Disabled="@_isReceivingResponse" />
</MudItem>
</MudGrid>
</MudItem>
</MudGrid>
Expand Down
Loading