Skip to content

feat: implemented background requests #160

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 19 commits into
base: main
Choose a base branch
from
Open

Conversation

nickytonline
Copy link
Member

@nickytonline nickytonline commented Jul 23, 2025

This pull request introduces significant updates to the codebase, primarily focusing on integrating background job management functionality, and enhancing the architecture for better state management and usability.

For testing out background mode, I've been using this prompt with o3 "Research and summarize the key differences between the top three open-source vector database solutions (such as Milvus, Qdrant, and Weaviate), including their architecture, supported features, scalability, and real-world use cases. Then, recommend the most suitable option for a SaaS platform handling millions of embeddings per day, justifying your choice."

const BACKGROUND_SUPPORTED_MODELS = [
  'gpt-4o',
  'gpt-4.1',
  'gpt-4.1-mini',
  'gpt-4.1-nano',
  'o3',
  'o4-mini',
]

Closes #71

CleanShot.2025-07-22.at.18.04.40.mp4

Copy link

netlify bot commented Jul 23, 2025

Deploy Preview for mcp-storybook ready!

Name Link
🔨 Latest commit e9599d4
🔍 Latest deploy log https://app.netlify.com/projects/mcp-storybook/deploys/6883d7829981fd00086dd265
😎 Deploy Preview https://deploy-preview-160--mcp-storybook.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@nickytonline nickytonline changed the title feat: implemented background mode feat: implemented background requests Jul 23, 2025
@nickytonline nickytonline requested a review from wasaga July 23, 2025 15:53
@nickytonline
Copy link
Member Author

One thing I noticed with this feature @wasaga, is once the background job has streamed in, whether that's just letting it all stream in initially, or loading it from the background jobs sidebar is subsequent prompts start a new background job. I think after the initial job, we can unset the background toggle, so the conversation continues. If we do that though, you'd have the oroginal background job that finished before that new prompt, and a new conversation that just continues where the original one ended. I think this is fine for the moment since we have no real storage atm. Thoughts?

@nickytonline nickytonline marked this pull request as ready for review July 25, 2025 19:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Background Requests
1 participant