User-Provided Azure OpenAI API Credentials

[herin7]

Feature Request: User-Provided Azure OpenAI API Credentials

Overview

Currently, the application uses hardcoded Azure OpenAI credentials from environment variables. We want to implement a feature that allows users to provide their own Azure OpenAI API credentials through the frontend, which will be passed to the backend for LLM operations.

✨ Motivation

• Users may want to use their own Azure OpenAI keys instead of relying on shared credentials.
• This promotes transparency, flexibility, and improved access control.
• However, users must feel confident that their credentials will not be leaked or misused.

🔐 Security & Trust Requirements

• ✅ No logging or server-side storage of credentials.
• ✅ Credentials must be used only for the current session/request and discarded immediately after use.
• ✅ Frontend UI should clearly state that credentials are not stored or shared.
• ✅ Inputs should be securely handled via HTTPS and never exposed in localStorage or sessionStorage.
• ✅ Validate input formats and show helpful error messages if credentials are invalid.

---

Technical Requirements

Backend Changes

1. Modify the /api/chat endpoint to accept Azure OpenAI credentials in the request payload
2. Update the stream_llm_response function to use provided credentials instead of environment variables
3. Add input validation for the API credentials

@app.route('/api/chat', methods=['POST'])
async def chat():
    data = request.get_json()
    
    # New credential fields
    azure_endpoint = data.get("azureEndpoint")
    api_key = data.get("apiKey")
    deployment = data.get("deployment")
    api_version = data.get("apiVersion", "2023-05-15")
    
    # Validate credentials
    if not all([azure_endpoint, api_key, deployment]):
        return jsonify({"error": "Missing required Azure OpenAI credentials"}), 400
        
    # Rest of the existing function...

[FATEH02]

Hi @herin7 @Himanshu-Yadav-0 ,

I’d like to work on implementing this feature for User-Provided Azure OpenAI API Credentials.
I have experience with React, Node.js, API integration, and security best practices, so I can ensure both the frontend and backend handle credentials safely while keeping the UX smooth.

My plan:

Frontend
Create a form for users to input Azure Endpoint, API Key, Deployment, and API Version
Add inline validation
Mask API key input with toggle visibility.
Display a trust statement (“Credentials are used only for this session and not stored”).

Backend
Modify /api/chat endpoint to accept credentials from request payload.
Update stream_llm_response to use provided credentials instead of environment variables.
Implement server-side validation and reject incomplete/invalid inputs.
Ensure credentials are not logged or stored in memory beyond request lifecycle.

Testing
Test with valid/invalid credentials to ensure proper error handling.
Verify no credentials appear in logs or browser storage.

If this sounds good, please assign me the issue and I can start working on it.

Thanks!

[herin7]

do test properly & make sure to add video whenever u create a PR

[FATEH02]

@herin7 i am not able to create my own azure openai credentials the locations are not allowed in student plan is there anything i can do about it

[herin7]

try changing locations
some will work,
Else try to arrange Azure Startup Creds