Skip to content

Commit 3963529

Browse files
author
ambsd
committed
fix: Rename Sequential Offload to Memory Swap Mode with better guidance
- Rename setting to "Memory Swap Mode" for clarity - Add guidance to enable if seeing CUBLAS_STATUS_EXECUTION_FAILED errors - Helps users with 14-20GB GPUs that may hit driver issues when loading both models
1 parent 33d385c commit 3963529

File tree

1 file changed

+4
-4
lines changed

1 file changed

+4
-4
lines changed

frontend/src/components/SettingsModal.tsx

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -337,20 +337,20 @@ export function SettingsModal({
337337
</p>
338338
</div>
339339

340-
{/* Sequential Offload */}
340+
{/* Sequential Offload / Memory Swap Mode */}
341341
<div>
342-
<label className={labelClass}>Sequential Offload</label>
342+
<label className={labelClass}>Memory Swap Mode</label>
343343
<select
344344
value={settings.sequential_offload}
345345
onChange={(e) => setSettings({ ...settings, sequential_offload: e.target.value })}
346346
className={selectClass}
347347
>
348348
<option value="auto">Auto (based on VRAM)</option>
349-
<option value="true">Enabled</option>
349+
<option value="true">Force Enabled (recommended if getting CUBLAS errors)</option>
350350
<option value="false">Disabled</option>
351351
</select>
352352
<p className={`text-xs mt-1 ${darkMode ? 'text-[#6a6a6a]' : 'text-slate-400'}`}>
353-
Swaps models to fit in 12GB VRAM (adds ~70s overhead)
353+
Loads one model at a time to reduce VRAM usage. Enable if you see CUBLAS_STATUS_EXECUTION_FAILED errors.
354354
</p>
355355
</div>
356356

0 commit comments

Comments
 (0)