⚡️ Speed up function sigmoid_stable by 232%
#568
Closed
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
📄 232% (2.32x) speedup for
sigmoid_stableincodeflash/process/infer.py⏱️ Runtime :
1.77 milliseconds→532 microseconds(best of631runs)📝 Explanation and details
Here is an optimized version of your function. The original code computes
np.exp(x)twice for thex < 0case. To optimize, we can precompute the exponent, reducing redundant computation.This computes
np.exp(-np.abs(x))once and reuses it for both cases, improving speed and efficiency for large arrays.✅ Correctness verification report:
🌀 Generated Regression Tests and Runtime
⏪ Replay Tests and Runtime
To edit these changes
git checkout codeflash/optimize-sigmoid_stable-mde2nmmjand push.