-
Notifications
You must be signed in to change notification settings - Fork 19.6k
Add Distillation API to Keras #21572
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Open
divyashreepathihalli
wants to merge
37
commits into
keras-team:master
Choose a base branch
from
divyashreepathihalli:distillation-api
base: master
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
Changes from 7 commits
Commits
Show all changes
37 commits
Select commit
Hold shift + click to select a range
137a37f
initial code dump
divyashreepathihalli 8b37482
clean up the implementation of the distillation api
divyashreepathihalli 8252b8f
code reformat
divyashreepathihalli 9bdec23
final clean up
divyashreepathihalli 6efecee
pre commit
divyashreepathihalli 36930e8
Merge branch 'keras-team:master' into distillation-api
divyashreepathihalli 1f73a69
address gemini review comments
divyashreepathihalli 88c2468
address gemini review comments
divyashreepathihalli 9de5809
add a way to save trained student model
divyashreepathihalli b954718
disable tests in numpy and openvino backends
divyashreepathihalli bf6219a
pre commit
divyashreepathihalli b7e51a9
address comments
divyashreepathihalli e8229c2
address comments
divyashreepathihalli 387595a
run pre-commit
divyashreepathihalli 4d6610a
update distiller and strategies
divyashreepathihalli a109178
code reformat
divyashreepathihalli 7c13687
Merge branch 'keras-team:master' into distillation-api
divyashreepathihalli 5b6bf03
clean up
divyashreepathihalli de73fa6
code reformat
divyashreepathihalli 5cd56bf
remove multi output distiilation
divyashreepathihalli 0b2d88f
clean up after merge
divyashreepathihalli b00d4a4
Merge branch 'keras-team:master' into distillation-api
divyashreepathihalli 9d8242c
address comments
divyashreepathihalli 9c6a70c
update file names
divyashreepathihalli a7d0b54
subclass logits distillation loss from feature distillation loss
divyashreepathihalli 1607807
update docstrings
divyashreepathihalli 5659310
add validation for feature extraction setup
divyashreepathihalli d3b27b3
Fix distiller API to accept single strategy or list of strategies
divyashreepathihalli bbe0868
minor fixes
divyashreepathihalli 7775079
fix tests
divyashreepathihalli a078fb4
address reveiw comments
divyashreepathihalli e2f7f6b
oh
divyashreepathihalli a730c4a
Merge branch 'keras-team:master' into distillation-api
divyashreepathihalli ed6768f
Merge branch 'keras-team:master' into distillation-api
divyashreepathihalli 649d7f2
Merge branch 'keras-team:master' into distillation-api
divyashreepathihalli a5f4605
address review comments
divyashreepathihalli df07758
address review comments
divyashreepathihalli File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,19 @@ | ||
"""DO NOT EDIT. | ||
|
||
This file was autogenerated. Do not edit it by hand, | ||
since your modifications would be overwritten. | ||
""" | ||
|
||
from keras.src.distillation.distiller import Distiller as Distiller | ||
from keras.src.distillation.strategies import ( | ||
BaseDistillationStrategy as BaseDistillationStrategy, | ||
) | ||
from keras.src.distillation.strategies import ( | ||
FeatureDistillation as FeatureDistillation, | ||
) | ||
from keras.src.distillation.strategies import ( | ||
LogitsDistillation as LogitsDistillation, | ||
) | ||
from keras.src.distillation.strategies import ( | ||
MultiOutputDistillation as MultiOutputDistillation, | ||
) | ||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,19 @@ | ||
"""DO NOT EDIT. | ||
|
||
This file was autogenerated. Do not edit it by hand, | ||
since your modifications would be overwritten. | ||
""" | ||
|
||
from keras.src.distillation.distiller import Distiller as Distiller | ||
from keras.src.distillation.strategies import ( | ||
BaseDistillationStrategy as BaseDistillationStrategy, | ||
) | ||
from keras.src.distillation.strategies import ( | ||
FeatureDistillation as FeatureDistillation, | ||
) | ||
from keras.src.distillation.strategies import ( | ||
LogitsDistillation as LogitsDistillation, | ||
) | ||
from keras.src.distillation.strategies import ( | ||
MultiOutputDistillation as MultiOutputDistillation, | ||
) | ||
divyashreepathihalli marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
"""Distillation module for knowledge distillation in Keras.""" |
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.