feat: FastAPI integration for In_Process Mode (2/2)#4808

Merged

benieric merged 90 commits intoaws:masterfrom

bryannahm1:fastapi-inprocess

Aug 22, 2024

Commits on Jun 26, 2024

InferenceSpec support for HF
Bryannah Hernandez
committed

Commits on Jun 27, 2024

Merge branch 'aws:master' into hf-inf-spec-support
bryannahm1
authored
feat: InferenceSpec support for MMS and testing
Bryannah Hernandez
committed

Commits on Jun 29, 2024

Introduce changes for InProcess Mode
Bryannah Hernandez
committed

Commits on Jul 3, 2024

mb_inprocess updates
Bryannah Hernandez
committed

Commits on Jul 8, 2024

In_Process mode for TGI transformers, edits
Bryannah Hernandez
committed
Remove InfSpec from branch
Bryannah Hernandez
committed

Commits on Jul 12, 2024

merge from master for inf spec
Bryannah Hernandez
committed

Commits on Jul 13, 2024

changes to support in_process
Bryannah Hernandez
committed

Commits on Jul 15, 2024

changes to get pre-checks passing
Bryannah Hernandez
committed
pylint fix
Bryannah Hernandez
committed
unit test, test mb
Bryannah Hernandez
committed
period missing, added
Bryannah Hernandez
committed

Commits on Jul 16, 2024

suggestions and test added
Bryannah Hernandez
committed
pre-push fix
Bryannah Hernandez
committed
missing an @
Bryannah Hernandez
committed

Commits on Jul 17, 2024

fixes to test, added stubbing
Bryannah Hernandez
committed
removing for fixes
Bryannah Hernandez
committed
variable fixes
Bryannah Hernandez
committed
init fix
Bryannah Hernandez
committed

Commits on Jul 18, 2024

tests for in process mode
Bryannah Hernandez
committed
prepush fix
Bryannah Hernandez
committed
FastAPI with In_Process
Bryannah Hernandez
committed
minor fixes
Bryannah Hernandez
committed

Commits on Jul 19, 2024

putting 6 args
Bryannah Hernandez
committed

Commits on Jul 23, 2024

server change
Bryannah Hernandez
committed
changes
Bryannah Hernandez
committed
format fix
Bryannah Hernandez
committed

Commits on Jul 24, 2024

fastapi fixes
Bryannah Hernandez
committed
port
Bryannah Hernandez
committed
start
Bryannah Hernandez
committed

Commits on Jul 28, 2024

changing port
Bryannah Hernandez
committed
prepush
Bryannah Hernandez
committed
import and unused fix
Bryannah Hernandez
committed

Commits on Jul 31, 2024

moving files and transformers
Bryannah Hernandez
committed

Commits on Aug 1, 2024

fix imports
Bryannah Hernandez
committed
changes
Bryannah Hernandez
committed
fixing modules
Bryannah Hernandez
committed
placement
Bryannah Hernandez
committed

Commits on Aug 2, 2024

dep fixes
Bryannah Hernandez
committed

Commits on Aug 6, 2024

Merge branch 'master' into fastapi-inprocess
bryannahm1
authored
minor change
Bryannah Hernandez
committed
Merge branch 'fastapi-inprocess' of https://github.com/bryannahm1/sagemaker-python-sdk into fastapi-inprocess
Bryannah Hernandez
committed
fastapi predictor fix
Bryannah Hernandez
committed

Commits on Aug 7, 2024

minor changes
Bryannah Hernandez
committed
import transformers
Bryannah Hernandez
committed
pylint comment
Bryannah Hernandez
committed
delete local_run.sh
Bryannah Hernandez
committed
format
Bryannah Hernandez
committed

Commits on Aug 8, 2024

fix
Bryannah Hernandez
committed
uvicorn fix
Bryannah Hernandez
committed
fastapi
Bryannah Hernandez
committed
try and except
Bryannah Hernandez
committed
Merge branch 'master' into fastapi-inprocess
sage-maker
authored
Merge branch 'master' into fastapi-inprocess
sage-maker
authored
app
Bryannah Hernandez
committed
merge
Bryannah Hernandez
committed
Merge branch 'master' into fastapi-inprocess
sage-maker
authored
Merge branch 'master' into fastapi-inprocess
sage-maker
authored

Commits on Aug 9, 2024

Merge branch 'master' into fastapi-inprocess
sage-maker
authored

Commits on Aug 12, 2024

deps comment out
Bryannah Hernandez
committed
Merge branch 'master' into fastapi-inprocess
bryannahm1
authored
app func fix
Bryannah Hernandez
committed
merge
Bryannah Hernandez
committed
deps
Bryannah Hernandez
committed
fix
Bryannah Hernandez
committed
test fix
Bryannah Hernandez
committed
non object
Bryannah Hernandez
committed
comment out test for in_process
Bryannah Hernandez
committed

Commits on Aug 13, 2024

removing unnecessary loggers
Bryannah Hernandez
committed
fixing UT
Bryannah Hernandez
committed

Commits on Aug 14, 2024

clean up loggers
Bryannah Hernandez
committed
Update in_process_mode.py
makungaj1
authored

Commits on Aug 15, 2024

In Process Mode
Jonathan Makunga
committed
workers flags not needed when reload is set to true.
Jonathan Makunga
committed
Refactore
Jonathan Makunga
committed
Merge pull request #1 from makungaj1/patch-1
makungaj1
authored
wheel
Bryannah Hernandez
committed

Commits on Aug 16, 2024

minor changes
Bryannah Hernandez
committed
merge
Bryannah Hernandez
committed
delete whl
Bryannah Hernandez
committed
Merge branch 'master' into fastapi-inprocess
makungaj1
authored

Commits on Aug 20, 2024

ut for app.py
Bryannah Hernandez
committed

Commits on Aug 21, 2024

unit test fir app
Bryannah Hernandez
committed
merge
Bryannah Hernandez
committed
more unit tests
Bryannah Hernandez
committed
py310 and higher
Bryannah Hernandez
committed

Commits on Aug 22, 2024

Merge branch 'master' into fastapi-inprocess
benieric
authored
delete whl file
Bryannah Hernandez
committed
Merge branch 'fastapi-inprocess' of https://github.com/bryannahm1/sagemaker-python-sdk into fastapi-inprocess
Bryannah Hernandez
committed