Skip to content

Minor Changes to configurability - Science.io Integration#848

Open
dataartist-og wants to merge 5 commits intoonnx:mainfrom
ScienceIO:dataartist-og-patch-1
Open

Minor Changes to configurability - Science.io Integration#848
dataartist-og wants to merge 5 commits intoonnx:mainfrom
ScienceIO:dataartist-og-patch-1

Conversation

@dataartist-og
Copy link
Copy Markdown

@dataartist-og dataartist-og commented Jun 10, 2022 

# DONE:
* Parse onnx model into tensorrt engine
* Allow Models larger than 2GB
* Set Builder Flags
* Set Precision Flags

# TODO:
* Start Making Threadsafe/Multiprocessing capable

@dataartist-og
Update Backend to take TRTBuilder Flags
6c7d038 
 def __init__(self, model, device,
            max_workspace_size=None, serialize_engine=False, verbose=False, fp16=False, flags=None,  **kwargs)
@dataartist-og
Add options for large pb files, serialize to disc
2f58cce 
external_data_format
engine_path
@dataartist-og
Add onnx model even with external_data_type
3dcc149
@dataartist-og
Fix model.graph call on string
c4e2a1e
@dataartist-og
Make engine module accessible
894f8b1
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@dataartist-og