Simplify the build #1306
Closed
Simplify the build #1306
+2
−0
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Printing the message as string is a very common use case. Make it super simple.
If there is image / audio output in the future, then the toString() of them is something like: `Content(AudioFile("/path/to/file"))`
LiteRT-LM-PiperOrigin-RevId: 829877174
Extends the `Message.of(content)` to `Message.of(content1, content2, content3, ...)`. It still works with only one content. LiteRT-LM-PiperOrigin-RevId: 830494523
Apple devices perform better with Buffers. LiteRT-LM-PiperOrigin-RevId: 830924175
Add `__declspec(dllexport)` when building for Windows so the .dll has the exported symbols. https://learn.microsoft.com/en-us/cpp/cpp/using-dllimport-and-dllexport-in-cpp-classes LiteRT-LM-PiperOrigin-RevId: 830991930
See Main.kt :-) This `Flow` approach is also faster than the callback approach because it does not wait for the `onMessage()` logic. LiteRT-LM-PiperOrigin-RevId: 831131771
LiteRT-LM-PiperOrigin-RevId: 831181727
LiteRT-LM-PiperOrigin-RevId: 831194431
Used Options::GetGpuOptions(). The new Create() method takes non-const reference to Options object. LiteRT-LM-PiperOrigin-RevId: 831216121
LiteRT-LM-PiperOrigin-RevId: 831627364
LiteRT-LM-PiperOrigin-RevId: 831637934
LiteRT-LM-PiperOrigin-RevId: 831948857
The new API doesn't require Model but create it internally with model_filename or model_buffer. Also users can get Signature from CompiledModel directly. LiteRT-LM-PiperOrigin-RevId: 832038920
LiteRT-LM-PiperOrigin-RevId: 832039059
LiteRT-LM-PiperOrigin-RevId: 832310477
… cache directory settings to LiteRT-LM C LiteRT-LM-PiperOrigin-RevId: 832381402
LiteRT-LM-PiperOrigin-RevId: 832406710
LiteRT-LM-PiperOrigin-RevId: 832460497
…thod returns null. LiteRT-LM-PiperOrigin-RevId: 832500201
…edHostMemory when environment is not needed. LiteRT-LM-PiperOrigin-RevId: 832519936
- Add sample code for a chat app and animation demo. And a Bazel command to quickly try it. - Mention JVM support, in additional to the original Android support. LiteRT-LM-PiperOrigin-RevId: 832701364
LiteRT-LM-PiperOrigin-RevId: 833396367
LiteRT-LM-PiperOrigin-RevId: 833463714
LiteRT-LM-PiperOrigin-RevId: 833478076
LiteRT-LM-PiperOrigin-RevId: 833506687
LiteRT-LM-PiperOrigin-RevId: 833507319
LiteRT-LM-PiperOrigin-RevId: 833601215
LiteRT-LM-PiperOrigin-RevId: 833667085
LiteRT-LM-PiperOrigin-RevId: 834046687
LiteRT-LM-PiperOrigin-RevId: 834334805
LiteRT-LM-PiperOrigin-RevId: 834346395
LiteRT-LM-PiperOrigin-RevId: 860170788
LiteRT-LM-PiperOrigin-RevId: 860216677
LiteRT-LM-PiperOrigin-RevId: 860278850
We will remove the `--hk_token`. The environment is the only way to set the token. LiteRT-LM-PiperOrigin-RevId: 860319701
LiteRT-LM-PiperOrigin-RevId: 860320494
LiteRT-LM-PiperOrigin-RevId: 860635677
- Add TensorBuffer Clear method - Replace @local_xla with @xla LiteRT-LM-PiperOrigin-RevId: 860680613
LiteRT-LM-PiperOrigin-RevId: 861221697
This is similar to the existing weight cache support that XNNPack uses. LiteRT-LM-PiperOrigin-RevId: 861245691
…ternal constraints and LLGuidance. LiteRT-LM-PiperOrigin-RevId: 861255750
…bled by checking whether there is corresponding `is_appending_to_prefill` in the jinja template. Templates with such capability can support multi-prefill. LiteRT-LM-PiperOrigin-RevId: 861409419
LiteRT-LM-PiperOrigin-RevId: 861449983
LiteRT-LM-PiperOrigin-RevId: 861460877
* Use LFS (Large File Storage) to prebuilt binaries * Enable LFS in workflows
…aries LiteRT-LM-PiperOrigin-RevId: 861722316
LiteRT-LM-PiperOrigin-RevId: 861900632
… interface LiteRT-LM-PiperOrigin-RevId: 861900719
LiteRT-LM-PiperOrigin-RevId: 861915621
… prefill for Conversation API Add ModelDataProcessor::RenderSingleTurnTemplate method to enable model-specific single turn template rendering Refactor: Consolidate optional arguments in Conversation::OptionalArgs. LiteRT-LM-PiperOrigin-RevId: 861915646
LiteRT-LM-PiperOrigin-RevId: 861919994
LiteRT-LM-PiperOrigin-RevId: 861936534
…rsions. LiteRT-LM-PiperOrigin-RevId: 861944789
LiteRT-LM-PiperOrigin-RevId: 861951627
LiteRT-LM-PiperOrigin-RevId: 862068350
copybara-service
bot
force-pushed
the
litert_lm_pr_862068350
branch
from
10779ec to
a2b6ddf
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
14 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Simplify the build