Skip to content

Disable count tokens for on device. #8961

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 13 commits into from
Closed

Disable count tokens for on device. #8961

wants to merge 13 commits into from

Conversation

gsiddh
Copy link
Contributor

@gsiddh gsiddh commented Apr 22, 2025

No description provided.

gsiddh and others added 13 commits April 15, 2025 15:35
@gsiddh
Vaihi add langmodel types. (#8927)
8319ae9 
* Adding LanguageModel types. These are based off https://github.com/webmachinelearning/prompt-api?tab=readme-ov-file#full-api-surface-in-web-idl

* Adding LanguageModel types.

* Remove bunch of exports

* yarn formatted

* after lint
@gsiddh @erikeldridge
Define HybridParams (#8935)
96e7dd5 
Co-authored-by: Erik Eldridge <[email protected]>
@gsiddh @erikeldridge
Adding smoke test for new hybrid params (#8937)
badaa74 
* Adding smoke test for new hybrid params

* Use the existing name of the model params input

---------

Co-authored-by: Erik Eldridge <[email protected]>
@gsiddh @erikeldridge
Moving to in-cloud naming (#8938)
e78c39a 
Co-authored-by: Erik Eldridge <[email protected]>
@gsiddh
Moving to string type for the inference mode (#8941)
82838c1
@gsiddh @erikeldridge
Define ChromeAdapter class (#8942)
ff364cd 
Co-authored-by: Erik Eldridge <[email protected]>
@erikeldridge
VinF Hybrid Inference: Implement ChromeAdapter (rebased) (#8943)
02c4ba7
@gsiddh
Adding count token impl (#8950)
e069751
@erikeldridge
VinF Hybrid Inference #4: ChromeAdapter in stream methods (rebased) (#…
3d7df8b 
…8949)
@erikeldridge
Define values for Availability enum (#8951)
622916c
@erikeldridge
VinF Hybrid Inference: narrow Chrome input type (#8953)
a46fa4a
@gsiddh
Add image inference support (#8954)
43a69d5 
* Adding image based input for inference

* adding image as input to create language model object
@gsiddh
disable count tokens api for on-device inference
5a0d4b1
@gsiddh gsiddh requested review from a team as code owners April 22, 2025 20:21
@changeset-bot changeset-bot
Copy link

changeset-bot bot commented Apr 22, 2025

⚠️ No Changeset found

Latest commit: 5a0d4b1

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

@gsiddh gsiddh closed this Apr 22, 2025
@github-actions GitHub Actions
Copy link
Contributor

Vertex AI Mock Responses Check ⚠️

A newer major version of the mock responses for Vertex AI unit tests is available. update_vertexai_responses.sh should be updated to clone the latest version of the responses: v10.0

@google-oss-bot
Copy link
Contributor

Size Report 1

Affected Products

  • @firebase/vertexai

    TypeBase (1363ecc)Merge (cd7178f)Diff
    browser34.7 kB39.3 kB+4.57 kB (+13.2%)
    main35.7 kB40.3 kB+4.57 kB (+12.8%)
    module34.7 kB39.3 kB+4.57 kB (+13.2%)

  • firebase

    TypeBase (1363ecc)Merge (cd7178f)Diff
    firebase-vertexai.js28.3 kB31.5 kB+3.25 kB (+11.5%)

Test Logs

  1. https://storage.googleapis.com/firebase-sdk-metric-reports/Z5zcHtutV1.html

@google-oss-bot
Copy link
Contributor

Size Analysis Report 1

This report is too large (68,271 characters) to be displayed here in a GitHub comment. Please use the below link to see the full report on Google Cloud Storage.

Test Logs

  1. https://storage.googleapis.com/firebase-sdk-metric-reports/PCBwxDqCbC.html

@firebase firebase locked and limited conversation to collaborators May 23, 2025
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@gsiddh @google-oss-bot @erikeldridge