Update protobuf definitions and endpoints to use current official client ones.

[sashahilton00]

Over the course of the past few years, Spotify has updated it's protobufs several times, along with its endpoints. This was to be expected as they continued to add functionality, nonetheless librespot is now pretty significantly diverged from the protobuf definitions that are in use in the official clients, and possibly at higher risk of experiencing issues with endpoints being depreciated at short notice, such as the recent issues Facebook login flow (admittedly not due to protobuf definition issues though).

Furthermore, newer functionality such as canvas, context management, streaming groups, etc. is implemented in the newer proto3 definitions, attached below.

Given that Spotify is slowly standardising to HTTP/Websockets/GRPC transports, and moving away from Hermes, it may be good for this project in the long run if we were to try to follow suit. To this end, further reverse engineering of the current endpoints that are in use will need to be carried out, and the existing code updated where necessary. As a side effect of this, my gut tells me that a number of the smaller issues/feature requests (eg. repeat functionality only partially working, more 'spotify-like' normalization, etc.) will be easier to implement once we are using their up to date APIs.

I will start investigating when I get some free time, and add to this comment accordingly with any findings that I turn up. Anyone else is also invited to crack out spotify-dissect and start digging through the network traffic. If the log of notes starts to become unwieldy we can always form some sort of to-do list or stick the information in a wiki page temporarily.

The latest protobufs: spotify_protobufs.zip

[Johannesd3]

One note: The best gRPC library in Rust is probably tonic (from the tokio stack). It uses prost instead of protobuf, so it might be better to switch.

[xou816]

Never done that so I can't promise I can help, but I might give it a try, it sounds interesting! Is there a place where you (and others) will be uploading your findings?

[sashahilton00]

Ok, so what I'm going to do is dedicate a comment to each endpoint that I reverse. I'll attach screenshots of the decoded protobufs (request/response) where it may be helpful, and reference the endpoint, along with the proto definitions.

The proto files I'm using I extracted earlier, available here.

The proto descriptor is useful for anyone looking to do their own poking around, uploaded here. Alternatively, you can compile if from the proto definitions above using a variant of the command:

protoc --descriptor_set_out=descriptor.desc **/*.proto *.proto

[sashahilton00]

Extended Metadata Endpoint (Protobuf)

Endpoint: https://spclient.wg.spotify.com/extended-metadata/v0/extended-metadata

Proto definitions (refer to extended_metadata.proto):

• Request: spotify.extendedmetadata.BatchedEntityRequest. It may also accept spotify.extendedmetadata.EntityRequest, but untested.
• Response: spotify.extendedmetadata.BatchedExtensionResponse.

Decoded Request Screenshot

Decoded Response Screenshot

[sashahilton00]

User Customisation Endpoint (Protobuf)

Endpoint: https://spclient.wg.spotify.com/extended-metadata/v0/extended-metadata

Proto definitions (refer to ucs.proto (user customisation service)):

• Request: spotify.remote_config.ucs.proto.UcsRequest.
• Response: spotify.remote_config.ucs.proto.UcsResponseWrapper.

Notes

I didn't think much of ths endpoint initially, it seemed to just be a bunch of A/B test flags, but on closer inspection, it appears to carry a bunch of possibly useful information. Besides feature flags (one of which is Spotify HiFi), it has buffer parameters, prefetch configuration, account status and permissions, api base urls, etc. Instead of a screenshot, I've posted the request/response json below (converted from protobuf)
@roderickvd loudness-levels might be interesting for you. There's also some other related stuff.

Request Payload

caller_info {
  request_origin_id: "desktop"
  request_orgin_version: "1.1.58.820"
  reason: "BACKGROUND_SYNC"
}
resolve_request {
  property_set_id: "762...cd5"
  fetch_type {
    type: BACKGROUND_SYNC
  }
  context {
    context {
      known_context: KNOWN_CONTEXT_INSTALLATION_ID
      value: "188...706"
    }
    context {
      known_context: KNOWN_CONTEXT_VERSION
      value: "1.1.58.820"
    }
  }
}
account_attributes_request {
}

Response Payload

success {
  resolve_success {
    configuration {
      configuration_assignment_id: "3f3...da3"
      fetch_time_millis: 1620515556953
      assigned_values {
        property_id {
          scope: "core-metadata-feature"
          name: "metadata_over_exts_rollout"
        }
        metadata {
          policy_id: 12959
          external_realm: "exp-planner"
          external_realm_id: 312886
        }
        enum_value {
          value: "EnabledWithMercury"
        }
      }
      assigned_values {
        property_id {
          scope: "core-player"
          name: "injection_enabled"
        }
        metadata {
          policy_id: 7669
          external_realm: "exp-planner"
          external_realm_id: 29993
        }
        enum_value {
          value: "Enabled"
        }
      }
      assigned_values {
        property_id {
          scope: "core-collection-feature"
          name: "injection_offline_enabled"
        }
        metadata {
          policy_id: 7669
          external_realm: "exp-planner"
          external_realm_id: 29993
        }
        bool_value {
          value: true
        }
      }
      assigned_values {
        property_id {
          scope: "core-playlist-feature"
          name: "injection_offline_enabled"
        }
        metadata {
          policy_id: 7669
          external_realm: "exp-planner"
          external_realm_id: 29993
        }
        bool_value {
          value: true
        }
      }
      assigned_values {
        property_id {
          scope: "core-connect-feature"
          name: "connect_dial_wol_enabled"
        }
        metadata {
          policy_id: 8302
          external_realm: "exp-planner"
          external_realm_id: 31258
        }
        bool_value {
          value: true
        }
      }
      assigned_values {
        property_id {
          scope: "core-connect-feature"
          name: "connect_use_injected_http_dial"
        }
        metadata {
          policy_id: 8484
          external_realm: "exp-planner"
          external_realm_id: 31953
        }
        bool_value {
        }
      }
      assigned_values {
        property_id {
          scope: "core-player-feature"
          name: "context_resolve_connectivity"
        }
        metadata {
          policy_id: 8596
          external_realm: "exp-planner"
          external_realm_id: 32404
        }
        enum_value {
          value: "WebGate"
        }
      }
      assigned_values {
        property_id {
          scope: "core-connect-feature"
          name: "show_offline_devices_in_core"
        }
        metadata {
          policy_id: 9128
          external_realm: "exp-planner"
          external_realm_id: 33532
        }
        bool_value {
          value: true
        }
      }
      assigned_values {
        property_id {
          scope: "core-connect-feature"
          name: "connect_ios_mdns_discovery"
        }
        metadata {
          policy_id: 9591
          external_realm: "exp-planner"
          external_realm_id: 9521
        }
        enum_value {
          value: "Combined"
        }
      }
      assigned_values {
        property_id {
          scope: "core-connect-feature"
          name: "connect_device_capabilities_required"
        }
        metadata {
          policy_id: 9595
          external_realm: "exp-planner"
          external_realm_id: 12678
        }
        bool_value {
        }
      }
      assigned_values {
        property_id {
          scope: "core-connect-feature"
          name: "allow_mft_to_mft_transfers"
        }
        metadata {
          policy_id: 9596
          external_realm: "exp-planner"
          external_realm_id: 12680
        }
        bool_value {
        }
      }
      assigned_values {
        property_id {
          scope: "core-connect-feature"
          name: "transfer_blob_enabled"
        }
        metadata {
          policy_id: 9774
          external_realm: "exp-planner"
          external_realm_id: 11016
        }
        bool_value {
          value: true
        }
      }
      assigned_values {
        property_id {
          scope: "client-desktop-shell"
          name: "enable_cpu_load_monitoring"
        }
        metadata {
          policy_id: 9838
          external_realm: "exp-planner"
          external_realm_id: 13159
        }
        bool_value {
        }
      }
      assigned_values {
        property_id {
          scope: "client-desktop-shell"
          name: "enable_device_info_logging_videocapture"
        }
        metadata {
          policy_id: 9839
          external_realm: "exp-planner"
          external_realm_id: 13161
        }
        bool_value {
        }
      }
      assigned_values {
        property_id {
          scope: "client-desktop-shell"
          name: "enable_device_info_logging"
        }
        metadata {
          policy_id: 9840
          external_realm: "exp-planner"
          external_realm_id: 13163
        }
        bool_value {
        }
      }
      assigned_values {
        property_id {
          scope: "core-player-feature"
          name: "affinity_connectivity"
        }
        metadata {
          policy_id: 10016
          external_realm: "exp-planner"
          external_realm_id: 34622
        }
        enum_value {
          value: "WebGate"
        }
      }
      assigned_values {
        property_id {
          scope: "core-player"
          name: "enable_kittehbox"
        }
        metadata {
          policy_id: 10154
          external_realm: "exp-planner"
          external_realm_id: 13532
        }
        bool_value {
          value: true
        }
      }
      assigned_values {
        property_id {
          scope: "core-perf-metrics-feature"
          name: "should_flush_request_accounting_on_cold_startup"
        }
        metadata {
          policy_id: 10424
          external_realm: "exp-planner"
          external_realm_id: 9628
        }
        bool_value {
          value: true
        }
      }
      assigned_values {
        property_id {
          scope: "client-desktop-client-updates"
          name: "enable_updates_over_webgate"
        }
        metadata {
          policy_id: 10459
          external_realm: "exp-planner"
          external_realm_id: 10143
        }
        bool_value {
          value: true
        }
      }
      assigned_values {
        property_id {
          scope: "client-desktop-cast"
          name: "enable_cast_discovery"
        }
        metadata {
          policy_id: 10579
          external_realm: "exp-planner"
          external_realm_id: 11967
        }
        bool_value {
          value: true
        }
      }
      assigned_values {
        property_id {
          scope: "client-desktop-shell"
          name: "show_offline_menu_option"
        }
        metadata {
          policy_id: 10590
          external_realm: "exp-planner"
          external_realm_id: 12287
        }
        bool_value {
          value: true
        }
      }
      assigned_values {
        property_id {
          scope: "core-player"
          name: "enable_vodcast_video"
        }
        metadata {
          policy_id: 10629
          external_realm: "exp-planner"
          external_realm_id: 12728
        }
        bool_value {
          value: true
        }
      }
      assigned_values {
        property_id {
          scope: "client-desktop-client-updates"
          name: "enable_win32_background_updates"
        }
        metadata {
          policy_id: 10643
          external_realm: "exp-planner"
          external_realm_id: 12919
        }
        bool_value {
        }
      }
      assigned_values {
        property_id {
          scope: "client-desktop-memusage"
          name: "enable_mem_load_monitoring"
        }
        metadata {
          policy_id: 10651
          external_realm: "exp-planner"
          external_realm_id: 13031
        }
        bool_value {
        }
      }
      assigned_values {
        property_id {
          scope: "core-ads"
          name: "event_sender_for_ad_event"
        }
        metadata {
          policy_id: 11081
          external_realm: "exp-planner"
          external_realm_id: 35755
        }
        bool_value {
          value: true
        }
      }
      assigned_values {
        property_id {
          scope: "core-connect-feature"
          name: "connect_strip_player_states"
        }
        metadata {
          policy_id: 11383
          external_realm: "exp-planner"
          external_realm_id: 28418
        }
        bool_value {
          value: true
        }
      }
      assigned_values {
        property_id {
          scope: "core-facebook"
          name: "facebook_http_enable"
        }
        metadata {
          policy_id: 11502
          external_realm: "exp-planner"
          external_realm_id: 329256
        }
        bool_value {
          value: true
        }
      }
      assigned_values {
        property_id {
          scope: "core-player-feature"
          name: "voice_context_connectivity"
        }
        metadata {
          policy_id: 11558
          external_realm: "exp-planner"
          external_realm_id: 329473
        }
        enum_value {
          value: "WebGate"
        }
      }
      assigned_values {
        property_id {
          scope: "client-desktop-shell"
          name: "use_event_persistence"
        }
        metadata {
          policy_id: 11750
          external_realm: "exp-planner"
          external_realm_id: 330327
        }
        bool_value {
        }
      }
      assigned_values {
        property_id {
          scope: "core-connect-feature"
          name: "set_server_time_from_connect"
        }
        metadata {
          policy_id: 12253
          external_realm: "exp-planner"
          external_realm_id: 332474
        }
        bool_value {
          value: true
        }
      }
      assigned_values {
        property_id {
          scope: "core-offline"
          name: "offline2_over_http"
        }
        metadata {
          policy_id: 12274
          external_realm: "exp-planner"
          external_realm_id: 332752
        }
        bool_value {
          value: true
        }
      }
      assigned_values {
        property_id {
          scope: "client-desktop-shell"
          name: "useCrossPlatformUIv2"
        }
        metadata {
          policy_id: 12365
          external_realm: "exp-planner"
          external_realm_id: 333070
        }
        bool_value {
          value: true
        }
      }
      assigned_values {
        property_id {
          scope: "core-connectivity-sdk"
          name: "product_state_write_to_client_settings"
        }
        metadata {
          policy_id: 12413
          external_realm: "exp-planner"
          external_realm_id: 333186
        }
        bool_value {
          value: true
        }
      }
      assigned_values {
        property_id {
          scope: "core-audio-track-player-feature"
          name: "enable_stereo_to_mono_downmixer"
        }
        metadata {
          policy_id: 12723
          external_realm: "exp-planner"
          external_realm_id: 333409
        }
        bool_value {
          value: true
        }
      }
      assigned_values {
        property_id {
          scope: "core-podcast-ads-feature"
          name: "enable_podcast_ad_segments_metadata"
        }
        metadata {
          policy_id: 13111
          external_realm: "exp-planner"
          external_realm_id: 311766
        }
        bool_value {
          value: true
        }
      }
      assigned_values {
        property_id {
          scope: "core-played-state"
          name: "enable_periodic_post_to_backend"
        }
        metadata {
          policy_id: 13160
          external_realm: "exp-planner"
          external_realm_id: 1000456
        }
        bool_value {
          value: true
        }
      }
      assigned_values {
        property_id {
          scope: "core-media-parsers-feature"
          name: "use_platform_media_parser_windows"
        }
        metadata {
          policy_id: 13481
          external_realm: "exp-planner"
          external_realm_id: 1001026
        }
        bool_value {
          value: true
        }
      }
      assigned_values {
        property_id {
          scope: "core-player"
          name: "enable_automix_rules"
        }
        metadata {
          policy_id: 13746
          external_realm: "exp-planner"
          external_realm_id: 1003513
        }
        bool_value {
        }
      }
      assigned_values {
        property_id {
          scope: "core-collection-feature"
          name: "core_use_collection2_for_artists"
        }
        metadata {
          policy_id: 13748
          external_realm: "exp-planner"
          external_realm_id: 1000239
        }
        bool_value {
        }
      }
      assigned_values {
        property_id {
          scope: "core-playlist-feature"
          name: "playlist_sync_events_logging_level"
        }
        metadata {
          policy_id: 14008
          external_realm: "exp-planner"
          external_realm_id: 1004493
        }
        enum_value {
          value: "Error"
        }
      }
      assigned_values {
        property_id {
          scope: "core-context-track-exts"
          name: "enable_podcast_poll"
        }
        metadata {
          policy_id: 14219
          external_realm: "exp-planner"
          external_realm_id: 1004412
        }
        bool_value {
          value: true
        }
      }
    }
  }
  account_attributes_success {
    account_attributes {
      key: "remote-control"
      value {
        string_value: "6"
      }
    }
    account_attributes {
      key: "publish-activity"
      value {
        string_value: "0"
      }
    }
    account_attributes {
      key: "audio-preview-url-template"
      value {
        string_value: "https://p.scdn.co/mp3-preview/{id}"
      }
    }
    account_attributes {
      key: "incognito_mode_timeout"
      value {
        long_value: 21600
      }
    }
    account_attributes {
      key: "ad-formats-preroll-video"
      value {
        bool_value: false
      }
    }
    account_attributes {
      key: "type"
      value {
        string_value: "premium"
      }
    }
    account_attributes {
      key: "ab_recently_played_feature_time_filter_threshold"
      value {
        string_value: "com.spotify.gaia=30,driving-mode=120,spotify%3Ainternal%3Astartpage=30"
      }
    }
    account_attributes {
      key: "license-agreements"
      value {
        string_value: ""
      }
    }
    account_attributes {
      key: "publish-playlist"
      value {
        bool_value: false
      }
    }
    account_attributes {
      key: "buffering-strategy"
      value {
        string_value: "0"
      }
    }
    account_attributes {
      key: "expiry"
      value {
        bool_value: true
      }
    }
    account_attributes {
      key: "ab-desktop-hide-follow"
      value {
        bool_value: false
      }
    }
    account_attributes {
      key: "ab-collection-hide-unavailable-albums"
      value {
        bool_value: false
      }
    }
    account_attributes {
      key: "payments-initial-campaign"
      value {
        string_value: "web"
      }
    }
    account_attributes {
      key: "capper-profile"
      value {
        string_value: ""
      }
    }
    account_attributes {
      key: "profile-image-upload"
      value {
        string_value: "1"
      }
    }
    account_attributes {
      key: "enable-annotations"
      value {
        string_value: "2"
      }
    }
    account_attributes {
      key: "ab-ad-player-targeting"
      value {
        bool_value: true
      }
    }
    account_attributes {
      key: "india-experience"
      value {
        string_value: "0"
      }
    }
    account_attributes {
      key: "video-wifi-initial-bitrate"
      value {
        long_value: 800000
      }
    }
    account_attributes {
      key: "ab-mobile-running-onlymanualmode"
      value {
        string_value: "only-manual"
      }
    }
    account_attributes {
      key: "playlist-annotations-markup"
      value {
        bool_value: false
      }
    }
    account_attributes {
      key: "prefetch-keys"
      value {
        string_value: "1"
      }
    }
    account_attributes {
      key: "allow-override-internal-prefs"
      value {
        bool_value: false
      }
    }
    account_attributes {
      key: "prefetch-window-max"
      value {
        long_value: 2
      }
    }
    account_attributes {
      key: "send-email"
      value {
        bool_value: false
      }
    }
    account_attributes {
      key: "ad-formats-video-takeover"
      value {
        bool_value: true
      }
    }
    account_attributes {
      key: "npt-disabled"
      value {
        string_value: "2"
      }
    }
    account_attributes {
      key: "ab-collection-bookmark-model"
      value {
        bool_value: true
      }
    }
    account_attributes {
      key: "pause-after"
      value {
        long_value: 0
      }
    }
    account_attributes {
      key: "local-files-import"
      value {
        string_value: "0"
      }
    }
    account_attributes {
      key: "video-manifest-url"
      value {
        string_value: "https://spclient.wg.spotify.com/manifests/v6/{type}/sources/{source_id}/options/supports_drm"
      }
    }
    account_attributes {
      key: "playlist-folders"
      value {
        bool_value: true
      }
    }
    account_attributes {
      key: "ab-sugarpills-sanity-check"
      value {
        string_value: "0"
      }
    }
    account_attributes {
      key: "arsenal_country"
      value {
        bool_value: true
      }
    }
    account_attributes {
      key: "track-cap"
      value {
        bool_value: false
      }
    }
    account_attributes {
      key: "ab-mobile-running-tempo-detection"
      value {
        string_value: "Control"
      }
    }
    account_attributes {
      key: "shows-collection"
      value {
        bool_value: true
      }
    }
    account_attributes {
      key: "is_email_verified"
      value {
        bool_value: true
      }
    }
    account_attributes {
      key: "enable-annotations-read"
      value {
        bool_value: false
      }
    }
    account_attributes {
      key: "addon-hifi"
      value {
        bool_value: false
      }
    }
    account_attributes {
      key: "mobile-browse"
      value {
        bool_value: false
      }
    }
    account_attributes {
      key: "payments-locked-state"
      value {
        bool_value: false
      }
    }
    account_attributes {
      key: "shows-collection-jam"
      value {
        bool_value: true
      }
    }
    account_attributes {
      key: "ab-browse-music-tuesday"
      value {
        bool_value: true
      }
    }
    account_attributes {
      key: "offline"
      value {
        bool_value: true
      }
    }
    account_attributes {
      key: "streaming"
      value {
        bool_value: true
      }
    }
    account_attributes {
      key: "fb-info-confirmation"
      value {
        string_value: "control"
      }
    }
    account_attributes {
      key: "audio-quality"
      value {
        string_value: "1"
      }
    }
    account_attributes {
      key: "taste-onboarding-disabled"
      value {
        bool_value: false
      }
    }
    account_attributes {
      key: "wanted-licenses"
      value {
        string_value: ""
      }
    }
    account_attributes {
      key: "lastfm-session"
      value {
        string_value: "b87...039|sashahilton00"
      }
    }
    account_attributes {
      key: "ab-desktop-playlist-annotation-edit"
      value {
        long_value: 1
      }
    }
    account_attributes {
      key: "ab-mobile-discover"
      value {
        long_value: 0
      }
    }
    account_attributes {
      key: "widevine-license-url"
      value {
        string_value: "https://spclient.wg.spotify.com/widevine-license/v1/video/license"
      }
    }
    account_attributes {
      key: "key-caching-max-count"
      value {
        long_value: 10000
      }
    }
    account_attributes {
      key: "ad-session-persistence"
      value {
        bool_value: true
      }
    }
    account_attributes {
      key: "video-initial-bitrate"
      value {
        string_value: "200000"
      }
    }
    account_attributes {
      key: "filter-explicit-content"
      value {
        bool_value: false
      }
    }
    account_attributes {
      key: "ab-play-history"
      value {
        bool_value: false
      }
    }
    account_attributes {
      key: "payment-state"
      value {
        string_value: ""
      }
    }
    account_attributes {
      key: "mobile-payment"
      value {
        string_value: "0"
      }
    }
    account_attributes {
      key: "key-caching-max-offline-seconds"
      value {
        long_value: 1800
      }
    }
    account_attributes {
      key: "ugc-abuse-report-url"
      value {
        string_value: "https://support.spotify.com/abuse/?uri={uri}"
      }
    }
    account_attributes {
      key: "shuffle-algorithm"
      value {
        bool_value: true
      }
    }
    account_attributes {
      key: "use-pl3"
      value {
        bool_value: false
      }
    }
    account_attributes {
      key: "image-url"
      value {
        string_value: "https://i.scdn.co/image/{file_id}"
      }
    }
    account_attributes {
      key: "use-playlist-app"
      value {
        bool_value: false
      }
    }
    account_attributes {
      key: "metadata-link-lookup-modes"
      value {
        bool_value: false
      }
    }
    account_attributes {
      key: "enable-autostart"
      value {
        bool_value: true
      }
    }
    account_attributes {
      key: "shuffle"
      value {
        bool_value: false
      }
    }
    account_attributes {
      key: "instant-search"
      value {
        bool_value: false
      }
    }
    account_attributes {
      key: "instant-search-expand-sidebar"
      value {
        bool_value: false
      }
    }
    account_attributes {
      key: "use-playlist-uris"
      value {
        bool_value: false
      }
    }
    account_attributes {
      key: "user-profile-show-invitation-codes"
      value {
        bool_value: false
      }
    }
    account_attributes {
      key: "ab-ad-requester"
      value {
        bool_value: true
      }
    }
    account_attributes {
      key: "nft-disabled"
      value {
        string_value: "1"
      }
    }
    account_attributes {
      key: "payments-cancel-state-interstitial"
      value {
        bool_value: false
      }
    }
    account_attributes {
      key: "ab-collection-union"
      value {
        bool_value: true
      }
    }
    account_attributes {
      key: "libspotify"
      value {
        bool_value: true
      }
    }
    account_attributes {
      key: "key-memory-cache-mode"
      value {
        string_value: "1:15,300"
      }
    }
    account_attributes {
      key: "high-bitrate"
      value {
        bool_value: true
      }
    }
    account_attributes {
      key: "head-file-caching"
      value {
        bool_value: true
      }
    }
    account_attributes {
      key: "radio"
      value {
        bool_value: true
      }
    }
    account_attributes {
      key: "key-caching-auto-offline"
      value {
        bool_value: false
      }
    }
    account_attributes {
      key: "explicit-content"
      value {
        bool_value: true
      }
    }
    account_attributes {
      key: "video-cdn-sampling"
      value {
        long_value: 1
      }
    }
    account_attributes {
      key: "ab-android-push-notifications"
      value {
        bool_value: true
      }
    }
    account_attributes {
      key: "unrestricted"
      value {
        bool_value: true
      }
    }
    account_attributes {
      key: "use-fb-publish-backend"
      value {
        long_value: 2
      }
    }
    account_attributes {
      key: "app-developer"
      value {
        long_value: 1
      }
    }
    account_attributes {
      key: "enable-gapless"
      value {
        bool_value: true
      }
    }
    account_attributes {
      key: "buffering-strategy-parameters"
      value {
        string_value: "0.8:0.2:0.0:0.0:0.0:0.0:1.0:10:10:2000:10000:10485760"
      }
    }
    account_attributes {
      key: "ab-playlist-extender"
      value {
        long_value: 5
      }
    }
    account_attributes {
      key: "enable-crossfade"
      value {
        bool_value: true
      }
    }
    account_attributes {
      key: "ad-persist-reward-time"
      value {
        bool_value: false
      }
    }
    account_attributes {
      key: "public-toplist"
      value {
        string_value: "2"
      }
    }
    account_attributes {
      key: "network-operator-premium-activation"
      value {
        bool_value: true
      }
    }
    account_attributes {
      key: "request-time"
      value {
        string_value: "6"
      }
    }
    account_attributes {
      key: "video-device-blacklisted"
      value {
        bool_value: false
      }
    }
    account_attributes {
      key: "collection"
      value {
        bool_value: true
      }
    }
    account_attributes {
      key: "fb-grant-permission-local-render"
      value {
        bool_value: false
      }
    }
    account_attributes {
      key: "backend-advised-bitrate"
      value {
        bool_value: true
      }
    }
    account_attributes {
      key: "catalogue"
      value {
        string_value: "premium"
      }
    }
    account_attributes {
      key: "storage-size-config"
      value {
        string_value: "10240,90,500,3"
      }
    }
    account_attributes {
      key: "ads"
      value {
        bool_value: false
      }
    }
    account_attributes {
      key: "head-files-url"
      value {
        string_value: "https://heads-fa.scdn.co/head/{file_id}"
      }
    }
    account_attributes {
      key: "browse-overview-enabled"
      value {
        bool_value: true
      }
    }
    account_attributes {
      key: "ab-collection-followed-artists-only"
      value {
        bool_value: false
      }
    }
    account_attributes {
      key: "on-demand"
      value {
        bool_value: true
      }
    }
    account_attributes {
      key: "ap-resolve-pods"
      value {
        string_value: "0"
      }
    }
    account_attributes {
      key: "name"
      value {
        string_value: "Spotify Premium"
      }
    }
    account_attributes {
      key: "sidebar-navigation-enabled"
      value {
        bool_value: false
      }
    }
    account_attributes {
      key: "loudness-levels"
      value {
        string_value: "1:-9.0,0.0,3.0:-2.0"
      }
    }
    account_attributes {
      key: "mobile-login"
      value {
        bool_value: true
      }
    }
    account_attributes {
      key: "preferred-locale"
      value {
        string_value: "en-gb"
      }
    }
    account_attributes {
      key: "license-acceptance-grace-days"
      value {
        long_value: 30
      }
    }
    account_attributes {
      key: "prefetch-strategy"
      value {
        long_value: 2
      }
    }
    account_attributes {
      key: "ugc-abuse-report"
      value {
        bool_value: true
      }
    }
    account_attributes {
      key: "ab-watch-now"
      value {
        bool_value: false
      }
    }
    account_attributes {
      key: "payments-latest-reusable-provider"
      value {
        string_value: "paypal;2020-06-15"
      }
    }
    account_attributes {
      key: "financial-product"
      value {
        string_value: "pr:premium,tc:0"
      }
    }
    account_attributes {
      key: "ab-collection-offline-mode"
      value {
        bool_value: false
      }
    }
    account_attributes {
      key: "streaming-rules"
      value {
        string_value: ""
      }
    }
    account_attributes {
      key: "head-files"
      value {
        bool_value: true
      }
    }
    account_attributes {
      key: "capping-bar-threshold"
      value {
        long_value: 3601
      }
    }
    account_attributes {
      key: "ab-new-share-flow"
      value {
        bool_value: false
      }
    }
    account_attributes {
      key: "video-keyframe-url"
      value {
        string_value: "http://keyframes-fa.cdn.spotify.com/keyframes/v1/sources/{source_id}/keyframe/heights/{height}/timestamps/{timestamp_ms}.jpg"
      }
    }
    account_attributes {
      key: "mobile"
      value {
        bool_value: true
      }
    }
    account_attributes {
      key: "is_maybe_in_social_session"
      value {
        bool_value: false
      }
    }
    account_attributes {
      key: "ab-mobile-startpage"
      value {
        long_value: 0
      }
    }
    account_attributes {
      key: "ab-moments-experience"
      value {
        string_value: "0"
      }
    }
    account_attributes {
      key: "ab-mobile-social-feed"
      value {
        string_value: "1"
      }
    }
    account_attributes {
      key: "ab-test-group"
      value {
        long_value: 972
      }
    }
    account_attributes {
      key: "player-license"
      value {
        string_value: "premium"
      }
    }
    account_attributes {
      key: "country_code"
      value {
        string_value: "GB"
      }
    }
    account_attributes {
      key: "com.spotify.madprops.delivered.by.ucs"
      value {
        bool_value: true
      }
    }
    account_attributes {
      key: "com.spotify.madprops.use.ucs.product.state"
      value {
        bool_value: false
      }
    }
  }
  fetch_time_millis: 1620515556953
}

[alejandroglib]

Can decompiling the app (reverse engineering the Spotify app) provide the endpoints or I need to catch the traffic using wireshark ?

[roderickvd]

I always inspected network traffic.

[photovoltex]

Same here. I have a very basic implementation of the endpoint here (https://github.com/photovoltex/librespot/tree/ucs) if you want to pick that work up, feel free to do so. Tho the only main advantage of having this endpoint fully or partially implemented would be to receive more info about the user session.

[sashahilton00]

Connect State Endpoint

Endpoint: https://spclient.wg.spotify.com/connect-state/v1/devices/2e8...202

Proto definitions (connect.proto):

• Request: This requires further investigation. The content that is sent appears to be either compressed, encrypted or obfuscated, unless I am missing something obvious. It doesn't have anything that stands out as a proto message.
• Response: The response seems to be a connectstate.Cluster message, though I want to double check this. It looks pretty similar to the web api connect state endpoint, there may be a few additional fields.

Notes

To implement the repeat single/context functonality on the client, one needs to look at the PlayerState (player.proto) entry of connectstate.Cluster. Within that there is a ContextPlayerOptions entry, which indicates whether repeat functionality is enabled and what type.

ContextRestrictions can also be seen in player state, and should be used to determine what functionality is enabled. For example, the disallow_pausing_reasons context restriction sometimes appears if the player is paused, with the somewhat self-explanatory already_paused message. Granted, not a very useful example, but we should probably pay attention to these context restrictions and pass through the reason for disabling either to stdout or the application using librespot. Example below:

restrictions {
    disallow_pausing_reasons: "already_paused"
    disallow_skipping_prev_reasons: "no_prev_track"
  }

Capabilities also has some new fields that indicate whether a device supports Spotify HiFi. There are some other fields within connectstate.CapabilitySupportDetails such as fully_supported and user_eligible that presumably need to be set for the option to appear. See below:

supports_hifi {
        device_supported: true
        fully_supported: false
        user_eligible: false
      }

Also, there are some other fields within the device message such as metadata_map that look to be the local network details of the client, notably device_address_mask and tier1_port, both of which appear to correspond to the mDNS/SSDP discovery that spotify clients do. It might be worth investigating adding this information to boost speed and reliability of device discovery.

The device-state endpoint needs quite a bit more exploration, and probably warrants a thread of its own, as it seems to be the bucket into which Spotify is dumping most of the player state used when syncing up devices.

[devgianlu]

The request is not encrypted, you might be seeing the gzipped version if it starts with 1f8b.

[alejandroglib]

Is this endpoint the streaming endpoint, because after implementing this endpoint is still didn't work, I believe something is still missing or what do you suggest ?

[photovoltex]

This endpoint is mainly used to communicate the status of the connect device to upstream. If you look into the usage of `put_connect_state_request You can follow how we currently use it.

[alejandroglib]

Which endpoint is important for client streaming ?

[photovoltex]

You can look into the player.rs which functions of the Spclient are in use. By that you should be able to find what you are looking for. If I remember correctly it was something with "cdn" in the name.

[roderickvd]

    account_attributes {
      key: "loudness-levels"
      value {
        string_value: "1:-9.0,0.0,3.0:-2.0"
      }

The comma-separated values probably map to Spotify's loudness levels. This is old documentation from the net:

Loud – equalling ca -11 dB LUFS (+6 dB gain multiplied to ReplayGain)
Normal (default) – equalling ca -14 dB LUFS (+3 dB gain multiplied to ReplayGain)
Quiet – equalling ca – 23 dB LUFS (-5 dB gain multiplied to ReplayGain)

Currently Spotify only documents the LUFS value and no longer the dB gain. Where dB is assumed to be dBFS and LUFS is k-weighted. So the documentation above is indicative but not necessarily normative.

If you add 3 dB to the comma-separated you're more-or-less meeting the indicative documented values.

I'd have to think harder what the first "1" and last "-2.0" indicate. Taking a guess: "1" for the scheme version number and "-2.0" for the -2 dB true peak that Spotify targets.

@sashahilton00 general question: so I understand librespot-java has implemented large parts of the new API. What can we reuse from their reverse engineering vs. your posts above? I'm just entirely new to these parts so trying to understand the lay of the land here.

[devgianlu]

Ping me if you need any help.

[sashahilton00]

@roderickvd that's a good question. From the issue emails I've been getting from librespot-java, it looks like @devgianlu and co. have put quite a bit of work into reverse engineering chunks of the new API, hence in some cases the stuff I post here has likely been reverse engineered in part or fully over at librespot-java. @devgianlu would be best placed to answer the question of what has been reverse engineered that we can use, something of note is the dealer endpoint, which if we want to support group listening at some point, will need to be added, as thisis where group listening context seems to be published to. Other than that, it just sends pingpong requests unless I am missing something.

My reverse engineering is simply me capturing and examining the network traffic between desktop <-> Spotify, so what I post should be useful enough as a reference, but in terms of what we focus on, we should probably look to discussions and their upvotes, along with features that we thnk are going to be increasingly important when working out what to prioritise.

In my mind, there are a few things that are must haves before the library hits 1.0.0, which are:

• removal of surplus audio backends. Currently my thinking is that retaining the pipe, rodio (default), alsa and gstreamer backends makes sense, on the understanding that the alsaand gstreamer backends are being actively maintained. Given the processing that we are already doing with normalisation, dithering, shaping, etc. combined with the slow movement on issues upstream in rodio, I am inclined to think that it may be worth dropping rodio in favour of cpal as a lighter alternative, given that we're not using the functionality that rodio provides (multi format decoding, dynamic mixing, filters, etc.). If we feel that this is going to change, for example with the introduction of HiFi, then perhaps this is worth reevaluating.

• remove redundant decoders. tremor and libvorbis should both be removed I think. The former because it was introduced iirc for the Pi rev 1, which didn't have a hardware FPU. The latter because it a) relies on bndings to a C library, and b) the crate appears unmaintained.

• support session reconnection. This is being tracked in Handle reconnection for Sessions #609 but requires a level of rust experience that exceeds my own. The reason for this being a requirement in my mind is that there's a trove of issues that appear to be connected to session reconnection not really being handled, which one wouldn't really consider acceptable in a 'stable' library.

• retrieve files from the CDN. Again, not technically a requirement, but from what I've seen in recent additions such as canvas, podcasts, etc. these are defaulting to being supplied via the CDN, and there is clearly a push to move to use the CDN at Spotify for all new projects. Besides avoiding the nasty surprise when Spotify eventually decides to turn off the mercury endpoint one day, there should be a small performance boost in that audio files will be served from edge locations as opposed to from Spotify servers, which may help reduce overall load times and responsiveness.

• there has been plenty of discussion in So many features flags... #648 around splitting out discovery functionality, moving audio playback and other features to Spotifyd, etc. If we are going to do that, it should be done before we hit stable. Personally I am in favour of moving most of the playback functionality to Spotifyd, and only retaining the pipe and cpal backends in librespot, though multiple people have said that they want alsa and gstreamer in librespot and are willing to maintain them, n which case I don't think forcing migration is necessary.

Besides the above, there are other things that would be 'nice to have', but are by no means essential. Things like extended metadata can be added in later versions, the above is just some of the stuff which I think is required for it to be released as stable. If people have a different view, I'm open to changing my mind. In the meantime, I will keep documenting the protocols when I have a moment and adding them here, since it's just grunt work that I can do when I have an hour or two spare. Anyone else feel free to do the same.

[Johannesd3]

In my mind, there are a few things that are must haves before the library hits 1.0.0

Just don't hurry, in the end no one cares whether it's librespot 0.x.y or librespot 1.x.y they use.

there has been plenty of discussion in #648 around splitting out discovery functionality, moving audio playback and other features to Spotifyd, etc. If we are going to do that, it should be done before we hit stable. Personally I am in favour of moving most of the playback functionality to Spotifyd, and only retaining the pipe and cpal backends in librespot, though multiple people have said that they want alsa and gstreamer in librespot and are willing to maintain them, n which case I don't think forcing migration is necessary.

I never meant it this way. Even with a few backends less, the Player logic etc. would still be there. I'm just pleading for a stronger separation of concerns, i.e. writing an audio player is an entirely different task than reverse-engineering the Spotify backing, they require totally different skills and could be done by different people.

Actually I don't care how this separation is executed. It could even mostly stay as is, except for the connect crate that mixes Spotify reverse-engineering and playback in an "unhealthy" manner. (One rule of thumb could be: crates that handle with audio output should not use librespot_protocol and protobuf directly).

Other options could be:

• splitting up responsibility for Spotify backend and playback to different maintainers but keeping them in one repository.
• creating a separate repository for playback-related stuff.
• move playback-related stuff to Spotifyd (poor ncspot).

What makes not much sense imo is just splitting a few backends off but keeping basic functionality. It wouldn't remove that much burden from librespot. Especially, having two different applications doing basically the same thing, but one with fewer backends, seem like an unnecessary duplication. (I could even imagine having no standalone librespot anymore, but this is more a question of organization and naming than anything else)

I hope I was able to explain my point of view.

[sashahilton00]

Looking back, the above is a bit of a roaming response, but hopefully it provides some clarification on why I'm spending the time to examine the latest protocols and the overall direction that I'm working to as a basis.

[roderickvd]

Looking back, the above is a bit of a roaming response, but hopefully it provides some clarification on why I'm spending the time to examine the latest protocols and the overall direction that I'm working to as a basis.

Yes I appreciate it. In fact great to get some guidance, have a list of tasks that we can split up. I mean just hold my beer for the backends, but for this new API I'm still unsure what to do or where to start.

So really just set me up with something and I'll be keen to get on it. I even suggest organising a meeting on chat or heck even video to identify and divide up the work. I'm all game.

something of note is the dealer endpoint, which if we want to support group listening at some point, will need to be added, as thisis where group listening context seems to be published to.

Assuming the goal is to reach feature-parity with official Spotify clients, then I'd say yes (regardless of being targeted for 1.0.0 or sometime later).

• removal of surplus audio backends. Currently my thinking is that retaining the pipe, rodio (default), alsa and gstreamer backends makes sense, on the understanding that the alsaand gstreamer backends are being actively maintained.

For this and other audio and playback points, it would be great if someone could merge #692. I'll then first play catch-up with the PR's concerning dithering and volume control (they're now diverging). Then I can continue on these other points.

Given the processing that we are already doing with normalisation, dithering, shaping, etc. combined with the slow movement on issues upstream in rodio, I am inclined to think that it may be worth dropping rodio in favour of cpal as a lighter alternative, given that we're not using the functionality that rodio provides (multi format decoding, dynamic mixing, filters, etc.). If we feel that this is going to change, for example with the introduction of HiFi, then perhaps this is worth reevaluating.

I agree, I don't there's anything in Rodio that we need over cpal. @Johannesd3 wrote a quick draft at https://gist.github.com/Johannesd3/920dd5558ca04142c81ff022c5daa95a, it shouldn't take too long to get this up to spec.

• remove redundant decoders. tremor and libvorbis should both be removed I think. The former because it was introduced iirc for the Pi rev 1, which didn't have a hardware FPU. The latter because it a) relies on bndings to a C library, and b) the crate appears unmaintained.

Again I can take this on having merged #692.

• support session reconnection. This is being tracked in Handle reconnection for Sessions #609 but requires a level of rust experience that exceeds my own. The reason for this being a requirement in my mind is that there's a trove of issues that appear to be connected to session reconnection not really being handled, which one wouldn't really consider acceptable in a 'stable' library.

I think @Johannesd3 is now the king of threads 😉

• retrieve files from the CDN. Again, not technically a requirement, but from what I've seen in recent additions such as canvas, podcasts, etc. these are defaulting to being supplied via the CDN, and there is clearly a push to move to use the CDN at Spotify for all new projects. Besides avoiding the nasty surprise when Spotify eventually decides to turn off the mercury endpoint one day, there should be a small performance boost in that audio files will be served from edge locations as opposed to from Spotify servers, which may help reduce overall load times and responsiveness.

For sure!

• there has been plenty of discussion in So many features flags... #648 around splitting out discovery functionality, moving audio playback and other features to Spotifyd, etc. If we are going to do that, it should be done before we hit stable. Personally I am in favour of moving most of the playback functionality to Spotifyd, and only retaining the pipe and cpal backends in librespot, though multiple people have said that they want alsa and gstreamer in librespot and are willing to maintain them, n which case I don't think forcing migration is necessary.

When all this decoupled into the playback, and unmaintained backends removed or behind a feature gate, I don't see the point. I mean other than the semantics of being a "lib", does it really matter? Anyone who just wants to use the lib is free to use those crates and not playback.

I know I supported the idea previously but thinking about it objectively, I'm starting to doubt it.

Besides the above, there are other things that would be 'nice to have', but are by no means essential. Things like extended metadata can be added in later versions, the above is just some of the stuff which I think is required for it to be released as stable. If people have a different view, I'm open to changing my mind. In the meantime, I will keep documenting the protocols when I have a moment and adding them here, since it's just grunt work that I can do when I have an hour or two spare. Anyone else feel free to do the same.

It'd be nice to map things out. Could even do release management in GitHub.

[sashahilton00]

Client Token Endpoint (Protobuf)

Endpoint: POST https://clienttoken.spotify.com/v1/clienttoken

Proto Definitions missing.

Notes

This endpoint is where the client token is retrieved from, which is subsequently used in a multitude of requests. The request/response are shown below. Further investigation is required to determne the proto definitions, which will be updated accordingly in the request/response once discovered.

65b7... appears to be a Spotify Client ID. This is also used in the login5 endpoint.

Request

1: 1
2 {
  1: "1.1.58.820.g2ae50076"
  2: "65b7080...33ca87bd"
  3 {
    1 {
      4 {
        1: 10
        3: 17763
        4: 2
        6: 9
        7: 332
        8: 34404
      }
    }
    2: "S-1-5-21-4265178016-72824351-3788689935"
  }
}

Response

1: 1
2 {
  1: "AABlJC8n81KZ3mO8VAbi9H9B6...z2FjzT+gISTWoyP0="
  2: 1216800
  3: 1209600
  4 {
    1: "spotify.com"
  }
}```

[SuisChan]

The Protobuf in this Repository was not suitable for the Requests

You are right, they should be updated

I adjusted the Protobufs manually. i attach the new Protobuf here, maybe it helps someone.

Yes, thank you, also that's my version too
client_token_upd.zip

But how can i "solve" this hashcash challange? => How to determine the "suffix"?

here's the java/go versions
#418

and cpp ver

#include <iostream>
#include <cstring>
#include <chrono>
#include <stdio.h>
#include <stdlib.h>

#include <openssl/sha.h>

#ifdef _WIN32
#define __bswap_64(x) _byteswap_uint64(x)
#endif //  _WIN32

#define arr2long(x) *reinterpret_cast<unsigned long long *>(x)

void convertToCharArray(unsigned char *arr, long long a)
{
  int i = 0;

  for (i = 0; i < 8; ++i)
  {
    arr[i] = (unsigned char)((((unsigned long long)a) >> (56 - (8 * i))) & 0xFFu);
  }
}

int solveHashCash(unsigned char *ctx, size_t ctx_len, unsigned char *prefix, size_t prefix_len, int length, unsigned char *dst, std::chrono::duration<int64_t, std::micro>::rep &elapsed)
{
  unsigned char md[20];
  SHA1(ctx, ctx_len, md); //  SHA1("")
  unsigned char concat[16];

  std::chrono::steady_clock::time_point begin = std::chrono::steady_clock::now();

  unsigned long long counter = 0LL;
  unsigned long long target = __bswap_64(arr2long(md + 12));

  do
  {
    convertToCharArray(&concat[0], (target + counter));
    convertToCharArray(&concat[8], (counter));

    SHA_CTX ctx;
    SHA1_Init(&ctx);
    SHA1_Update(&ctx, prefix, 16);
    SHA1_Update(&ctx, concat, 16);
    SHA1_Final(md, &ctx);

    counter++;

    // } while ((__bswap_64(array2long(md + 12)) & ~(-1 << length)) != 0);
  } while (!(__builtin_ctz(__bswap_64(arr2long(md + 12))) >= length));

  elapsed = std::chrono::duration_cast<std::chrono::nanoseconds>(std::chrono::steady_clock::now() - begin).count();
  memcpy(dst, concat, 16);

  return 16;
}

  int length = 999;
  unsigned char prefix[16] = {0xff, 0xdf, ...};

  unsigned char dst[16];
  std::chrono::duration<int64_t, std::micro>::rep elapsed;
  int len = solveHashCash(NULL, 0, prefix, 16, length, dst, elapsed);

  for (size_t count = 0; count < sizeof dst / sizeof *dst; count++)
    printf("%02x", dst[count]);
  printf("\nelapsed: %ld\n\n", elapsed);

• Are there Libs you can recommend?
• Which Algorythm is used? SHA1, SHA256, SHA3 ?

whatever you prefer, SHA1

[roderickvd]

@StefanV85 you're pinging me but isn't everything you're asking already implemented in librespot-java? Just read that code.

@SuisChan kind of you to offer the help. With regards to the updated protobuf, isn't most of that in https://github.com/librespot-org/librespot/blob/new-api/protocol/proto/connectivity.proto already? Extracted from 1.1.33.569 around June last year. I did a protobuf update last month from 1.1.73.517 but that didn't have it. If you've got a newer one to share, a PR for new-api would be great!

[SuisChan]

isn't most of that in https://github.com/librespot-org/librespot/blob/new-api/protocol/proto/connectivity.proto already?

Almost, one of the minor changes is adding NativeWindowsData (partially) and changing NativeAndroidData to be compatible with mobile client_token requests, and it's not newer, just rewritten )

[SuisChan]

a PR for new-api would be great!

Also I have plans to create a PR with Grain / HC (Fingerprint / PoWScheme) implementation, but since this is part of the old API does it make sense?

[roderickvd]

I don't know? What would this bring to the table?

[sashahilton00]

I thought it already was, just realised it's still in issues. Will move it.

[devgianlu]

Just FYI, many endpoints do not like getting gzipped content and will return 400.

[roderickvd]

OK guys I'm eager to take this on but am going to need a bit of initiation. I looked at librespot-org/librespot-java#105 but from where I'm at it's overwhelming.

Where do I start without turning this into an endless break-fest?

Really please set me up with some clear and bounded tasks, I'm happy to take them on. I'll likely become more self-sufficient fast but for now I just don't know where to start.

[sashahilton00]

@Johannesd3 try starting a group session and you'll see activity

[Johannesd3]

Sorry for inconvenience, but I printed it to stdout while looking at stderr.

[Johannesd3]

So, here's my first attempt of websocket support: https://github.com/Johannesd3/librespot/tree/new-api/core/src/dealer

• It uses tungstenite and tokio-tungstenite as websocket library.
• There's a Builder struct to register handlers before a connection is established.
• After the Builder is created, there are two ways to launch the Dealer:
  • Builder::launch: Attempts to connect, returns a Dealer on success and an error otherwise.
  • Builder::launch_in_background: Returns immediately a Dealer and behaves as if it would be reconnecting (see below).
• Reconnecting: If the connection is closed or the server doesn't react on pings, there's an attempt to reconnect every 10 seconds (but all replies sent in between are lost).
• Message handling: It's possible to subscribe to any uri an arbitrary number of times. Every message sent to a "sub-uri" will be received.
• Request handling: One can add exactly one RequestHandler per uri. Currently, these handlers indicate success by returning a bool. But that's easy to change.
• The handlers are stored in custom tree structs, hierarchally by uri components. Maybe it's too complicated - or maybe such a tree would also be useful for mercury.
• Messages and requests are parsed with serde/serde_json.
• Request payloads are gzip-decoded if necessary (using flate2). I was not able to test whether it works, I didn't receive a gzipped request (I didn't receive a request at all).

@devgianlu

• If I lose the connection while there are outstanding replies: does it make sense to send them as soon as a new connection is established?
• Is there anything I can do to receive requests?
• Why do you put message payloads into a byte[]?

Thanks for your help!

[devgianlu]

• When you lose connection the server will send you a new X-Spotify-Connection-Id upon reconnection therefore I think it doesn't remember your previous state.
• To receive requests you need to make a put state request with the X-Spotify-Connection-Id header
• Because if you advertise the support for gzip pushes you'll get Base64 encoded Gzip data and having it in a byte[] allows for easy decompression. I believe you could also get protobuf data from the dealer, don't know if it's still the case.

[roderickvd]

@Johannesd3 great going man. I suggest we make a new-api branch here so we can both work on it as a working tree. We can coordinate efforts here and on chat to minimise conflicts. I'll first contribute the new apresolve, it's not much but a start.

@devgianlu well gzipping spurious messages whilst streaming hundreds kbps of music does seem like over-optimization 😆 but might as well be a good netizen.

[roderickvd]

@devgianlu I'm dipping my toes porting the new Spotify API from librespot-java. From what I gather, to implement the ApiClient, I first need to implement the TokenManager right? And those two should be able to get us showing as a Connect device?

[devgianlu]

librespot-java is getting hm://pusher/v1/connections/ via the websocket dealer as soon as it connects, same with Hermes. The commit where that happened is librespot-org/librespot-java@f8d61ec.

[roderickvd]

Having dumped all Mercury packets I get (so even without subscribing, like you say "it should just arrive") all that arrives on connection is "hm://remote/user/xxx/" and then "hm://metadata/3/track/xxx".

[roderickvd]

Just to be clear this is without the websocket. When you said "you should be able to get it even through Hermes" I thought that would be possible and a nice intermediate step before doing the dealer. But if it doesn't work that way then onto the websocket dealer it is.

[devgianlu]

hm://pusher/v1/connections/ is coming in with a packet type of 0xb5, maybe that's new to librespot? Either way, if you don't get it there you should get it from the dealer unless it's gated there too.

[roderickvd]

No not new, MercuryEvent 0xb5 packages were getting dispatched already. Thanks for your help so far. Yeah I'll proceed to implementing the dealer then.

[roderickvd]

For reference this is today's ProductInfo packet data I got pushed. It's probably nothing material, mostly remote configuration of the local application. There are a couple of URLs of possible interest. And we could think about following certain caching or prefetching strategies.

<?xml version='1.0' encoding='utf-8'?>
<products>
	<product>
		<type>premium</type>
		<ab-ad-player-targeting>1</ab-ad-player-targeting>
		<ab-android-push-notifications>1</ab-android-push-notifications>
		<ab-browse-music-tuesday>1</ab-browse-music-tuesday>
		<ab-collection-bookmark-model>1</ab-collection-bookmark-model>
		<ab-collection-followed-artists-only>0</ab-collection-followed-artists-only>
		<ab-collection-hide-unavailable-albums>0</ab-collection-hide-unavailable-albums>
		<ab-collection-offline-mode>0</ab-collection-offline-mode>
		<ab-collection-union>1</ab-collection-union>
		<ab-desktop-hide-follow>0</ab-desktop-hide-follow>
		<ab-mobile-discover>0</ab-mobile-discover>
		<ab-mobile-running-onlymanualmode>only-manual</ab-mobile-running-onlymanualmode>
		<ab-mobile-running-tempo-detection>Control</ab-mobile-running-tempo-detection>
		<ab-mobile-social-feed>1</ab-mobile-social-feed>
		<ab-mobile-startpage>0</ab-mobile-startpage>
		<ab-moments-experience>0</ab-moments-experience>
		<ab-new-share-flow>0</ab-new-share-flow>
		<ab-play-history>0</ab-play-history>
		<ab-sugarpills-sanity-check>0</ab-sugarpills-sanity-check>
		<ab-test-group>705</ab-test-group>
		<ab-watch-now>0</ab-watch-now>
		<ab_recently_played_feature_time_filter_threshold>com.spotify.gaia=30,driving-mode=120,spotify%3Ainternal%3Astartpage=30</ab_recently_played_feature_time_filter_threshold>
		<ad-formats-preroll-video>0</ad-formats-preroll-video>
		<ad-formats-video-takeover>0</ad-formats-video-takeover>
		<ad-persist-reward-time>0</ad-persist-reward-time>
		<ad-session-persistence>1</ad-session-persistence>
		<ads>0</ads>
		<allow-override-internal-prefs>0</allow-override-internal-prefs>
		<ap-resolve-pods>0</ap-resolve-pods>
		<app-developer>0</app-developer>
		<arsenal_country>1</arsenal_country>
		<audio-preview-url-template>https://p.scdn.co/mp3-preview/{id}</audio-preview-url-template>
		<browse-overview-enabled>1</browse-overview-enabled>
		<buffering-strategy>2</buffering-strategy>
		<buffering-strategy-parameters>0.8:0.2:0.0:0.0:0.0:0.0:1.0:10:10:2000:10000:10485760</buffering-strategy-parameters>
		<capper-profile></capper-profile>
		<capping-bar-threshold>3601</capping-bar-threshold>
		<catalogue>premium</catalogue>
		<collection>1</collection>
		<enable-annotations-read>0</enable-annotations-read>
		<enable-autostart>1</enable-autostart>
		<enable-crossfade>1</enable-crossfade>
		<enable-gapless>1</enable-gapless>
		<expiry>1</expiry>
		<explicit-content>1</explicit-content>
		<fb-grant-permission-local-render>0</fb-grant-permission-local-render>
		<fb-info-confirmation>control</fb-info-confirmation>
		<financial-product>pr:premium,tc:0,rt:v2_NL_default_new-family-master_14.99_EUR_default</financial-product>
		<head-file-caching>1</head-file-caching>
		<head-files>1</head-files>
		<head-files-url>http://heads4-ak.spotify.com.edgesuite.net/head/{file_id}</head-files-url>
		<high-bitrate>1</high-bitrate>
		<image-url>https://i.scdn.co/image/{file_id}</image-url>
		<incognito_mode_timeout>21600</incognito_mode_timeout>
		<india-experience>0</india-experience>
		<instant-search>0</instant-search>
		<instant-search-expand-sidebar>0</instant-search-expand-sidebar>
		<is_email_verified>1</is_email_verified>
		<is_maybe_in_social_session>0</is_maybe_in_social_session>
		<key-caching-max-count>10000</key-caching-max-count>
		<key-caching-max-offline-seconds>1800</key-caching-max-offline-seconds>
		<lastfm-session></lastfm-session>
		<libspotify>1</libspotify>
		<license-acceptance-grace-days>30</license-acceptance-grace-days>
		<license-agreements></license-agreements>
		<local-files-import>0</local-files-import>
		<metadata-link-lookup-modes>0</metadata-link-lookup-modes>
		<mobile>1</mobile>
		<mobile-browse>0</mobile-browse>
		<mobile-login>1</mobile-login>
		<mobile-payment>0</mobile-payment>
		<name>Spotify Premium</name>
		<network-operator-premium-activation>1</network-operator-premium-activation>
		<nft-disabled>1</nft-disabled>
		<npt-disabled>2</npt-disabled>
		<offline>1</offline>
		<on-demand>1</on-demand>
		<pause-after>0</pause-after>
		<payment-state></payment-state>
		<payments-cancel-state-interstitial>0</payments-cancel-state-interstitial>
		<payments-initial-campaign>default</payments-initial-campaign>
		<payments-latest-reusable-provider>adyen_ideal;2020-06-02</payments-latest-reusable-provider>
		<payments-locked-state>0</payments-locked-state>
		<player-license>premium</player-license>
		<playlist-annotations-markup>0</playlist-annotations-markup>
		<playlist-folders>1</playlist-folders>
		<preferred-locale>nl-nl</preferred-locale>
		<prefetch-keys>1</prefetch-keys>
		<prefetch-strategy>8</prefetch-strategy>
		<prefetch-window-max>2</prefetch-window-max>
		<public-toplist>1</public-toplist>
		<publish-activity>1</publish-activity>
		<publish-playlist>1</publish-playlist>
		<radio>1</radio>
		<remote-control>0</remote-control>
		<send-email>1</send-email>
		<shows-collection>0</shows-collection>
		<shows-collection-jam>0</shows-collection-jam>
		<shuffle>0</shuffle>
		<shuffle-algorithm>1</shuffle-algorithm>
		<sidebar-navigation-enabled>0</sidebar-navigation-enabled>
		<storage-size-config>10240,90,500,3</storage-size-config>
		<streaming>1</streaming>
		<streaming-rules></streaming-rules>
		<taste-onboarding-disabled>0</taste-onboarding-disabled>
		<track-cap>0</track-cap>
		<ugc-abuse-report>0</ugc-abuse-report>
		<ugc-abuse-report-url>https://support.spotify.com/abuse/?uri={uri}</ugc-abuse-report-url>
		<unrestricted>1</unrestricted>
		<use-fb-publish-backend>2</use-fb-publish-backend>
		<use-pl3>0</use-pl3>
		<use-playlist-uris>0</use-playlist-uris>
		<user-profile-show-invitation-codes>0</user-profile-show-invitation-codes>
		<video-cdn-sampling>1</video-cdn-sampling>
		<video-device-blacklisted>0</video-device-blacklisted>
		<video-initial-bitrate>200000</video-initial-bitrate>
		<video-keyframe-url>http://keyframes-fa.cdn.spotify.com/keyframes/v1/sources/{source_id}/keyframe/heights/{height}/timestamps/{timestamp_ms}.jpg</video-keyframe-url>
		<video-manifest-url>https://spclient.wg.spotify.com/manifests/v3/{type}/sources/{source_id}</video-manifest-url>
		<video-wifi-initial-bitrate>800000</video-wifi-initial-bitrate>
		<wanted-licenses></wanted-licenses>
		<widevine-license-url>https://spclient.wg.spotify.com/widevine-license/v1/video/license</widevine-license-url>
	</product>
</products>

[StefanV85]

i'm working on an other project. but this thread helps me a lot. thank you very much.
i extracted new protobuf definitions 2 weeks ago. maybe it could help you too.
Spotify Protobuf - 2021-12-21.zip

[roderickvd]

Thanks. You might also be interested in #917.

[roderickvd]

Connecting as a client, I see more messages being pushed, like these ones when you favourite songs:

[2022-01-12T00:26:04Z DEBUG librespot_core::mercury] unknown subscription uri=hm://collection/collection/roderickvd
[2022-01-12T00:26:04Z DEBUG librespot_core::mercury] unknown subscription uri=hm://collection/collection/roderickvd/json

When you create a playlist and add a track to it, remove one, rename it:

[2022-01-12T00:27:08Z DEBUG librespot_core::mercury] unknown subscription uri=hm://playlist/v2/user/roderickvd/rootlist
[2022-01-12T00:27:08Z DEBUG librespot_core::mercury] unknown subscription uri=hm://playlist/v2/playlist/5RBCAirgHYiMJVzzPaG5bf

I can't remember what this was, I think they arrived seemingly randomly as I was just playing a track:

[2022-01-10T22:09:59Z TRACE librespot_core::mercury] response pushed over Mercury: MercuryResponse { uri: "hm://playlist/v2/playlist/4dwu8FLKXg4J3LQ4yHdVfr", status_code: 200, payload: [[...]] }
[2022-01-10T22:11:04Z TRACE librespot_core::mercury] response pushed over Mercury: MercuryResponse { uri: "hm://playlist-annotate/v2/annotation/playlist/4dwu8FLKXg4J3LQ4yHdVfr", status_code: 200, payload: [[...]] }