Support for more modalities and base64 content #3004
Replies: 33 comments 25 replies
-
|
+1 base64 image (most wanted) I dont need to support video in my use-case |
Beta Was this translation helpful? Give feedback.
-
|
Great! The dataset also need to support Multi-Modal input. Looking forward! |
Beta Was this translation helpful? Give feedback.
-
|
Eagerly awaiting base64 support, especially in markdown |
Beta Was this translation helpful? Give feedback.
-
|
A few double clicks on base64 as reactions to our most recent newsletter |
Beta Was this translation helpful? Give feedback.
-
|
base64 images for sure. |
Beta Was this translation helpful? Give feedback.
-
|
+1 b64 images. Seems like the very next thing to support. Schema seems well established at this point. |
Beta Was this translation helpful? Give feedback.
-
|
Base64 images for multimodal models is the missing feature that is holding us back from using Langfuse. PDF attachments would also be very helpful. |
Beta Was this translation helpful? Give feedback.
-
|
Bas64 or image url would be great to support |
Beta Was this translation helpful? Give feedback.
-
|
Audio is mission critical for us |
Beta Was this translation helpful? Give feedback.
-
|
just here to add my support for base64 (because claude) |
Beta Was this translation helpful? Give feedback.
-
|
this is on the near-term roadmap, @hassiebp is working on it and specs look great, can't wait for the release! |
Beta Was this translation helpful? Give feedback.
-
|
Here to support Audio, PDF source. |
Beta Was this translation helpful? Give feedback.
-
|
+1 base64 (because claude) |
Beta Was this translation helpful? Give feedback.
-
|
+1 base64 image (because claude) |
Beta Was this translation helpful? Give feedback.
-
|
Good news - we have just launched multimodal support in beta! 🎨 Please let us know your feedback here or create an issue if you encounter any bugs. Thanks! 🙏🏾 |
Beta Was this translation helpful? Give feedback.
-
|
Hi, I've tried the suggested ways to upload images using the API directly from https://langfuse.com/docs/tracing-features/multi-modality But my images do not render correctly in the UI. I tried both Markdown with the image link and sending base64 encoded data URIs passing into the trace input field. I want to see the images rendered. Please help 🙏 |
Beta Was this translation helpful? Give feedback.
-
|
the ability to embed an iframe -> we would want to visualized 3d objects so either native support for a simple three.js renderer would be pretty easy to implement and nice, alternatively an iframe where we could add our own 3d renderer |
Beta Was this translation helpful? Give feedback.
-
|
It would be really cool if this supported OTEL data. From from what I'm seeing so far it doesn't. If I could send my traces with the images in base64 (which I'm currently doing anyway), it would be great if Langfuse converted them to it's object storage, and have a link to them. Unfortunately for now, it's looking like I'm going to have to call an API to do this. |
Beta Was this translation helpful? Give feedback.
-
|
Video would be great! |
Beta Was this translation helpful? Give feedback.
-
|
Please, add |
Beta Was this translation helpful? Give feedback.
-
|
As stated in this issue : #7319, in the meanwhile it would be a nice workaround to work with the dataset item POST endpoint. As for now, this route doesn't accept payloads bigger than 1MB. Increasing this limit to 10MB would allow to work with most PDF documents and images |
Beta Was this translation helpful? Give feedback.
-
|
need video support. |
Beta Was this translation helpful? Give feedback.
-
|
Please also support .flac file format for audio files. Thank you! |
Beta Was this translation helpful? Give feedback.
-
|
Please also support .ogg file format for audio files. Thank you! |
Beta Was this translation helpful? Give feedback.
-
|
csvs and xlsx would be great!!! |
Beta Was this translation helpful? Give feedback.
-
|
html, markdown, but most important (as said above) video |
Beta Was this translation helpful? Give feedback.
-
The base64 somehow not working (?)
|
Beta Was this translation helpful? Give feedback.
-
Beta Was this translation helpful? Give feedback.
-
|
For litellm it seems this works only when using the langfuse v2 integration as explained here https://docs.litellm.ai/docs/observability/langfuse_integration. With the v3 integration using |
Beta Was this translation helpful? Give feedback.
-
|
Super tool out there! would love to see video rendering as well! |
Beta Was this translation helpful? Give feedback.





Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Describe the feature or potential improvement
After our latest release supporting images (passed via url) in Langfuse, we're looking to support other modalities soon.
We're committed to supporting base64 images in the near term. We're further planning support for audio, video, and attachments (e.g. PDFs).
We'd love to gauge interest across the modalities to help with most efficient prioritisation.
Beta Was this translation helpful? Give feedback.
All reactions