Merge branch 'main' of https://github.com/PolymathicAI/AstroCLIP

Author: lhparker1

README.md

@@ -9,6 +9,10 @@ Official PyTorch implementation and pre-trained models for the paper **AstroCLIP
 
 AstroCLIP is a novel, cross-modal, self-supervised foundation model that creates a shared embedding space for multi-band imaging and optical spectra of galaxies. These embeddings encode meaningful physical information shared between both modalities, and can be used as the basis for competitive zero- and few-shot learning on a variety of downstream tasks, including similarity search, redshift estimation, galaxy property prediction, and morphology classification.
 
+## Web App
+Check out our interactive similarity search app, enabling both in-modal and cross-modal search for galaxies:
+https://astroclip.streamlit.app/
+
 ## Installation
 The training and evaluation code requires PyTorch 2.0. Additionally, an up-to-date eventlet is required for wandb. Note that the code has only been tested with the specified versions and also expects a Linux environment. To install the AstroCLIP package and its corresponding dependencies, please follow the code below.
 
@@ -49,23 +53,23 @@ We provide the pretrained AstroCLIP model on the Huggingface model hub for easy
     <td>AstroCLIP</td>
     <td>CLIP</td>
     <td>370M</td>
-    <td><a href="">ckpt</a></td>
+    <td><a href="https://huggingface.co/polymathic-ai/astroclip">ckpt</a></td>
     <td><a href="https://github.com/PolymathicAI/AstroCLIP/blob/main/configs/astroclip.yaml">config</a></td>
     <td><a href="https://example.com/link3">logs</a></td>
   </tr>
   <tr>
     <td>Image Encoder</td>
     <td>DINOv2</td>
     <td>302M</td>
-    <td><a href="https://example.com/link1">ckpt</a></td>
+    <td><a href="https://huggingface.co/polymathic-ai/astrodino">ckpt</a></td>
     <td><a href="https://github.com/PolymathicAI/AstroCLIP/blob/main/astroclip/astrodino/config.yaml">config</a></td>
     <td><a href="https://example.com/link3">logs</a></td>
   </tr>
   <tr>
     <td>Spectrum Encoder</td>
     <td>Masked Modeling</td>
     <td>43M</td>
-    <td><a href="https://example.com/link1">ckpt</a></td>
+    <td><a href="https://huggingface.co/polymathic-ai/specformer">ckpt</a></td>
     <td><a href="https://github.com/PolymathicAI/AstroCLIP/blob/main/configs/specformer.yaml">config</a></td>
     <td><a href="https://example.com/link3">logs</a></td>
   </tr>