|
1 | 1 | ---
|
2 |
| -title: PosterLens |
3 |
| -description: Turn static scientific posters into interactive research insights |
| 2 | +title: PosterLens | Scientific Poster Scanner & Research Assistant |
| 3 | +description: An iOS app that transforms static scientific posters into interactive insights using OCR and Perplexity's Sonar Pro API for semantic search and context |
| 4 | +sidebar_position: 21 |
| 5 | +keywords: [PosterLens, iOS, OCR, scientific posters, research, Apple Vision, Sonar Pro, semantic search, medical research] |
4 | 6 | ---
|
5 | 7 |
|
6 |
| -## 🔍 What is PosterLens? |
| 8 | +**PosterLens** is an iOS app that transforms static scientific posters into interactive, explorable insights using OCR and AI. Created for the Perplexity Hackathon 2025, it allows researchers, MSLs, and medical writers to scan posters and explore them interactively using natural language, extracting meaning and surfacing related studies instantly. |
7 | 9 |
|
8 |
| -**PosterLens** is a mobile app that transforms static scientific posters into interactive, explorable insights using OCR and AI. |
| 10 | + |
9 | 11 |
|
10 |
| -Created for the Perplexity Hackathon 2025, it allows researchers, MSLs, and medical writers to: |
| 12 | +## Features |
11 | 13 |
|
12 |
| -- Scan posters using device camera + Apple Vision OCR |
13 |
| -- Ask natural-language questions about the content |
14 |
| -- Find semantically related studies using **Sonar Pro** |
15 |
| -- Auto-generate research questions & future directions |
16 |
| -- Validate citations with PubMed E-utilities |
| 14 | +* **Scientific Poster Scanning** using device camera and Apple Vision OCR |
| 15 | +* **Natural Language Q&A** about poster content with AI-powered responses |
| 16 | +* **Semantic Search Integration** using Perplexity Sonar Pro for related studies |
| 17 | +* **Citation Validation** with PubMed E-utilities for academic accuracy |
| 18 | +* **Auto-Generated Research Questions** and future research directions |
| 19 | +* **On-Device Processing** for privacy and performance |
| 20 | +* **Interactive Research Experience** transforming static content into dynamic insights |
17 | 21 |
|
18 |
| ---- |
| 22 | +## Prerequisites |
19 | 23 |
|
20 |
| -## 📸 Screenshots |
| 24 | +* iOS 17+ device with camera |
| 25 | +* Xcode 15+ for development |
| 26 | +* Apple Developer account for App Store distribution |
| 27 | +* Perplexity API key (Sonar Pro) |
| 28 | +* OpenAI API key (GPT-3.5) |
| 29 | +* PubMed E-utilities access |
21 | 30 |
|
22 |
| - |
| 31 | +## Installation |
23 | 32 |
|
24 |
| ---- |
| 33 | +```bash |
| 34 | +# Clone the repository |
| 35 | +git clone https://github.com/nickjlamb/PosterLens.git |
| 36 | +cd PosterLens |
25 | 37 |
|
26 |
| -## 🔗 Links |
| 38 | +# Open in Xcode |
| 39 | +open PosterLens.xcodeproj |
| 40 | +``` |
27 | 41 |
|
28 |
| -- 🧠 GitHub Repo: [PosterLens](https://github.com/nickjlamb/PosterLens) |
29 |
| -- 📲 App Store: [PosterLens on iOS](https://apps.apple.com/us/app/posterlens-research-scanner/id6745453368) |
| 42 | +## Configuration |
30 | 43 |
|
31 |
| ---- |
| 44 | +Add your API keys to the project configuration: |
| 45 | + |
| 46 | +```swift |
| 47 | +// API Configuration |
| 48 | +PERPLEXITY_API_KEY=your_sonar_pro_api_key |
| 49 | +OPENAI_API_KEY=your_gpt_api_key |
| 50 | +PUBMED_API_KEY=your_pubmed_api_key |
| 51 | +``` |
| 52 | + |
| 53 | +## Usage |
| 54 | + |
| 55 | +1. **Install from App Store**: Download PosterLens from the iOS App Store |
| 56 | +2. **Scan Poster**: Point your camera at a scientific poster |
| 57 | +3. **OCR Processing**: Apple Vision automatically extracts text content |
| 58 | +4. **Ask Questions**: Use natural language to query the poster content |
| 59 | +5. **Explore Related Research**: Discover semantically related studies via Sonar Pro |
| 60 | +6. **Validate Citations**: Check academic references with PubMed integration |
| 61 | + |
| 62 | +## Code Explanation |
32 | 63 |
|
33 |
| -## 🧠 How PosterLens Uses Sonar Pro |
| 64 | +* **Frontend**: Native iOS app built with SwiftUI for modern UI/UX |
| 65 | +* **OCR Processing**: Apple Vision framework for text extraction from images |
| 66 | +* **AI Integration**: Perplexity Sonar Pro API for semantic search and context understanding |
| 67 | +* **Natural Language**: GPT-3.5 for Q&A and content interpretation |
| 68 | +* **Academic Validation**: PubMed E-utilities for citation verification |
| 69 | +* **On-Device Processing**: Local OCR and processing for privacy and performance |
| 70 | +* **Research Enhancement**: Auto-generation of research questions and future directions |
34 | 71 |
|
35 |
| -PosterLens integrates **Sonar Pro** for: |
36 |
| -- Semantic understanding of OCR-extracted poster text |
37 |
| -- Factual Q&A grounded in scientific literature |
38 |
| -- Retrieval of related studies and citation-backed content |
| 72 | +## Links |
39 | 73 |
|
40 |
| -Sonar Pro is essential for turning a static scan into a dynamic research experience. |
| 74 | +- [GitHub Repository](https://github.com/nickjlamb/PosterLens) |
| 75 | +- [App Store](https://apps.apple.com/us/app/posterlens-research-scanner/id6745453368) |
0 commit comments