Skip to content

Commit ba76e2c

Browse files
authored
Merge pull request #38 from nickjlamb/main
Add PosterLens to Perplexity Cookbook showcase
2 parents c68d7e3 + 50f1a70 commit ba76e2c

File tree

1 file changed

+75
-0
lines changed

1 file changed

+75
-0
lines changed

docs/showcase/posterlens.mdx

Lines changed: 75 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,75 @@
1+
---
2+
title: PosterLens | Scientific Poster Scanner & Research Assistant
3+
description: An iOS app that transforms static scientific posters into interactive insights using OCR and Perplexity's Sonar Pro API for semantic search and context
4+
sidebar_position: 21
5+
keywords: [PosterLens, iOS, OCR, scientific posters, research, Apple Vision, Sonar Pro, semantic search, medical research]
6+
---
7+
8+
**PosterLens** is an iOS app that transforms static scientific posters into interactive, explorable insights using OCR and AI. Created for the Perplexity Hackathon 2025, it allows researchers, MSLs, and medical writers to scan posters and explore them interactively using natural language, extracting meaning and surfacing related studies instantly.
9+
10+
![PosterLens Screenshot](https://cdn.prod.website-files.com/66d49e8555a289120a81ec3e/68930ad938e072c05d1be0b9_PosterLens.png)
11+
12+
## Features
13+
14+
* **Scientific Poster Scanning** using device camera and Apple Vision OCR
15+
* **Natural Language Q&A** about poster content with AI-powered responses
16+
* **Semantic Search Integration** using Perplexity Sonar Pro for related studies
17+
* **Citation Validation** with PubMed E-utilities for academic accuracy
18+
* **Auto-Generated Research Questions** and future research directions
19+
* **On-Device Processing** for privacy and performance
20+
* **Interactive Research Experience** transforming static content into dynamic insights
21+
22+
## Prerequisites
23+
24+
* iOS 17+ device with camera
25+
* Xcode 15+ for development
26+
* Apple Developer account for App Store distribution
27+
* Perplexity API key (Sonar Pro)
28+
* OpenAI API key (GPT-3.5)
29+
* PubMed E-utilities access
30+
31+
## Installation
32+
33+
```bash
34+
# Clone the repository
35+
git clone https://github.com/nickjlamb/PosterLens.git
36+
cd PosterLens
37+
38+
# Open in Xcode
39+
open PosterLens.xcodeproj
40+
```
41+
42+
## Configuration
43+
44+
Add your API keys to the project configuration:
45+
46+
```swift
47+
// API Configuration
48+
PERPLEXITY_API_KEY=your_sonar_pro_api_key
49+
OPENAI_API_KEY=your_gpt_api_key
50+
PUBMED_API_KEY=your_pubmed_api_key
51+
```
52+
53+
## Usage
54+
55+
1. **Install from App Store**: Download PosterLens from the iOS App Store
56+
2. **Scan Poster**: Point your camera at a scientific poster
57+
3. **OCR Processing**: Apple Vision automatically extracts text content
58+
4. **Ask Questions**: Use natural language to query the poster content
59+
5. **Explore Related Research**: Discover semantically related studies via Sonar Pro
60+
6. **Validate Citations**: Check academic references with PubMed integration
61+
62+
## Code Explanation
63+
64+
* **Frontend**: Native iOS app built with SwiftUI for modern UI/UX
65+
* **OCR Processing**: Apple Vision framework for text extraction from images
66+
* **AI Integration**: Perplexity Sonar Pro API for semantic search and context understanding
67+
* **Natural Language**: GPT-3.5 for Q&A and content interpretation
68+
* **Academic Validation**: PubMed E-utilities for citation verification
69+
* **On-Device Processing**: Local OCR and processing for privacy and performance
70+
* **Research Enhancement**: Auto-generation of research questions and future directions
71+
72+
## Links
73+
74+
- [GitHub Repository](https://github.com/nickjlamb/PosterLens)
75+
- [App Store](https://apps.apple.com/us/app/posterlens-research-scanner/id6745453368)

0 commit comments

Comments
 (0)