Skip to content

Interactive Cesium visualization with dynamic parquet query paths#25

Merged
rdhyee merged 7 commits intoisamplesorg:mainfrom
rdhyee:issue-13-parquet-duckdb
Sep 25, 2025
Merged

Interactive Cesium visualization with dynamic parquet query paths#25
rdhyee merged 7 commits intoisamplesorg:mainfrom
rdhyee:issue-13-parquet-duckdb

Conversation

@rdhyee
Copy link
Copy Markdown
Contributor

@rdhyee rdhyee commented Sep 25, 2025

Summary

  • Enhanced the parquet_cesium.qmd tutorial to support interactive point selection on Cesium map
  • Implemented two distinct query paths for finding samples related to clicked geospatial locations
  • Added comprehensive loading states and error handling for improved user experience

Changes

Core Functionality

  • Interactive map clicks: Users can now click on points on the Cesium map to explore related samples
  • Two query paths implemented:
    • Path 1 (direct_event_location): MaterialSampleRecord → SamplingEvent → GeospatialCoordLocation
    • Path 2 (via_site_location): MaterialSampleRecord → SamplingEvent → SamplingSite → GeospatialCoordLocation
  • Async data loading: Improved loadData function with request tokens to prevent race conditions

User Experience Improvements

  • Added loading indicators for all async operations
  • Implemented latest-only pattern to handle rapid user clicks
  • Added explanatory text for both query paths to help users understand the data relationships
  • Improved error handling and display

Additional Enhancements

  • Enhanced OpenContext parquet tutorial with comprehensive lessons from notebook analysis
  • Updated README with tutorial descriptions
  • Added detailed analysis of Zenodo iSamples data

Test Plan

  • Click on points in the Cesium map to verify interactive selection works
  • Verify that both query paths return appropriate sample data
  • Test rapid clicking to ensure no race conditions occur
  • Check that loading states display properly during data fetching
  • Verify error handling for invalid or empty queries

Related Issues

Addresses #13 - Working with parquet files and DuckDB

🤖 Generated with Claude Code

rdhyee and others added 7 commits September 23, 2025 15:43
@rdhyee @claude
Add enhanced OpenContext parquet analysis tutorial
8000dcb 
- Comprehensive property graph model documentation
- Interactive DuckDB-WASM based analysis in browser
- Corrected sample location queries with proper graph traversal
- Educational content about archaeological data relationships
- Performance optimization strategies for large datasets

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
@rdhyee @claude
Update README with enhanced OpenContext parquet tutorial
725da48 
- Document new oc_parquet_enhanced.qmd tutorial
- Highlight browser-based DuckDB-WASM analysis capabilities
- Add description of property graph traversal patterns
- Update tutorials section with comprehensive overview

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
@rdhyee @claude
Enhance OpenContext parquet tutorial with comprehensive lessons from …
20f76a9 
…notebook

Major additions:
- Critical discovery section highlighting correct vs incorrect query patterns
- Step-by-step debugging methodology showing how to find relationship paths
- Interactive validation queries demonstrating 0 → 1M+ sample recovery
- Archaeological insights with top sites and material distributions
- Comprehensive performance guidelines and debugging strategies

Key lessons emphasized:
- Multi-hop traversal required (Sample → Event → Location)
- Direct Sample→Location relationships don't exist (critical bug fix)
- Property graph debugging methodology for complex datasets
- Archaeological context with major sites (Çatalhöyük, Petra, etc.)

This tutorial now captures all essential insights from the enhanced notebook
for browser-based analysis and serves as definitive reference for querying
the OpenContext property graph structure.

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
@rdhyee
Merge branch 'isamplesorg:main' into issue-13-parquet-duckdb
740afad
@rdhyee @claude
Transitional progress: 2 paths calculation working proof of concept
b4f925c 
- pid is hardcoded for testing
- working towards setting pid as the clicked id
- get_samples_1 and get_samples_2 functions implemented

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
@rdhyee @claude
Use clicked point ID for dynamic sample path queries
173a013 
- Changed from hardcoded pid to using clickedPointId
- get_samples_1 and get_samples_2 now return arrays instead of single records
- Updates display sections to show data based on selected point
- Now fully interactive with map clicks

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
@rdhyee @claude
Major improvements to parquet_cesium visualization
52bd89b 
- Added loading states for async operations with visual feedback
- Improved error handling with loadData function using latest-only pattern
- Added explanatory text for Path 1 and Path 2 sample queries
- Fixed race conditions in data fetching with request tokens
- Added loading indicators for geo record and sample queries
- Improved user experience with clear loading/error states
- Added detailed documentation of query chains for both paths

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
@rdhyee rdhyee merged commit 50a70b5 into isamplesorg:main Sep 25, 2025
1 check passed
@rdhyee rdhyee mentioned this pull request Sep 25, 2025
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@rdhyee