Skip to content

[Epic] Markerless image tracking #48

Description

@kalwalt

Goal

Develop markerless image tracking for WebARKit — tracking natural images / planar surfaces without a pre-registered marker — building on the marker-based planar tracker.

Context

The marker-based Teblid / AKAZE / ORB / FREAK planar tracker is being made correct and robust (pose, projection, tracking-loss, examples) under the Marker-based tracking foundation milestone. That pipeline (feature detection → matching → homography → solvePnP → pose) is the stepping stone toward markerless tracking. This epic seeds the Markerless tracking milestone and will be broken into sub-issues as the approach is decided.

Scope / open questions (to refine)

  • Define the "markerless" target: on-the-fly reference acquisition (use the first frame / a captured keyframe as the reference), matching against a database of natural images, or instant tracking of an arbitrary planar surface.
  • Reference/keyframe management without a pre-supplied marker image.
  • Extend the existing OCVT pipeline (TrackingPointSelector, homography, optical flow) to a markerless workflow.
  • Evaluate approaches (instant tracking, plane detection, SLAM-lite).
  • New example(s) in webarkit-testing demonstrating markerless tracking.
  • WASM performance budget (detection cost per frame — cf. Restore downsampled feature detection + single-marker detection guard for performance (reconcile with ArtoolkitX OCVT) #44).

Foundation it builds on

Status

Planning / north-star epic. Sub-issues to follow.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    Status
    To do

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions