---

FROM VISION TO UNDERSTANDING: Leveraging VLMs to enable autonomous driving decisions

1. Optical Flow with SAM2 and YOLO-V8:

   1. Result

      

   2. Flowchart

      

2. Optical Flow aided Ego-Vehicle Motion Estimation:

   1. Road Segmentation Mask

      

   2. Largest Rectangle Drivable area

      

   3. Optical flow of dynamic objects

      

   4. Optical Flow of drivable are

      

   5. Ego-Vehicle motion direction visualization - This shows 4 consecutive frame’s motion direction of the ego-vehicle in 3D world coordinates - estimated from 1 camera using Optical Flow

      

---