Patrasche
Overview
Human Specific tracking automobile (Patrasche) system on a drivable road
Main functions
Object Detection
Based on OWOD. Detect all person class object and classify other object as obstacles
Human Tracking
Based on Deep Sort. Track specific Human figure (Master), yet the possiblity of tracking id loss is modified with nearest-distance tracking object algorithm
In short, nearest-distance tracking object algorithm detect find new tracking object by searching a new human figure with the nearest distance from the location of the most recently tracked human figure.
Drivable Area Segmentation
Based on YOLOP. Fine-tuned with various types of roads in Korea. Find and do segmentation on drivable area in a given frame
Depth Evaluation
With Depth-Image, find object’s average depth. Area for depth evaluation refers to the center cropped part of the results from OWOD.
Method
Using Object Detection and Human Tracking, find the location of master. Then, calibrate angle for Patrasche
Collaborating above with the Drivable Area Segmentation, set examine area to decide whether Patrasche can drive towards Master or not
Using Depth Evaluation on objects detect potential threat for Patrasche, and using Master’s depth, determine an appropriate speed level for Patrasche
Demo
Master Bounding Box
Drivable Area
Examination result & Drive/Stop flag
Examine Area