Teleoperated Vehicle-Perspective Predictive Display Accounting for Network Time Delays

Variable network time-delays in data-transmission is the major problem in tele-operating a vehicle. Even on LTE network, variability of these delays is high (70-150 ms ping). This paper presents an innovative approach of providing the remote operator a forecasted video stream which replicates future perspective of vehicle’s FOV upon reception of maneuvering commands. First, vehicle position is predicted accounting for its speed and data transmission delays. Then perspective image transformation2 is performed to get exact new perspective of vehicle FOV corresponds to the predicted position. This approach addresses both issues, time-delays as well as its variability. Only one display, which shows frontward FOV is availed for mock-up.