The combination of multiple sources of sensor and other data correlated together simultaneously to help provide situational awareness for autonomous vehicles and other devices. Sensor fusion inputs come from sources such as LiDAR, Radar, ultrasonic, cameras, and other sensors that generate three-dimensional “point clouds” as well as correlate image data with other sensors to determine an awareness of the environment.