An evaluation system and related processes are provided for evaluating computing systems associated with vehicle mapping, navigation, and/or control. An evaluation system can include ground truth data generated based on sensor data from an evaluation sensor system as an evaluation vehicle traverses a travelway. A trial system can be evaluated by comparing one or more outputs of the trial system with the ground truth data at the evaluation system. The ground truth data can be projected onto a map associated with a trial vehicle position as it maneuvers along a travelway. Simulated output data of the trial system can be generated based on the projected ground truth data. The simulated output data can then be compared with an actual output of the trial system. Data indicative of the performance of the trial system can be generated based on the comparison between the trial system output and the ground truth data.

Creative Commons License

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.