Software
Flight software and autonomy, organized by the problem the code solves rather than by the vehicle that carried it. A page belongs here if it describes something that runs, on a processor, under a real-time or downlink constraint.
Round-trip light time sets the boundary, seconds at the Moon and hours in the outer solar system. Every technique here exists because some decision had to be made inside that window, or because the data to make it on the ground would not fit down the link. The processor sets the second boundary. On the Mars Exploration Rovers, stereo matching of a 256x256 pair took 24 to 30 seconds on the 20 MHz RAD6000, a full obstacle avoidance cycle about 70 seconds and a visual odometry step about 160 seconds, which held median net driving speed near 0.6 cm per second [1]. The same cost explains why rovers still stop, perceive, plan and step: the Stanford Cart worked that way in 1979 because one move took minutes of computation [2].
What the software knows
Section titled “What the software knows”Localization and perception turn sensor data into a position and a map. The mathematical core is older than any flight program: gradient-based image registration [3], scale invariant keypoints [4], robust model fitting by random sample consensus [5], recursive estimation [12] and the uncertainty-weighted merging of perceptions into a world model [6]. Dense stereo, the range source on every flown rover, is compared by a common taxonomy of matching cost, aggregation, optimization and refinement [7]. Flown systems used a small, conservative subset of these methods on flight-qualified processors; most of the published literature has been demonstrated only in laboratories, test yards or simulation, and each page below states which.
What it decides
Section titled “What it decides”Planning spans three time scales. Local path selection repairs a cost-to-goal field when a sensor shows an arc cost was wrong, without replanning from scratch [8]. Onboard planning and execution was flown as the Remote Agent on Deep Space 1, with a shared goal profile between ground and spacecraft [9]. For rovers, a planner that replans during execution to handle over- and under-subscription and opportunistic science was demonstrated in the JPL Mars Yard, not on Mars [10]. Control covers attitude and trajectory, manipulators and free flyers. Null-space obstacle avoidance on a redundant arm dates to simulation work in 1985 [11], and real-time obstacle avoidance for manipulators and mobile robots was formulated in 1986 [30]. Curiosity’s traction control is a flown control algorithm with published flight results [31]. Formation flying controllers are now checked in a common simulator before running on air-bearing free flyers [24].
How it survives being wrong
Section titled “How it survives being wrong”Fault management rests on the dependability taxonomy of faults, errors and failures [13]. Two flight cases anchor the field. SIFT put redundancy in software, with each processor voting on its neighbors’ results and no hardware voter [15]. Flown fault protection is documented for the Mars Exploration Rovers [25] and for the Curiosity fault protection engine [26], and NASA’s study of flight software complexity [27] frames why that code is hard to verify. Mars Pathfinder’s resets were reported as a priority inversion in which a low-priority task held a bus mutex [14]; that account circulated as an email summary of a keynote, not a mission report, so its details carry that weight.
How it talks and what it runs on
Section titled “How it talks and what it runs on”Communications and data handling share one constraint: the link is narrow and intermittent. Delay Tolerant Networking was proposed for Mars and lunar relay and evaluated in simulation [17], then profiled for space use as a CCSDS standard [16]. Onboard compression is the other lever, for example a progressive wavelet compressor for hyperspectral images derived from the MER image compressor [18]. The ICER compressor itself is described in [29]. The MER relay and direct-to-Earth link design is documented in [28]. The platform side runs from the layered core Flight System [19] to the argument that commercial multicore parts, not FPGAs, are the route to higher onboard computing, a proposal with a stated requirements list rather than a flown part [20].
How people work with it and how it is verified
Section titled “How people work with it and how it is verified”As command authority moves onboard, ground tools have to support goal and priority based commanding instead of sequences, a gap identified in a two year JPL study [22]. The flown reference for collaborative ground planning is the Mars 2020 activity planning tool [21]. Verification is covered through model-based software engineering practice on SMAP [23] and through simulation fidelity and hardware-in-the-loop pages.
What has flown and what is being tried
Section titled “What has flown and what is being tried”Flown perception and navigation. The Mars 2020 Lander Vision System reduced a 3.2 km initial horizontal position error to under 40 m within 10 seconds, matching up to 150 patches per image against a 6 m/pixel onboard map; it is the first operational terrain relative navigation on a planetary landing [32]. On the surface, visual odometry was used on 87 percent of Curiosity drives over nine years, and a flight software change to process images while driving was tested on a terrestrial testbed, not on Mars [45]. Perseverance flew onboard global localization by repurposing Ingenuity’s Snapdragon 801 base station as a co-processor, matching post-drive orthomosaics to a HiRISE map to within 1 m on benchmark data; the flight phases were open loop [33].
Flown planning and onboard science. The Mars 2020 onboard planner is a priority-first, non-backtracking scheduler, described before it took control of the rover [34]. The MEXEC planner and executive flew on the ASTERIA CubeSat in September 2019, with the reactive capability shown only on a testbed [39]. AEGIS ran 237 times on Curiosity between sols 1343 and 2830 and selected 284 ChemCam targets, usually in under 500 seconds on the RAD750 [41].
Flown software infrastructure. Ingenuity ran F Prime in three deployments on three processors [37]. Curiosity’s mobility downlink assessment is now largely automated: over 80 percent of the chair’s work, with nominal assessments falling from 30 to 45 minutes to under 10 [42].
Ground-tested or pre-flight. The CADRE three-rover lunar demonstration has a multi-agent architecture and planner tested in cleanrooms and the Mars Yard, with no flight data in the cited papers [36][35]. A learned traversability predictor cut perception latency from about 500 ms to 140 ms on an off-road vehicle in desert terrain, scored against its own training labels [43]. SPLICE hazard detection software was measured on helicopter-collected lidar maps, with true positive rates of 50 to 70 percent and false positive rates of 0.4 to 0.6 percent at operational step sizes [44].
Verification. Mars 2020 fault protection validation executed 265 scenario cases of a minimal set of 150 [38]. The Surface System Development Environment ran flight software against commercial avionics to relieve scarce flight-like testbeds, at the cost of fidelity gaps that surfaced later as operational problems [40].
Communications, control, data handling, fault management, flight software, human interaction, localization, multi-agent, perception, planning and verification each have a section. Every page carries the cost of the technique on the hardware it ran on, and says whether the method flew, was tested on the ground, or was only proposed.
What is not established
Section titled “What is not established”Cost figures are available for the Mars Exploration Rover processors [1]; comparable published figures for newer flight computers and for most of the learned perception and planning methods are not held in the corpus. The Pathfinder reset account [14] is a secondary source. Multicore and onboard-autonomy proposals [20][10] lack flight data. The CADRE papers report no flight data [36][35], and the SPLICE rates come from post-processed replay of one hazard field [44].
References
- Maimone, M., Johnson, A., Cheng, Y., Willson, R. and Matthies, L. (2004). Autonomous Navigation Results from the Mars Exploration Rover (MER) Mission
. International Symposium on Experimental Robotics. Source
BibTeX
@inproceedings{maimone2004autonomous, title = {Autonomous Navigation Results from the Mars Exploration Rover (MER) Mission}, author = {Maimone, Mark and Johnson, Andrew and Cheng, Yang and Willson, Reg and Matthies, Larry}, booktitle = {International Symposium on Experimental Robotics}, address = {Singapore}, year = {2004}, url = {https://dataverse.jpl.nasa.gov/dataset.xhtml?persistentId=hdl:2014/41077} } - Moravec, H. P. (1980). Obstacle Avoidance and Navigation in the Real World by a Seeing Robot Rover
. Carnegie Mellon University, CMU-RI-TR-3 / STAN-CS-80-813 / AIM-340. Source
BibTeX
@phdthesis{moravec1980obstacle, title = {Obstacle Avoidance and Navigation in the Real World by a Seeing Robot Rover}, author = {Moravec, Hans P.}, journal = {Carnegie Mellon University}, number = {CMU-RI-TR-3 / STAN-CS-80-813 / AIM-340}, school = {Stanford University}, type = {Ph.D. dissertation}, year = {1980}, doi = {10.1184/r1/6557033.v1} } - Lucas, B. D. and Kanade, T. (1981). An Iterative Image Registration Technique with an Application to Stereo Vision
. DARPA Image Understanding Workshop. Source
BibTeX
@inproceedings{lucas1981iterative, title = {An Iterative Image Registration Technique with an Application to Stereo Vision}, author = {Lucas, Bruce D. and Kanade, Takeo}, booktitle = {DARPA Image Understanding Workshop}, pages = {121--130}, year = {1981}, url = {https://www.ri.cmu.edu/pub_files/pub3/lucas_bruce_d_1981_2/lucas_bruce_d_1981_2.pdf} } - Lowe, D. G. (2004). Distinctive Image Features from Scale-Invariant Keypoints
. International Journal of Computer Vision, 2. Source
BibTeX
@article{lowe2004distinctive, title = {Distinctive Image Features from Scale-Invariant Keypoints}, author = {Lowe, David G.}, journal = {International Journal of Computer Vision}, volume = {60}, number = {2}, pages = {91--110}, year = {2004}, doi = {10.1023/b:visi.0000029664.99615.94} } - Fischler, M. A. and Bolles, R. C. (1981). Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography
. Communications of the ACM, 6. Source
BibTeX
@article{fischler1981random, title = {Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography}, author = {Fischler, Martin A. and Bolles, Robert C.}, journal = {Communications of the ACM}, volume = {24}, number = {6}, pages = {381--395}, year = {1981}, doi = {10.1145/358669.358692}, abstract = {A new paradigm, Random Sample Consensus (RANSAC), for fitting a model to experimental data is introduced. RANSAC is capable of interpreting/smoothing data containing a significant percentage of gross errors, and is thus ideally suited for applications in automated image analysis where interpretation is based on the data provided by error-prone feature detectors. A major portion of this paper describes the application of RANSAC to the Location Determination Problem (LDP): Given an image depicting a set of landmarks with known locations, determine that point in space from which the image was obtained. In response to a RANSAC requirement, new results are derived on the minimum number of landmarks needed to obtain a solution, and algorithms are presented for computing these minimum-landmark solutions in closed form. These results provide the basis for an automatic system that can solve the LDP under difficult viewing} } - Chatila, R. and Laumond, J.-P. (1985). Position Referencing and Consistent World Modeling for Mobile Robots
. IEEE International Conference on Robotics and Automation. Source
BibTeX
@inproceedings{chatila1985position, title = {Position Referencing and Consistent World Modeling for Mobile Robots}, author = {Chatila, Raja and Laumond, Jean-Paul}, booktitle = {IEEE International Conference on Robotics and Automation}, volume = {2}, pages = {138-145}, year = {1985}, doi = {10.1109/robot.1985.1087373}, abstract = {In order to understand its environment, a mobile robot should be able to model consistently this environment, and to locate itself correctly. One major difficulty to be solved is the inaccuracies introduced by the sensors. The approach proposed in this paper to cope with this problem relies on 1) defining general principles to deal with uncertainties : the use of a multisensory system, favo ring of the data collected by the more accurate sensor in a given situation, averaging of different but consistent measurements of the same entity weighted with their associated uncertainties, and 2) a methodology enabling a mobile robot to define its own reference landmarks while exploring its environment. These ideas are presented together with an example of their application on the mobile robot HILARE.} } - Scharstein, D. and Szeliski, R. (2002). A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms
. International Journal of Computer Vision. Source
BibTeX
@article{scharstein2002taxonomy, title = {A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms}, author = {Scharstein, Daniel and Szeliski, Richard}, journal = {International Journal of Computer Vision}, volume = {47}, pages = {7-42}, year = {2002}, doi = {10.1023/a:1014573219977} } - Stentz, A. (1994). The D* Algorithm for Real-Time Planning of Optimal Traverses
. Robotics Institute, Carnegie Mellon University, CMU-RI-TR-94-37. Source
BibTeX
@techreport{stentz1994algorithm, title = {The D* Algorithm for Real-Time Planning of Optimal Traverses}, author = {Stentz, Anthony}, number = {CMU-RI-TR-94-37}, institution = {Robotics Institute, Carnegie Mellon University}, year = {1994}, url = {https://www.ri.cmu.edu/pub_files/pub3/stentz_anthony__tony__1994_2/stentz_anthony__tony__1994_2.pdf} } - Pell, B., Sawyer, S. R., Muscettola, N., Smith, B. and Bernard, D. E. (1998). Mission Operations with an Autonomous Agent
. IEEE Aerospace Conference. Source
BibTeX
@inproceedings{pell1998mission, title = {Mission Operations with an Autonomous Agent}, author = {Pell, Barney and Sawyer, Scott R. and Muscettola, Nicola and Smith, Benjamin and Bernard, Douglas E.}, booktitle = {IEEE Aerospace Conference}, volume = {2}, pages = {289-313}, year = {1998}, doi = {10.1109/aero.1998.687917}, abstract = {The Remote Agent (RA) is an Artificial Intelligence (AI) system which automates some of the tasks normally reserved for human mission operators and performs these tasks autonomously on-board the spacecraft. These tasks include activity generation, sequencing, spacecraft analysis, and failure recovery. The RA will be demonstrated as a flight experiment on Deep Space One (DS1), the first deep space mission of the NASA's New Millennium Program (NMP). As we moved from prototyping into actual flight code development and teamed with ground operators, we made several major extensions to the RA architecture to address the broader operational context in which RA would be used. These extensions support ground operators and the RA sharing a long-range mission profile with facilities for asynchronous ground updates; support ground operators monitoring and commanding the spacecraft at multiple levels of detail simultaneously; and enable ground operators to provide additional knowledge to the RA, such as parameter updates, model updates, and diagnostic information, without interfering with the activities of the RA or leaving the system in an inconsistent state. The resulting architecture supports incremental autonomy, in which a basic agent can be delivered early and then used in an increasingly autonomous manner over the lifetime of the mission. It also supports variable autonomy, as it enables ground operators to benefit from autonomy when they want it, but does not inhibit them from obtaining a detailed understanding and exercising tighter control when necessary. These issues are critical to the successful development and operation of autonomous spacecraft.} } - Chouinard, C., Estlin, T., Gaines, D. and Fisher, F. (2005). Intelligent rover decision-making in response to exogenous events. Source
BibTeX
@other{chouinard2005, title = {Intelligent rover decision-making in response to exogenous events}, author = {Chouinard, C. and Estlin, T. and Gaines, D. and Fisher, F.}, year = {2005}, url = {https://dataverse.jpl.nasa.gov/dataset.xhtml?persistentId=hdl:2014/37757} } - Maciejewski, A. A. and Klein, C. A. (1985). Obstacle Avoidance for Kinematically Redundant Manipulators in Dynamically Varying Environments
. The International Journal of Robotics Research, 3. Source
BibTeX
@article{maciejewski1985obstacle, title = {Obstacle Avoidance for Kinematically Redundant Manipulators in Dynamically Varying Environments}, author = {Maciejewski, Anthony A. and Klein, Charles A.}, journal = {The International Journal of Robotics Research}, volume = {4}, number = {3}, pages = {109-117}, publisher = {SAGE Publications}, year = {1985}, doi = {10.1177/027836498500400308}, abstract = {The vast majority of work to date concerned with obstacle avoidance for manipulators has dealt with task descriptions in the form ofpick-and-place movements. The added flexibil ity in motion control for manipulators possessing redundant degrees offreedom permits the consideration of obstacle avoidance in the context of a specified end-effector trajectory as the task description. Such a task definition is a more accurate model for such tasks as spray painting or arc weld ing. The approach presented here is to determine the re quired joint angle rates for the manipulator under the con straints of multiple goals, the primary goal described by the specified end-effector trajectory and secondary goals describ ing the obstacle avoidance criteria. The decomposition of the solution into a particular and a homogeneous component effectively illustrates the priority of the multiple goals that is exact end-effector control with redundant degrees of freedom maximizing the distance to obstacles. An efficient numerical implementation of the technique permits sufficiently fast cycle times to deal with dynamic environments.} } - Kalman, R. E. (1960). A New Approach to Linear Filtering and Prediction Problems
. Journal of Basic Engineering, 1. Source
BibTeX
@article{kalman1960new, title = {A New Approach to Linear Filtering and Prediction Problems}, author = {Kalman, Rudolf E.}, journal = {Journal of Basic Engineering}, volume = {82}, number = {1}, pages = {35-45}, year = {1960}, doi = {10.1115/1.3662552}, abstract = {The classical filtering and prediction problem is re-examined using the Bode-Shannon representation of random processes and the “state-transition” method of analysis of dynamic systems. New results are: (1) The formulation and methods of solution of the problem apply without modification to stationary and nonstationary statistics and to growing-memory and infinite-memory filters. (2) A nonlinear difference (or differential) equation is derived for the covariance matrix of the optimal estimation error. From the solution of this equation the co-efficients of the difference (or differential) equation of the optimal linear filter are obtained without further calculations. (3) The filtering problem is shown to be the dual of the noise-free regulator problem. The new method developed here is applied to two well-known problems, confirming and extending earlier results. The discussion is largely self-contained and proceeds from first principles; basic concepts of the theory of random processes are reviewed in the Appendix.} } - Avizienis, A., Laprie, J.-C., Randell, B. and Landwehr, C. (2004). Basic Concepts and Taxonomy of Dependable and Secure Computing
. IEEE Transactions on Dependable and Secure Computing, 1. Source
BibTeX
@article{avizienis2004basic, title = {Basic Concepts and Taxonomy of Dependable and Secure Computing}, author = {Avizienis, Algirdas and Laprie, Jean-Claude and Randell, Brian and Landwehr, Carl}, journal = {IEEE Transactions on Dependable and Secure Computing}, volume = {1}, number = {1}, pages = {11--33}, year = {2004}, doi = {10.1109/tdsc.2004.2}, abstract = {This paper gives the main definitions relating to dependability, a generic concept including a special case of such attributes as reliability, availability, safety, integrity, maintainability, etc. Security brings in concerns for confidentiality, in addition to availability and integrity. Basic definitions are given first. They are then commented upon, and supplemented by additional definitions, which address the threats to dependability and security (faults, errors, failures), their attributes, and the means for their achievement (fault prevention, fault tolerance, fault removal, fault forecasting). The aim is to explicate a set of general concepts, of relevance across a wide range of situations and, therefore, helping communication and cooperation among a number of scientific and technical communities, including ones that are concentrating on particular types of system, of system failures, or of causes of system failures.} } - Jones, M. B. (1997). What really happened on Mars?. cs.unc.edu/~anderson/teach/comp790/papers/mars_pathfinder_short_versi...
BibTeX
@misc{jones1997what, title = {What really happened on Mars?}, author = {Jones, Michael B.}, organization = {Microsoft Research}, year = {1997}, url = {https://www.cs.unc.edu/~anderson/teach/comp790/papers/mars_pathfinder_short_version.html} } - Goldberg, J., Green, M. W., Kautz, W. H., Levitt, K. N., Melliar-Smith, P. M., Schwartz, R. L. and Weinstock, C. B. (1984). Development and Analysis of the Software Implemented Fault-Tolerance (SIFT) Computer
. SRI International for NASA Langley Research Center, NASA CR-172146. Source
BibTeX
@techreport{goldberg1984development, title = {Development and Analysis of the Software Implemented Fault-Tolerance (SIFT) Computer}, author = {Goldberg, Jack and Green, Milton W. and Kautz, William H. and Levitt, Karl N. and Melliar-Smith, P. Michael and Schwartz, Richard L. and Weinstock, Charles B.}, number = {NASA CR-172146}, institution = {SRI International for NASA Langley Research Center}, year = {1984}, url = {https://ntrs.nasa.gov/citations/19840010885}, abstract = {SIFT (Software Implemented Fault Tolerance) is an experimental, fault-tolerant computer system designed to meet the extreme reliability requirements for safety-critical functions in advanced aircraft. Errors are masked by performing a majority voting operation over the results of identical computations, and faulty processors are removed from service by reassigning computations to the nonfaulty processors. This scheme has been implemented in a special architecture using a set of standard Bendix BDX930 processors, augmented by a special asynchronous-broadcast communication interface that provides direct, processor to processor communication among all processors. Fault isolation is accomplished in hardware; all other fault-tolerance functions, together with scheduling and synchronization are implemented exclusively by executive system software. The system reliability is predicted by a Markov model. Mathematical consistency of the system software with respect to the reliability model has been partially verified, using recently developed tools for machine-aided proof of program correctness.} } - CCSDS. (2015). CCSDS Bundle Protocol Specification
. Consultative Committee for Space Data Systems, CCSDS 734.2-B-1, Blue Book. Source
BibTeX
@techreport{ccsds2015bundle, title = {CCSDS Bundle Protocol Specification}, author = {{CCSDS}}, number = {CCSDS 734.2-B-1, Blue Book}, institution = {Consultative Committee for Space Data Systems}, year = {2015}, url = {https://ccsds.org/Pubs/734x2b1.pdf} } - Krupiarz, C. J., Jennings, E. H., Seguí, J. S., Pang, J. N., Schoolcraft, J. B. and Torgerson, J. L. (2006). Spacecraft data and relay management using delay tolerant networking
. SpaceOps Conference. Source
BibTeX
@inproceedings{krupiarz2006spacecraft, title = {Spacecraft data and relay management using delay tolerant networking}, author = {Krupiarz, Christopher J. and Jennings, Esther H. and Seguí, John S and Pang, Jackson N and Schoolcraft, Joshua B. and Torgerson, J. Leigh}, booktitle = {SpaceOps Conference}, year = {2006}, doi = {10.2514/6.2006-5754}, abstract = {NASA's demonstration of the successful transmission of relay data through the orbiting Mars Odyssey, Mars Global Surveyor, and Mars Express by the Mars Exploration Rovers has shown not only the benefit of using a relay satellite for multiple landed assets in a deep space environment but also the benefit of international standards for such architecture. As NASA begins the quest defined in the Vision for Exploration with robotic and manned missions to the Moon, continues its study of Mars, and is joined in these endeavors by countries world-wide, landed assets transmitting data through relay satellites will be crucial for completing mission objectives. However, this method of delivery of data will result in increased complexity in routing and prioritization of data transmission as the number of missions increases. Also, there is currently no standard method among organizations conducting such missions to return these data sets to Earth given a complex environment. One possibility for establishing such a standard is for mission designers to deploy protocols which fall under the umbrella of Delay Tolerant Networking (DTN). These developing standards include the Bundle Protocol (BP) which provides a standard, secure, store and forward mechanism designed for high latency and asymmetric communication links and the Licklider Transmission Protocol (LTP) which is used to provide a reliable deep space link transmission service.} } - Kiely, A., Klimesh, M., Xie, H. and Aranki, N. (2006). ICER-3D: A Progressive Wavelet-Based Compressor for Hyperspectral Images
. IPN Progress Report. Source
BibTeX
@article{kiely2006icer3d, title = {ICER-3D: A Progressive Wavelet-Based Compressor for Hyperspectral Images}, author = {Kiely, A. and Klimesh, M. and Xie, Heping and Aranki, N.}, journal = {IPN Progress Report}, volume = {42-164}, institution = {Jet Propulsion Laboratory}, year = {2006}, url = {https://ipnpr.jpl.nasa.gov/progress_report/42-164/164A.pdf} } - NASA. (2020). Core Flight System (cFS) Training
. NASA, NASA/TM-20205000691 Rev 1. Source
BibTeX
@techreport{nasa2020core, title = {Core Flight System (cFS) Training}, author = {{NASA}}, number = {NASA/TM-20205000691 Rev 1}, institution = {NASA}, year = {2020}, url = {https://ntrs.nasa.gov/citations/20205011588} } - Powell, W. A., Johnson, M. A., Wilmot, J., Some, R., Gostelow, K. P., Reeves, G. and Doyle, R. J. (2011). Enabling future robotic missions with multicore processors
. Infotech@Aerospace. Source
BibTeX
@inproceedings{powell2011enabling, title = {Enabling future robotic missions with multicore processors}, author = {Powell, Wesley A. and Johnson, Michael A. and Wilmot, Jonathan and Some, Raphael and Gostelow, Kim P. and Reeves, Glenn and Doyle, Richard J.}, booktitle = {Infotech@Aerospace}, publisher = {American Institute of Aeronautics and Astronautics}, year = {2011}, doi = {10.2514/6.2011-1447} } - Deliz, I., Connell, A., Joswig, C., Kanefsky, B. and Marquez, J. (2022). COCPIT: Collaborative Activity Planning Software for Mars Perseverance Rover
. IEEE Aerospace Conference, 20220003012. Source
BibTeX
@inproceedings{deliz2022cocpit, title = {{COCPIT}: Collaborative Activity Planning Software for {Mars} {Perseverance} Rover}, author = {Deliz, Ivy and Connell, Andrea and Joswig, Chet and Kanefsky, Bob and Marquez, Jessica}, booktitle = {IEEE Aerospace Conference}, number = {20220003012}, pages = {1-13}, institution = {NASA}, address = {Big Sky, Montana}, year = {2022}, doi = {10.1109/aero53065.2022.9843397}, abstract = {Since landing on the Martian surface, the Perseverance rover has relied on a distributed team to generate commands for exploring its new environment each sol (Martian day). The team uses a complex suite of software tools to accomplish this challenging task in time for the next window of opportunity to send commands to the rover. A key piece of this software ecosystem is COCPIT (Component-based Campaign Planning, Implementation, and Tactical). COCPIT is part of the next generation of planning and scheduling software tools developed by NASA's Jet Propulsion Laboratory in partnership with NASA's Ames Research Center. COCPIT is a web-based application that allows users to collaboratively view and update the Perseverance rover's activity plans, continuously verify that the plan satisfies constraints, assign targets for directing scientific instruments, document science intent, and model power and data resources. Mars Surface Operations requires diverse expertise from team members within the Engineering, Science, Robotic, and Instrument Operations groups, distributed across North America and Europe. In order to improve efficiency and reduce risk, all teams are able to review and edit their activities simultaneously and see the effects on the plan in its entirety. As part of the Ground Data System (GDS) tool suite, COCPIT is responsible for the activity plan. It provides specialized views that allow operators to understand where there may be room for additional observations, see whether any planning constraints are being violated, and confirm that energy usage and data generation are within the defined limits. It contains details such as which filters a camera will use for a given observation, what the resolution of the images should be, where to store the data onboard, and how long the observation is expected to take. It predicts when specific data will be downlinked from the rover to a passing orbiter, so that the team knows when to expect that data on Earth for evaluation in future planning. Ultimately the information from the COCPIT plan is translated to sequences that will be bundled and radiated to Perseverance for execution. The COCPIT tool is used throughout all planning phases.} } - Castano, R., Rossi, F., Vaquero, T. S., Verma, V., Allard, D., Amini, R., Barrett, A., Choukroun, M., Davidoff, S., Dhamani, N., Francis, R., Hofstadter, M., Huffmann, B., Ingham, M., Jasour, A., Jorritsma, M., Van Wyk, E. and Rabideau, G. (2023). Operating Deep Space Autonomous Spacecraft: Ground Processes and Tools for Operability and Trust
. SpaceOps The International Conference on Space Operations. Source
BibTeX
@inproceedings{castano2023operating, title = {Operating Deep Space Autonomous Spacecraft: Ground Processes and Tools for Operability and Trust}, author = {Castano, Rebecca and Rossi, Federico and Vaquero, Tiago Stegun and Verma, Vandi and Allard, Dan and Amini, Rashied and Barrett, Anthony and Choukroun, Mathieu and Davidoff, Scott and Dhamani, Nihal and Francis, Raymond and Hofstadter, Mark and Huffmann, Bennett and Ingham, Michel and Jasour, Ashkan and Jorritsma, Marijke and Van Wyk, Ellen and Rabideau, Gregg}, booktitle = {SpaceOps The International Conference on Space Operations}, publisher = {JPL Open Repository}, year = {2023}, doi = {10.48577/jpl.xefelw} } - Murray, A., Jones, C. G., Reder, L. and Cheng, S.-W. (2011). The use of modeling for flight software engineering on SMAP
. Aerospace Conference. Source
BibTeX
@inproceedings{murray2011use, title = {The use of modeling for flight software engineering on SMAP}, author = {Murray, Alexander and Jones, Chris G. and Reder, Leonard and Cheng, Shang-Wen}, booktitle = {Aerospace Conference}, pages = {1-19}, year = {2011}, doi = {10.1109/aero.2011.5747540}, abstract = {The Soil Moisture Active Passive (SMAP) mission proposes to deploy an Earth-orbiting satellite with the goal of obtaining global maps of soil moisture content at regular intervals. Launch is currently planned in 2014. The spacecraft bus would be built at the Jet Propulsion Laboratory (JPL), incorporating both new avionics as well as hardware and software heritage from other JPL projects. [4] provides a comprehensive overview of the proposed mission.} } - Krantz, E., Chan, N. N., Tibert, G., Mao, H. and Fuglesang, C. (2025). Bridging the Basilisk Astrodynamics Framework with ROS 2 for Modular Spacecraft Simulation and Hardware Integration
. International Conference on Space Robotics. Source
BibTeX
@inproceedings{krantz2025bridging, title = {Bridging the Basilisk Astrodynamics Framework with ROS 2 for Modular Spacecraft Simulation and Hardware Integration}, author = {Krantz, Elias and Chan, Ngai Nam and Tibert, Gunnar and Mao, Huina and Fuglesang, Christer}, booktitle = {International Conference on Space Robotics}, pages = {343-348}, year = {2025}, doi = {10.1109/isparo66239.2025.11437323}, abstract = {Integrating high-fidelity spacecraft simulators with modular robotics frameworks remains a challenge for autonomy development. This paper presents a lightweight, open-source communication bridge between the Basilisk astro-dynamics simulator and the Robot Operating System 2 (ROS 2), enabling real-time, bidirectional data exchange for spacecraft control. The bridge requires no changes to Basilisk’s core and integrates seamlessly with ROS 2 nodes. We demonstrate its use in a leader-follower formation flying scenario using nonlinear model predictive control, deployed identically in both simulation and on the ATMOS planar microgravity testbed. This setup supports rapid development, hardware-in-the-loop testing, and seamless transition from simulation to hardware. The bridge offers a flexible and scalable platform for modular spacecraft autonomy and reproducible research workflows.} } - Neilson, T. (2005). Mars Exploration Rovers Surface Fault Protection
. IEEE International Conference on Systems, Man and Cybernetics. Source
BibTeX
@inproceedings{neilson2005mars, title = {Mars Exploration Rovers Surface Fault Protection}, author = {Neilson, Tracy}, booktitle = {IEEE International Conference on Systems, Man and Cybernetics}, volume = {1}, pages = {14-19}, address = {Big Sky, Montana}, year = {2005}, doi = {10.1109/icsmc.2005.1571115}, abstract = {The Mars exploration rovers surface fault protection design was influenced by the need for the solar powered rovers to recharge their batteries during the day to survive the night. The rovers were required to autonomously maintain thermal stability, and initiate reliable communication with orbiting assets or directly to Earth, while maintaining their energy balance. This paper describes the system fault protection design for the surface phase of the mission, including hardware descriptions and software algorithms. Additionally, a few in-flight experiences are described, including the Spirit flash memory anomaly and the Opportunity "stuck-on" heater failure.} } - Benowitz, E. (2015). The Curiosity Mars Rover's Fault Protection Engine
. IEEE International Conference on Space Mission Challenges for Information Technology. Source
BibTeX
@inproceedings{benowitz2015curiosity, title = {The Curiosity Mars Rover's Fault Protection Engine}, author = {Benowitz, Ed}, booktitle = {IEEE International Conference on Space Mission Challenges for Information Technology}, volume = {111}, pages = {62-66}, address = {Big Sky, Montana}, year = {2015}, doi = {10.1109/smc-it.2014.16}, abstract = {The Curiosity Rover, currently operating on Mars, contains flight software onboard to autonomously handle aspects of system fault protection. Over 1000 monitors and 39 responses are present in the flight software. Orchestrating these behaviorsis the flight software's fault protection engine. In this paper, we discuss the engine's design, responsibilities, and present some lessons learned for future missions.} } - Dvorak, D. (2009). NASA Study on Flight Software Complexity
. AIAA Infotech@Aerospace Conference. Source
BibTeX
@inproceedings{dvorak2009nasa, title = {NASA Study on Flight Software Complexity}, author = {Dvorak, Daniel}, booktitle = {AIAA Infotech@Aerospace Conference}, year = {2009}, doi = {10.2514/6.2009-1882}, abstract = {In 2007 the NASA Office of Chief Engineer commissioned a multi-center study to bring forth technical and managerial strategies to address risks from growth in size and complexity of flight software in NASA’s space missions. The motivation for the study grew from problems attributed to flight software in a variety of missions—in both pre-launch and post-launch activities—and concerns that such problems were growing with the expanding role of flight software. The study was tasked to examine the growth in flight software size and complexity, recommend ways to reduce and better manage complexity, and identify methods of testing complex logic. This report examines complexity throughout the engineering lifecycle—from requirements definition through design, development, verification, and operations—and presents sixteen findings and associated recommendations.} } - Taylor, J., Makovsky, A., Barbieri, A., Tung, R., Estabrook, P. and Thomas, A. G. (2014). Mars Exploration Rover Telecommunications
. Deep Space Communications. Source
BibTeX
@incollection{taylor2014mars, title = {Mars Exploration Rover Telecommunications}, author = {Taylor, Jim and Makovsky, Andre and Barbieri, Andrea and Tung, Ramona and Estabrook, Polly and Thomas, A. Gail}, booktitle = {Deep Space Communications}, series = {DESCANSO Design and Performance Summary Series}, publisher = {Jet Propulsion Laboratory, California Institute of Technology}, chapter = {7}, year = {2014}, url = {https://descanso.jpl.nasa.gov/monograph/series13/DeepCommo_Chapter7--141030.pdf} } - Kiely, A. and Klimesh, M. (2003). The ICER Progressive Wavelet Image Compressor
. IPN Progress Report. Source
BibTeX
@article{kiely2003icer, title = {The ICER Progressive Wavelet Image Compressor}, author = {Kiely, A. and Klimesh, M.}, journal = {IPN Progress Report}, volume = {42-155}, institution = {Jet Propulsion Laboratory}, year = {2003}, url = {https://ipnpr.jpl.nasa.gov/progress_report/42-155/155J.pdf} } - Khatib, O. (1986). Real-Time Obstacle Avoidance for Manipulators and Mobile Robots
. Earth and Space Science, 1. Source
BibTeX
@article{khatib1986real, title = {Real-Time Obstacle Avoidance for Manipulators and Mobile Robots}, author = {Khatib, Oussama}, journal = {Earth and Space Science}, volume = {5}, number = {1}, pages = {90-98}, publisher = {SAGE Publications}, year = {1986}, doi = {10.1177/027836498600500106}, abstract = {This paper presents a unique real-time obstacle avoidance approach for manipulators and mobile robots based on the artificial potential field concept. Collision avoidance, tradi tionally considered a high level planning problem, can be effectively distributed between different levels of control, al lowing real-time robot operations in a complex environment. This method has been extended to moving obstacles by using a time-varying artificial patential field. We have applied this obstacle avoidance scheme to robot arm mechanisms and have used a new approach to the general problem of real-time manipulator control. We reformulated the manipulator con trol problem as direct control of manipulator motion in oper ational space—the space in which the task is originally described—rather than as control of the task's corresponding joint space motion obtained only after geometric and kine matic transformation. Outside the obstacles' regions of influ ence, we caused the end effector to move in a straight line with an upper speed limit. The artificial potential field ap proach has been extended to collision avoidance for all ma nipulator links. In addition, a joint space artificial potential field is used to satisfy the manipulator internal joint con straints. This method has been implemented in the COSMOS system for a PUMA 560 robot. Real-time collision avoidance demonstrations on moving obstacles have been performed by using visual sensing.} } - Toupet, O., Biesiadecki, J., Rankin, A., Steffy, A., Meirion-Griffith, G., Levine, D., Schadegg, M. and Maimone, M. (2020). Traction Control on the Curiosity Mars Rover: Algorithm and Flight Results
. Journal of Field Robotics. Source
BibTeX
@article{toupet2020traction, title = {Traction Control on the Curiosity Mars Rover: Algorithm and Flight Results}, author = {Toupet, Olivier and Biesiadecki, Jeffrey and Rankin, Arturo and Steffy, Amanda and Meirion-Griffith, Gareth and Levine, Dan and Schadegg, Maximilian and Maimone, Mark}, journal = {Journal of Field Robotics}, year = {2020}, doi = {10.48577/jpl.hkzuqs}, abstract = {No abstract available.} } - Johnson, A. E., Aaron, S., Ansari, H., Bergh, C., Bourdu, H., Butler, J., Chang, J., Cheng, R., Cheng, Y., Clark, K., Clouse, D., Donnelly, R., Gostelow, K., Jay, W., Jordan, M., Mohan, S., Montgomery, J. F., Morrison, J., Schroeder, S., Shenker, B., Sun, G., Trawny, N., Umsted, C., Vaughan, G., Ravine, M., Schaffner, J., Shamah, J. M. and Zheng, J. (2022). Mars 2020 Lander Vision System Flight Performance
. AIAA SCITECH Forum. Source
BibTeX
@inproceedings{johnson2022mars, title = {Mars 2020 Lander Vision System Flight Performance}, author = {Johnson, Andrew E. and Aaron, Seth and Ansari, Hugh and Bergh, Charles and Bourdu, Helene and Butler, Jim and Chang, Johnny and Cheng, Richard and Cheng, Yang and Clark, Ken and Clouse, Daniel and Donnelly, Robert and Gostelow, Kim and Jay, William and Jordan, Michael and Mohan, Swati and Montgomery, James F. and Morrison, Jack and Schroeder, Steven and Shenker, Boris and Sun, George and Trawny, Nikolas and Umsted, Carson and Vaughan, Geoffrey and Ravine, Michael and Schaffner, Jacob and Shamah, Joe M. and Zheng, Jason}, booktitle = {AIAA SCITECH Forum}, year = {2022}, doi = {10.2514/6.2022-1214}, abstract = {View Video Presentation: https://doi.org/10.2514/6.2022-1214.vid The Mars 2020 Entry Descent and Landing (EDL) system delivered the Perseverance rover to the surface of Mars on February 18th, 2021. A large fraction of the Jezero Crater landing site was covered with landing hazards including cliffs, inescapable dune fields and rocks. These hazards were identified or inferred using orbital imagery before launch so that they could be avoided using Terrain Relative Navigation (TRN) which was composed of two parts: the Lander Vision System (LVS) and Safe Target Selection (STS). During EDL, the LVS successfully estimated map relative position by fusing landmarks matched between descent imagery and a map of the landing site with Inertial Measurement Unit (IMU) data. This position estimate was used by STS to identify the safest target for landing that was also reachable given fuel and other constraints. The EDL system then used the powered descent phase to retarget to this location and land safely. The overall error between the targeted location and actual landing location was 5m which was an order of magnitude less than the 60m touchdown error requirement. This paper will describe the final tests of the LVS before launch, the checkout of the LVS during operations and the LVS performance during EDL.} } - Verma, V., Nash, J., Saldyt, L., Dwight, Q., Wang, H., Myint, S., Biesiadecki, J., Maimone, M., Tumbar, A., Ansar, A., Kubiak, G. and Hogg, R. (2024). Enabling Long and Precise Drives for the Perseverance Mars Rover via Onboard Global Localization
. IEEE Aerospace Conference. Source
BibTeX
@inproceedings{verma2024enabling, title = {Enabling Long and Precise Drives for the Perseverance Mars Rover via Onboard Global Localization}, author = {Verma, Vandi and Nash, Jeremy and Saldyt, Lucas and Dwight, Quintin and Wang, Haoda and Myint, Steven and Biesiadecki, Jeffrey and Maimone, Mark and Tumbar, Andrei and Ansar, Adnan and Kubiak, Gerik and Hogg, Robert}, booktitle = {IEEE Aerospace Conference}, address = {Big Sky, Montana}, year = {2024}, url = {https://www-robotics.jpl.nasa.gov/media/documents/2024_Global_Localization_IEEE_Aero.pdf} } - Gaines, D., Chien, S., Rabideau, G., Kuhn, S., Wong, V., Yelamanchili, A., Towey, S., Agrawal, J., Chi, W., Connell, A., Davis, E. and Lohr, C. (2020). Onboard Planning for the Mars 2020 Perseverance Rover
. International Symposium on Artificial Intelligence, Robotics and Automation in Space. Source
BibTeX
@inproceedings{gaines2020onboard, title = {Onboard Planning for the Mars 2020 Perseverance Rover}, author = {Gaines, Daniel and Chien, Steve and Rabideau, Gregg and Kuhn, Stephen and Wong, Vincent and Yelamanchili, Amruta and Towey, Shannon and Agrawal, Jagriti and Chi, Wayne and Connell, Andrea and Davis, Evan and Lohr, Colette}, booktitle = {International Symposium on Artificial Intelligence, Robotics and Automation in Space}, year = {2020}, doi = {10.48577/jpl.fpifzq}, abstract = {The Mars 2020 Mission is developing a scheduler for use onboard the Mars 2020 Perseverance Rover. The purpose of this scheduler is to adjust the activities to account for variances in onboard resources (e.g. available energy) or execution (e.g. activity failures or activities taking shorter or longer than expected). The onboard scheduler is a priority-first non backtracking scheduler. The scheduling problem is challenged by: (1) limited onboard computing resources; (2) scheduler/execution interactions; (3) energy management including scheduling of wakeup and shutdown; (4) and thermal management (preheat and maintenance heating for mechanical actuation). We overview how these challenges are addressed in the scheduler design. We also discuss the ground software being developed to support operations with onboard autonomy. We also describe the current status and target deployment timeline.} } - Rabideau, G., Russino, J., Branch, A., Dhamani, N., Vaquero, T. S., Chien, S., de la Croix, J.-P. and Rossi, F. (2025). Planning, scheduling, and execution on the Moon: the CADRE technology demonstration mission
. arXiv preprint. Source
BibTeX
@article{rabideau2025planning, title = {Planning, scheduling, and execution on the Moon: the CADRE technology demonstration mission}, author = {Rabideau, Gregg and Russino, Joseph and {Branch, Andrew} and Dhamani, Nihal and Vaquero, Tiago Stegun and Chien, Steve and de la Croix, Jean-Pierre and Rossi, Federico}, journal = {arXiv preprint}, pages = {1727-1735}, year = {2025}, doi = {10.65109/ilfn7216}, abstract = {NASA's Cooperative Autonomous Distributed Robotic Exploration (CADRE) mission, slated for flight to the Moon's Reiner Gamma region in 2025/2026, is designed to demonstrate multi-agent autonomous exploration of the Lunar surface and sub-surface. A team of three robots and a base station will autonomously explore a region near the lander, collecting the data required for 3D reconstruction of the surface with no human input; and then autonomously perform distributed sensing with multi-static ground penetrating radars (GPR), driving in formation while performing coordinated radar soundings to create a map of the subsurface. At the core of CADRE's software architecture is a novel autonomous, distributed planning, scheduling, and execution (PS&E) system. The system coordinates the robots' activities, planning and executing tasks that require multiple robots' participation while ensuring that each individual robot's thermal and power resources stay within prescribed bounds, and respecting ground-prescribed sleep-wake cycles. The system uses a centralized-planning, distributed-execution paradigm, and a leader election mechanism ensures robustness to failures of individual agents. In this paper, we describe the architecture of CADRE's PS&E system; discuss its design rationale; and report on verification and validation (V&V) testing of the system on CADRE's hardware in preparation for deployment on the Moon.} } - de la Croix, J.-P., Rossi, F., Brockers, R., Aguilar, D., Albee, K., Boroson, E., Cauligi, A., Delaune, J., Hewitt, R., Kogan, D., Lim, G., Morrell, B., Nakka, Y., Nguyen, V., Proença, P., Rabideau, G., Russino, J., da Silva, M. S., Zohar, G. and Comandur, S. (2024). Multi-Agent Autonomy for Space Exploration on the CADRE Lunar Technology Demonstration
. IEEE Aerospace Conference. Source
BibTeX
@inproceedings{delacroix2024multi, title = {Multi-Agent Autonomy for Space Exploration on the CADRE Lunar Technology Demonstration}, author = {de la Croix, Jean-Pierre and Rossi, Federico and Brockers, Roland and Aguilar, Dustin and Albee, Keenan and Boroson, Elizabeth and Cauligi, Abhishek and Delaune, Jeff and Hewitt, Robert and Kogan, Dima and Lim, Grace and Morrell, Benjamin and Nakka, Yashwanth and Nguyen, Viet and Proença, Pedro and Rabideau, Gregg and Russino, Joseph and da Silva, Maira Saboia and Zohar, Guy and Comandur, Subha}, booktitle = {IEEE Aerospace Conference}, pages = {1-14}, publisher = {IEEE}, year = {2024}, doi = {10.1109/aero58975.2024.10521425} } - Canham, T. K. (2022). The Mars Ingenuity Helicopter - A Victory for Open-Source Software
. IEEE Aerospace Conference. Source
BibTeX
@inproceedings{canham2022mars, title = {The Mars Ingenuity Helicopter - A Victory for Open-Source Software}, author = {Canham, Timothy K}, booktitle = {IEEE Aerospace Conference}, pages = {01-11}, publisher = {IEEE}, year = {2022}, doi = {10.1109/aero53065.2022.9843438} } - Clark, J. J., Lam, M., DuCharme, L., Lumnah, A. and Morantz, C. (2022). Validation of the Mars 2020 Fault Protection Design: Navigating the Infinity of the Off-Nominal
. IEEE Aerospace Conference. Source
BibTeX
@inproceedings{clark2022validation, title = {Validation of the Mars 2020 Fault Protection Design: Navigating the Infinity of the Off-Nominal}, author = {Clark, Jessica J and Lam, Mary and DuCharme, Lauren and Lumnah, Alex and Morantz, Chaz}, booktitle = {IEEE Aerospace Conference}, pages = {1-8}, publisher = {IEEE}, year = {2022}, doi = {10.1109/aero53065.2022.9843661}, abstract = {On July 30th 2020, the Mars 2020 mission successfully launched out of Cape Canaveral, Florida, passed through the Earth's shadow, and began its short cruise to Mars. Less than seven months later, the Perseverance rover touched down safely in Jezero Crater to begin its ambitious mission that includes looking for signs of ancient life and collecting samples for future return to Earth. Getting to the successful landing, or “Tango Delta Nominal,” could not have been achieved without also considering the off-nominal. One of the teams supporting this ambitious mission is the fault protection (FP) team. This team is tasked with assessing the various failures, or faults, that could prevent mission success and with ensuring that the autonomous behaviors built into the software and hardware can detect faults and recover the vehicle to a safe state. As part of its charter, the FP team designed a test campaign to provide confidence in the system's robustness to off-nominal scenarios across all of Mars 2020's mission phases. The greatest challenge associated with designing such a validation campaign was reducing the infinite number of anomalous scenarios into a finite test suite. In addition, the tests needed to be executed efficiently in order to utilize the team's limited test venue access, but still needed to maintain a level of rigor that guaranteed confidence in the test outcomes. Given that each test scenario generated massive amounts of data, the team also developed methods for quickly ascertaining whether the autonomous fault protection behaviors maintained vehicle safety in the presence of an anomaly. This paper summarizes the processes that the Mars 2020 fault protection team employed to execute its off-nominal validation campaign. It captures both the methods of generating a suite of off-nominal tests, as well as reducing it to a subset that can be realistically executed within schedule and resource constraints. It also describes the various processes and philosophies that the team utilized to execute the tests efficiently, including creating a standardized procedure template, keeping the test cases modular so that they could be easily interchanged, and capturing common fault injections in a change-controlled database. Finally, it will describe the tools and processes for assessing the test data, focusing in particular on a tool that evaluated vehicle state using “secondary” sources of data to validate that the software had truly configured the spacecraft to the expected safe state.} } - Troesch, M., Mirza, F., Hughes, K., Rothstein-Dowden, A., Bocchino, R., Donner, A., Feather, M., Smith, B., Fesq, L., Barker, B. and Campuzano, B. (2020). MEXEC: An Onboard Integrated Planning and Execution Approach for Spacecraft Commanding
. Workshop on Integrated Execution / Goal Reasoning. Source
BibTeX
@inproceedings{troesch2020mexec, title = {MEXEC: An Onboard Integrated Planning and Execution Approach for Spacecraft Commanding}, author = {Troesch, Martina and Mirza, Faiz and Hughes, Kyle and Rothstein-Dowden, Ansel and Bocchino, Robert and Donner, Amanda and Feather, Martin and Smith, Benjamin and Fesq, Lorraine and Barker, Brian and Campuzano, Brian}, booktitle = {Workshop on Integrated Execution / Goal Reasoning}, year = {2020}, url = {https://ai.jpl.nasa.gov/public/papers/IntEx-2020-MEXEC.pdf} } - Brooks, S., Litwin, T., Biesiadecki, J., Abcouwer, N., Del Sesto, T., McHenry, M., Myint, S., Twu, P. and Wai, D. (2022). Testing Mars 2020 Flight Software and Hardware in the Surface System Development Environment
. IEEE Aerospace Conference. Source
BibTeX
@inproceedings{brooks2022testing, title = {Testing Mars 2020 Flight Software and Hardware in the Surface System Development Environment}, author = {Brooks, Sawyer and Litwin, Todd and Biesiadecki, Jeffrey and Abcouwer, Neil and Del Sesto, Tyler and McHenry, Michael and Myint, Steven and Twu, Philip and Wai, Dennis}, booktitle = {IEEE Aerospace Conference}, pages = {1-13}, address = {Big Sky, Montana}, year = {2022}, doi = {10.1109/aero53065.2022.9843794}, abstract = {The Mars 2020 (M2020) Perseverance Rover is NASA's most advanced planetary rover mission to date. It includes a novel Sample Caching Subsystem (SCS) which will collect rock cores for possible future return to Earth, as well as an improved mobility system with enhanced autonomous navigation which will enable it to traverse faster and farther than prior rovers. The development of both systems required extensive flight software and flight hardware testing. To support this testing, we developed the Surface System Development Environment (SSDEV) and used it for a wide variety of testing. SSDEV is a bundled subset of M2020 Flight Software which runs on commercially available Linux computers and can be combined with multiple backend options for simulation and hardware control. The SSDEV architecture enabled our teams to perform much more testing of flight software and flight hardware than would have otherwise been possible. As a secondary benefit, the SSDEV-based test campaigns also helped our teams enter the operations phase of the mission with greater readiness of operations products and tools. In this paper, we summarize the motivation for SSDEV, provide an overview of the SSDEV architecture, list several examples of how SSDEV was used, and summarize lessons learned. SSDEV is not a substitute for integrated testing with flight-like avionics, but it enabled substantially more testing than would have otherwise been possible and also provided some unique benefits. We recommend architectures like SSDEV to future projects that need to perform extensive hardware and software testing using a limited set of flight-like avionics.} } - Verma, V., Estlin, T., Doran, G., Gaines, D., Francis, R., Romano, P., Skeggs, C. and Castano, R. (2020). Results from the first four years of AEGIS autonomous targeting for ChemCam on Mars Science Laboratory and new capability planned for SuperCam on Mars 2020 rover
. International Symposium on Artificial Intelligence, Robotics and Automation in Space. Source
BibTeX
@inproceedings{verma2020results, title = {Results from the first four years of AEGIS autonomous targeting for ChemCam on Mars Science Laboratory and new capability planned for SuperCam on Mars 2020 rover}, author = {Verma, V. and Estlin, T. and Doran, Gary and Gaines, D. and Francis, Raymond and Romano, P. and Skeggs, C. and Castano, Rebecca}, booktitle = {International Symposium on Artificial Intelligence, Robotics and Automation in Space}, address = {Virtual}, year = {2020}, url = {https://dataverse.jpl.nasa.gov/dataset.xhtml?persistentId=hdl:2014/53247} } - Rollins, P., Sabzehi, M. and Kafadarian, L. (2024). Look Mob, No Hands! Automating Mobility Downlink for the Mars Science Laboratory
. IEEE Field and Service Robots. Source
BibTeX
@inproceedings{rollins2024look, title = {Look Mob, No Hands! Automating Mobility Downlink for the Mars Science Laboratory}, author = {Rollins, PJ and Sabzehi, Mielad and Kafadarian, Lauren}, booktitle = {IEEE Field and Service Robots}, publisher = {JPL Open Repository}, year = {2024}, doi = {10.48577/jpl.rhrlbe} } - Frey, J., Patel, M., Atha, D., Nubert, J., Fan, D., Agha, A., Padgett, C., Spieler, P., Hutter, M. and Khattak, S. (2024). RoadRunner -- Learning Traversability Estimation for Autonomous Off-road Driving
. arXiv. Source
BibTeX
@article{frey2024roadrunner, title = {RoadRunner -- Learning Traversability Estimation for Autonomous Off-road Driving}, author = {Frey, Jonas and Patel, Manthan and Atha, Deegan and Nubert, Julian and Fan, David and Agha, Ali and Padgett, Curtis and Spieler, Patrick and Hutter, Marco and Khattak, Shehryar}, journal = {arXiv}, year = {2024}, doi = {10.1109/tfr.2024.3464369}, abstract = {Autonomous navigation at high speeds in off-road environments necessitates robots to comprehensively understand their surroundings using onboard sensing only. The extreme conditions posed by the off-road setting can cause degraded camera image quality due to poor lighting and motion blur, as well as limited sparse geometric information available from LiDAR sensing when driving at high speeds. In this work, we present RoadRunner, a novel framework capable of predicting terrain traversability and an elevation map directly from camera and LiDAR sensor inputs. RoadRunner enables reliable autonomous navigation, by fusing sensory information, handling of uncertainty, and generation of contextually informed predictions about the geometry and traversability of the terrain while operating at low latency. In contrast to existing methods relying on classifying handcrafted semantic classes and using heuristics to predict traversability costs, our method is trained end-to-end in a self-supervised fashion. The RoadRunner network architecture builds upon popular sensor fusion network architectures from the autonomous driving domain, which embed LiDAR and camera information into a common Bird's Eye View perspective. Training is enabled by utilizing an existing traversability estimation stack to generate training data in hindsight in a scalable manner from real-world off-road driving datasets. Furthermore, RoadRunner improves the system latency by a factor of roughly 4, from 500 ms to 140 ms, while improving the accuracy for traversability costs and elevation map predictions. We demonstrate the effectiveness of RoadRunner in enabling safe and reliable off-road navigation at high speeds in multiple real-world driving scenarios through unstructured desert environments.} } - Chen, P.-T., Liu, J. Y., Bocchino, R. L. J., Mendeck, G. F. and Vaughan, G. M. (2026). Hazard Detection Flight Software for Processing LIDAR Generated DEM
. AIAA SciTech. Source
BibTeX
@inproceedings{chen2026hazard, title = {Hazard Detection Flight Software for Processing LIDAR Generated DEM}, author = {Chen, Po-Ting and Liu, John Y. and Bocchino, Robert L., Jr. and Mendeck, Gavin F. and Vaughan, Geoffrey M.}, booktitle = {AIAA SciTech}, publisher = {JPL Open Repository}, year = {2026}, doi = {10.48577/jpl.d3e9iv}, abstract = {Hazard Detection (HD) is an enabling technology for safe landing on planetary bodies when the lander hazard tolerance capability is at the resolution limit of orbital imagery. This situation is common to many planetary bodies in the Solar System including Moon and Mars. At these locations, an autonomous lander can utilize a Light Detection and Ranging (LIDAR) sensor to map the landing area and construct a Digital Elevation Map (DEM) in real-time. The HD software developed by the Safe and Precise Landing Integrated Capabilities Evolution (SPLICE) project is designed to process a DEM and identify safe landing locations in real-time. The hazard detection method is applicable to 4-legged lander geometry and is adaptable to different hazard tolerance and run time requirements. This paper discusses the hazard detection performance of the SPLICE HD software using DEMs generated by the SPLICE Hazard Detection LIDAR.} } - Rankin, A., Holloway, A., Sabel, A., Patel, N. and Maimone, M. W. (2022). Visual Odometry Thinking While Driving for the Curiosity Mars Rover's Three-Year Test Campaign: Impact of Evolving Constraints on Verification and Validation
. IEEE Aerospace Conference, 20230005759. Source
BibTeX
@inproceedings{rankin2022visual, title = {Visual Odometry Thinking While Driving for the Curiosity Mars Rover's Three-Year Test Campaign: Impact of Evolving Constraints on Verification and Validation}, author = {Rankin, Arturo and Holloway, Alexandra and Sabel, Anna and Patel, Nikunj and Maimone, Mark W.}, booktitle = {IEEE Aerospace Conference}, number = {20230005759}, pages = {1-10}, institution = {NASA}, year = {2022}, doi = {10.1109/aero53065.2022.9843487}, abstract = {Over the first 9 years of the Mars Science Laboratory (MSL) Curiosity rover's surface mission, more than 87% of its driving was performed using Visual Odometry (VO). The benefits of using VO during driving are that it minimizes rover position uncertainty and can be used to monitor wheel slip, halting a drive if excessive wheel slip is occurring. The VO implementation onboard Curiosity acquires and processes VO images in between drive steps while the rover is stationary. A VO Thinking While Driving (VTWD) flight software capability has been developed to enable the processing of VO images during rover driving, increasing the distance Curiosity can drive using VO during a given time period up to as much as 1.75x total distance. Verification and Validation (V&V) of this capability has been challenging due to impacts from the COVID-19 pandemic and unavailability of the JPL Mars Yard outdoor test site. The VTWD V&Vtest procedures were modified to use a small indoor space with Mars-like terrain. This paper describes the 3 year V&V effort under challenging conditions to approve the VTWD capability for use on the Curiosity rover.} }