Fetching the paper…
Reading the bibliography…
We introduce RobotPerf, a vendor-agnostic benchmarking suite designed to evaluate robotics computing performance across a diverse range of hardware platforms using ROS 2 as its common baseline.
A. P. del Pobil, R. Madhavan, and E. Messina, “Benchmarks in robotics research,” in Workshop IROS . Citeseer, 2006
2006
Earlier work this paper cites.
M. Desnoyers and M. R. Dagenais, “The lttng tracer: A low impact performance and behavior monitor for gnu/linux,” in OLS (Ottawa Linux Symposium) , vol. 2006. Citeseer, 2006, pp. 209–224
2006
Earlier work this paper cites.
O. Michel, F. Rohrer, and Y. Bourquin, “Rat’s life: A cognitive robotics benchmark,” in European Robotics Symposium 2008 . Springer, 2008, pp. 223–232
2008
Earlier work this paper cites.
M. Quigley, K. Conley, B. Gerkey, J. Faust, T. Foote, J. Leibs, R. Wheeler, and A. Y. Ng, “Ros: an open-source robot operating system,” in ICRA workshop on open source software , vol. 3, no. 3.2. Kobe, Japan, 2009, p. 5
2009
Earlier work this paper cites.
I. A. Sucan, M. Moll, and L. E. Kavraki, “The open motion planning library,” IEEE Robotics & Automation Magazine , vol. 19, no. 4, pp. 72–82, 2012
2012
Earlier work this paper cites.
K. Yamashina, T. Ohkawa, K. Ootsu, and T. Yokota, “Proposal of ros-compliant fpga component for low-power robotic systems: case study on image processing application,” International Workshop on FPGAs for Software Programmers (FSP) , 2015
2015
Earlier work this paper cites.
J. Weisz, Y. Huang, F. Lier, S. Sethumadhavan, and P. Allen, “Robobench: Towards sustainable robotics system benchmarking,” in 2016 IEEE International Conference on Robotics and Automation (ICRA) . IEEE, 2016, pp. 3383–3389
2016
Earlier work this paper cites.
K. Yamashina, H. Kimura, T. Ohkawa, K. Ootsu, and T. Yokota, “crecomp: Automated design tool for ros-compliant fpga component,” in IEEE International Symposium on Embedded Multicore/Many-core Systems-on-Chip (MCSOC) , 2016, pp. 138–145
2016
Earlier work this paper cites.
T. Ohkawa, K. Yamashina, T. Matsumoto, K. Ootsu, and T. Yokota, “Architecture exploration of intelligent robot system using ros-compliant fpga component,” in IEEE International Symposium on Rapid System Prototyping (RSP) , 2016, pp. 1–7
2016
Earlier work this paper cites.
J. Leitner, A. W. Tow, N. Sünderhauf, J. E. Dean, J. W. Durham, M. Cooper, M. Eich, C. Lehnert, R. Mangels, C. McCool, et al. , “The acrv picking benchmark: A robotic shelf picking benchmark to foster reproducible research,” in 2017 IEEE International Conference on Robotics and Automation (ICRA) . IEEE, 2017, pp. 4705–4712
2017
Earlier work this paper cites.
M. Althoff, M. Koschi, and S. Manzinger, “Commonroad: Composable benchmarks for motion planning on roads,” in 2017 IEEE Intelligent Vehicles Symposium (IV) . IEEE, 2017, pp. 719–726
2017
Earlier work this paper cites.
Y. Sugata, T. Ohkawa, K. Ootsu, and T. Yokota, “Acceleration of publish/subscribe messaging in ros-compliant fpga component,” in International Symposium on Highly Efficient Accelerators and Reconfigurable Technologies , 2017, pp. 1–6
2017
Earlier work this paper cites.
Y. Deng, Y. Ni, Z. Li, S. Mu, and W. Zhang, “Toward real-time ray tracing: A survey on hardware acceleration and microarchitecture techniques,” ACM Computing Surveys (CSUR) , vol. 50, no. 4, pp. 1–41, 2017
2017
Earlier work this paper cites.
B. Boroujerdian, H. Genc, S. Krishnan, W. Cui, A. Faust, and V. Reddi, “Mavbench: Micro aerial vehicle benchmarking,” in 2018 51st annual IEEE/ACM international symposium on microarchitecture (MICRO) . IEEE, 2018, pp. 894–907
2018
Earlier work this paper cites.
L. Fan, Y. Zhu, J. Zhu, Z. Liu, O. Zeng, A. Gupta, J. Creus-Costa, S. Savarese, and L. Fei-Fei, “Surreal: Open-source reinforcement learning framework and robot manipulation benchmark,” in Conference on Robot Learning . PMLR, 2018, pp. 767–782
2018
Earlier work this paper cites.
J. Delmerico and D. Scaramuzza, “A benchmark comparison of monocular visual-inertial odometry algorithms for flying robots,” in 2018 IEEE international conference on robotics and automation (ICRA) . IEEE, 2018, pp. 2502–2509
2018
Earlier work this paper cites.
Y. Suzuki, T. Azumi, S. Kato, and N. Nishio, “Real-time ros extension on transparent cpu/gpu coordination mechanism,” in IEEE International Symposium on Real-Time Distributed Computing (ISORC) , 2018, pp. 184–192
2018
Earlier work this paper cites.
2018
Earlier work this paper cites.
2018
Earlier work this paper cites.
2018
Earlier work this paper cites.
2018
Earlier work this paper cites.
T. Ohkawa, K. Yamashina, H. Kimura, K. Ootsu, and T. Yokota, “Fpga components for integrating fpgas into robot systems,” IEICE Transactions on Information and Systems , vol. 101, no. 2, pp. 363–375, 2018
2018
Earlier work this paper cites.
Y. Nitta, S. Tamura, and H. Takase, “A study on introducing fpga to ros based autonomous driving system,” in IEEE International Conference on Field-Programmable Technology (FPT) , 2018, pp. 421–424
2018
Earlier work this paper cites.
S. M. Neuman, T. Koolen, J. Drean, J. E. Miller, and S. Devadas, “Benchmarking and workload analysis of robot dynamics algorithms,” in 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) . IEEE, 2019, pp. 5235–5242
2019
Earlier work this paper cites.
2019
Earlier work this paper cites.
T. Ohkawa, Y. Sugata, H. Watanabe, N. Ogura, K. Ootsu, and T. Yokota, “High level synthesis of ros protocol interpretation and communication circuit for fpga,” in IEEE/ACM International Workshop on Robotics Software Engineering (RoSE) , 2019, pp. 33–36
2019
Earlier work this paper cites.
A. Podlubne and D. Göhringer, “Fpga-ros: Methodology to augment the robot operating system with fpga designs,” in IEEE International Conference on ReConFigurable Computing and FPGAs (ReConFig) , 2019, pp. 1–5
2019
Earlier work this paper cites.
J. P. Queralta, F. Yuhong, L. Salomaa, L. Qingqing, T. N. Gia, Z. Zou, H. Tenhunen, and T. Westerlund, “Fpga-based architecture for a low-cost 3d lidar design and implementation from multiple rotating 2d lidars with ros,” in IEEE SENSORS , 2019, pp. 1–4
2019
Earlier work this paper cites.
“Benchmarking tools for evaluating robotic assembly of small parts,” July 2020. [Online]. Available: https://www.uml.edu/research/nerve/assembly-workshop-rss-2020.aspx
2020
Earlier work this paper cites.
T. Tan, R. Weller, and G. Zachmann, “Opencollbench-benchmarking of collision detection & proximity queries as a web-service,” in The 25th International Conference on 3D Web Technology , 2020, pp. 1–9
2020
Earlier work this paper cites.
D. Perille, A. Truong, X. Xiao, and P. Stone, “Benchmarking metric ground navigation,” in 2020 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR) . IEEE, 2020, pp. 116–121
2020
Earlier work this paper cites.
M. Ahn, H. Zhu, K. Hartikainen, H. Ponte, A. Gupta, S. Levine, and V. Kumar, “Robel: Robotics benchmarks for learning with low-cost robots,” in Conference on robot learning . PMLR, 2020, pp. 1300–1313
2020
Earlier work this paper cites.
S. James, Z. Ma, D. R. Arrojo, and A. J. Davison, “Rlbench: The robot learning benchmark & learning environment,” IEEE Robotics and Automation Letters , vol. 5, no. 2, pp. 3019–3026, 2020
2020
Cited alongside, same era.
2020
Cited alongside, same era.
M. Reke, D. Peter, J. Schulte-Tigges, S. Schiffer, A. Ferrein, T. Walter, and D. Matheis, “A self-driving car architecture in ros2,” in 2020 International SAUPEC/RobMech/PRASA Conference . IEEE, 2020, pp. 1–6
2020
Cited alongside, same era.
L. Puck, P. Keller, T. Schnell, C. Plasberg, A. Tanev, G. Heppner, A. Roennau, and R. Dillmann, “Distributed and synchronized setup towards real-time robotic control using ros2 on linux,” in 2020 IEEE 16th International Conference on Automation Science and Engineering (CASE) . IEEE, 2020, pp. 1287–1293
“Robot learning in the cloud: Remote operations and benchmarking,” July 2022. [Online]. Available: https://sites.google.com/andrew.cmu.edu/cloud-robotics-benchmarking/
2022
Later among the works it cites.
M. Bakhshalipour, M. Likhachev, and P. B. Gibbons, “Rtrbench: A benchmark suite for real-time robotics,” in 2022 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS) . IEEE, 2022, pp. 175–186
2022
Later among the works it cites.
S. Krishnan, Z. Wan, K. Bhardwaj, P. Whatmough, A. Faust, S. M. Neuman, G.-Y. Wei, D. Brooks, and V. J. Reddi, “Automatic domain-specific soc design for autonomous unmanned aerial vehicles,” in 2022 55th IEEE/ACM International Symposium on Microarchitecture (MICRO) . IEEE, 2022, pp. 300–317
2022
Later among the works it cites.
S. Krishnan, Z. Wan, K. Bhardwaj, N. Jadhav, A. Faust, and V. J. Reddi, “Roofline model for uavs: A bottleneck analysis tool for onboard compute characterization of autonomous unmanned aerial vehicles,” in 2022 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS) . IEEE, 2022, pp. 162–174
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
2020
Cited alongside, same era.
Y. Yang and T. Azumi, “Exploring real-time executor on ros 2,” in IEEE International Conference on Embedded Software and Systems (ICESS) , 2020, pp. 1–8
2020
Cited alongside, same era.
C. Lienen, M. Platzner, and B. Rinner, “Reconros: Flexible hardware acceleration for ros2 applications,” in International Conference on Field-Programmable Technology (ICFPT) , 2020, pp. 268–276
2020
Cited alongside, same era.
D. P. Leal, M. Sugaya, H. Amano, and T. Ohkawa, “Automated integration of high-level synthesis fpga modules with ros2 systems,” in International Conference on Field-Programmable Technology (ICFPT) , 2020, pp. 292–293
2020
Cited alongside, same era.
D. P. Leal, M. Sugaya, H. Amano, and T. Ohkawa, “Fpga acceleration of ros2-based reinforcement learning agents,” in International Symposium on Computing and Networking Workshops , 2020, pp. 106–112
2020
Cited alongside, same era.
S. M. Neuman, B. Plancher, T. Bourgeat, T. Tambe, S. Devadas, and V. J. Reddi, “Robomorphic computing: a design methodology for domain-specific accelerators parameterized by robot morphology,” in ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) , 2021, pp. 674–686
2021
Cited alongside, same era.
W. Liu, B. Yu, Y. Gan, Q. Liu, J. Tang, S. Liu, and Y. Zhu, “Archytas: A framework for synthesizing and dynamically optimizing accelerators for robotic localization,” in MICRO-54: 54th Annual IEEE/ACM International Symposium on Microarchitecture , 2021, pp. 479–493
2021
Cited alongside, same era.
2021
Cited alongside, same era.
S. Liu, Z. Wan, B. Yu, and Y. Wang, Robotic computing on fpgas . Springer, 2021
2021
Cited alongside, same era.
2022
Later among the works it cites.
Z. Kingston and L. E. Kavraki, “Robowflex: Robot motion planning with moveit made easy,” in 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) . IEEE, 2022, pp. 3108–3114
2022
Later among the works it cites.
A. A. Arafat, S. Vaidhun, K. M. Wilson, J. Sun, and Z. Guo, “Response time analysis for dynamic priority scheduling in ros2,” in Proceedings of the 59th ACM/IEEE Design Automation Conference , 2022, pp. 301–306
2022
Later among the works it cites.
NVIDIA, “NVIDIA Isaac ROS,” Accessed 2022, github.com/NVIDIA-ISAAC-ROS
2022
Later among the works it cites.
Z. Wan, K. Swaminathan, P.-Y. Chen, N. Chandramoorthy, and A. Raychowdhury, “Analyzing and improving resilience and robustness of autonomous systems,” in Proceedings of the 41st IEEE/ACM International Conference on Computer-Aided Design , 2022, pp. 1–9
2022
Later among the works it cites.
C. Bédard, I. Lütkebohle, and M. Dagenais, “ros2_tracing: Multipurpose low-overhead framework for real-time tracing of ros 2,” Accessed 2022, gitlab.com/ros-tracing/ros2_tracing
2022
Later among the works it cites.
V. Mayoral-Vilches, “ros-robotics-companies,” https://github.com/vmayoral/ros-robotics-companies , [Accessed: July 9, 2023]
2023
Closest in time.
“Methods for objective comparison of results in intelligent robotics research,” Oct. 2023. [Online]. Available: http://www.robot.t.u-tokyo.ac.jp/TCPEBRAS_IROS2023/index.html
2023
Closest in time.
“Datasets and benchmarking tools for advancing and evaluating robotic manufacturing,” July 2023. [Online]. Available: https://sites.google.com/view/rss-2023-nist-moad
2023
Closest in time.
D. Nikiforov, S. C. Dong, C. L. Zhang, S. Kim, B. Nikolic, and Y. S. Shao, “Rosé: A hardware-software co-simulation infrastructure enabling pre-silicon full-stack robotics soc evaluation,” in Proceedings of the 50th Annual International Symposium on Computer Architecture , 2023, pp. 1–15
2023
Closest in time.
Object Management Group (OMG), “Data Distribution Service (DDS) Interoperability Wire Protocol RTPS (Real-Time Publish-Subscribe) Protocol Specification Version 2.5,” https://www.omg.org/spec/DDSI-RTPS/2.5/ , [Accessed: July 9, 2023]
2023
Closest in time.
R.-A. Community, “ros-acceleration,” 2023, gitHub repository. [Online]. Available: https://github.com/ros-acceleration
2023
Closest in time.
R. P. Developers, “image_proc subdirectory on humble branch of image pipeline,” GitHub Repository, 2023. [Online]. Available: https://github.com/ros-perception/image_pipeline/tree/humble/image_proc
2023
Closest in time.
——, “stereo_image_proc subdirectory on humble branch of image pipeline,” GitHub Repository, 2023. [Online]. Available: https://github.com/ros-perception/image_pipeline/tree/humble/stereo_image_proc
2023
Closest in time.
——, “depth_image_proc subdirectory on humble branch of image pipeline,” GitHub Repository, 2023. [Online]. Available: https://github.com/ros-perception/image_pipeline/tree/humble/depth_image_proc
2023
Closest in time.
N. I. R. Developers, “isaac_ros_visual_slam,” GitHub Repository, 2023. [Online]. Available: https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_visual_slam
2023
Closest in time.
——, “isaac_ros_map_localization,” GitHub Repository, 2023. [Online]. Available: https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_map_localization
2023
Closest in time.
——, “isaac_ros_apriltag,” GitHub Repository, 2023. [Online]. Available: https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_apriltag
2023
Closest in time.
R. C. Developers, “joint_trajectory_controller subdirectory in ros 2 controllers,” GitHub Repository, 2023. [Online]. Available: https://github.com/ros-controls/ros2_controllers/tree/master/joint_trajectory_controller
2023
Closest in time.
——, “diff_drive_controller subdirectory in ros 2 controllers,” GitHub Repository, 2023. [Online]. Available: https://github.com/ros-controls/ros2_controllers/tree/master/diff_drive_controller
2023
Closest in time.
——, “forward_command_controller subdirectory in ros 2 controllers,” GitHub Repository, 2023. [Online]. Available: https://github.com/ros-controls/ros2_controllers/tree/master/forward_command_controller
2023
Closest in time.
M. Maintainers, “Moveit,” https://moveit.ros.org/ , 2023, official website
2023
Closest in time.
F. C. L. Developers, “Flexible collision library (fcl),” https://github.com/flexible-collision-library/fcl , 2023, gitHub repository
2023
Closest in time.
M. Documentation, “The kdl kinematics plugin,” MoveIt Documentation, 2023, available online: https://moveit.picknik.ai/main/doc/examples/kinematics_configuration/kinematics_configuration_tutorial.html#the-kdl-kinematics-plugin
2023
Closest in time.
——, “The lma kinematics plugin,” MoveIt Documentation, 2023, available online: https://moveit.picknik.ai/main/doc/examples/kinematics_configuration/kinematics_configuration_tutorial.html#the-lma-kinematics-plugin
2023
Closest in time.
Nvidia, “R2B Dataset 2023,” 4 2023. [Online]. Available: https://catalog.ngc.nvidia.com/orgs/nvidia/teams/isaac/resources/r2bdataset2023
2023
Closest in time.
N. I. ROS, “Ros2 benchmark,” https://github.com/NVIDIA-ISAAC-ROS/ros2_benchmark , 2023
2023
Closest in time.
K. E. Chen, Y. Liang, N. Jha, J. Ichnowski, M. Danielczuk, J. Gonzalez, J. Kubiatowicz, and K. Goldberg, “Fogros: An adaptive framework for automating fog robotics deployment,” in IEEE International Conference on Automation Science and Engineering (CASE) , 2021, pp. 2035–2042
2042
Closest in time.