Learning intuitive physics
The ability to interact and understand the environment is fundamental in a wide range of applications from robotics to augmented reality.
In particular, predicting how deformable objects will react to applied forces in real time is a significant challenge.
Another challenge is learning to estimate the simple dynamics of moving and interacting objects through observations.
My research tries to bring common sense understanding to robotic perception, with a focus on low-cost vision sensors and interaction with humans. Learning to predict intuitive physics, such as how objects move and interact with each other, will enable robots to interact with a dynamic, unconstrained environment.
Publications:  
Human-Robot Cooperation and Semantic Understanding for Long-term Localization and Mapping
I am working on using human experiences, such as complex activities detected using visual-inertial information, to improve semantic understanding of the environment for mobile assistive robots, and using robots to help user's localization by sharing location information. Another area of interest is using higher level understanding of the enviroment (semantics) in deep reinformcement learning approaches for improving robot and user navigation.
Publications:  
Object Pose Estimation for Robotic Grasping
Detection and pose estimation of 3D objects is of great importance in robotics applications for many high level tasks such as manipulation, grasping, human-robot interaction and also localization and mapping. We are interested in segmenting objects with large variety in appearance, from lack of texture to strong textures, for the task of robotic grasping, using affordable RGB-D sensors.
Publications:    
Code (OpenCV/CUDA): https://github.com/morpheus1820/graph-canny-segm
Fly4SmartCity: a Cloud Robotics Service for Smart City Applications
The emerging cloud robotics paradigm considers robots as simple agents connected to a remote network infrastructure; this networked approach allows them to benefit from off-board powerful computational and storage resources, to easily access data and to build a common knowledge. We propose a possible implementation of a cloud-robotics service in a smart city scenario. This project shows how the integration of ROS-based cloud robotics platform, small unmanned vehicles, high-bandwidth/low-latency mobile networks and open data publicly available on the internet makes the design of a real-world UAV-based emergency management service possible.
Press: Wired, La Stampa
Code (ROS): https://github.com/fly4smartcity
Autonomous Robots for Data Center Hotspot Detection
In this project, in collaboration with Telecom Italia Lab, we developed a
Cloud Robotics service application for the detection of hotspots in a data center
using mobile robots carrying thermal sensors and thermal cameras. The robots are able to create
a map of the environment and to autonomously navigate, while executing user-defined missions.
We developed a laser-based package for graph-based SLAM algorithm.
Publications: , , 
Code (ROS nodes): https://github.com/rrg-polito/rrg-polito-ros-pkg
Code (LAGO Optimizer): https://github.com/rrg-polito/lago
Visual Navigation for Mobile Robots
This project, in collaboration with Telecom Italia Lab, aims at the study of
Cloud Robotics for service applications, with a focus on vision-based semantic localization and
mapping for mobile platforms in domestic environments. We are currently working on semantic localization based
on object detection only.
People and Object Tracking, Vision-based Body Mass Estimation
A prerequisite for human–robot interaction is the capability of successfully tracking humans and objects in the environment.
We proposed a system for real-time visual object tracking in 2D images for mobile robotic systems. The proposed algorithm is able to specialize to individual objects and to adapt to substantial changes in illumination and object appearance during tracking.
The algorithm is composed by two main blocks: a detector based on Histogram of Oriented Gradient (HOG) descriptors and linear Support Vector Machines (SVM), and a tracker which is implemented by an adaptive Rao-Blackwellised particle filter (RBPF). The SVM is re–trained online on new samples taken from previous predicted positions.
Another work involved a system for weighting astronauts in space, using RBG-D cameras. The body is reconstructed using 3D non-rigid registration techniques, then anthropometric measures are extracted and matched on a medical database, in order to retreve an estimate of the body mass.
Press: New Scientist, TomsHW.it
The three-years (2008-2010) project “MACP4Log - Mobile, autonomous and cooperating robotic platforms for supervision and monitoring of large logistic surfaces” was aimed at the study and development of a prototype of a mobile robotic platform, with on-board vision systems and sensors, integrating a flexible wireless communication solution, able to move autonomously in large logistic spaces, and to communicate with a supervisor and other similar platforms to achieve a coordinated action to carry out specific tasks. The project was coordinated by the Robotics Research Group from Politecnico di Torino; the research activity was carried on in collaboration with ERXA s.r.l. and the Istituto Superiore “Mario Boella” (ISMB).
Publications:   
Chen C.‚ Rosa S., Miao Y.‚ Lu X.‚ Wu W.‚ Markham A., Trigoni N., Selective Sensor Fusion for Neural Visual Inertial Odometry, Conference on Computer Vision and Pattern Recognition (CVPR), 2019
Rosa S.*, Wang Z.*, Markham A., Learning the Intuitive Physics of Non-Rigid Object Deformations, NeurIPS Workshop: Modeling the Physical World: Perception, Learning, and Control, Montreal, 2018
Yang B., Rosa S., Markham A., Trigoni N., Wen H., 3D Object Dense Reconstruction from a Single Depth View, Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2018, DOI: 10.1109/TPAMI.2018.2868195
Wang Z., Rosa S., Miao Y., Lai Z., Xie L., Trigoni N., Neural Allocentric Intuitive Physics Prediction from Real Videos, Arxiv, 2018
Rosa S., Patane' A., Lu X., Trigoni N., Semantic Place Understanding for Human-Robot Coexistence - Towards Intelligent Workplaces, Transactions on Human-Machine Systems (THMS), 2018, DOI: 10.1109/THMS.2018.2875079
Wang Z.*, Rosa S.*, Wei B., Wang S., Markham A., Trigoni N., 3D-PhysNet: Learning the Intuitive Physics of Non-Rigid Object Deformations, IJCAI 2018 [website]
Rosa S.*, Wang Z.*, Wei B., Xie L.,Wang S., Markham A., Trigoni N., Defo-Net: Learning Body Deformation using Generative Adversarial Networks, ICRA 2018 [website]
Xie L.,Wang S.,Rosa S., Markham A., Trigoni N., Learning with Training Wheels: Speeding up Training with a Simple Controller for Deep Reinforcement Learning, ICRA 2018
Rosa S., Patane' A., Lu X., Trigoni N., CommonSense: Collaborative learning of scene semantics by robots and humans, IoPARTS workshop, MOBISYS 2018
Lu X., Kan X., Rosa S., Wen H., Markham A., Trigoni N., Towards Self-supervised Face Labeling via Cross-modality Association, poster, SenSys 2017, The Netherlands
Rosa S., Lu X., Wen H., Trigoni N.,
Leveraging User Activities and Mobile Robots for Semantic Mapping and User Localization., HRI 2017 late break reports
Rosa S., Toscana G., Bona B. Q-PSO: Fast Quaternion-based Pose Estimation From RGB-D Images, Journal of Intelligent and Robotic Systems, 2017, DOI: 10.1007/s10846-017-0714-3
Anjum M.L., Rosa S., Bona B. Tracking a subset of skeleton joints - An effective approach towards complex human activity recognition, Journal of Robotics, vol. 2017, doi:10.1155/2017/7610417
Rosa S., Toscana G.
Fast Feature-Less Quaternion-based Particle Swarm Optimization for Rigid and Articulated Pose Estimation From RGB-D Images, poster, ECCV 2016, Amsterdam, NL
Toscana G., Rosa S.,
Fast Feature-Less Quaternion-based Particle Swarm Optimization for Object Pose Estimation From RGB-D Images, BMVC 2016, York, UK
Toscana G., Rosa S., Bona B.,
Fast Graph-Based Object Segmentation for RGB-D Images, Intellisys 2016, London, UK
Toscana G., Rosa S., Bona B.,
Vocal Interaction with a 7-DOF Robotic Arm for Object Detection, Learning and Grasping, HRI 2016 Late break reports
Russo L.O., Rosa S., Maggiora M., Bona B. A Novel Cloud Based Service Robotics Application to Data Center
Environmental Monitoring, Sensors, 2016, DOI: 10.3390/s16081255
Ermacora G., Rosa S., Toma A. Fly4SmartCity: a Cloud Robotics Service for Smart City Applications, Journal of Ambient Intelligence and Smart Environments, 2016, DOI: 10.3233/AIS-160374
Rosa S., Russo L.O., Toscana G., Primatesta S., Kaouk Ng M., Bona B.,
Leveraging the Cloud for Connected Service Robotics Applications, Workshop on Robotics and Technology Transfer, ETFA 2015, Luxemburg, LU
B. de Gusmao P.B., Rosa S., Magli E., Lepsøy S., Francini L.,
Robotics Navigation Using MPEG CDVS, 17th International Workshop on Multimedia Signal Processing, MMSP 2015, Xiamen, China
Lupetti M.L., Rosa S., Ermacora G.,
From a Robotic Vacuum Cleaner to Robot Companion: Acceptance and Engagement in Domestic Environments., HRI 2015 late break reports
Russo L.O., Farulla G., Pianu D., Salgarella A., Controzzi M., Cipriani C., Oddo C., Geraci C., Rosa S., Indaco M.A remote communication system for deafblind persons by means of gesture recognition, International Journal of Advanced Robotic Systems, 2014
Bona B., Carlone L., Indri M., Rosa S., Supervision and monitoring of logistic spaces by a cooperative robotic team: methodologies, problems, and solutions, Intelligent Service Robotics, 2014, DOI: 10.1007/s11370-014-0151-0
Rosa S., Russo L.O., Bona B.,
Towards A ROS-Based Autonomous Cloud Robotics Platform for Data Center Monitoring. the 19th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA), Barcelona, Spain, 2014
G. Ermacora, A. Toma, S. Rosa, B.
Bona, M. Chiaberge, M. Silvagni, M. Gaspardone, R. Antonini,
A cloud based service for management and planning of autonomous
UAV missions in smartcity scenarios, MESAS 2014, Rome, IT
Airo' Farulla G., Russo L.O., Pintor C., Pianu D., Micotti G., Salgarella A.R., Camboni D., Controzzi M., Cipriani C., Calogero M.O., Rosa S., Indaco M.,
Real-time single camera hand gesture recognition system for remote deaf-blind communication 1st International Conference on Augmented and Virtual Reality - Salento AVR 2014, Lecce, 17-20 September 2014
Ahmad O., Yin J., Bona B., Rosa S., Anjum M.L., Skeleton Tracking Based Complex Human Activity Recognition Using Kinect Camera, ICSR 2014, Syndey, AU
Ermacora G., Toma A., Rosa S., Antonini R.,
Leveraging open data for supporting a cloud robotics service in a smart city environment. at IAS-13, July 15 - 19, 2014, Padova, Italy
Rosa S., Russo L.O., Airò Farulla G., Antonini R., Gaspardone M., Carlone L., Bona B.,
An Application of Laser-Based Autonomous Navigation for Data-Center Monitoring. at IAS-13, July 15 - 19, 2014, Padova, Italy
Yuan Z., Rosa S., Russo L.O., Bona B.,
A Kinect-based Front-end for Graph-SLAM Using Plane Matching in Planar Indoor Environments. at IAS-13, July 15 - 19, 2014, Padova, Italy
Yin J., Carlone L., Rosa S., Anjum M.L., Bona B.,
Scan Matching for Graph SLAM in Indoor Dynamic Scenarios.27th International FLAIRS Conference, May 21 - 23, 2014, Pensacola Beach, Florida, USA
Russo L.O., Rosa S., Matteucci M., Bona B., A ROS Implementation of the Mono-SLAM Algorithm. In: International Conference on Artificial Intelligence & Applications (ARIA-2014), 2014
Abrate F., Bona B., Indri M., Rosa S., Tibaldi F., Multi-robot map updating in dynamic environments, in Springer Tracts in Advanced Robotics, Volume 83, 2013, DOI: 10.1007/978-3-642-32723-0
Russo L.O., Airò farulla G., Indaco M., Rosa S., Rolfo D., Bona B., Blurring prediction in Monocular SLAM, In: 8th IEEE International Design & Test Symposium 2013 (IDT), 2013
Abrate F., Bona B., Indri M., Rosa S., Tibaldi F., Multirobot Localization in Highly Symmetric Environments, Journal of Intelligent and Robotic Systems, 2012, DOI: 10.1007/s10846-012-9790-6
L. Carlone, J. Yin, S. Rosa, Z. Yuan, Graph optimization with unstructured covariance: fast, accurate, linear approximation. In: Simulation, Modeling, and Programming for Autonomous Robots (SIMPAR 2012), 2012.
Rosa S., Paleari M., Ariano P., Bona B., Object Tracking with Adaptive HOG Detector and Adaptive Rao-Blackwellised Particle Filter. In: SPIE 8301, Intelligent Robots and Computer Vision XXIX: Algorithms and Techniques, 2012.
Paleari M., Margaria V., Rosa S., Ariano P., HExEC: hand exoskeleton electromyographic control, 4th International Workshop on Human-Friendly Robotics (HFR 2011) November 8th-9th, 2011, University of Twente, The Netherlands
Macchia V.; Rosa S; Carlone L; Bona B., An Application of Omnidirectional Vision to Grid-based SLAM in Indoor Environments. In: Workshop on Omnidirectional Robot Vision, International Conference on Robotics and Automation (ICRA 2010), 2010.
Abrate F; Bona B; Indri M; Rosa S.; Tibaldi F., Map updating in dynamic environments. In: ISR/ROBOTIK 2010, 2010.
Brevi D., Fileppo F. , Scopigno R. , Abrate F., Bona B., Rosa S., Tibaldi F., Hybrid localization solutions for robotic logistic applications. In: Technologies for Practical Robot Applications (TePRA), 2009.
Abrate F; Bona B.; Indri M; Rosa S; Tibaldi F., Three-State Multirobot Collaborative Localization in Symmetrical Environments. In: ROBOTICA 2009, 2009
Abrate F; Bona B; Indri M.; Rosa S; Tibaldi F., Switching Multirobot Collaborative Localization in Symmetrical Environments. In: IROS 2008 2nd Workshop on Planning, Perception and Navigation for Intelligent Vehicles, 2008.