CURRICULUM VITAE

Karinne Ramirez-Amaro

Contact Information

Address: SE-412 96, Gothenburg, Sweden

+46 73 250 1583

karinne@chalmers.se

http://web.ics.ei.tum.de/∼karinne/Ramirez/index.html

Google Scholar: http://scholar.google.de/citations?user=m24umY4AAAAJ&hl=en

Current Position

Sept. 2019 -until now

Assistant Professor at Chalmers University of Technology, Department of Elec-trical Engineering, Division of Systems and Control. Mechatronics group.

Education

2015 Dr.-Ing. (summa cum laude) at the Technical University of Munich, Department ofElectrical and Computer Engineering, Institute for Cognitive Systems. Munich, Germany.Thesis: “Inferring Human Activities from Observation via Semantic Reasoning: A novelmethod for transferring skills to robots”. Thesis advisor: Univ.-Prof. Gordon Cheng.Co-advisor: Univ.-Prof. Michael Beetz.

2007 M.Sc. (Computer Science) with honors at the Center for Computing Research of theNational Polytechnic Institute (CIC-IPN), Mexico City, Mexico. www.cic.ipn.mx. Thesis:“New Image Based Learning Approach to Stationary Time Series”. Thesis advisor: Dr.Juan Carlos Chimal Eguıa.

2004 B.Eng. (Computer Systems Engineering) at the Technological Institute of Merida(I.T.M.), Merida, Yucatan, Mexico. www.itmerida.mx.

1

Professional Experience

April 2015 -August 2019

Post-doctoral Researcher at the Technical University of Munich, Department ofElectrical and Computer Engineering, Institute for Cognitive Systems. Hosted byProf. Dr. Gordon Cheng.

Aug. 2017 &March 2016

Visiting Researcher at the National Institute of Informatics. Principles of Infor-matics Research Division. Hosted by Dr. Inamura Tetsunari. Tokyo, Japan.

Jan. 2013 –March 2015

Researcher at Technical University of Munich. Department of Electrical and Com-puter Engineering. Institute for Cognitive Systems. Hosted by Prof. Dr. GordonCheng. Munich, Germany.

Nov. 2011 Visiting Researcher at the Seoul National University. School of Computer Scienceand Engineering, Biointelligence Laboratory. Hosted by Prof. Dr. Byoung-TakZhang. Seoul, South Korea.

Oct. 2009 –Dec. 2012

Researcher at Technical University of Munich. Computer Science Department.Intelligent Autonomous Systems Group. Hosted by Prof. Michael Beetz, Ph.D.Munich, Germany.

2007 – 2009 Lecturer and Researcher at the Professional School of Computing of the NationalPolytechnic Institute (ESCOM-IPN). www.escom.ipn.mx. Mexico City, Mexico.

2008 – 2009 Guest Researcher at the Center for Computing Research (CIC-IPN).www.cic.ipn.mx. Mexico City, Mexico.

2004 – 2005 Teacher at the Modern Institute of Computation and English (I.M.C.O). Merida,Yucatan, Mexico.

2003 Research Staff at the Scientific Research Center of Yucatan (CICY). Merida,Yucatan, Mexico.

Awards

July 2017 Best Scientific Poster of the RoboCup@Home League. The team Alle@Home,formed at the Institute for Cognitive Systems, participated for the first time in theRoboCup@Home international competition. The Best Scientific Poster award was givento the team with significant state-of-the-art improvements applied to service robotics ap-plications. That year more than 30 teams participated in this international competition.

May 2017 MOU grant for research exchange with NII: MOU grants provide assistance fortravel expenses (airfare, daily expenses) to overseas researchers to perform an internshipwith Prof. Inamura Tetsunari at the National Institute of Informatics (NII) researchcenter, Tokyo, Japan.

Jan. 2016 TUM Laura Bassi Award for one-year research project as postdoctoral fel-low. With this award, the Technische Universitat Munchen (TUM) supports outstandingwomen in science and engineering. The title of the research project was “Exploitingsemantic representations to infer human activities from different input sources”. Thefunding is provided by the government of Bavaria, Germany.

2

Dec. 2015 MOU grant for research exchange with NII: MOU grants provide assistance fortravel expenses (airfare, daily expenses) to overseas researchers to perform an internshipat the National Institute of Informatics (NII) research center, Tokyo, Japan with Prof.Inamura Tetsunari.

Sept. 2015 Bavaria Excellent Doctoral degree for female engineering students: This prize isgiven as a recognition to the outstanding final or doctoral thesis from Bavarian universitiesto female graduates in engineering. This prize is granted by the Bavarian Ministry forScience, Education, Arts and Cultural Affairs, Germany.

Oct. 2013 IEEE - Miura Travel Grant: In recognition of Dr. Kanako Miura’s contributions toHumanoid Robotics, the IEEE RAS Technical Committee on Humanoid Robotics initiatethe Miura Memorial award. Travel grant for the IEEE Humanoids conference, Atlanta,Georgia, USA.

May 2013 DFG Student Travel Support: Travel support to participate at the IEEE InternationalConference on Robotics and Automation (ICRA), Karlsruhe, Germany.

Nov. 2011 DAAD Travel Support: Travel support for one month internship staying at the SeoulNational University as part of the GEnKO project, Seoul, South Korea.

June 2011 Google Fellowship: Google Anita Borg Memorial Scholarship: Europe, the Middle Eastand Africa. In Anita Borg honor, Google supports leading women in technology with thismemorial scholarship. The main goal is to encourage women to excel in computing andtechnology and become active role models and leaders in their field.

Oct. 2009 DAAD-CONACYT Fellowship: Scholarship for excellent students to pursue an inter-national doctoral degree, in this case at the Technical University of Munich. This Ph.D.research award was granted by German Academic Exchange Service (DAAD) and TheNational Council on Science and Technology (CONACYT).

Research Interests

• Semantics Reasoning: Define models that generalize and explain the human behaviors and intentionsfrom observations during everyday activities. For example, I had researched about the capabilitiesof First order logic methods to understand human intentions.

• Knowledge Representations: Automatic generation of knowledge representations via ontologies. Wehave define a new approach that uses Description logics to transfer the environment information tosymbolic representations.

• Decision Making: Probabilistic approach methods such as decision trees for a domain specific lan-guage using abstract and symbolic representations. In this case, the graphical representations aswell as cause-effect methods are currently being developed to allow the prediction of the humanintentions, thus making intelligent systems cognitive.

• Analysis of human motions: Study and analysis of human motions in daily activities in manipulationtasks in order to obtain (probabilistic) model(s) for robot controllers.

• Machine learning: Study and further development of algorithms based on supervised and no super-vised learning, such as reinforcement learning, pattern recognition, etc. Also in the definition of theadequate learning strategy to enhance it with the methods of knowledge-based and reasoning systemsfor the learning behavior of a different systems while learning new activities on-demand.

3

• Time series analysis using linear and non-linear techniques such as autocorrelation, cross correlation,recurrence plots, state space techniques, Poincare maps, Lyapunov exponent, among others.

• Time series forecasting using new and classic forecasting techniques such as artificial neuronal net-works, support vector machine, linear approaches, state phase approaches.

Teaching Experience

WS 2018/19,SS 2018,WS 2017/18,SS 2017,WS 2016/17

Lecturer: Practical course. RoboCup@Home at the Department of Electrical andComputer Engineering at TUM.

WS 2018/19 Invited Guest Lecturer: Lecture w/Discussion. Technology trends class. Topicof the guest lecture: A Semantic Reasoning method for the Recognition of HumanActivities for the master program in management and innovation at the School ofManagement at TUM.

SS 2018,SS 2017,SS 2016,SS 2015

Lecturer: Lecture w/ Exercise. Humanoid Cognitive Reasoning. Department ofElectrical and Computer Engineering at TUM.

WS 2017/18 Lecturer: Practical course. Practical Project Cognitive Systems at the Departmentof Electrical and Computer Engineering at TUM.

WS 2017/18 Invited Guest Lecturer: Lecture w/Discussion. Dynamic Human Robot Interac-tion. Topic of the guest lecture: Semantic Reasoning for Human-Robot-Interactionat the Department of Electrical and Computer Engineering at TUM.

WS 2015/16 Invited Guest Lecturer: Lecture w/Discussion. Robots Learning from Humans.Topic of the guest lecture: Inferring Human Activities from Observation via Se-mantic Reasoning: A novel method for transferring skills to robots at the ComputerScience and Engineering, Cognitive Science, adn Brain Science at the Seoul NationalUniversity (SNU), Seoul, South Korea.

WS 2015/16,WS 2014/15,SS 2013

Teaching assistant: Lecture w/ Exercise. Multi-sensory Based Robot Dynamicmanipulation. Department of Electrical and Computer Engineering at TUM.

SS 2012 Seminar Instructor: Advance Seminar. Robot Learning at the Department ofInformatics at TUM. https://hcai.in.tum.de/teaching/semrl-ss12

SS 2009,WS 2008/09,SS 2008,WS 2007/08

Lecturer: (B.Eng. at Programming and Systems Development Department, TheProfessional School of Computing, ESCOM). Mexico.

• Artificial intelligence. Class hours: 325.

• Discrete mathematics. Class hours: 325

• Compilers and interpreters. Class hours: 108.

Thesis Supervision

4

• Mentoring the Ph.D. Thesis of Constantin Uhde at the Department of Electrical and ComputerEngineering at TUM. Topic: “Semantic Understand of Human Activities”. This thesis started inApril 2018.

• M. Sc. thesis Adam Zylka at the Department of Electrical and Computer Engineering at TUM.Topic: “Self-Structuring of Relationships for Assembly Tasks”. 2017.

• M. Sc. thesis Tamas Bates at the Department of Informatics at TUM. Topic: “On-Line Simulta-neous Learning and Recognition of Everyday Activities from Virtual Reality Performances”. 2017.

• M. Sc. thesis Niklas Barkmeyer at the Department of Electrical and Computer Engineering atTUM. Topic: “Learning to recognize new objects using deep learning and contextual information”.2016.

• M. Sc. thesis Aankita Debroy at the Department of Informatics at TUM. Topic: “Prediction of Hu-man Activities from Live Demonstrations via Semantic Representations and Probabilistic Methods”.2016.

• M. Sc. thesis Ilya Dianov at the Department of Informatics at TUM. Topic: “Transferring SemanticRepresentations from Kitchen Scenarios to the Automotive Domain for Activity Recognition”. 2015.

• M. Sc. thesis Nicholas Hubert Kirk at the Department of Informatics at TUM. Topic: “PredictingModular Robotic Plans via Kinesthetic Learning and Semantic Reasoning”. 2015.

• M. Sc. thesis Nolang Fanani at the Department of Electrical and Computer Engineering at TUM.A Thesis Submitted for the Degree of MSc Erasmus Mundus in Vision and Robotics (VIBOT). Topic:“Interpreting and Modeling Human Activities Using Probabilistic Methods”. 2013.

• M. Sc. thesis Robin Lev Jansohn at the Department of Informatics at TUM. Topic: “Virtualimpedance for operational space motion with self-collision avoidance applied in a humanoid robot”.2013.

I have also supervised more than 25 students from Bachelor thesis and Practical internships.

Professional Skills

• Associate Editor for ICRA (2019): Associate Editor for profile AU of the the InternationalConference on Robotics and Automation (ICRA 2019) to be held on May 20-24, 2019 in Montreal,Canada.

• Associate Editor for SII (2019): Associate Editor of the the International Symposium on SystemIntegration (SII 2019) to be held on January 14-16, 2019 in Paris, France.

• Associate Editor for Humanoids (2018): Associate Editor and member of the Conference Edito-rial Board for the 2018 IEEE-RAS 18th International Conference on Humanoid Robots (Humanoids2018) to be held on November 6-9, 2018 in Beijing, China.

• IEEE Associate Vice President - Conference Operations Committee (2018-2019): Maincoordinator of the operations team of the IEEE RAS Conference Activities Board. This committeehelps and supports the conference organizers sponsored by IEEE in maintaining high standards andto coordinate activities between different conference organization teams.

http://www.ieee-ras.org/conferences-workshops/conference-activities-board/conference-operations-committee-cab-o

5

• Guest editor for the special issue on the Robotics and Autonomous System (2018):Managing guest editor of the Robotics and Autonomous System (RAS) special issue on “SemanticPolicy and Action Representations for Autonomous Robots” (SPAR). This special issue is a follow-upoutcome of two successful IROS workshops held in 2015 and 2017. The expected publication of thespecial issue is September 2018. https://www.ics.ei.tum.de/workshop-iros-spar17/ras-special-issue/

• Team leader RoboCup@Home (2017): Leader of the first student team from TUM for theRoboCup@Home competition held in Nagoya, Japan. The RoboCup@Home league aims to developservice robot technology for domestic applications. https://www.ics.ei.tum.de/robocup-athome/

– Main coordination and leader of a team of 14 people. The team consisted of Bachelor students,Master students, Ph.D, and postdoctoral researchers.

– Fundraise of around 20,000 EUR to cover the trip costs of 9 team members through sponsor-ship and donations from different companies such as Zenuity, TUM-Promos, TNG-TechnologyConsultant, Schunk, and Siemens.

– The team participated with the robot platform TIAGo, which was sponsored by the PAL-robotics company, their sponsorship also included the logistic transportation of the robot toJapan. The cost of the robot and its transportation was around 100,000 EUR.

– Successful performance of the team that won the best scientific poster of the whole RoboCup@Homeleague (more than 30 teams).

• Workshop Organization: I have been involved in the organization of 7 workshops.

1. Co-organizer of the event WeLead (2018) - Women Leaders in Artificial Intelligence,Robotics and Engineering. The main objective of this event is to encourage the next femalegenerations to take up engineering career paths by showing the extraordinary work that womenare currently achieving in these fields. This event will host around 500 attendees hosted at theTechnical University of Munich, 17th November 2018.

2. Co-organizer of the IROS Workshop “Semantic Policy and Action Representationsfor Autonomous Robots (SPAR 2018)”. Accepted to be a full day workshop proposedfor October 5th, 2018, as part of the IEEE/RSJ International Conference on Intelligent Robotsand Systems 2018 conference (IROS). This workshop will host around 100 participants, Madrid,Spain.

3. Co-organizer of the IROS Workshop “Latest Advances in Big Activity Data Sourcesfor Robotics & New Challenges” (2018). Accepted to be a full day workshop proposedfor October 1st, 2018, as part of the IEEE/RSJ International Conference on Intelligent Robotsand Systems 2018 conference (IROS). This workshop will host around 50 participants, Madrid,Spain.

4. Main Organizer of the IROS Workshop “Semantic Policy and Action Representa-tions for Autonomous Robots (SPAR 2017)”. It was a full day workshop proposed forSeptember 24th, 2017, as part of the IEEE/RSJ International Conference on Intelligent Robotsand Systems 2017 conference. This workshop hosted around 90 participants and it took placein Vancouver, Canada. https://www.ics.ei.tum.de/workshop-iros-spar17/

5. Main organizer of the event women@TUM get-together (2016). The aim of this eventwas to motivate women in the areas of computer science and engineering to build a TUMcommunity, sponsored by Google, Diversity TUM office and the Institute for Cognitive Systems

6

(ICS). This workshop hosted around 40 participants and it was held in Munich at ICS-TUMthe 19th February 2016. https://www.ics.ei.tum.de/event-womentum/

6. Co-organizer of the Factory-in-a-day EU-project workshop (2014). Workshop for theproject consortium on hands-on Multi-modal Artificial Skin & Task Specification. The workshopwas held in Munich at ICS-TUM the 8th and 9th of April 2014.

7. Main organizer of the workshop on “Understanding Human Everyday Activities”(2011). The workshop was held in Munich at the Intelligent Autonomous System group at theTechnical University of Munich on the 7th and 8th of March 2011.

http://ias.cs.tum.edu/events/workshop-understanding-human-everyday-activities

• Conference co-chair: Main organizer of the First Students of Computer Science Encounter (E2C2),held in Mexico City, Mexico, 16 – 18 May 2007. /www.cic.ipn.mx/e2c2/.

• Reviewing services:

– Conferences: AAAI, ECAI, IJCAI, IROS, ICRA, Humanoids, ICAR, RO-MAN, CORE,ISICS, etc.

– Journals: Neuronal Networks, IEEE Transactions on Robotics (T-RO), IEEE Robotics andAutomation Letters (RA-L), Kunstliche Intelligenz (KI), Robotics and Autonomous Systems(RAS), Journal from the Institution of Engineering and Technology (IET)-Computer Vision,Journal of Visual Communication and Image Representation (JVCI), Journal Computers andElectronics in Agriculture, etc.

• Programming Tools:

– Languages: C++, Prolog, Java, Matlab, PHP, Python (basic).

– Robot software: ROS (Robot Operating System) and YARP (Yet Another Robot Platform).User and developer of the semantic reasoning packages from ICS-TUM.

– Robot hardware: iCub, REEM-C, PR2, Nao, TOMM, TIAGo, Pepper.

– Operating Systems: Linux (Debian and Ubuntu), Windows.

Selected List of PublicationsA total of 35 papers have been published in peer-reviewed journals or international conferences.

• 9 journal papers have been successfully published in journals and two are still pending.

• 30 publications have been published in international conferences and workshops.

• 295 citations, according to Google Scholar.

• The h-index is 11 and the i10-index is 15.

Selected journal papers

1. Karinne Ramirez-Amaro, Yezhou Yang, Gordon Cheng. “A Survey on Semantics and Under-standing of Human Activities”. Elseiver, Robotics and Autonomous Systems Vol. 119, Pages 31-50,September 2019. Impact factor: 2.928. CiteScore: 4.69.

7

2. Gordon Cheng, Karinne Ramirez-Amaro, Michael Beetz, Yasou Kuniyoshi, “Purposive learn-ing: Robot reasoning about the meanings of human activities”. Science Robotics 4 (26), eaav1530,January 2019. Impact factor: 19.4

3. Emmanuel Dean, Karinne Ramirez-Amaro, Florian Bergner, Ilya Dianov, and Gordon Cheng.“Integration of Advanced Robotic Technologies for Rapidly Deployable Industrial Robots”. IEEETransactions on Industrial Informatics, Vol. 14, No. 4, April 2018. DOI:10.1109/TII.2017.2766096.Impact factor: 7.377

4. Karinne Ramirez Amaro, Michael Beetz, Gordon Cheng. “Transferring Skills to HumanoidRobots by Extracting Semantic Representations from Observations of Human Activities”. ArtificialIntelligence, Volume 247, Pages: 95-118, May 2017. DOI:10.1016/j.artint.2015.08.009. Impact factor:5.186. CiteScore: 4.33.

5. Karinne Ramirez-Amaro, Michael Beetz, Gordon Cheng. “Added Value of Gaze-Exploiting Se-mantic Representation to Allow Robots Inferring Human Behaviors”. ACM Transactions on Inter-active Intelligent Systems (TiiS), Volume 7, Issue 1, March 2017. DOI:10.1145/2939381. Cites/Doc(Eq. to impact factor): 5.623.

6. Karinne Ramirez Amaro, Michael Beetz and Gordon Cheng. “Understanding the intention ofhuman activities through semantic perception: observation, understanding and execution on a hu-manoid robot”. Advanced Robotics 29 (5), 345-362, Special Issue on Humanoid Robotics (1), 2015.Impact factor: 1.104

7. Agnieszka Wykowska, Jasmin Kajopoulos, Karinne Ramirez Amaro, Gordon Cheng. “Autistictraits and sensitivity to human-like features of robot behavior”. Interaction studies journal, Vol 16(2), 219-248, 2015. Impact factor: 1.150

Selected publications at international conferences:

1. Tamas Bates, Karinne Ramirez-Amaro, Tetsunari Inamura, Gordon Cheng. “On-Line Simultane-ous Learning and Recognition of Everyday Activities from Virtual Reality Performances”. IEEE/RSJInternational Conference on Intelligent Robots and Systems (IROS), Vancouver, Canada, 2017.

2. Karinne Ramirez-Amaro, Emmanuel Dean-Leon, Ilya Dianov, Florian Bergner and Gordon Cheng.“General Recognition Models Capable of Integrating Multiple Sensors for Different Domains”. IEEE-RAS International Conference on Humanoid Robots, Cancun, Mexico, 2016.

3. Ilya Dianov, Karinne Ramirez-Amaro, Pablo Lanillos, Emmanuel Dean-Leon, Florian Bergnerand Gordon Cheng. “Extracting general task structures to accelerate the learning of new tasks”.IEEE-RAS International Conference on Humanoid Robots, Cancun, Mexico, 2016.

4. Emmanuel Dean, Karinne Ramirez-Amaro, Florian Bergner, Ilya Dianov, Pablo Lanillos, andGordon Cheng. “Robotic technologies for fast deployment of industrial robot systems”. 42nd IEEEIndustrial Electronics Conference (IEEE IECON2016). IEEE, October 2016.

5. Karinne Ramirez-Amaro, Emmanuel Dean-Leon, and Gordon Cheng. “Robust Semantic Rep-resentations for Inferring Human Co-manipulation Activities even with Different DemonstrationStyles”. 15th IEEE-RAS International Conference on Humanoid Robots, Seoul Korea, November2015.

8

6. Karinne Ramirez Amaro, Tetsunari Inamura, Emmanuel Dean, Michael Beetz and Gordon Cheng.“Bootstrapping Humanoid Robot Skills by Extracting Semantic Representations of Human-like Ac-tivities from Virtual Reality”. 14th IEEE-RAS International Conference on Humanoid Robots, 18-20Nov. Madrid, Spain, 2014.

7. Stefan Ehrlich, Agnieszka Wykowska, Karinne Ramirez Amaro, and Gordon Cheng. “When toengage in interaction - and how? EEG-based enhancement of robots ability to sense social signals inHRI”. 14th IEEE-RAS International Conference on Humanoid Robots, 18-20 Nov. Madrid, Spain,2014.

8. Karinne Ramirez Amaro, Michael Beetz and Gordon Cheng. “Automatic Segmentation andRecognition of Human Activities from Observation based on Semantic Reasoning”. IEEE/RSJ In-ternational Conference on Intelligent Robots and Systems (IROS 2014), 14-18 Sept. 2014. Chicago,Illinois, USA.

9. Karinne Ramirez Amaro, Eun-Sol Kim, Jiseob Kim, Byoung-Tak Zhang, Michael Beetz, GordonCheng. “Enhancing Human Action Recognition through Spatio-temporal Feature Learning andSemantic Rules”. Humanoid Robots, 2013, 13th IEEE-RAS International Conference, October 2013.

10. S. Albrecht, K. Ramırez-Amaro, F. Ruiz-Ugalde, D. Weikersdorfer, M. Leibold, M. Ulbrich, M.Beetz. “Imitating Human Reaching Motions Using Physically Inspired Optimization Principles”. In11th IEEE-RAS International Conference on Humanoid Robots, 2011.

Research Projects

1. DFG-SFB Everyday Activity Science and Engineering (EASE), July 2017 – 2021. Mainly involvedin the research area R “Generative models for mastering everyday activity and their embodiment”.Responsible for the sub-area R01 “NEEM-based embodied knowledge framework”. This projectreceives founding from the Deutsche Forschungsgemeinschaft (DFG) as a Collaborative ResearchCenter (SFB). http://ease.informatik.uni-bremen.de.Contribution: Investigate and develop methods to enable robotic agents to master human-scaleeveryday manipulation tasks, these methods include knowledge acquisition, learning, and reasoning.As a result, the robot will be knowledgeable about what it did, why, how it behaves, what happened,and what it saw.Received budget: 324.000 AC (Personal funding is 25%)Project Coordinator: University of Bremen.

2. TUM Laura Bassi Exploiting semantic representations to infer human activities from differentinput sources, January – December 2016. This project was founded by the government of Bavariaand TUM, Germany.Contribution: project leader, which goal was to enhance our multilevel framework to providean automatic segmentation and recognition of human behaviors from different observations usingsemantic reasoning tools. To this aim, a modular method was developed to extract the relevantinformation from observed human activities obtained from different sources, including non-visualsensors such as proximity and forces applied during the execution of the activity as well as egocentricviews.Received budget: 45.000 AC (Personal funding was 100%)Project Coordinator: Technical University of Munich.

9

3. EU-FP7 EU founded project, Factory in a Day (FiaD), October 2013 – September 2017. Thisproject has received funding from the European Union Seventh Framework Programme (FP7/2007-2013) no. 609206. www.factory-in-a-day.eu. This project aimed at improving the competitiveness ofEuropean manufacturing SMEs by optimizing the robot installation time and installation cost.Contribution: Develop reasoning and knowledge-based methods to allow a natural way to teachindustrial robots new tasks by physically interacting with them. A semantic-based reasoning ap-proach was proposed to integrate different input sensors, such as the joint encoders of a robot, skinsensors (tactile and proximity) and visual information from the cameras embedded in the robot (firstview perspective). Additionally, we developed a state-of-the-art knowledge-based representation toincrementally learn new representations from the demonstrations to accelerate the teaching of theunknown tasks. We show that our presented framework enables a standard industrial robotic systemto be flexible, modular and adaptable to different production requirements.Received budget: 1.400.000 AC (Personal funding was 20%)Project Coordinator: Technical University of Delf.

4. DAAD German-Korean Partnership Programme (GEnKO), July 2011-April 2013. This project re-ceived founding from DAAD. The goal of this research project was to develop a practically applicablerobot arm control technique based on the generation of robot arm motions through continuous feed-back based on constraints.Contribution: Analysis and collection of human body motions represented as trajectories obtainedfrom a markerless tracking system, then, we found the appropriate transformations and representa-tions of the collected data that facilitate the application of probabilistic knowledge representationformalisms and, finally, apply machine learning techniques in order to develop methods that arecapable of generating flexible motions of robot arms and manipulators, which we will subsequentlyapply in real-world robot control tasks.Project Coordinators: Technical University of Munich and Seoul National University.

5. DFG-CoTeSys Cluster of Excellence Cognition for Technical Systems, January 2010 - December2012. DFG German Excellence Initiative. Mainly, working on the sub-project: Cognitive Models ofEveryday Manipulation Tasks. The CogMan project (1) developed computational and control modelsof pick-and-place tasks in the context of everyday manipulation activities in human environments,(2) implements the model into a control system for the kitchen scenario, and (3) empirically analyzesthe impact of this control model on the flexibility, robustness, adaptability, and naturalness of therobot behavior.Contribution: Obtaining models of human everyday activities such as setting the table. Thesemodels describe the arm movement in common task such as the stereotypical reaching movements.Project Coordinator: Technical University of Munich.

6. IPN-SIP Computational Modeling and Simulation of physical and biological systems, January 2008– December 2008. This project was funded by the Instituto Politecnico Nacional, Mexico throughthe IPN-SIP resource, project number: 20082721. The goal of this project was to develop non-linear techniques to model and simulate thermodynamics systems, mechanical systems and biologicalsystems.Contribution: Analysis of nonlinear systems of the thermodynamics, mechanical, and biologicalsystem through non-linear techniques such as Lyapunov exponent, fractal dimension, Poincare maps,among others.Project Coordinator: Center for Computing Research of the National Polytechnic Institute (CIC-IPN)

10

International Collaborations

1. University of Bremen, Germany. Institute for Artificial Intelligence, Prof. Michael Beetz, Ph.D.Collaboration since 2009. Several joint publications and the SFB-EASE project.

2. Seoul National University, Korea (SNU). Biointelligence group, Prof. Dr. Byoung-Tak Zhang. Col-laboration since 2011. Several joint publications and DAAD-GEnKO project.

3. National Institute of Informatics, Japan (NII). Principles of Informatics Research Division, Prof. Dr.Tetsunari Inamura. Collaboration since 2013. Several joint publications.

4. BMW Group, Forschung und Technik GmbH, Project leader Connected Drive. Dr. Peter Zahn andLouis Lawrence. Collaboration from 2014 - 2015. Student project work that resulted in a masterthesis and a workshop publication.

5. Arizona State University, USA. School of Computing, Informatics, and Decision Systems Engineering,Asst. Prof. Dr. Yezhou Yang. Collaboration since 2015. Organization of international workshopsand a joint paper.

6. Halmstad University, Sweden. Intelligent Systems laboratory. Asst. Prof. Dr.-rer.nat Eren ErdalAksoy. Collaboration since 2015. Organization on international workshops.

7. Johns Hopkins University, USA, Computer Science Department, Prof. Dr. Gregory D. Hager andChris Paxton. Collaboration since 2016. Joint paper to be submitted.

8. Colorado School of Mines, USA. Computer Science. Asst. Prof. Dr. Neil Dantam. Collaborationsince 2016. Organization of international workshops.

9. Autoliv, Munich, Germany. Dr. Christina Lichtenthaeler, Software Team Lead, Active Safety team.Collaboration since 2016. Student project collaboration.

10. Shinshu University, Japan. Autonomous Intelligence and Systems laboratory. Assoc. Prof. KimitishiYamazaki. Collaboration since 2018. Working on a joint proposal to be submitted.

Invited Talks and Seminars

1. “Robots that reason”. Keynote speaker at the event WeLead- Women Leaders in Artificial Intelli-gence, Robotics and Engineering, 17th November, Munich, Germany, 2018.

2. “Semantic Reasoning Method for the Understanding of Human Actions”. Invited talk at the 3rdWorkshop on Semantic Policy and Action Representations for Autonomous Robots (SPAR), duringthe IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 5th October,Madrid, Spain, 2018.

3. “A Semantic Reasoning Method for the Recognition of Human Activities”. Invited talk at theWorkshop on Latest Advances in Big Activity Data Sources for Robotics & New Challenges, duringthe IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 1st October,Madrid, Spain, 2018.

4. “A Semantic Reasoning Method for the Recognition of Human Activities”. Invited talk at theUniversity of Bremen, 25th September, Bremen, Germany, 2018.

11

5. “Semantic Reasoning under Realistic Conditions”. Invited speaker at the 20th International mul-ticonference, Robotics section organized by Jozef Stefan Institute. Information Society 2017, 13thOctober, Ljubljana, Slovenia, 2017.

6. “Semantic Reasoning Methods applied to robots to infer human activities”. Invited speaker at theNational Institute of Informatics, 3rd August, Tokyo Japan, 2017.

7. “Semantic Reasoning Methods Applied to Robots to Infer Human Activities”. Invited keynotespeaker at the Big Techday 10 organized by the TNG Technology consulting company, June 2nd,Munich, Germany 2017. http://events.techcast.com/bigtechday10/Patenkirchen-1345

8. “A Novel Method for Inferring Human Activities from Observation via Semantic Reasoning”. Invitedkeynote speaker at the International Congress CORE 2016, November 9th to November 11th, MexicoCity, Mexico, 2016.

9. “Towards a General Method to Enable Robots Inferring Human Activities from Observations viaSemantic Reasoning”. Invited keynote speaker at the 1st Young Roboticists Workshop: Developingthe Future of Robotics as part of the International Conference on Humanoid Robots, November 15,Cancun, Mexico, 2016.

10. “Learning New Robot Behaviors from Multiple Sensors by Segmenting and Recognizing HumanBehaviors”. Poster presentation at the Robotics in the 21st century: Challenges and PromisesInternational Workshop (funded by the Volkswagen Foundation and the HeKKSaGOn Network),September 25th - September 28th, Uslar, Germany, 2016.

11. “Inferring Human Activities from Observation via Semantic Reasoning: A novel method for trans-ferring skills to robots” at Biointelligence group, Seoul National University, Korea (SNU), November2015.

12. “Models of Human Everyday Manipulation Activities and their Transfer into Autonomous RobotControl Systems” at Cognition for Technical Systems (CoTeSys) Fall Workshop, 13th of October2010. http://www.cotesys.de/events/cotesys-fall-workshop-2010.html

13. “Understanding the reaching trajectories through biomechanical simulations” at the Seminar onProbabilistic Methods for Perceiving, Learning, and Reasoning about Everyday Activities. Dagstuhl,Germany. June 2010.

14. “On a New Approach to Time Series Tracking” at the seminar of thermodynamic and complexsystems, organized by the Superior School of Physics and Mathematics (ESFM-IPN), 14th of June,2007. www.esfm.ipn.mx.

Live Demonstrations and Fairs

2018 Trade fair Automatica, the leading marketplace for automated production in Munich,Germany, June 19 - 22.

2017 Workshop on Semantic Policy and Action Representations for Autonomous Robots(SPAR) as part of the IEEE/RSJ International Conference on Intelligent Robots andSystems (IROS), September 24.

2017 Big Techday 10, organized by TNG Technology Consulting GmbH. Munich, Germany,2nd of June.

12

2016 GlobalTech Robotic Workshop 2016, organized by the Technical University of Munichand Carnegie Mellon University. Munich, Germany, May 22-23.

2016 EU-project Factory in a Day plenary meeting, Munich, Germany, April 21 - 22.2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) in

Hamburg, Germany, September 28 - October 02.2015 European Robotics Forum (ERF) in Vienna, March 11 - 13.2014 Trade fair Automatica. Munich, Germany, May 2 - 6.2013 IEEE International Conference on Robotics and Automation (ICRA) in Karlsruhe,

Germany, May 6 - 10.

Personal Information

• Personal data

– Born: 09/Sep/1981 in Chetumal, Quintana Roo, Mexico.

– Citizenship: Mexican.

– Marital status: Married.

• Languages

– Spanish: native tongue.

– English: fluent.

– German: intermediate level (B2) and still learning.

– French: basic courses.

List of References

• Prof. Dr. Gordon Cheng. Founder and Director of Institute for Cognitive Systems, Faculty ofElectrical and Computer Engineering at Technical University of Munich, Germany.

– gordon@tum.de https://www.ics.ei.tum.de/people/cheng/

• Prof. Michael Beetz, PhD. Head of the Institute for Artificial Intelligence (IAI) at the Faculty forMathematics and Informatics of the University Bremen, Germany.

– beetz@cs.uni-bremen.de http://ai.uni-bremen.de/team/michael beetz

• Prof. Dr. Gregory D. Hager. Mandell Bellmore Professor in the Department of Computer Scienceand director of the Malone Center for Engineering in Healthcare, The Johns Hopkins University,Maryland, USA. Named in 2017 a Technical University of Munich Ambassador.

– hager@cs.jhu.edu http://www.cs.jhu.edu/∼hager/

• Prof. Dr. Byoung-Tak Zhang. Head of the Biointelligence laboratory, Seoul National University,Korea (SNU).

– btzhang@snu.ac.kr https://bi.snu.ac.kr/∼btzhang/

13

• Prof. Dr. Tamim Asfour. Head of the High Performance Humanoid Technologies Lab (H2T),KarlsruheInstitute of Technology (KIT), Germany.

– asfour@kit.edu

• Prof. Dr. Tetsunari Inamura. Associate Professor, Principles of Informatics Research Division,National Institute of Informatics, Tokyo, Japan.

– inamura@nii.ac.jp

14