fulfilling ieee’s mission by fostering technological...

23
Fulfilling IEEE’s Mission By Fostering Technological Innovation IEEE/Eastern NC Section Humanoid Robot Project Daniel McDonald 6-Mar-2015

Upload: dokhuong

Post on 21-Aug-2018

215 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Fulfilling IEEE’s Mission By Fostering Technological ...sites.ieee.org/ncc-roboresearch/files/2015/03/MCDonald_2015-Robo...Fulfilling IEEE’s Mission By Fostering Technological

Fulfilling IEEE’s Mission By Fostering

Technological InnovationIEEE/Eastern NC Section Humanoid Robot Project

Daniel McDonald6-Mar-2015

Page 2: Fulfilling IEEE’s Mission By Fostering Technological ...sites.ieee.org/ncc-roboresearch/files/2015/03/MCDonald_2015-Robo...Fulfilling IEEE’s Mission By Fostering Technological

IEEE's core purpose is to foster

technological innovation and

excellence for the benefit of humanity.

IEEE Mission

Page 3: Fulfilling IEEE’s Mission By Fostering Technological ...sites.ieee.org/ncc-roboresearch/files/2015/03/MCDonald_2015-Robo...Fulfilling IEEE’s Mission By Fostering Technological

Robotics and Automation Society Chapter at NCSU

NCSU Engineering Building 1

Page 4: Fulfilling IEEE’s Mission By Fostering Technological ...sites.ieee.org/ncc-roboresearch/files/2015/03/MCDonald_2015-Robo...Fulfilling IEEE’s Mission By Fostering Technological

January 2014 Project Proposal

Let’s build a humanoid robot.

Page 5: Fulfilling IEEE’s Mission By Fostering Technological ...sites.ieee.org/ncc-roboresearch/files/2015/03/MCDonald_2015-Robo...Fulfilling IEEE’s Mission By Fostering Technological

The Pitch

Page 6: Fulfilling IEEE’s Mission By Fostering Technological ...sites.ieee.org/ncc-roboresearch/files/2015/03/MCDonald_2015-Robo...Fulfilling IEEE’s Mission By Fostering Technological

Let’s Do It!

Page 7: Fulfilling IEEE’s Mission By Fostering Technological ...sites.ieee.org/ncc-roboresearch/files/2015/03/MCDonald_2015-Robo...Fulfilling IEEE’s Mission By Fostering Technological

Now What?

A.L.I.C.E.

Page 8: Fulfilling IEEE’s Mission By Fostering Technological ...sites.ieee.org/ncc-roboresearch/files/2015/03/MCDonald_2015-Robo...Fulfilling IEEE’s Mission By Fostering Technological

● Start with head and upper body● Focus on personal interaction rather than

many degrees of freedom● Link hearing, AI, vision, and speech● Adopt the Robot Operating System (ROS)

Some Early Decisions

Page 9: Fulfilling IEEE’s Mission By Fostering Technological ...sites.ieee.org/ncc-roboresearch/files/2015/03/MCDonald_2015-Robo...Fulfilling IEEE’s Mission By Fostering Technological

Knowledge Enabled Neophyte● Mannequin provides structure● Tilt-Pan servos in neck● Raspberry Pi vision, servo control,

and speech● Mac Mini hearing and chatbot AI● Offboard video processing for face

detection and recognition

January 2015 - KEN Is Born

Page 10: Fulfilling IEEE’s Mission By Fostering Technological ...sites.ieee.org/ncc-roboresearch/files/2015/03/MCDonald_2015-Robo...Fulfilling IEEE’s Mission By Fostering Technological

Google Web Speech API

eSpeak Speech Synthesis

KEN’s Ears and Voice

Page 11: Fulfilling IEEE’s Mission By Fostering Technological ...sites.ieee.org/ncc-roboresearch/files/2015/03/MCDonald_2015-Robo...Fulfilling IEEE’s Mission By Fostering Technological

● 3D Printed Iris

● Raspberry Pi Spy Cameras

KEN’s Eyes

Page 12: Fulfilling IEEE’s Mission By Fostering Technological ...sites.ieee.org/ncc-roboresearch/files/2015/03/MCDonald_2015-Robo...Fulfilling IEEE’s Mission By Fostering Technological

First Images From KEN’s Eyes

Page 13: Fulfilling IEEE’s Mission By Fostering Technological ...sites.ieee.org/ncc-roboresearch/files/2015/03/MCDonald_2015-Robo...Fulfilling IEEE’s Mission By Fostering Technological

● Use OpenCV for face detection● Rotate, crop, and normalize images● Compare images for recognition● Link to AI to put name with face

Face Recognition

Page 14: Fulfilling IEEE’s Mission By Fostering Technological ...sites.ieee.org/ncc-roboresearch/files/2015/03/MCDonald_2015-Robo...Fulfilling IEEE’s Mission By Fostering Technological

KEN’s Intelligence

A.L.I.C.E.

Page 15: Fulfilling IEEE’s Mission By Fostering Technological ...sites.ieee.org/ncc-roboresearch/files/2015/03/MCDonald_2015-Robo...Fulfilling IEEE’s Mission By Fostering Technological

Culminating in the demo you can see today.

Page 16: Fulfilling IEEE’s Mission By Fostering Technological ...sites.ieee.org/ncc-roboresearch/files/2015/03/MCDonald_2015-Robo...Fulfilling IEEE’s Mission By Fostering Technological

● Why are we doing this?

● Where do we go from here?

Why and What’s Next?

Page 17: Fulfilling IEEE’s Mission By Fostering Technological ...sites.ieee.org/ncc-roboresearch/files/2015/03/MCDonald_2015-Robo...Fulfilling IEEE’s Mission By Fostering Technological

From the Charter

Page 18: Fulfilling IEEE’s Mission By Fostering Technological ...sites.ieee.org/ncc-roboresearch/files/2015/03/MCDonald_2015-Robo...Fulfilling IEEE’s Mission By Fostering Technological

Phase 1 - Head and Shoulders (KEN)

Phase 2 - Upper Body on Mobile Platform

Phase 3 - Walking, Talking, Singing, Dancing,Bike Riding Biped Best

Friend

Future Phases

Page 19: Fulfilling IEEE’s Mission By Fostering Technological ...sites.ieee.org/ncc-roboresearch/files/2015/03/MCDonald_2015-Robo...Fulfilling IEEE’s Mission By Fostering Technological

Project Web Sitehttp://sites.ieee.org/encs-humanoid/

Project Forumhttps://groups.google.com/forum/#!forum/encshumanoidroboticsproject

YouTubehttps://www.youtube.com/user/ENCSHumanoidRobotics

GitHubhttps://github.com/encs-humanoid

Where Can I Learn More?

Page 20: Fulfilling IEEE’s Mission By Fostering Technological ...sites.ieee.org/ncc-roboresearch/files/2015/03/MCDonald_2015-Robo...Fulfilling IEEE’s Mission By Fostering Technological

● All technical areas need team members with expertise, desire to learn, and time to contribute

● Need help documenting and publicising the project● Need better onboard computers● Need funding for hardware components

How Can I Help?

Page 21: Fulfilling IEEE’s Mission By Fostering Technological ...sites.ieee.org/ncc-roboresearch/files/2015/03/MCDonald_2015-Robo...Fulfilling IEEE’s Mission By Fostering Technological

Special Thanks

Page 22: Fulfilling IEEE’s Mission By Fostering Technological ...sites.ieee.org/ncc-roboresearch/files/2015/03/MCDonald_2015-Robo...Fulfilling IEEE’s Mission By Fostering Technological

end

Page 23: Fulfilling IEEE’s Mission By Fostering Technological ...sites.ieee.org/ncc-roboresearch/files/2015/03/MCDonald_2015-Robo...Fulfilling IEEE’s Mission By Fostering Technological

In January 2014, the IEEE Eastern North Carolina Section Robotics and Automation Chapter embarked on an ambitious project to pool the resources of local engineers in the Research Triangle Park area to build a humanoid robot. With the audacious goal of building a robot that is indistinguishable from a human being, the team set off to gather requirements, architect, and prototype the technologies that would make up this robot. This talk will provide a brief overview of the project, the dream, and the challenges that lie ahead on the long road to produce a machine with humanlike characteristics and behaviors. Intended as a tool to inspire both experienced engineers and students aspiring to be engineers, the humanoid robot project aims to fulfill IEEE's mission by fostering technological innovation that will lead to a better understanding of technology and humanity.

Abstract