cogmacogma : :A Mobile Code Middleware for A Mobile Code Middleware for

Ad hoc Networks andAd hoc Networks and Ubiquitous Environment Ubiquitous Environment

Nobuo KawaguchiNobuo Kawaguchihttp://www.cogma.org/http://www.cogma.org/

2121stst Century Center of Excellence, Century Center of Excellence, （（ 2002—2002002—20077 ））

Information Technology Center, Information Technology Center, Nagoya UniversityNagoya University

Various services areVarious services are embedded in embedded in the environment the environmentUser can use themUser can use them intuitively intuitivelyComing soon!?Coming soon!?

　　　　

A Middleware for various devices

There are requirements for

Ubiquitous Computing Ubiquitous Computing EnvironmentEnvironment

Ubiquitous EnvironmentUbiquitous Environment

Many kind Many kind of information network devicesof information network devices– Sensors, Actuators, Servers, TerminalsSensors, Actuators, Servers, Terminals

At any place, huge number of At any place, huge number of information devices information devices – invisible information devicesinvisible information devices

Services are implemented byServices are implemented by cooperation cooperation of of several devicesseveral devices– Context (placeContext (place ・・ environment) awareenvironment) aware services services

CalmCalm Computing Computing– User does not required to understand the usageUser does not required to understand the usage

To realize ubiquitous To realize ubiquitous environmentenvironment

1.1. Handle unpredictable dynamic change (Handle unpredictable dynamic change (addition/ addition/ deletiondeletion) of devices) of devices

- Continue to serve cooperative service- Continue to serve cooperative service

2.2. Inter-device cooperation between devices which Inter-device cooperation between devices which do do not know about each othernot know about each other

- Every year, new device comes.- Every year, new device comes.

3.3. HeterogeneousHeterogeneous device/ networkdevice/ network4.4. SimplifySimplify the usage of the services the usage of the services5.5. Reduction of Reduction of environmental loadenvironmental load by by

information devicesinformation devices

Middleware solutionMiddleware solution

To satisfy the requirements To satisfy the requirements some smart architecture is required.some smart architecture is required.

We have developed a middleware namedWe have developed a middleware named“cogma” for easy development of “cogma” for easy development of cooperative device software.cooperative device software.

Features of cogmaFeatures of cogma

Multiple PlatformMultiple Platform– Most of CPU/ OS Most of CPU/ OS （（ Java Java ／ ／ VPVP ））Multiple Network / ProtocolMultiple Network / Protocol– TCP/IP (Wireless, Ethernet), HTTPTCP/IP (Wireless, Ethernet), HTTP– SerialSerial

Dynamic Transfer of SoftwareDynamic Transfer of Software– Dynamic updateDynamic update

Small Resource / HardwareSmall Resource / Hardware– Less memory and High performance with VPLess memory and High performance with VP

Agent System

Embedded ManagerLink Manager Application Agents

Agent Manager

Protocol AgentsTCP Manager

Ir ManagerControlAgent

Sensor Agent

Management of Links

Management of Codget

Management of Embedded device

Each module is implemented as Mobile Agent

Structure of cogma Architecture

Target of cogma architectureTarget of cogma architecture

Human to human communication supportHuman to human communication support– Ad-hoc communicationAd-hoc communication

Human to Environment comm. supportHuman to Environment comm. support– Multimedia meeting supportMultimedia meeting support

Inter device communication supportInter device communication support– to provide a device cooperativeto provide a device cooperative

ubiquitous serviceubiquitous service

Running Environment of Running Environment of Java based cogmaJava based cogma

OS:Windows, Linux, MacOS, PocketPC OS:Windows, Linux, MacOS, PocketPC LanguageLanguage ：： JavaJava （（ JDK1.1.8) or Higher JDK1.1.8) or Higher PerPersonalJava/ J2MEsonalJava/ J2ME

Code SizeCode Size ：：　　　　　　 Number of FilesNumber of Files 　　 ２２０２２０　　　　　　 Number of ClassesNumber of Classes ４２５４２５　　　　　　 Number of Lines Number of Lines ４５０００ ４５０００ lineslines 　　 　　 Bytecode size about Bytecode size about ６６０６６０ KbyteKbyte

Design Concept of cogmaDesign Concept of cogma

Agent Networks

Mobile Applications

IntelligentAgents

Application for supportingad-hoc communications

Construct a context aware ad-hoc network

Smart agent technology forsupporting calm computing

In the officeIn the office

Smart agent autonomously moves to PDA (Transfer a meeting data)

Intelligent smart agent based on mobile software

Let’s go tomeeting!

move to

In the meeting roomIn the meeting room

Automatically transfer and present the data.

Transfer the data to participants!

Hey!

Hey!

In the homeIn the home

At the home, prepare for tomorrow based on schedule.

Tomorrow’sagenda will …

It was hard day..

I’m Home!

cogma Applicationscogma Applications

VPcogmaVPcogma

SmartRoomSmartRoom

Smart MeetingsSmart Meetings

Cooperation with industryCooperation with industry

VPcogmaVPcogmaＶＰ ＶＰ = Virtual Processor= Virtual Processor– Works on multiple CPU/ OSWorks on multiple CPU/ OS

Win32 / PocketPC/ Linux / T-EngineWin32 / PocketPC/ Linux / T-Engine– High-speed using translator technologyHigh-speed using translator technology

Ｊａｖａ：Ｊａｖａ：– High productivity High productivity – Resource requirement is also highResource requirement is also high

ＶＰ：ＶＰ：– Need to develop in “C”Need to develop in “C”– Low costLow cost （（ less memory less memory ・ ・ small CPU)small CPU)

Runs on intentRuns on intent (TAO corp. in UK) (TAO corp. in UK)

Running Environment of Running Environment of ＶＰＶＰcogma cogma

Windows PC

Intel x86 1GHz Memory 512Mbyte

Pocket PC

XScale 400MHzMemory 32Mbyte

Running Environment of Running Environment of ＶＰＶＰcogma cogma

T-Engine

SH-3 96MHzMemory 8Mbyte

Running Environment of Running Environment of ＶＰＶＰcogma cogma

OpenBlocksLinux

PowerPC 405GP 200MHzMemory 64Mbyte

Running Environment of VPcogma Running Environment of VPcogma

VR4181A (Mips) 130MHzMemory 32Mbyte

Linux

Requirements for Test bed Requirements for Test bed

Test in Real World Environment is requiredTest in Real World Environment is required– Exemplify the usefulnessExemplify the usefulness– Cooperation of AppliancesCooperation of Appliances– Heterogeneous NetworksHeterogeneous Networks– Long-term experimentsLong-term experiments

Construct a Smart Room

Construction of theConstruction of theSmart Room Smart Room (( ２００２～２００２～ ))

Heterogeneous Network

A lot of devices areEmbedded in the room

Construction of the Smart RoomConstruction of the Smart Room

Ceiling Lights(8)Brightness/Human Sensor(3)

Networked PDP

Temperature Sensor(15)Power Monitor(3)

Networked Screen/Projector

Humidity Sensor(6) Human Sensor(6)

Matrix Switcher

X10 Devices

Multi Monitors(7)

Temperature Sensor, Human DetectorTemperature Sensor, Human Detector

Temperature Sensor, Light SensorTemperature Sensor, Light Sensor

Human Detector

Controller of the Sensor/LightsController of the Sensor/Lights

Devices areembedded

Heterogeneous NetworksHeterogeneous Networks

Full2wire networkFull2wire network （（ Matsushita Elec.Matsushita Elec. ））http://dmedia.mew.co.jp/Ebox/d_shohin/full2/index.htmlhttp://dmedia.mew.co.jp/Ebox/d_shohin/full2/index.html

– LightsLightsＬｏｎＷｏｒｋｓＬｏｎＷｏｒｋｓ（（ EchelonEchelon ） ） LonMark Org.LonMark Org.http://www.lonmark.gr.jp/http://www.lonmark.gr.jp/

– PowerMeterPowerMeter （（ MitsubishiMitsubishi ：： EcoMonitorEcoMonitor ＩＩ）ＩＩ）– Human DetectorHuman Detector 、、 BrightnessBrightness

（（ MitsubishiMitsubishi ： ： MelSave NETMelSave NET ））ＭｉｃｒｏＬＡＮＭｉｃｒｏＬＡＮ（（ MAXIMMAXIM ））http://www.maxim-ic.com/http://www.maxim-ic.com/

– TenperatureTenperature ／／ Moisture SensorMoisture Sensor 　　 （（ Kihoku Elec.Kihoku Elec. ：： MLtoLON throughMLtoLON through ））

Jan. 2004

Thermo Sen. x 15

Humid. Sen. x 6

Human Sen. x 6

Brightness Sen. x 3

Power Monitor x 3

LonWorks

PC interfacefor 2-wire Network

Ceiling light x 8

MicroLAN

RS232C

X10 Controller

LonWorks

2-Wire Network

MLtoLON

MLtoLON

MLtoLON

MicroLAN

LonWorks

Sensor Server

SensorDeviceCodget

cogma

Device Server

LIghtDeviceCodget

cogma

X10DeviceCodget Power Line

Networked Screen X10 DevicesDisplay Server

MatrixSwitcherCodget

cogma

PDPControllerCodget

RGB Matrix Switcher

Display Outputs x 10

PDPDisplay Inputs x 10

RS232C

Ethenet

Data Acquisition using CogmaData Acquisition using Cogma

←Temparature

Power Consumption→

Smart Meeting SystemSmart Meeting SystemSimple Application for supporting MeetiSimple Application for supporting Meetingng– Embedded Devices in the room areEmbedded Devices in the room are

incorporatedincorporatedProjectorProjectorLightsLightsPDAPDAMultiple NotePCsMultiple NotePCs

Found neighbor embeddeddevices and control them.

Java basedcogma

Intent basedVPcogma

　　 Hardware basedμcogma

Servers

Embedded Devices

Human Interaction Devices

Controller / Complex Devices

Networked Sensors/ Actuators

Grid ComputingApplication ServerDependable Computing

PC, PDACellular Phone

Information AppliancesDevice Controller

Digital DevicesEveryday life objects

SensorActuators

Billions

10Miliions

Millions

Triangle of cogma architectureTriangle of cogma architecture

Found a venture companyFound a venture company

There is a There is a HUGE HUGE gap called “Death Valley”gap called “Death Valley”between academic research and between academic research and real world application or industries.real world application or industries.

To overcome the gap, we found the a ventuTo overcome the gap, we found the a venture company named “Ubigraph Co.Ltd”re company named “Ubigraph Co.Ltd”

http://www.ubigraph.com/Only in Japanese, sorry

productresearch

ConclusionConclusion

A A Mobile code middlewareMobile code middleware named ”cogma” named ”cogma”helps to construct ubiquitous society.helps to construct ubiquitous society.We have built “We have built “cogma roomcogma room” to exemplify” to exemplifythe middleware and applications.the middleware and applications.Found a Found a venture companyventure company to deploy the to deploy thesoftware and ubiquitous solutions.software and ubiquitous solutions.

http://www.cogma.org/