perfect link between human and digital worlds · 24/07/2018 · arduino environment stores all the...
TRANSCRIPT
![Page 1: Perfect Link Between Human and Digital Worlds · 24/07/2018 · Arduino environment stores all the downloaded boards packages in the following directory: C:\Users\\AppData\Local\Arduino15\packages\](https://reader034.vdocuments.mx/reader034/viewer/2022050601/5fa86ab73a8007612d7d51d2/html5/thumbnails/1.jpg)
Perfect Link Between Human and Digital Worlds
Rev.0 07-24-2018Mountain View
![Page 2: Perfect Link Between Human and Digital Worlds · 24/07/2018 · Arduino environment stores all the downloaded boards packages in the following directory: C:\Users\\AppData\Local\Arduino15\packages\](https://reader034.vdocuments.mx/reader034/viewer/2022050601/5fa86ab73a8007612d7d51d2/html5/thumbnails/2.jpg)
Rev.0 07-24-2018
Mountain View (CA) – Meet Up TACTIGON SDK
07-24-2018
![Page 3: Perfect Link Between Human and Digital Worlds · 24/07/2018 · Arduino environment stores all the downloaded boards packages in the following directory: C:\Users\\AppData\Local\Arduino15\packages\](https://reader034.vdocuments.mx/reader034/viewer/2022050601/5fa86ab73a8007612d7d51d2/html5/thumbnails/3.jpg)
TACTIGON SKIN
It’ also compatbile with Arduino IDE. You can download APP and the system change
functionality
It’s a Platform
01
It’s no a glove it’s no a bracelet it’s no a ring. It’s new way for the hand gesture controller.
The system recognize the movement of the hand and the fingers with capacity key
Hand + Finger Recognition
03
The hand are free and you can use the device in very simple way. It’s very easy to wear it
Ergonomic Form Factor
02
![Page 4: Perfect Link Between Human and Digital Worlds · 24/07/2018 · Arduino environment stores all the downloaded boards packages in the following directory: C:\Users\\AppData\Local\Arduino15\packages\](https://reader034.vdocuments.mx/reader034/viewer/2022050601/5fa86ab73a8007612d7d51d2/html5/thumbnails/4.jpg)
Examples
Rover Control CAD/CAM software
Robotic harm AR/VR
![Page 5: Perfect Link Between Human and Digital Worlds · 24/07/2018 · Arduino environment stores all the downloaded boards packages in the following directory: C:\Users\\AppData\Local\Arduino15\packages\](https://reader034.vdocuments.mx/reader034/viewer/2022050601/5fa86ab73a8007612d7d51d2/html5/thumbnails/5.jpg)
TACTIGON SKIN & TheTactigon One
![Page 6: Perfect Link Between Human and Digital Worlds · 24/07/2018 · Arduino environment stores all the downloaded boards packages in the following directory: C:\Users\\AppData\Local\Arduino15\packages\](https://reader034.vdocuments.mx/reader034/viewer/2022050601/5fa86ab73a8007612d7d51d2/html5/thumbnails/6.jpg)
HW Architecture
GPIOs
BT interface
Microprocessor
temperature
sensor
Pressure
sensor
Battery manager
3 axis
accelerometer3 axis
gyroscope
3 axis
magnetoeter
Generic
BT device
Serial Port
(UART)
![Page 7: Perfect Link Between Human and Digital Worlds · 24/07/2018 · Arduino environment stores all the downloaded boards packages in the following directory: C:\Users\\AppData\Local\Arduino15\packages\](https://reader034.vdocuments.mx/reader034/viewer/2022050601/5fa86ab73a8007612d7d51d2/html5/thumbnails/7.jpg)
Sensor Fusion Algorithm
Sensor Fusion
Alghoritm
Acceleration x,y,z
Angular Speed x,y,z
Earth Mag Field x,y,z
- Quaternions
- Euler Angles
-detection of orientation in the space of the
device in terms of Eulero Angles:
roll, pitch, yaw
- Based on Kalman filter
- Running by default at 50 Hz. Customizable in
next API release
![Page 8: Perfect Link Between Human and Digital Worlds · 24/07/2018 · Arduino environment stores all the downloaded boards packages in the following directory: C:\Users\\AppData\Local\Arduino15\packages\](https://reader034.vdocuments.mx/reader034/viewer/2022050601/5fa86ab73a8007612d7d51d2/html5/thumbnails/8.jpg)
HW Architecture
GPIOs
BT interface
Microprocessor
temperature
sensor
Pressure
sensor
Battery manager
3 axis
accelerometer3 axis
gyroscope
3 axis
magnetoeter
Generic
BT device
Serial Port
(UART)
![Page 9: Perfect Link Between Human and Digital Worlds · 24/07/2018 · Arduino environment stores all the downloaded boards packages in the following directory: C:\Users\\AppData\Local\Arduino15\packages\](https://reader034.vdocuments.mx/reader034/viewer/2022050601/5fa86ab73a8007612d7d51d2/html5/thumbnails/9.jpg)
HW DetailsMicrocontroller:
STM32 32 bit 32Mhz
IMU: 3 Axis gyroscope (FS: 2000 deg/s) 3 Axis accelerometer (FS: 16g) 3 Axis magnetometer (FS: 16 Gauss)
Connectivity: Bluetooth Low Energy Up 2 UART 4 GPIO
Flash Memory: 512 KB
RAM: 80KB
EEPROM: 16KB
Temperature Sensor
Barometric Pressure Sensorr
Battery: 3.7 Li Ion Rechargeable via Micro USB connector
![Page 10: Perfect Link Between Human and Digital Worlds · 24/07/2018 · Arduino environment stores all the downloaded boards packages in the following directory: C:\Users\\AppData\Local\Arduino15\packages\](https://reader034.vdocuments.mx/reader034/viewer/2022050601/5fa86ab73a8007612d7d51d2/html5/thumbnails/10.jpg)
Software Architecture
Tactigon
Arduino Library
Sensor Fusion
Alghoritm
Arduino
User Code
Sensors, GPIO,
UART, led drivers
Sensors, GPIO,
UART, led,
battery
Bluetooth
driver
Bluetooth
Interface
Standard
Arduino Library
Hard
ware
Drivers
Soft
ware
AP
IU
ser
Space
CORE
![Page 11: Perfect Link Between Human and Digital Worlds · 24/07/2018 · Arduino environment stores all the downloaded boards packages in the following directory: C:\Users\\AppData\Local\Arduino15\packages\](https://reader034.vdocuments.mx/reader034/viewer/2022050601/5fa86ab73a8007612d7d51d2/html5/thumbnails/11.jpg)
Software Architecture – CORECORE{
- Sensors management: call drivers, get data
- Sensor Fusion
}
{
- Battery management
- BLE management: connection manager Role management (CENTRAL, PERIPHERAL) Read/write BLE characteristics
- Virtual COM port management for fw downloading and debug
}
{
- Hook to Arduino setup() function
- Hook to Arduino loop() function
}
![Page 12: Perfect Link Between Human and Digital Worlds · 24/07/2018 · Arduino environment stores all the downloaded boards packages in the following directory: C:\Users\\AppData\Local\Arduino15\packages\](https://reader034.vdocuments.mx/reader034/viewer/2022050601/5fa86ab73a8007612d7d51d2/html5/thumbnails/12.jpg)
Software Executionvoid main()
{
system_init()
while(1)
{
//50Hz timing
{
ble_management()
others() (*)
}
//custom timing (dflt: 50Hz)
{
sensors_read()
sensor_fusion()
}
//continuos loop
}
}
setup()
{
}
loop()
{
}
core code Arduino code
(*) VCOM, battery management,
GPIOs, UARTs, power button,...
![Page 13: Perfect Link Between Human and Digital Worlds · 24/07/2018 · Arduino environment stores all the downloaded boards packages in the following directory: C:\Users\\AppData\Local\Arduino15\packages\](https://reader034.vdocuments.mx/reader034/viewer/2022050601/5fa86ab73a8007612d7d51d2/html5/thumbnails/13.jpg)
SDK installation - Arduino configFile → Preferences
In “Additional Board Manager URLs” add:
http://nextind.eu/arduino/package_next_index.json
![Page 14: Perfect Link Between Human and Digital Worlds · 24/07/2018 · Arduino environment stores all the downloaded boards packages in the following directory: C:\Users\\AppData\Local\Arduino15\packages\](https://reader034.vdocuments.mx/reader034/viewer/2022050601/5fa86ab73a8007612d7d51d2/html5/thumbnails/14.jpg)
SDK installation – Board ManagerArduino IDE is now able to download the SDK by mean of “Boards Manger” tool:
Tools→Board: xxx → Boards Manager...
![Page 15: Perfect Link Between Human and Digital Worlds · 24/07/2018 · Arduino environment stores all the downloaded boards packages in the following directory: C:\Users\\AppData\Local\Arduino15\packages\](https://reader034.vdocuments.mx/reader034/viewer/2022050601/5fa86ab73a8007612d7d51d2/html5/thumbnails/15.jpg)
SDK installation – Board ManagerIn Boards Manager:
-Type: select ”Contributed”
-Tactigon board is included in list of suppoerted board
- Click on “Install” to download and install the whole SDK
![Page 16: Perfect Link Between Human and Digital Worlds · 24/07/2018 · Arduino environment stores all the downloaded boards packages in the following directory: C:\Users\\AppData\Local\Arduino15\packages\](https://reader034.vdocuments.mx/reader034/viewer/2022050601/5fa86ab73a8007612d7d51d2/html5/thumbnails/16.jpg)
SDK installation - Details
Following components are included in SDK:
- Tactigon library
- API documentation (doxygen; also available at http://thetactigon.com/arduino/doxygen)
- gcc toolchain for STM32
- USB Driver: STMicroelectronics Virtual COM Port
- STM32 loader(jtag or Serial via VCOM)
- First whole installation takes about 90MB
- Updates usually involves only Tactigon library (about 30MB)
At the moment only Windows platform is supported.
Coming soon Mac & Linux
![Page 17: Perfect Link Between Human and Digital Worlds · 24/07/2018 · Arduino environment stores all the downloaded boards packages in the following directory: C:\Users\\AppData\Local\Arduino15\packages\](https://reader034.vdocuments.mx/reader034/viewer/2022050601/5fa86ab73a8007612d7d51d2/html5/thumbnails/17.jpg)
SDK installation – VCOM driver
Arduino environment stores all the downloaded boards packages in the following
directory:
C:\Users\<UserName>\AppData\Local\Arduino15\packages\
Starting from this folder, Tactigon SDK is in subfolder .\Next-packages
VCOM port driver are located in the following subfolder
.\Next-package\tools\STM32Tools\2018.7.16\tools\win\stlink\ST-LINK_USB_V2_Driver
![Page 18: Perfect Link Between Human and Digital Worlds · 24/07/2018 · Arduino environment stores all the downloaded boards packages in the following directory: C:\Users\\AppData\Local\Arduino15\packages\](https://reader034.vdocuments.mx/reader034/viewer/2022050601/5fa86ab73a8007612d7d51d2/html5/thumbnails/18.jpg)
SDK installation – Last Settings
In Tools → Board:
Board: Next Board -Tactigon
Upload Method: USBserial
Port: COM35
![Page 19: Perfect Link Between Human and Digital Worlds · 24/07/2018 · Arduino environment stores all the downloaded boards packages in the following directory: C:\Users\\AppData\Local\Arduino15\packages\](https://reader034.vdocuments.mx/reader034/viewer/2022050601/5fa86ab73a8007612d7d51d2/html5/thumbnails/19.jpg)
SDK installation – Recap
- SDK download via Arduino Boards Manager
- VCOM driver installation
- Board-UploadMethod-Port selection
Detailed step-by-step manual available at:
https://thetactigon.com/download
Quick Start Guide – Arduino IDE Configuration
![Page 20: Perfect Link Between Human and Digital Worlds · 24/07/2018 · Arduino environment stores all the downloaded boards packages in the following directory: C:\Users\\AppData\Local\Arduino15\packages\](https://reader034.vdocuments.mx/reader034/viewer/2022050601/5fa86ab73a8007612d7d51d2/html5/thumbnails/20.jpg)
T-SKIN BLE Peripheral Role
MAC = {11 22 33 44 55 66}
BLE_name = “TACTI”
BLE Characteristics [20 byte]
128bit UUID
SmartWatch
MAC = {11 22 33 44 55 66}
BLE_name = “…...”
BLE Characteristics [20 byte]
128bit UUID
Heart Rate Band
MAC = {11 22 33 44 55 66}
BLE_name = “…...”
BLE Characteristics [20 byte]
128bit UUID
scan
pairing
![Page 21: Perfect Link Between Human and Digital Worlds · 24/07/2018 · Arduino environment stores all the downloaded boards packages in the following directory: C:\Users\\AppData\Local\Arduino15\packages\](https://reader034.vdocuments.mx/reader034/viewer/2022050601/5fa86ab73a8007612d7d51d2/html5/thumbnails/21.jpg)
T- SKIN BLE Central role
scan
pairing
BLE – COM converter
MAC = {11 22 33 44 55 66}
BLE_name = “…...”
BLE Characteristics [20 byte]
128bit UUID
Any BLE devices
MAC = {11 22 33 44 55 66}
BLE_name = “…...”
BLE Characteristics [20 byte]
128bit UUID
MAC = {11 22 33 44 55 66}
BLE_name = “…...”
BLE Characteristics [20 byte]
128bit UUID
![Page 22: Perfect Link Between Human and Digital Worlds · 24/07/2018 · Arduino environment stores all the downloaded boards packages in the following directory: C:\Users\\AppData\Local\Arduino15\packages\](https://reader034.vdocuments.mx/reader034/viewer/2022050601/5fa86ab73a8007612d7d51d2/html5/thumbnails/22.jpg)
Raw data Sensors
Acceleration x,y,z
Angular Speed x,y,z
Earth Mag Field x,y,zEarth Mag Field x,y,z
Battery Charge Status
Environment Temperature
Earth Mag Field x,y,zBarometric Pressure
![Page 23: Perfect Link Between Human and Digital Worlds · 24/07/2018 · Arduino environment stores all the downloaded boards packages in the following directory: C:\Users\\AppData\Local\Arduino15\packages\](https://reader034.vdocuments.mx/reader034/viewer/2022050601/5fa86ab73a8007612d7d51d2/html5/thumbnails/23.jpg)
LABs
PrintAngles.ino
PrintGyro.ino
BLE_HelloWorld
TactigonAcc - Android App
TactigonCube – Android App
CINGO_controller
Swipe
![Page 24: Perfect Link Between Human and Digital Worlds · 24/07/2018 · Arduino environment stores all the downloaded boards packages in the following directory: C:\Users\\AppData\Local\Arduino15\packages\](https://reader034.vdocuments.mx/reader034/viewer/2022050601/5fa86ab73a8007612d7d51d2/html5/thumbnails/24.jpg)
ROVER project
UART interface
wired UART connection
BLE Pairing
BLE Peripheral Role
BLE Central Role
![Page 25: Perfect Link Between Human and Digital Worlds · 24/07/2018 · Arduino environment stores all the downloaded boards packages in the following directory: C:\Users\\AppData\Local\Arduino15\packages\](https://reader034.vdocuments.mx/reader034/viewer/2022050601/5fa86ab73a8007612d7d51d2/html5/thumbnails/25.jpg)
PC connection project
BLE Pairing BLE to COM
adapter
USB connection
Client application
BLE Peripheral Role
BLE Central Role
![Page 26: Perfect Link Between Human and Digital Worlds · 24/07/2018 · Arduino environment stores all the downloaded boards packages in the following directory: C:\Users\\AppData\Local\Arduino15\packages\](https://reader034.vdocuments.mx/reader034/viewer/2022050601/5fa86ab73a8007612d7d51d2/html5/thumbnails/26.jpg)
Conclusions Tactigon board is:
Very little Equipped with inertial sensors Powerful: it can run Sensor Fusion algorithm on board Self powered with Lithium battery
Suitable for gesture controller
Design and ergonomic approach: T-Skin
Arduino: to be open to all possible use cases
![Page 27: Perfect Link Between Human and Digital Worlds · 24/07/2018 · Arduino environment stores all the downloaded boards packages in the following directory: C:\Users\\AppData\Local\Arduino15\packages\](https://reader034.vdocuments.mx/reader034/viewer/2022050601/5fa86ab73a8007612d7d51d2/html5/thumbnails/27.jpg)
thank you.