Multimodal Input

Back to Use Cases

Enhancing ink with sensor data - Have fun experimenting

The multimodal input capabilities enabled by the sensors in Wacom digital pens provide the capacity to record, analyze and present a broad range of data in real time.

The ability to leverage this data in innovative ways opens up a vast array of application opportunities across a broad range of industry sectors, from education to psychology and medicine.

The WILL™3.0 SDK for ink enables the capture of:

The raw sensor data captured from a digital pen as it moves across the device screen
The geometry of the visual ink representation created by rendering algorithms.
Ink metadata including document, author and semantic metadata attached to the ink for interpreting, for example, the meaning of a word

The WILL™3.0 SDK for ink captures detailed pen pressure, inclination and time and speed data in Wacom's proprietary binary Forensic Signature Stream (FSS) format. This can be used to experiment with integrating digital ink and data from other sources.

For example, Wacom has already co-developed a proof of concept that uses a headset, a notebook PC and a digital pen to measure and embed brainwave data into handwritten digital ink. This can be used to present a visual display of the user’s emotional state.