论文标题
用于创建多模式代理的模块化体系结构
A modular architecture for creating multimodal agents
论文作者
论文摘要
本文描述了一个灵活而模块化的平台，以创建多模式交互式代理。该平台通过一个事件公交车运行，该事件按时发布了信号和解释的时间顺序。可以通过将其输入和输出定义为主题来整合不同的传感器和解释组件，从而导致逻辑工作流以进行进一步的解释。我们解释了到目前为止已经开发并集成到一系列交互式代理中的广泛组件。我们还解释了如何将实际相互作用记录为多模式数据以及所谓的情节知识图。通过分析记录的相互作用，我们可以分析和比较不同的代理和代理成分。
The paper describes a flexible and modular platform to create multimodal interactive agents. The platform operates through an event-bus on which signals and interpretations are posted in a sequence in time. Different sensors and interpretation components can be integrated by defining their input and output as topics, which results in a logical workflow for further interpretations. We explain a broad range of components that have been developed so far and integrated into a range of interactive agents. We also explain how the actual interaction is recorded as multimodal data as well as in a so-called episodic Knowledge Graph. By analysing the recorded interaction, we can analyse and compare different agents and agent components.
