论文标题
变形金刚可以推理行动的影响吗?
Can Transformers Reason About Effects of Actions?
论文作者
论文摘要
最近的一项工作表明,在有限的环境中,变形金刚能够以事实和规则为“理性”,在这种情况下,规则是条件结合的自然语言表达,这意味着结论。由于这表明变形金刚可以用自然语言给出的知识用于推理,因此我们对此进行了严格的评估,以相对的知识及其相应的推理 - 对行动影响的推理。关于行动和变化的推理一直是AI初期的知识代表子领域的主要重点,最近它一直是常识问题回答的亮点。我们在自然语言中考虑了四个动作域(封锁世界,物流,码头工人 - 机器人和一个通用域),并创建QA数据集,涉及这些域中动作效果的推理。我们研究了变形金刚(a)学会在这些域中推理的能力,以及(b)将其从通用域学习到其他领域的能力。
A recent work has shown that transformers are able to "reason" with facts and rules in a limited setting where the rules are natural language expressions of conjunctions of conditions implying a conclusion. Since this suggests that transformers may be used for reasoning with knowledge given in natural language, we do a rigorous evaluation of this with respect to a common form of knowledge and its corresponding reasoning -- the reasoning about effects of actions. Reasoning about action and change has been a top focus in the knowledge representation subfield of AI from the early days of AI and more recently it has been a highlight aspect in common sense question answering. We consider four action domains (Blocks World, Logistics, Dock-Worker-Robots and a Generic Domain) in natural language and create QA datasets that involve reasoning about the effects of actions in these domains. We investigate the ability of transformers to (a) learn to reason in these domains and (b) transfer that learning from the generic domains to the other domains.