论文标题
通过机器人技能学习来加速实验室自动化,以进行样品刮擦
Accelerating Laboratory Automation Through Robot Skill Learning For Sample Scraping
论文作者
论文摘要
将实验室机器人技术用于自主实验提供了一条有吸引力的途径,以减轻科学家的繁琐任务,同时加速诸如气候变化和药品等局部问题的物质发现。尽管某些实验性工作流程已经可以从自动化中受益,但由于处理不同工具,化学品和玻璃器皿时所需的高电动机功能和灵巧性,仍需要手动进行样品制备。化学场中的基本工作流程是结晶,其中一种应用是多晶筛筛选,即从晶体获得三维分子结构。对于此过程,尽可能多的样本是至关重要的,因为合成分子的时间和金钱上都是昂贵的。为此,化学家在成像板转移之前刮擦小瓶以检索样品含量。自动化此过程是充满挑战的,因为它超越了机器人插入任务,因为必须在受约束的环境中执行细红运动(样品小瓶)。由人类化学家如何从小瓶中刮擦粉末的过程中,我们的工作提出了一种无模型的加固学习方法,以学习刮擦政策,从而导致完全自主的样本刮擦程序。我们首先使用熊猫弗兰加·埃米卡(Panda Franka Emika)机器人使用实验室刮刀插入模拟的小瓶中,创建一个特定方案的模拟环境,以证明如何在模拟中成功学习刮擦策略。然后,我们在实验室环境中对真正的机器人操纵器进行训练并评估我们的方法,并表明我们的方法可以自主在各种设置中自动刮擦粉末。
The use of laboratory robotics for autonomous experiments offers an attractive route to alleviate scientists from tedious tasks while accelerating material discovery for topical issues such as climate change and pharmaceuticals. While some experimental workflows can already benefit from automation, sample preparation is still carried out manually due to the high level of motor function and dexterity required when dealing with different tools, chemicals, and glassware. A fundamental workflow in chemical fields is crystallisation, where one application is polymorph screening, i.e., obtaining a three dimensional molecular structure from a crystal. For this process, it is of utmost importance to recover as much of the sample as possible since synthesising molecules is both costly in time and money. To this aim, chemists scrape vials to retrieve sample contents prior to imaging plate transfer. Automating this process is challenging as it goes beyond robotic insertion tasks due to a fundamental requirement of having to execute fine-granular movements within a constrained environment (sample vial). Motivated by how human chemists carry out this process of scraping powder from vials, our work proposes a model-free reinforcement learning method for learning a scraping policy, leading to a fully autonomous sample scraping procedure. We first create a scenario-specific simulation environment with a Panda Franka Emika robot using a laboratory scraper that is inserted into a simulated vial, to demonstrate how a scraping policy can be learned successfully in simulation. We then train and evaluate our method on a real robotic manipulator in laboratory settings, and show that our method can autonomously scrape powder across various setups.