Automated Hooking of Biomedical Microelectrode Guided by Intelligent Microscopic Vision

Biomedical microelectrode implantation is a promising approach to achieve invasive brain-machine interface with high bandwidth and good biocompatibility. However, it is difficult to manipulate a microelectrode probe because of its micron-level width and flexible material. Toward the challenging robo...

Full description

Saved in:
Bibliographic Details
Published in:IEEE/ASME transactions on mechatronics 2023-10, Vol.28 (5), p.1-13
Main Authors: Qin, Fangbo, Xu, De, Zhang, Dapeng, Pei, Weihua, Han, Xinyong, Yu, Shan
Format: Article
Language:English
Subjects:
Alignment
Automation
Biocompatibility
Brain-machine interface (BMI)
Cameras
Control systems design
Feature extraction
few-shot learning
flexible electrode
Implantation
Man-machine interfaces
Microelectrodes
micromanipulation
microscopic vision
Microscopy
Needles
Optical design
Optimization
Probes
Robot control
Task analysis
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Biomedical microelectrode implantation is a promising approach to achieve invasive brain-machine interface with high bandwidth and good biocompatibility. However, it is difficult to manipulate a microelectrode probe because of its micron-level width and flexible material. Toward the challenging robotic implantation, this article addresses an essential operation step: automated hooking of flexible microelectrode probe with a micro-needle. First, a point-contour of interest extraction network for microscopic image (MicroPCIE) is proposed to obtain key image features for visual guidance. Based on few-shot learning mechanism, MicroPCIE trained on nonspecific dataset can be rapidly deployed to the specific hooking task without requiring data-driven optimization. Second, a robotic hooking control system is designed considering the distributed probe locations, variable needle direction, and efficiency requirements. The needle-probe alignment control is executed under low and high microscope magnifications, to realize larger operation range and permit high alignment precision. The optical design and camera aiming control are proposed to guarantee the visibility and clearness of objects after low-to-high magnification switch. The effectiveness of the proposed methods is validated with a series of experiments.
ISSN:1083-4435
1941-014X
DOI:10.1109/TMECH.2023.3248112