|
The goal of the Protein Crystal Mounting project is to produce a microrobotic system capable of autonomously mounting protein crystals on a tool for the purpose of X-ray data collection. The system uses visual feedback from a camera mounted on a microscope to control a micromanipulator which has the mounting tool attached as its end-effector. For use with our robotic system, we have developed unique new tools, called miscroshovels, which are designed to address certain limitations of the traditionally used by crystallographers cryogenic loops and capillaries. The motivation for this project, along with some background information, is described separately. |
A crystal mounted on a microshovel |
|
We have designed and assembled a micro-robotic system for protein crystal manipulation, which we use for our research and experiments. The system uses our own custom tools, called microshovels, which we designed and fabricated using MEMS technology. |
|
|
The system operates as follows: The user places the coverslip with the crystals under the microscope, starts the program and selects a target crystal. After that, the program proceeds in three phases: descent, approach and pickup. During the descent phase, the miscroshovel is lowered into the droplet all the way down to the surface of the coverslip. The main difficulty in this phase is to detect when the correct depth is achieved. To do this we utilize the rigidity of the silicon. The systems continues its downward motion in large steps (100-200um) until the tool touches the plastic coverslip. At the time of contact between the tool and the coverslip, due to the rigidity of the silicon, the coverslips slides horizontally under the force. To accentuate the horizontal component, we use a zig-zag descending motion. We detect the motion using optical flow methods on the video feed from the camera. |
Crystal mounting setup |
|
After the tool is in focus, we control its horizontal movement to slide it under a target protein crystal for pickup. The approach phase consists of visual servoing of the tool toward the crystal such that the tool is positioned immediately before the crystal but there is no contact between them. Both the tool and the crystal are tracked using region trackers on the video stream. The tracker for the tool is initialized automatically, by briefly withdrawing the tool from the field of view and using image differences to locate its position. The crystal is selected manually, as visual categorization and evalution of the quality of different crystals is beyond the scope of our work for now. |
|
|
Finally, when the tool and the crystal are aligned, the pickup phase consists of rapidly sliding the tool under the crystal and lifting it up. The video on the right shows the entire 3-phase process, peformed automatically by the system. After the successful mounting, the refocusing, the repositioning of the light and the tool were performed manually for a better view of the crystal on the tool (these are not part of the regular procedure). |
Automatic crystal mounting (5MB) |