Thomas White, Deutsches Elektronen-Synchrotron DESY

Abstract: 

We have implemented a system for fully real-time data processing during serial X-ray crystallography experiments. Using the CrystFEL software in combination with the ASAP::O data framework used at DESY, we were able to keep up with the maximum full-frame readout speed of 133 frames per second while searching for peaks, indexing and integrating the frames. The pipeline produced un-merged Bragg reflection intensity measurements which could be directly scaled and merged in order to solve the structure, with no need (at least in principle) to store image data on disk.

The performance of the system depends on the hit rate, because blank frames can quickly be skipped over. Performance profiling and algorithmic improvements, combined with a careful choice of data format and processing parameters, have reduced the hardware requirements down to only 32 CPU cores being sufficient for a 40% hit rate.

Poster Session Link: https://gather.town/invite?token=0pEoq7VP

If you have any questions for the presenter, please contact them via email: thomas.white@desy.de