Toward a Benchmarking Data Set Able to Evaluate Ligand- and Structure-based Virtual Screening Using Public HTS Data

• Published in: Journal of chemical information and modeling 2015-02, Vol.55 (2), p.343-353
• Main Authors: Lindh, Martin, Svensson, Fredrik, Schaal, Wesley, Zhang, Jin, Sköld, Christian, Brandt, Peter, Karlén, Anders
• Format: Article
• Language: English
• Subjects: Algorithms; Benchmarking - methods; Benchmarks; Chemical compounds; Chemistry with specialization in Bioorganic Chemistry; Computer Simulation; Databases, Chemical; High-Throughput Screening Assays - methods; Kemi med inriktning mot bioorganisk kemi; Ligands; Molecular Conformation; Molecular structure; Molecules; Pharmacology; R&D; Reproducibility of Results; Research & development; Structure-Activity Relationship; User-Computer Interface
• ISSN: 1549-9596; 1549-960X
• DOI: 10.1021/ci5005465

Virtual screening has the potential to accelerate and reduce costs of probe development and drug discovery. To develop and benchmark virtual screening methods, validation data sets are commonly used. Over the years, such data sets have been constructed to overcome the problems of analogue bias and artificial enrichment. With the rapid growth of public domain databases containing high-throughput screening data, such as the PubChem BioAssay database, there is an increased possibility to use such data for validation. In this study, we identify PubChem data sets suitable for validation of both structure- and ligand-based virtual screening methods. To achieve this, high-throughput screening data for which a crystal structure of the bioassay target was available in the PDB were identified. Thereafter, the data sets were inspected to identify structures and data suitable for use in validation studies. In this work, we present seven data sets (MMP13, DUSP3, PTPN22, EPHX2, CTDSP1, MAPK10, and CDK5) compiled using this method. In the seven data sets, the number of active compounds varies between 19 and 369 and the number of inactive compounds between 59 405 and 337 634. This gives a higher ratio of the number of inactive to active compounds than what is found in most benchmark data sets. We have also evaluated the screening performance using docking and 3D shape similarity with default settings. To characterize the data sets, we used physicochemical similarity and 2D fingerprint searches. We envision that these data sets can be a useful complement to current data sets used for method evaluation.