OPEN 3 ACCESS Freely available online pips one Systematic Validation of Protein Force Fields against Experimental Data Kresten Lindorff-Larsen19, Paul Maragakis19, Stefano Piana19, Michael P. Eastwood1, Ron O. Dror1, David E. Shaw1'2* 1 D. E. Shaw Research, New York, New York, United States of America, 2 Center for Computational Biology and Bioinformatics, Columbia University, New York, New York, United States of America Abstract Molecular dynamics simulations provide a vehicle for capturing the structures, motions, and interactions of biological macromolecules in full atomic detail. The accuracy of such simulations, however, is critically dependent on the force field— the mathematical model used to approximate the atomic-level forces acting on the simulated molecular system. Here we present a systematic and extensive evaluation of eight different protein force fields based on comparisons of experimental data with molecular dynamics simulations that reach a previously inaccessible timescale. First, through extensive comparisons with experimental NMR data, we examined the force fields' abilities to describe the structure and fluctuations of folded proteins. Second, we quantified potential biases towards different secondary structure types by comparing experimental and simulation data for small peptides that preferentially populate either helical or sheet-like structures. Third, we tested the force fields' abilities to fold two small proteins—one oc-helical, the other with f3-sheet structure. The results suggest that force fields have improved over time, and that the most recent versions, while not perfect, provide an accurate description of many structural and dynamical properties of proteins. Citation: Lindorff-Larsen K, Maragakis P, Piana S, Eastwood MP, Dror RO, et al. (2012) Systematic Validation of Protein Force Fields against Experimental Data. PLoS ONE 7(2): e32131. doi:10.1371/journal.pone.0032131 Editor: Daniel J. Muller, Swiss Federal Institute of Technology Zurich, Switzerland Received November 1, 2011; Accepted January 24, 2012; Published February 22, 2012 Copyright: © 2012 Lindorff-Larsen et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Funding: These authors have no support or funding to report. Competing Interests: The authors have read the journal's policy and have the following conflicts: All the authors are affiliated with D. E. Shaw Research, the funder of this study. This research was conducted within D. E. Shaw Research, of which D.E.S. is the sole beneficial owner and Chief Scientist. There are no patents, products in development or marketed products to declare. This does not alter the authors' adherence to all the PLoS ONE policies on sharing data and materials, as detailed online in the guide for authors. * E-mail: David.Shaw@DEShawResearch.com (5 These authors contributed equally to this work. Introduction Historically, two principal factors have limited the utility of molecular dynamics (MD) simulations as a research tool in biology and biophysics [1]. First, lengthy and computationally intensive simulations may be required to sufficiently sample the conformational space of the molecules under study. Thanks to recent developments in computing hardware [2—4] and in methods to distribute [5] and parallelize [6] simulations or enhance sampling efficiency [7], it is now possible to simulate directly protein dynamics on the millisecond timescale [8] or to reconstruct long-timescale behavior from shorter simulations [9]. Second, in order for MD simulations to provide a realistic description of the molecules under study, the molecular mechanics force field used in such simulations must be sufficiently accurate to provide biologically useful results. A large number of force fields are available for studying proteins by MD simulation. While the mathematical functional forms of many of these force fields are quite similar, they differ in the parameters that describe the various energetic components and in the methods employed to obtain these parameters. Current protein force fields were for the most part derived by fitting parameters to data from quantum-level calculations or experiments on small molecules thought to mimic the properties of proteins. Although most such parameters have not been changed for some time, a number of force fields have recently been refined in order to improve their accuracy for proteins and peptides. These developments have led to a plethora of new force fields that often differ only in the parameters associated with a few (important) torsion angles. With some notable exceptions [10,11], previous comparisons of different force fields' abilities to reproduce the structure and dynamics of peptides and proteins have mostly involved only a few versions of related force fields. In most cases such studies have utilized only one or a few related test systems, leaving unresolved questions about how different force fields compare more generally in their ability to provide an accurate description of protein conformational ensembles. Here we describe the results of an extensive test of eight protein force fields, using simulations of a number of diverse protein and peptide systems and subsequent comparison of the resulting conformational ensembles with experimental data. When evaluating a force field, it is important to sample the test systems as extensively as possible in order to ensure that the level of agreement with experiments is a reliable measure of the accuracy of the force field. The choice of test systems should thus be based in part on the extent to which such systems could be sampled using available computational resources. We have recently described the construction and initial applications of a PLoS ONE I www.plosone.org 1 February 2012 | Volume 7 | Issue 2 | e32131 Systematic Validation of Protein Force Fields specialized computer for MD simulations called Anton [2,8]. Anton is capable of performing simulations that are two orders of magnitude longer than the prior state of the art, enabling much more comprehensive testing of force fields than was previously feasible. We have used Anton to perform a broad range of computationally demanding tests using protein and peptide systems. For each of the eight different force fields that we examined, we ran a total of 100 u,s of simulation distributed across six different molecular systems: (i) two folded proteins, (ii) two peptides that preferentially populate a helical or strand-like structure, respectively, and (iii) an oc-helical and a |3-sheet protein, simulated at a temperature where they would be expected to fold and unfold. Our results suggest that force fields are improving over time and that, for the tests described here, simulations in two of the force fields result in particularly good overall agreement with experimental data. Our results also highlight certain remaining deficiencies in all force fields studied here and point towards areas for future improvements. Results In the last few years, a substantial number of studies have revised existing force fields by modifying the torsion potentials associated with a few important dihedral angles. Simmerling and colleagues [12] modified the backbone potential in the original Amber ff99 force field by fitting to additional quantum-level data and thus derived the improved Amber ff99SB force field. Best and colleagues followed up on this work by modifying the backbone potential in ff99SB and ff03 to obtain a better energetic balance between helix and coil conformations, thus producing the ff99SB* and ff03* force fields [13]. We modified the side-chain torsion potential for four amino acid types in ff99SB to produce the ff99SB-ILDN force field [14], and more recently we changed parameters associated with both the backbone and certain side chains in a CHARMM force field to produce CHARMM22* [15]. We also demonstrated that the "ILDN" side chain modifications can be combined with the ff99SB* potential to produce the ff99SB*-ILDN force field [15]. We decided to evaluate a number of the modified force fields described above, as well as the force fields from which they were originally derived. We also included the widely used OPLS-AA force field, such that our comparison set was comprised of the following eight protein force fields: Amber ff99SB-ILDN [12,14], Amber ff99SB*-ILDN [12-14] Amber fiU3 [16], Amber ff03* [13,16], OPLS-AA [17], CHARMM22 [18], CHARMM22 with the CMAP correction ([18,19]; herein termed CHARMM27), and CHARMM22* [15,18,19]. Comparison of simulations with NMR data for folded proteins MD simulations are often used to study the structural dynamics of folded proteins, and we thus first examined the ability of the eight force fields to reproduce experimental data describing the folded-state structure and dynamics of two well-characterized proteins, ubiquitin and GB3. Both proteins are relatively small (76 and 56 residues, respectively) and have been characterized extensively by solution-state NMR spectroscopy, thus providing experimental data for evaluating the ability of a force field to describe the folded state of a protein correctly [11]. Further, these NMR experiments have shown that the two proteins are very stable and display only relatively little (albeit possibly biologically important) motion on timescales beyond microseconds [20,21], suggesting that it should be possible to sample the native state ensemble sufficiently well using MD simulations on Anton. We thus performed 10-u.s simulations for both ubiquitin and GB3 in each of the eight force fields considered here. In all but one case we found the native state to be stable and the protein to remain close to the experimental structure throughout the 10-u,s MD simulation. (In the case of GB3 simulated with CHARMM22, we found that the native state was not stable and that the protein unfolded during the simulation.) We focused our comparison on the polypeptide backbone because this is the most fundamental part of the protein structure, and because most problems in the description of side chains will eventually reveal themselves at the level of the backbone as the protein distorts in an attempt to accommodate inaccurate rotamer distributions of the side chains. In Figure 1, we show the agreement between the ensembles obtained from simulations and NMR measurements of backbone scalar and residual dipolar couplings as well as NMR order parameters. Overall, four force fields (ff99SB-ILDN, ff99SB*-ILDN, CHARMM27 and CHARMM22*) provide a reasonably accurate description of the native state of ubiquitin and GB3, close to that of ensembles that were reconstructed to fit the experimental data [22]. For the four of the eight force fields that had been studied previously using similar tests [11], we find good agreement between our results and these earlier studies. Temperature-dependent structural propensities in short peptides The simulations of ubiquitin and GB3 provide a detailed test of a force field's ability to describe a well-defined folded state and the fluctuations within that state. In those simulations, only a few substantial conformational excursions are observed. These tests might thus miss differences in force fields that arise, for example, from variations in the relative energies between the different basins on the Ramachandran map. Indeed, although our tests of ubiquitin and GB3 suggested that CHARMM27 and ff99SB-ILDN perform equally well, it has been shown that CHARMM27 severely overstabilizes the formation of helical structures [10,23] and that ff99SB-ILDN underestimates the stability of helices [13]. We thus performed simulations of two small peptide systems with the aim of evaluating how well the eight force fields provide a balance between propensity to form helical, sheet-like, and coil structures. The first test involves a 15-residue peptide consisting of three repeats of the amino acid sequence AAQAA [24]. NMR and circular dichroism measurements suggest that this peptide is ~45% helical at a temperature of 275 K, and that the helicity has a relatively steep temperature dependency resulting in less than 10% helicity at 320 K. Using 10 u,s of simulated tempering MD simulations, we calculated the temperature-dependent fraction of helical structure of the AAQAA peptide in each of the eight force fields (Fig. 2a). The results confirm that the force fields display a broad range of propensities towards forming helical structure, with CHARMM27 and Amber ff03 overstabilizing helices and ff99SB-ILDN understabilizing them. The three "helix coil—balanced" force fields (ff99SB*-ILDN, fiU3* and CHARMM22*) all provide a better description of this peptide system. This result is not surprising, however, given that the comparison with the helicity of the AAQAA peptide was part of the optimization procedure used to refine these force fields. As a second test, we performed a comparable set of calculations for the 10-residue peptide CLN025 [25]. CLN025 preferentially attains a hairpin-like structure in solution at temperatures less than ~340 K, and only at higher temperatures is the unfolded "coil" structure the free-energy minimum. In Figure 2b, we show the temperature-dependent stability of CLN025 in the eight force fields and the comparison to the experimentally derived melting PLoS ONE I www.plosone.org 2 February 2012 | Volume 7 | Issue 2 | e32131 Systematic Validation of Protein Force Fields _ 1.0- N Z 0.8- 0.6- 0.12- Q .c 0.6- c o 0.5- 1 2 0.4- u_ 0.3- 0.2- 0.1- 0 - — A99SB-ILDN — A99SB*-ILDN AOS — A03* OPLS-AA - C22 C27 — C22* Experiment 280 310 320 330 340 350 Temperature (K) 370 1 0.9 0.8 0.7 0.6 0.5 0.4 0.3 0.2 0.1 0 h-H T T I I i i i I —i—i—i—i—i—i—i—i— 280 290 300 310 320 330 340 350 360 370 Table 1. Evaluating force fields by folding simulations. Force field Villin WW Amber ff99SB-ILDN / (1/1) / (1/0) Amber ff99SB*-ILDN / (2/2) / (1/0) Amber ff03 / (1/0) * Amber ff03* / (1/1) / (1/1) OPLS-AA / / (1/0) CHARMM22 CHARMM27 / (1/0) * CHARMM22* / (4/4) y n/D Temperature (K) The table shows whether we observed any folding events of villin and the WW domain in our simulations. A check mark indicates that simulations started in the unfolded state were able to reach the folded state in 10 p,s (villin at 360 K) or 50 p,s (WW domain at 370 K), while an "X" means that we did not observe any folding events. In those cases where we did observe at least one folding event, the numbers in parentheses indicate the number of folding/unfolding events we observed in that simulation. For ff99SB-ILDN, for example, we observed first a folding event and subsequently an unfolding event for villin, but only a folding event with no subsequent unfolding event for the WW domain. Since the simulations are roughly 10 times longer than the experimental folding and unfolding times, one would expect roughly five folding and five unfolding events in a force field that models perfectly both the kinetics and thermodynamics of folding. doi:10.1371/journal.pone.0032131.t001 suggests that the smaller (and easier to sample) peptide systems indeed contain useful information that can be used to optimize force fields for application to conformational changes in proteins. As sampling efficiency and force fields continue to improve in the future, we expect that more detailed and quantitative studies of the thermodynamics and kinetics of folding [31] might provide even more stringent tests of force fields. Figure 2. Comparison between calculated and experimental secondary structure propensities. In (a), we show the helical fraction of the (AAQAA)3 15-mer peptide in simulations and experiment as a function of temperature. In (b), we show the fraction folded of the CLN025 10-residue peptide in simulations and experiments as a function of temperature, dohl 0.1371/journal.pone.0032131 ,g002 ff99SB-ILDN (in agreement with earlier findings [8]). The two very helical force fields (ff03 and CHARMM27) were able to fold villin correctly, but were not able to fold the P-sheet—containing WW domain. For both of these force fields the villin domain folded relatively quickly (0.2 u.s and 0.8 u,s for ff03 and CHARMM27, respectively), after which the protein stayed folded for the remainder of the simulation, suggesting that the native state is too stable, as also observed previously [15]. For all four force fields that were able to fold both proteins, we also observed reversible folding and unfolding of villin; only for CHARMM22* did we observe reversible folding of both proteins. Even minor force field deficiencies can result in substantial changes in calculated folding rates and melting temperature— even in the case where the folded state is a free-energy minimum. Because the simulations were run for only 10 times the experimental folding time and only at a single temperature, one should avoid overinterpreting the results in Table 1. Nevertheless, it is worth noting that the three force fields that were parameterized to obtain a reasonable balance between helical and coil structures were all able to fold both an oc-helical and a 13-sheet protein. The agreement between these two different tests Discussion We have presented a systematic comparison of a number of force fields for all-atom simulations in explicit solvent. Although several of the test systems have previously been used individually to evaluate force fields, the broad nature of the tests applied here—as well as the increased length of the simulations—allows us to draw broader conclusions about the ability of the various force fields to reproduce a range of experimentally measured properties correctly. For example, while Amber ff99SB-ILDN and CHARMM27 appear to describe folded proteins equally well (Fig. 1), our tests on flexible peptides (Fig. 2) revealed large differences between these two force fields. We thus stress the need for validating force fields using as broad a set of systems as possible. In an attempt to evaluate and compare the different force fields across all three sets of tests, we assigned a "force field score" reflecting the degree of agreement between the experiments and simulations. While one might in principle define a score directly from a quantitative comparison between the calculated and experimental results, such a score would depend on a number of somewhat arbitrary parameters and functional forms used to aggregate across the different results. Instead, we decided to assign a very simple score manually (using integer values ranging from 0 to 6, with low values indicating good agreement with experiments; see Methods for details), thus explicitly acknowledging that the score relies in part on subjective choices and that others might assign different scores based on the same set of results. The assigned scores indicate that two of the eight force fields, ff99SB*- PLoS ONE I www.plosone.org 4 February 2012 | Volume 7 | Issue 2 | e32131 Systematic Validation of Protein Force Fields ILDN and CHARMM22*, perform consistently well in reproducing the experimental data in the set of tests presented here (Fig. 3). As these two force fields are also among the most recent ones, we examined whether force fields have generally improved over time. The results show a clear correlation between the year of publication of a force field and the assigned force field score, suggesting that force fields are indeed improving over time (Fig. 3). It should be noted that other factors will often be relevant to the choice of a force field for specific types of MD simulations. Such factors may include the availability of force field parameters for molecules other than proteins (e.g., lipids, nucleic acids, carbohydrates, co-factors, substrates or drug molecules). In particular, it should be noted that our tests do not include any membrane proteins, and that the force field best used to describe such proteins might in principle depend on the lipid model employed. Our results also highlight areas for future improvements of the force fields we tested. These include the ability to model the temperature dependency of the conformational propensities in both the AAQAA and CLN025 peptides, and to more accurately match the kinetics and thermodynamics of the folding of villin and the WW domain. We are hopeful that the tests described here will prove useful in further refining contemporary force fields, thus enhancing the value of MD simulation as a tool for elucidating the molecular details of important biological processes. Methods Common methods. All production molecular dynamics simulations were performed on Anton [2]. Simulations were performed in the TIP3P water model ([32]; for Amber and OPLS-AA force fields) or the CHARMM modified TIP3P water model ([18,32]; for CHARMM force fields). Simulations and analysis of the native state of ubiquitin and GB3. Production simulations of ubiquitin and GB3 were performed in the NVT ensemble. We used a 9.5-A cutoff for the Lennard-Jones and short-range electrostatic interactions; long-range electrostatic interactions were treated with the Gaussian split Ewald method [33]. The starting structures for the simulations 5- 84 10 9 -i d> u o2-\ 1- CHARMM22 OPLS-AA ff03 CHARMM27 ff03* ff99SB-ILDN CHARMM22' ff99SB*-ILDN^ Ý 1998 2000 2002 2004 2006 2008 2010 2012 Year of publication Figure 3. Improvement of force fields over time. For each force field, we assigned a score depending on the agreement with experiments in the tests presented here. Low scores indicate good agreement with experiments. These scores are plotted against the year in which the force field was published. For the force fields that involve multiple corrections (e.g., ff99SB*-ILDN), we use the year of the most recently published correction, dohl 0.1371/journal.pone.0032131 ,g003 were the high-resolution NMR structures of ubiquitin ([34]; PDB entry 1D3Z) and GB3 ([35]; PDB entry 1P7E). The structures were solvated in a cubic box with side lengths 58 A, and were first minimized, heated to 300 K during 0.4 ns, and finally equilibrated in the NPT ensemble for 0.8 ns. The frame with the volume closest to the average during this NPT simulation was used as starting point for the production simulations in the NVT ensemble, thus ensuring that the average pressure in the simulations is close to the reference standard pressure. For both ubiquitin and GB3 we also performed simulations in the NPT ensemble (using ff99SB*-ILDN) and found that the calculated NMR observables are within error the same as those in the corresponding simulations in the NVT ensemble. We calculated backbone scalar couplings using published Karplus relationships for HNHA, HNCO and HNCB [36], and HACO [37] couplings and compared to experimental data measured for ubiquitin ([38]; HNHA, HNCO, HNCB and HACO) and GB3 ([36]; HNHA, HNCO and HNCB). We calculated backbone residual dipolar couplings and the associated Q_ scores as previously described [39] and compared to experimental values in ubiquitin [34] and GB3 [35]. Order parameters were calculated from the values of the internal autocorrelation functions at lag times close to the experimentally determined rotational correlation times. Simulated tempering simulations and analysis of AAQAA and CLN025 peptides. The temperature-dependent conformational properties of the (AAQAA)3 [24] and CLN025 [25] peptides were obtained using simulated tempering simulations [40] in the NPT ensemble. In contrast to the simulations of folded proteins or of protein folding, we found it necessary to perform these simulations in the NPT ensemble to avoid changing the average pressure as the temperature varied. We used a 9.5-A cutoff for the Lennard-Jones and short-range electrostatic interactions; long-range electrostatic interactions were treated with the Gaussian split Ewald method [33]. The helical fraction of the AAQAA-peptide was calculated as the fraction of helical residues [13,15] at each temperature in the simulated tempering simulations and compared to the experimental values [24]. The fraction of the CLN025 that was folded was determined by applying a dual-cutoff approach [15,41] to separate the simulations into folded and unfolded states. In this analysis, a folding event was recorded if the Coc-RMSD to the experimental NMR structure dropped below 1.0 A and an unfolding event was recorded once the same RMSD went above 4.0 A. Folding simulations of villin and WW domain. Simulations of fast-folding variants of villin [29] and the WW domain [30] were performed in the NVT ensemble using a Nose-Hoover thermostat and a force-shifted cutoff [42] of 10.0 A (villin) or 10.5 A (WW domain) for the Lennard-Jones and electrostatic interactions. The starting structures for the simulations were heat-unfolded states of the two proteins in a cubic box of water with side length 52 A. The simulations were performed near the experimental melting temperatures (at 360 K for villin and 370 K for the WW domain). For the WW domain, we recorded a folding event when the Coc-RMSDs (to PDB entry 2F21) calculated over four stretches of amino acids all were below the cutoff value: 2-33 (2.0 A), 8-22 (1.1 A), 12-18 (0.6 A), 19—30 (0.9 A). An unfolding event was recorded when the same set of RMSDs went above 7.0 A, 5.8 A, 1.8 A and 3.8 A, respectively. For villin, we recorded a folding event when the Coc-RMSDs (to PDB entry 2F4K) calculated over three stretches of amino acids were all below the cutoff value: 3—31 (1.2 A), 3—18 (0.9 A), 14—31 (0.9 A). An unfolding event was recorded when the same set of RMSDs simultaneously went above 5.0 A, 4.6 A, and 2.5 A, respectively. PLoS ONE I www.plosone.org February 2012 | Volume 7 | Issue 2 | e32131 Systematic Validation of Protein Force Fields Assigning a force field score. For each of the three sets of tests we manually assigned to each force field a number in the range 0—2, with 0 referring to a reasonable agreement, 1 to some agreement and 2 to severe discrepancies with respect to the experimental data. The assigned scores for each of these tests (folded proteins/peptides/folding) were 0/1/0 (B99SB-ILDN), 0/ 0/0 (fI99SB*-ILDN), 1/2/1 (ff03), 1/1/0 (ff03*), 2/1/1 (OPLS-AA), 2/1/2 (CHARMM22), 0/2/1 (CHARMM27) and 0/0/0 (CHARMM22*). Each force field was then assigned an overall score (between 0 and 6) that was the sum of the values for each of the three tests. When evaluating the results of the simulations of the AAQAA and CLN025 peptides, we focused mostly on the temperature range around 280—320 K, where most biomolecular simulations are performed. Since simulations of the AAQAA peptide were used in the re-parameterization of the three helix coil—balanced force fields, one could argue that these results should not be included in the evaluation. The nature of the results References 1. Klepeis JL, Lindorff-Larson K, Dror RO, Shaw DE (2009) Long-timescale molecular dynamics simulations of protein structure and function. Curr Opin Struct Biol 19: 120-127. 2. Shaw DE, Dror RO, Salmon JK, Grossman JP, Mackenzie KM, et al. (2009) Millisecond-scale molecular dynamics simulations on Anton. Proceedings of the Conference on High Performance Computing, Networking, Storage and Analysis (SC09). New York: ACM. 3. Stone JE, Hardy DJ, Ufimtsev IS, Schulten K (2010) GPU-accelerated molecular modeling coming of age. J Mol Graph Model 29: 116-125. 4. Vendruscolo M, Dobson CM (2011) Protein dynamics: Moore's law in molecular biology. Curr Biol 21: R68-R70. 5. Voter AF (1998) Parallel replica method for dynamics of infrequent events. Phys Rev B 57: R13985-R13988. 6. Bowers KJ, Dror RO, Shaw DE (2007) Zonal methods for the parallel execution of range-limited N-body simulations. J Comput Phys 221: 303-329. 7. Lei H, Duan Y (2007) Improved sampling methods for molecular simulation. Curr Opin Struct Biol 17: 187-191. 8. Shaw DE, Maragakis P, Lindroff-Larsen K, Piana S, Dror RO, et al. (2010) Atomic-level characterization of the structural dynamics of proteins. Science 330: 341-346. 9. Prinz JH, Wu H, Sarich M, Keller B, Senne M, et al. (2011) Markov models of molecular kinetics: generation and validation. J Chem Phys 134: 174105. 10. Best RB, Buchete NV, Hummer G (2008) Are current molecular dynamics force fields too helical? Biophys J 95: L07-09. 11. Lange OF, van der Spoel D, de Groot BL (2010) Scrutinizing molecular mechanics force fields on the submicrosecond timescale with NMR data. Biophys J 99: 647-655. 12. Hornak V, Abel R, Okur A, Strockbine B, Roitberg A, et al. (2006) Comparison of multiple Amber force fields and development of improved protein backbone parameters. Proteins 65: 712-725. 13. Best RB, Hummer G (2009) Optimized molecular dynamics force fields applied to the helix-coil transition of polypeptides. J Phys Chem B 113: 9004-9015. 14. Lindorff-Larsen K, Piana S, Palmo K, Maragakis P, Klepeis JL, et al. (2010) Improved side-chain torsion potentials for the Amber ff99SB protein force field. Proteins 78: 1950-1958. 15. Piana S, Lindorff-Larsen K, Shaw DE (2011) How robust are protein folding simulations with respect to force field parameterization? Biophys J 100: L47-L49. 16. Duan Y, Wu C, Chowdhury S, Lee MC, Xiong G, et al. (2003) A point-charge force field for molecular mechanics simulations of proteins based on condensed-phase quantum mechanical calculations. J Comput Chem 24: 1999-2012. 17. Kaminski GA, Friesner RA, Tirado-Rives J, Jorgensen WL (2001) Evaluation and parametrization of the OPLS-AA force field for proteins via comparison with accurate quantum chemical calculations on peptides. J Phys Chem B 105: 6474-6487. 18. MacKerell AD, Jr., Bashord D, Bellott M, Dunbrack RL, Jr., EvanseckJD, et al. (1998) All-atom empirical potential for molecular modeling and dynamics studies of proteins. J Phys Chem B 102: 3586-3616. 19. MacKerell AD, Jr., Feig M, Brooks CL (2004) Extending the treatment of backbone energetics in protein force fields: limitations of gas-phase quantum mechanics in reproducing protein conformational distributions in molecular dynamics simulations. J Comput Chem 25: 1400-1415. 20. Markwick PR, Bouvignies G, Blackledge M (2007) Exploring multiple timescale motions in protein GB3 using accelerated molecular dynamics and NMR spectroscopy. J Am Chem Soc 129: 4734-4730. presented in Figure 3, however, would not change even if the AAQAA tests were excluded. Finally, we stress that the assigned scores rely in part on subjective choices and that different sets of scores could be derived from the data presented in Figures 1 and 2 and Table 1. Acknowledgments We thank Morten Jensen and John Klepeis for valuable discussions, and Mollie Kirk and Rebecca Kastleman for editorial assistance. Author Contributions Conceived and designed the experiments: KL-L PM SP MPE ROD DES. Performed the experiments: KL-L PM SP. Analyzed the data: KL-L PM SP. Contributed reagents/materials/analysis tools: KL-L PM SP. Wrote the paper: KL-L PM SP ROD DES. 21. Fenwick RB, Esteban-Martin S, Richter B, Lee D, Walter KFA, et al. (2011) Weak long-range correlated motions in a surface patch of ubiquitin involved in molecular recognition. J Am Chem Soc 133: 10336-103369. 22. Lange OF, Lakomek N-A, Fares C, Schröder GF, Walter KFA, et al. (2008) Recognition dynamics up to microseconds revealed from an RDC-derived ubiquitin ensemble in solution. Science 320: 1471-1475. 23. Freddolino PL, Park S, Roux B, Schulten K (2009) Force field bias in protein folding simulations. Biophys J 96: 3772-3780. 24. Shalongo W, Dugad L, Stellwagen E (1994) Distribution of helicity within the model peptide acetyl(AAQAA)3amide. J Am Chem Soc 1 16: 8288-8293. 25. Honda S, Akiba T, Kalo YS, Sawada Y, Sekijima M, et al. (2008) Crystal structure of a ten-amino acid protein. J Am Chem Soc 130: 15327-15331. 26. Freddolin PL, Harrison CB, Liu Y, Schulten K (2010) Challenges in protein folding simulations: timescale, representation, and analysis. Nat Phys 6: 751-758. 27. Faver JC, Benson ML, He X, Roberts BP, Wang B, et al. (2011) The energy computation paradox and ab initio protein folding. PLoS One 6: el8868. 28. Best RB, Mittal J (2010) Balance between alpha and beta structures in ab initio protein folding. J Phys Chem B 114: 8790-8798. 29. Kubelka J, Chiu TK, Davies DR, Eaton WA, Hofrichter J (2006) Sub-microsecond protein folding. J Mol Biol 359: 546-553. 30. Piana S, Sarkar K, Lindorff-Larsen K, Guo M, Gruebele M, et al. (2011) Computational design and experimental testing of the fastest-folding ß-sheet protein. J Mol Biol 405: 43-48. 31. Lindorff-Larsen K, Piana S, Dror RO, Shaw DE (2011) How fast-folding proteins fold. Science 334: 517-520. 32. Jorgensen WL, Chandrasekhar J, Madura JD, Impey RW, Klein ML (1983) Comparison of simple potential functions for simulating liquid water. J Chem Phys 79: 926-935. 33. Shan Y, Klepeis JL, Eastwood MP, Dror RO, Shaw DE (2005) Gaussian split Ewald: a fast Ewald mesh method for molecular simulation. J Chem Phys 122: 54101. 34. Conilescu G, Marquardt JL, Ottiger M, Bax A (1998) Validation of protein structure from anisotropic carbonyl chemical shifts in a dilute liquid crystalline phase. J Am Chem Soc 120: 6836-6837. 35. Ulmer TS, Ramirez BE, Delaglio F, Bax A (2003) Evaluation of backbone proton positions and dynamics in a small protein by liquid crystal NMR spectroscopy. J Am Chem Soc 125: 9179-9191. 36. Vögeli B, Ying J, Grishaev A, Bax A (2007) Limits on variations in protein backbone dynamics from precise measurements of scalar couplings. J Am Chem Soc 129: 9377-9985. 37. Lindorff-Larsen K, Best RB, Vendruscolo M (2005) Interpreting dynamically-averaged scalar couplings in proteins. J Biomol NMR 32: 273-280. 38. Wang AC, Bax A (1996) Determination of the backbone dihedral angles q> in human ubiquitin from reparametrized empirical Karplus equations. J Am Chem Soc 118: 2483-2494. 39. Lindorff-Larsen K, Best RB, Depristo MA, Dobson CM, Vendruscolo M (2005) Simultaneous determination of protein structure and dynamics. Nature 433: 128-132. 40. Marinari E, Parisi G (1992) Simulated tempering: a new Monte Carlo scheme. Europhys Lett 19: 451-458. 41. Northrup SH, Hynes JT (1980) The stable states picture of chemical reactions. I. Formulation for rate constants and initial conditional effects. J Chem Phys 73: 2700-2714. 42. Fennell CJ, Gezelter D (2006) Is the Ewald summation still necessary? Pairwise alternatives to the accepted standard for long-range electrostatics. J Chem Phys 124: 234104. PLoS ONE I www.plosone.org 6 February 2012 | Volume 7 | Issue 2 | e32131