The widespread popularity of density functional theory has given rise to an extensive range of dedicated codes for predicting molecular and crystalline properties. However, each code implements the formalism in a different way, raising questions about the reproducibility of such predictions. We report the results of a community-wide effort that compared 15 solid-state codes, using 40 different potentials or basis set types, to assess the quality of the Perdew-Burke-Ernzerhof equations of state for 71 elemental crystals. We conclude that predictions from recent codes and pseudopotentials agree very well, with pairwise differences that are comparable to those between different high-precision experiments. Older methods, however, have less precise agreement. Our benchmark provides a framework for users and developers to document the precision of new applications and methodological improvements.
Kohn W., Sham L. J., Self-Consistent Equations Including Exchange and Correlation Effects, 10.1103/physrev.140.a1133
Jones R. O., Density functional theory: Its origins, rise to prominence, and future, 10.1103/revmodphys.87.897
Curtarolo Stefano, Setyawan Wahyu, Hart Gus L.W., Jahnatek Michal, Chepulskii Roman V., Taylor Richard H., Wang Shidong, Xue Junkai, Yang Kesong, Levy Ohad, Mehl Michael J., Stokes Harold T., Demchenko Denis O., Morgan Dane, AFLOW: An automatic framework for high-throughput materials discovery, 10.1016/j.commatsci.2012.02.005
Jain Anubhav, Ong Shyue Ping, Hautier Geoffroy, Chen Wei, Richards William Davidson, Dacek Stephen, Cholia Shreyas, Gunter Dan, Skinner David, Ceder Gerbrand, Persson Kristin A., Commentary: The Materials Project: A materials genome approach to accelerating materials innovation, 10.1063/1.4812323
Nature materials, 4, 68 (2005)
Friák M., Hickel T., Grabowski B., Lymperakis L., Udyansky A., Dick A., Ma D., Roters F., Zhu L. -F., Schlieter A., Kühn U., Ebrahimi Z., Lebensohn R. A., Holec D., Eckert J., Emmerich H., Raabe D., Neugebauer J., Methodological challenges in combining quantum-mechanical and continuum approaches for materials science applications, 10.1140/epjp/i2011-11101-2
Staroverov Viktor N., Scuseria Gustavo E., Tao Jianmin, Perdew John P., Tests of a ladder of density functionals for bulk solids and surfaces, 10.1103/physrevb.69.075102
Haas Philipp, Tran Fabien, Blaha Peter, Calculation of the lattice constant of solids with semilocal functionals, 10.1103/physrevb.79.085104
Csonka Gábor I., Perdew John P., Ruzsinszky Adrienn, Philipsen Pier H. T., Lebègue Sébastien, Paier Joachim, Vydrov Oleg A., Ángyán János G., Assessing the performance of recent density functionals for bulk solids, 10.1103/physrevb.79.155107
Pernot Pascal, Civalleri Bartolomeo, Presti Davide, Savin Andreas, Prediction Uncertainty of Density Functional Approximations for Properties of Crystals with Cubic Symmetry, 10.1021/jp509980w
Curtiss Larry A., Raghavachari Krishnan, Redfern Paul C., Pople John A., Assessment of Gaussian-2 and density functional theories for the computation of enthalpies of formation, 10.1063/1.473182
Paier Joachim, Hirschl Robin, Marsman Martijn, Kresse Georg, The Perdew–Burke–Ernzerhof exchange-correlation functional applied to the G2-1 test set using a plane-wave basis set, 10.1063/1.1926272
Zhao Yan, Truhlar Donald G., Density Functionals with Broad Applicability in Chemistry, 10.1021/ar700111a
Goerigk Lars, Grimme Stefan, A thorough benchmark of density functional methods for general main group thermochemistry, kinetics, and noncovalent interactions, 10.1039/c0cp02984j
Kiejna Adam, Kresse Georg, Rogal Jutta, De Sarkar Abir, Reuter Karsten, Scheffler Matthias, Comparison of the full-potential and frozen-core approximation approaches to density-functional calculations of surfaces, 10.1103/physrevb.73.035404
Grabowski Blazej, Hickel Tilmann, Neugebauer Jörg, Ab initiostudy of the thermodynamic properties of nonmagnetic elementary fcc metals: Exchange-correlation-related error bars and chemical trends, 10.1103/physrevb.76.024309
Lejaeghere K., Van Speybroeck V., Van Oost G., Cottenier S., Error Estimates for Solid-State Density-Functional Theory Predictions: An Overview by Means of the Ground-State Elemental Crystals, 10.1080/10408436.2013.772503
Jollet François, Torrent Marc, Holzwarth Natalie, Generation of Projector Augmented-Wave atomic data: A 71 element validated table in the XML format, 10.1016/j.cpc.2013.12.023
Poncé S., Antonius G., Boulanger P., Cannuccia E., Marini A., Côté M., Gonze X., Verification of first-principles codes: Comparison of total energies, phonon frequencies, electron–phonon coupling and zero-point motion correction to the gap between ABINIT and QE/Yambo, 10.1016/j.commatsci.2013.11.031
Madsen Georg K. H., Blaha Peter, Schwarz Karlheinz, Sjöstedt Elisabeth, Nordström Lars, Efficient linearization of the augmented plane-wave method, 10.1103/physrevb.64.195134
Blum Volker, Gehrke Ralf, Hanke Felix, Havu Paula, Havu Ville, Ren Xinguo, Reuter Karsten, Scheffler Matthias, Ab initio molecular simulations with numeric atom-centered orbitals, 10.1016/j.cpc.2009.06.022
Perdew John P., Burke Kieron, Ernzerhof Matthias, Generalized Gradient Approximation Made Simple, 10.1103/physrevlett.77.3865
Yuan Gary, Gygi François, ESTEST: a framework for the validation and verification of electronic structure codes, 10.1088/1749-4699/3/1/015004
4, 56 (2002)
Pizzi Giovanni, Cepellotti Andrea, Sabatini Riccardo, Marzari Nicola, Kozinsky Boris, AiiDA: automated interactive infrastructure and database for computational science, 10.1016/j.commatsci.2015.09.013
Holzapfel W. B., Hartwig M., Sievers W., Equations of State for Cu, Ag, and Au for Wide Ranges in Temperature and Pressure up to 500 GPa and Above, 10.1063/1.1370170
Grosshans W. A., Holzapfel W. B., Atomic volumes of rare-earth metals under pressures to 40 GPa and above, 10.1103/physrevb.45.5171
Dyall Kenneth G., van Lenthe Erik, Relativistic regular approximations revisited: An infinite-order relativistic approximation, 10.1063/1.479395
Koelling D D, Harmon B N, A technique for relativistic spin-polarised calculations, 10.1088/0022-3719/10/16/019
van Lenthe E., Baerends E. J., Snijders J. G., Relativistic total energy using regular approximations, 10.1063/1.467943
Lee In-Ho, Martin Richard M., Applications of the generalized-gradient approximation to atoms, clusters, and solids, 10.1103/physrevb.56.7197
Miyake Takashi, Ogitsu Tadashi, Tsuneyuki Shinji, Quantum Distributions of Muonium and Hydrogen in Crystalline Silicon, 10.1103/physrevlett.81.1873
Windl W., Bunea M. M., Stumpf R., Dunham S. T., Masquelier M. P., First-Principles Study of Boron Diffusion in Silicon, 10.1103/physrevlett.83.4345
Vitos L., Johansson B., Kollár J., Skriver H. L., Exchange energy in the local Airy gas approximation, 10.1103/physrevb.62.10046
Miotto R., Srivastava G. P., Ferraz A. C., Dissociative adsorption ofPH3on the Si(001) surface, 10.1103/physrevb.63.125321
Ramos L. E., Teles L. K., Scolfaro L. M. R., Castineira J. L. P., Rosa A. L., Leite J. R., Structural, electronic, and effective-mass properties of silicon and zinc-blende group-III nitride semiconductor compounds, 10.1103/physrevb.63.165210
Assali L. V. C., Machado W. V. M., Justo J. F., Titanium impurities in silicon, diamond, and silicon carbide, 10.1590/s0103-97332004000400016
Heyd Jochen, Peralta Juan E., Scuseria Gustavo E., Martin Richard L., Energy band gaps and lattice parameters evaluated with the Heyd-Scuseria-Ernzerhof screened hybrid functional, 10.1063/1.2085170
Paier J., Marsman M., Hummer K., Kresse G., Gerber I. C., Ángyán J. G., Screened hybrid density functionals applied to solids, 10.1063/1.2187006
Tran Fabien, Laskowski Robert, Blaha Peter, Schwarz Karlheinz, Performance on molecules, surfaces, and solids of the Wu-Cohen GGA exchange-correlation energy functional, 10.1103/physrevb.75.115131
Gulans Andris, Kontur Stefan, Meisenbichler Christian, Nabok Dmitrii, Pavone Pasquale, Rigamonti Santiago, Sagmeister Stephan, Werner Ute, Draxl Claudia, exciting: a full-potential all-electron package implementing density-functional theory and many-body perturbation theory, 10.1088/0953-8984/26/36/363202
Zhang Igor Ying, Ren Xinguo, Rinke Patrick, Blum Volker, Scheffler Matthias, Numeric atom-centered-orbital basis sets with valence-correlation consistency from H to Ar, 10.1088/1367-2630/15/12/123033
Lehmann G., Taut M., On the Numerical Calculation of the Density of States and Related Properties, 10.1002/pssb.2220540211
Froyen Sverre, Brillouin-zone integration by Fourier quadrature: Special points for superlattice and supercell calculations, 10.1103/physrevb.39.3168
Gonze X., Beuken J.-M., Caracas R., Detraux F., Fuchs M., Rignanese G.-M., Sindic L., Verstraete M., Zerah G., Jollet F., Torrent M., Roy A., Mikami M., Ghosez Ph., Raty J.-Y., Allan D.C., First-principles computation of material properties: the ABINIT software project, 10.1016/s0927-0256(02)00325-7
Gonze X., Amadon B., Anglade P.-M., Beuken J.-M., Bottin F., Boulanger P., Bruneval F., Caliste D., Caracas R., Côté M., Deutsch T., Genovese L., Ghosez Ph., Giantomassi M., Goedecker S., Hamann D.R., Hermet P., Jollet F., Jomard G., Leroux S., Mancini M., Mazevet S., Oliveira M.J.T., Onida G., Pouillon Y., Rangel T., Rignanese G.-M., Sangalli D., Shaltaf R., Torrent M., Verstraete M.J., Zerah G., Zwanziger J.W., ABINIT: First-principles approach to material and nanosystem properties, 10.1016/j.cpc.2009.07.007
Torrent Marc, Jollet François, Bottin François, Zérah Gilles, Gonze Xavier, Implementation of the projector augmented-wave method in the ABINIT code: Application to the study of iron under pressure, 10.1016/j.commatsci.2007.07.020
Garrity Kevin F., Bennett Joseph W., Rabe Karin M., Vanderbilt David, Pseudopotentials for high-throughput DFT calculations, 10.1016/j.commatsci.2013.08.053
Mortensen J. J., Hansen L. B., Jacobsen K. W., Real-space grid implementation of the projector augmented wave method, 10.1103/physrevb.71.035109
Enkovaara J, Rostgaard C, Mortensen J J, Chen J, Dułak M, Ferrighi L, Gavnholt J, Glinsvad C, Haikola V, Hansen H A, Kristoffersen H H, Kuisma M, Larsen A H, Lehtovaara L, Ljungberg M, Lopez-Acevedo O, Moses P G, Ojanen J, Olsen T, Petzold V, Romero N A, Stausholm-Møller J, Strange M, Tritsaris G A, Vanin M, Walter M, Hammer B, Häkkinen H, Madsen G K H, Nieminen R M, Nørskov J K, Puska M, Rantala T T, Schiøtz J, Thygesen K S, Jacobsen K W, Electronic structure calculations with GPAW: a real-space implementation of the projector augmented-wave method, 10.1088/0953-8984/22/25/253202
Giannozzi Paolo, Baroni Stefano, Bonini Nicola, Calandra Matteo, Car Roberto, Cavazzoni Carlo, Ceresoli Davide, Chiarotti Guido L, Cococcioni Matteo, Dabo Ismaila, Dal Corso Andrea, de Gironcoli Stefano, Fabris Stefano, Fratesi Guido, Gebauer Ralph, Gerstmann Uwe, Gougoussis Christos, Kokalj Anton, Lazzeri Michele, Martin-Samos Layla, Marzari Nicola, Mauri Francesco, Mazzarello Riccardo, Paolini Stefano, Pasquarello Alfredo, Paulatto Lorenzo, Sbraccia Carlo, Scandolo Sandro, Sclauzero Gabriele, Seitsonen Ari P, Smogunov Alexander, Umari Paolo, Wentzcovitch Renata M, QUANTUM ESPRESSO: a modular and open-source software project for quantum simulations of materials, 10.1088/0953-8984/21/39/395502
Dal Corso Andrea, Projector augmented wave method with spin-orbit coupling: Applications to simple solids and zincblende-type semiconductors, 10.1103/physrevb.86.085135
Marzari Nicola, Vanderbilt David, De Vita Alessandro, Payne M. C., Thermal Contraction and Disordering of the Al(110) Surface, 10.1103/physrevlett.82.3296
Kresse G., Furthmüller J., Efficiency of ab-initio total energy calculations for metals and semiconductors using a plane-wave basis set, 10.1016/0927-0256(96)00008-0
Hafner Jürgen, Ab-initiosimulations of materials using VASP: Density-functional theory and beyond, 10.1002/jcc.21057
Blöchl Peter E., Jepsen O., Andersen O. K., Improved tetrahedron method for Brillouin-zone integrations, 10.1103/physrevb.49.16223
Schlipf Martin, Gygi François, Optimization algorithm for the generation of ONCV pseudopotentials, 10.1016/j.cpc.2015.05.011
Fuchs Martin, Scheffler Matthias, Ab initio pseudopotentials for electronic structure calculations of poly-atomic systems using density-functional theory, 10.1016/s0010-4655(98)00201-x
Hartwigsen C., Goedecker S., Hutter J., Relativistic separable dual-space Gaussian pseudopotentials from H to Rn, 10.1103/physrevb.58.3641
Krack M., Pseudopotentials for H to Kr optimized for gradient-corrected exchange-correlation functionals, 10.1007/s00214-005-0655-y
Genovese Luigi, Neelov Alexey, Goedecker Stefan, Deutsch Thierry, Ghasemi Seyed Alireza, Willand Alexander, Caliste Damien, Zilberberg Oded, Rayson Mark, Bergman Anders, Schneider Reinhold, Daubechies wavelets as a basis set for density functional pseudopotential calculations, 10.1063/1.2949547
Mohr Stephan, Ratcliff Laura E., Boulanger Paul, Genovese Luigi, Caliste Damien, Deutsch Thierry, Goedecker Stefan, Daubechies wavelets for linear scaling density functional theory, 10.1063/1.4871876
Willand Alex, Kvashnin Yaroslav O., Genovese Luigi, Vázquez-Mayagoitia Álvaro, Deb Arpan Krishna, Sadeghi Ali, Deutsch Thierry, Goedecker Stefan, Norm-conserving pseudopotentials with chemical accuracy compared to all-electron calculations, 10.1063/1.4793260
Lejaeghere, K. ; Bihlmayer, G. ; Bjorkman, T. ; Blaha, P. ; Blugel, S. ; et. al. Reproducibility in density functional theory calculations of solids. In: Science, Vol. 351, no.6280, p. aad3000-aad3000 (2016)