We present the first benchmark set focusing on the conformational energies of highly flexible, long n-alkane chains, termed ACONFL. Unbranched alkanes are ubiquitous building blocks in nature, so the goal is to be able to calculate their properties most accurately to improve the modeling of, e.g., complex (biological) systems. Very accurate DLPNO-CCSD(T1)/CBS reference values are provided, which allow for a statistical meaningful evaluation of even the best available density functional methods. The performance of established and modern (dispersion corrected) density functionals is comprehensively assessed. The recently introduced r2SCAN-V functional shows excellent performance, similar to efficient composite DFT methods like B97-3c and r2SCAN-3c, which provide an even better cost-accuracy ratio, while almost reaching the accuracy of much more computationally demanding hybrid or double hybrid functionals with large QZ AO basis sets. In addition, we investigated the performance of common wave function methods, where MP2/CBS surprisingly performs worse compared to the simple D4 dispersion corrected Hartree-Fock. Furthermore, we investigate the performance of several semiempirical and force field methods, which are commonly used for the generation of conformational ensembles in multilevel workflows or in large scale molecular dynamics studies. Outstanding performance is obtained by the recently introduced general force field, GFN-FF, while other commonly applied methods like the universal force field yield large errors. We recommend the ACONFL as a helpful benchmark set for parametrization of new semiempirical or force field methods and machine learning potentials as well as a meaningful validation set for newly developed DFT or dispersion methods.