Infrared perfect absorption has been widely investigated due to its potential applications in photodetectors, photovoltaics and medical diagnostics. In this report, we demonstrate that at particular infrared frequencies, a simple planar structure made up of graphene-hexagonal Boron Nitride (hBN) hyper-structure is able to nearly perfectly absorb incident light irrespective of its polarization (Transverse-Magnetic TM, or Transverse-Electric TE). By using this interferenceless technique, the hyper-structure achieves nearly zero reflectance at a wide range of angles in a narrow frequency band. We analytically predict the condition of achieving such an important feature of perfect absorption for both TM and TE polarizations. Interestingly, the infrared perfect absorption can be redshifted by increasing the thickness of the hBN layers and blueshifted by increasing the graphene's chemical potential. Such flexible control of infrared perfect absorption offers a new tool for controlling electromagnetic waves and has potential applications in photodetection and other light control applications.