Late-onset Alzheimer's disease (LOAD) likely results from combinations of risk factors that include both genetic predisposition and modifiable lifestyle factors. The E4 allele of apolipoprotein E (ApoE) is the most significant genetic risk factor for LOAD. A Western-pattern diet (WD) has been shown to strongly increase the risk of cardiovascular disease and diabetes, conditions which have been strongly linked to an increased risk for developing AD. Little is known about how the WD may contribute to, or enhance, the increased risk presented by possession of the ApoE4 allele. To model this interaction over the course of a lifetime, we exposed male and female homozygote ApoE4 knock-in mice and wild-type controls to nine months of a high-fat WD or standard chow diet. At eleven months of age, the mice were tested for glucose tolerance and then for general activity and spatial learning and memory. Postmortem analysis of liver function and neuroinflammation in the brain was also assessed. Our results suggest that behavior impairments resulted from the convergence of interacting metabolic alterations, made worse in a male ApoE4 mice group who also showed liver dysfunction, leading to a higher level of inflammatory cytokines in the brain. Interestingly, female ApoE4 mice on a WD revealed impairments in spatial learning and memory without the observed liver dysfunction or increase in inflammatory markers in the brain. These results suggest multiple direct and indirect pathways through which ApoE and diet-related factors interact. The striking sex difference in markers of chronic neuroinflammation in male ApoE4 mice fed the high-fat WD suggests a specific mechanism of interaction conferring significant enhanced LOAD risk for humans with the ApoE4 allele, which may differ between sexes. Additionally, our results suggest researchers exercise caution when designing and interpreting results of experiments employing a WD, being careful not to assume a WD impacts both sexes by the same mechanisms.