It’s never too late to start exercising, especially when it comes to brain fitness. Neurologists have long known that our brains get slightly smaller as we grow older and that this shrinkage is associated with a gradual decline in certain mental functions.