Longterm dynamics of a conserved phase-field system with memory