Abstract
Customer is the source of business income, a stable customer base is the guarantee of enterprise survival and development of enterprises by using Markov decision process, decision-makers in the new decision point in time, to the latest state of observation system and adopt an original decision, decided in a well-posed option set an action sequence, and then choose to create value and total revenue in this sequence the most significant behavior, obtain the best marketing strategy, formulate relevant enterprise actual customer, dynamic programming model.