Complexity Bounds For Approximately Solving Markov Decision Processes And Properties Of Turnpike Functions