dynamic traveling salesman problem, Markov chains, martingale, ergodic theorem, Monte Carlo simulation, simulated annealing