Probability and Statistics Seminar

Meets Mondays 3--4 pm in 509 Lake Hall

This seminar features talks in the areas of probability theory, classical information theory, quantum information theory, and statistics. The current organizer of the seminar is Michael Malyutov.

• March 26, 2001
  Speaker: Eugene A. Feinberg (SUNY Stony Brook)
  Title: Nonatomic Total Reward Markov Decision Processes with Multiple Criteria
  Abstract: We consider a Markov decision process with an uncountable state space for which the vector performance functional has the form of expected total rewards. Under the single condition that initial distribution and transition probabilities are nonatomic, we prove that the performance space coincides with that generated by nonrandomized Markov policies. We also provide conditions for the existence of optimal policies when the goal is to maximize one component of the performance vector subject to inequality constraints on other components. We illustrate our results with examples of production and financial problems.