Statistics for Sequential Decision Making Schemes in Inventory and Transportation Environments