Search results for "Markov decision process"

Hits ?▲	Authors	Title	Venue	Year	Link	Author keywords
3	Tang Lung Cheung, Kari Okamoto, Frank Maker III, Xin Liu, Venkatesh Akella	Markov decision process (MDP) framework for optimizing software on mobile phones.	EMSOFT	2009	DBLP DOI BibTeX RDF	talk time extension, user-profile driven, mobile phones, markov-decision process, power optimization, android
3	Qi Zhang, Guangzhong Sun, Yinlong Xu	Parallel Algorithms for Solving Markov Decision Process.	ICA3PP	2009	DBLP DOI BibTeX RDF	Markov Decision Process (MDP), parallel algorithm
3	Romulus Grigoras, Vincent Charvillat, Matthijs Douze	Optimizing hypervideo navigation using a Markov decision process approach.	ACM Multimedia	2002	DBLP DOI BibTeX RDF	simulation, optimization, interaction, navigation, reinforcement learning, uncertainty, streaming, hypermedia, prefetching, Markov Decision Process
2	Jaeyoung Park, Kee-Eung Kim, Sungho Jo	A POMDP approach to P300-based brain-computer interfaces.	IUI	2010	DBLP DOI BibTeX RDF	brain-computer interface (bci), partially observable markov decision process (pomdp), P300
2	Naoki Abe, Prem Melville, Cezar Pendus, Chandan K. Reddy, David L. Jensen, Vince P. Thomas, James J. Bennett, Gary F. Anderson, Brent R. Cooley, Melissa Kowalczyk, Mark Domick, Timothy Gardinier	Optimizing debt collections using constrained reinforcement learning.	KDD	2010	DBLP DOI BibTeX RDF	business analytics and optimization, constrained markov decision process, debt collection optimization, reinforcement learning
2	Sandhya S. Pillai, Nanjangud C. Narendra	Optimal Replacement Policy of Services Based on Markov Decision Process.	IEEE SCC	2009	DBLP DOI BibTeX RDF
2	Jeffrey L. Popyack	Blackjack-playing agents in an advanced AI course.	ITiCSE	2009	DBLP DOI BibTeX RDF	blackjack, artificial intelligence, markov chain, markov decision process, tournament
2	S. Mostapha Kalami Heris, Mohammad-Bagher Naghibi Sistani, Naser Pariz	Using Control Theory for Analysis of Reinforcement Learning and Optimal Policy Properties in Grid-World Problems.	ICIC	2009	DBLP DOI BibTeX RDF	Discrete-Time Control Systems, Dynamic Programming, Reinforcement Learning, Markov Decision Process, Stochastic Control
2	Somayeh Kianpisheh, Nasrollah Moghaddam Charkari	Dynamic Power Management for Sensor Node in WSN Using Average Reward MDP.	WASA	2009	DBLP DOI BibTeX RDF	Average reward Markov Decision Process, Wireless sensor network, Dynamic programming, Power management
2	Jiang Zhu, Jun Wang, Tao Luo, Shaoqian Li	Adaptive transmission scheduling over fading channels for energy-efficient cognitive radio networks by reinforcement learning.	Telecommunication Systems	2009	DBLP DOI BibTeX RDF	Energy-efficient networks, Reinforcement learning, Cognitive radio, Markov decision process, Cross-layer design
2	Jianrong Wang, Shouming Hou, Yingying Su, Jianwei Du, Wanshan Wang	Markov Decision Process Based Multi-agent System Applied to Aeroengine Maintenance Policy Optimization.	FSKD	2008	DBLP DOI BibTeX RDF
2	Ngo Anh Vien, TaeChoong Chung	Policy Gradient Semi-markov Decision Process.	ICTAI	2008	DBLP DOI BibTeX RDF
2	Eric Demeester, Alexander Hüntemann, Dirk Vanhooydonck, Gerolf Vanacker, Hendrik Van Brussel, Marnix Nuttin	User-adapted plan recognition and user-adapted shared control: A Bayesian approach to semi-autonomous wheelchair driving.	Auton. Robots	2008	DBLP DOI BibTeX RDF	Intent estimation, User modeling, Plan recognition, User adaptation, Partially observable Markov decision process, Shared control
2	Vikram Krishnamurthy, Dejan V. Djonin	Structured Threshold Policies for Dynamic Sensor Scheduling - A Partially Observed Markov Decision Process Approach.	IEEE Transactions on Signal Processing	2007	DBLP DOI BibTeX RDF
2	Dejan V. Djonin, Vikram Krishnamurthy	MIMO Transmission Control in Fading Channels - A Constrained Markov Decision Process Formulation With Monotone Randomized Policies.	IEEE Transactions on Signal Processing	2007	DBLP DOI BibTeX RDF
2	Dejan V. Djonin, Qing Zhao, Vikram Krishnamurthy	Optimality and Complexity of Opportunistic Spectrum Access: A Truncated Markov Decision Process Formulation.	ICC	2007	DBLP DOI BibTeX RDF
2	Tariq Mahmood, Francesco Ricci	Learning and adaptivity in interactive recommender systems.	ICEC	2007	DBLP DOI BibTeX RDF	adaptivity, reinforcement learning, markov decision process, conversational recommender systems
2	Hussein Al-Zubaidy, Ioannis Lambadaris, Jerome Talim, Ioannis Marmorkos	Determination of optimal policy for code allocation in high speed downlink packet access networks with multi-state channel model.	PM2HW2N	2007	DBLP DOI BibTeX RDF	dynamic programming, markov decision process, HSDPA, optimal scheduling
2	Ca Van Phan, Kikyung Baek, Jeong Geun Kim	Opportunistic Transmission for Wireless Sensor Networks Under Delay Constraints.	ICCSA	2007	DBLP DOI BibTeX RDF	Markov decision process (MDP), opportunistic transmission, Wireless sensor networks, energy efficiency
2	Con Tran, Zbigniew Dziong, Michal Pióro	SLA Adaptation for Service Overlay Networks.	Networking	2007	DBLP DOI BibTeX RDF	Quality of Service, Resource Management, Markov Decision Process, Economic Model, Service Overlay Network
2	Kazunori Iwata, Kazushi Ikeda, Hideaki Sakai	A statistical property of multiagent learning based on Markov decision process.	IEEE Transactions on Neural Networks	2006	DBLP DOI BibTeX RDF
2	Ramana Isukapalli, Ahmed M. Elgammal, Russell Greiner	Learning to Identify Facial Expression During Detection Using Markov Decision Process.	FG	2006	DBLP DOI BibTeX RDF
2	Arvind K. Tripathi, Suresh K. Nair	Mobile Advertising in Capacitated Wireless Networks.	IEEE Trans. Knowl. Data Eng.	2006	DBLP DOI BibTeX RDF	Ad targeting, wireless advertising, wireless networks, Markov decision process, mobile advertising
2	Hiroyuki Eto, Tadashi Dohi	Analysis of a Service Degradation Model with Preventive Rejuvenation.	ISAS	2006	DBLP DOI BibTeX RDF	service degradation, software rejuvenation, software aging, service availability, semi-Markov decision process
2	C. V. L. Raju, Y. Narahari, K. Ravikumar	Learning dynamic prices in electronic retail markets with customer segmentation.	Annals OR	2006	DBLP DOI BibTeX RDF	Electronic retail market, Captives, Shoppers, Volume discounts, Inventory replenishment, Reinforcement learning, Markov decision process, Q-learning, Dynamic pricing, Customer segmentation
2	Shilpa Yogesh Tisgaonkar, Chih-Cheng Hung, Benny Bing	Next generation wireless systems using Markov decision process model.	ACM Southeast Regional Conference	2005	DBLP DOI BibTeX RDF
2	Sherief Abdallah, Victor R. Lesser	Modeling task allocation using a decision theoretic model.	AAMAS	2005	DBLP DOI BibTeX RDF	reinforcement learning, multiagent systems, markov decision process, task allocation
2	Jalal Almhana, Vartan Choulakian, Robert McGorman	A Mobile Terminal Location Tracking Model for Personal Communication Systems.	LCN	2005	DBLP DOI BibTeX RDF	Wireless personal communication service network, location registration, Markov decision process, online optimization
2	Scott Buffett	A Markov Model for Inventory Level Optimization in Supply-Chain Management.	Canadian Conference on AI	2005	DBLP DOI BibTeX RDF	dynamic programming, supply-chain management, Markov decision process, purchasing
2	Arsalan Farrokh, Vikram Krishnamurthy	Optimal Threshold Policies for Operation of a Dedicated-Platform with Imperfect State Information - A POMDP Framework.	ECSQARU	2005	DBLP DOI BibTeX RDF	Partially Observable Markov Decision Process (POMDP), optimal threshold policies, Bellman equation, two-state Markov chain, overlook probability, dynamic programming, Hidden Markov Model (HMM), sufficient statistics, optimal search
2	Masami Kurano, Masami Yasuda, Jun-ichi Nakagami, Yuji Yoshida	Perceptive Evaluation for the Optimal Discounted Reward in Markov Decision Processes.	MDAI	2005	DBLP DOI BibTeX RDF	Fuzzy perceptive model, fuzzy perceptive reward, optimal policy function, Markov decision process
2	Clemens C. Wüst, Liesbeth Steffens, Wim F. J. Verhaegh, Reinder J. Bril, Christian Hentschel	QoS Control Strategies for High-Quality Video Processing.	Real-Time Systems	2005	DBLP DOI BibTeX RDF	Quality of Service (QoS), multimedia, reinforcement learning, Markov decision process, soft real time, overload
2	Scott Buffett	Considering expected utility of future bidding options in bundle purchasing with multiple auctions.	ICEC	2004	DBLP DOI BibTeX RDF	bundle purchasing, multiple auctions, dynamic programming, markov decision process, decision analysis, expected utility
2	Hiroyuki Okamura, Yuki Nishimura, Tadashi Dohi	A Dynamic Checkpointing Scheme Based on Reinforcement Learning.	PRDC	2004	DBLP DOI BibTeX RDF	Dynamic checkpointing, Uniprocess application, Reinforcement learning, Q-learning, Semi-Markov decision process
2	Chengcheng Li, Larry D. Pyeatt	A Short Tutorial on Reinforcement Learning.	Intelligent Information Processing	2004	DBLP DOI BibTeX RDF	Temporal Difference, Dynamic Programming, Reinforcement Learning, Markov Decision Process, Monte Carlo method
2	Clemens C. Wüst, Wim F. J. Verhaegh	Quality Control for Scalable Media Processing Applications.	J. Scheduling	2004	DBLP DOI BibTeX RDF	load variations, real-time systems, scalability, Markov decision process, quality control, media processing
2	Taro Konda, Shinjiro Tensyo, Tomohiro Yamaguchi	LC-Learning: Phased Method for Average Reward Reinforcement Learning - Preliminary Results.	PRICAI	2002	DBLP DOI BibTeX RDF	Average Reward Method, LC-learning, Machine Learning, Artificial Intelligence, Reinforcement Learning, Markov Decision Process
2	Taro Konda, Tomohiro Yamaguchi	LC-Learning: Phased Method for Average Reward Reinforcement Learning - Analysis of Optimal Criteria.	PRICAI	2002	DBLP DOI BibTeX RDF	Average Reward Method, LC-learning, Machine Learning, Artificial Intelligence, Reinforcement Learning, Markov Decision Process
2	Martin Mundhenk, Judy Goldsmith, Christopher Lusena, Eric Allender	Complexity of finite-horizon Markov decision process problems.	J. ACM	2000	DBLP DOI BibTeX RDF	NPPP, computational complexity, Markov decision processes, NP, PL, partially observable Markov decision processes, PSPACE, succinct representations
2	Franck Gechter, François Charpillet	Vision based localisation for a mobile robot.	ICTAI	2000	DBLP DOI BibTeX RDF	vision-based localisation system, representative image set, environment exploration, partially Markov decision process, robot decisions, principal components analysis, probability, probabilities, mobile robots, mobile robot, Markov processes, image recognition, image recognition, data fusion, image matching, image matching, sensor fusion, robot vision, position estimation
2	Jihyuk Choi, Taekyoung Kwon, Yanghee Choi, Mahmoud Naghshineh	Call Admission Control for Multimedia Services in Mobile Cellular Networks: A Markov Decision Approach.	ISCC	2000	DBLP DOI BibTeX RDF	Call admission control, mobile multimedia, semi-Markov decision process
1	Xueqing Zhang, Hui Gao	Road maintenance optimization through a discrete-time semi-Markov decision process.	Rel. Eng. & Sys. Safety	2012	DBLP DOI BibTeX RDF
1	Abdel-Illah Mouaddib	Vector-Value Markov Decision Process for multi-objective stochastic path planning.	Int. J. Hybrid Intell. Syst.	2012	DBLP DOI BibTeX RDF
1	Yi-Cheng Pan, Hung-yi Lee, Lin-Shan Lee	Interactive Spoken Document Retrieval With Suggested Key Terms Ranked by a Markov Decision Process.	IEEE Transactions on Audio, Speech & Language Processing	2012	DBLP DOI BibTeX RDF
1	Yasin Gocgun, Brian W. Bresnahan, Archis Ghate, Martin L. Gunn	A Markov decision process approach to multi-category patient scheduling in a diagnostic facility.	Artificial Intelligence in Medicine	2011	DBLP DOI BibTeX RDF
1	Yifan Zhou, Lin Ma, Joseph Mathew, Yong Sun, Rodney Wolff	Maintenance strategy optimization using a continuous-state partially observable semi-Markov decision process.	Microelectronics Reliability	2011	DBLP DOI BibTeX RDF
1	Lars Relund Nielsen, Erik Jørgensen, Søren Højsgaard	Embedding a state space model into a Markov decision process.	Annals OR	2011	DBLP DOI BibTeX RDF
1	Nicklas Forsell, Peder Wikström, Frédérick Garcia, Régis Sabbadin, Kristina Blennow, Ljusk Ola Eriksson	Management of the risk of wind damage in forestry: a graph-based Markov decision process approach.	Annals OR	2011	DBLP DOI BibTeX RDF
1	Nicholas Mastronarde, Karim Kanoun, David Atienza, Pascal Frossard, Mihaela van der Schaar	Markov Decision Process Based Energy-Efficient On-Line Scheduling for Slice-Parallel Video Decoders on Multicore Systems	CoRR	2011	DBLP BibTeX RDF
1	Yu. A. Chizhov, Arkady N. Borisov	Markov decision process in the problem of dynamic pricing policy.	Automatic Control and Computer Sciences	2011	DBLP DOI BibTeX RDF
1	Jiuyun Xu, Kun Chen, Stephan Reiff-Marganiec	Using Markov Decision Process Model with Logic Scoring of Preference Model to Optimize HTN Web Services Composition.	Int. J. Web Service Res.	2011	DBLP DOI BibTeX RDF
1	Wang-Zhou Dai, Yang Yu, Zhi-Hua Zhou	Lifted-Rollout for Approximate Policy Iteration of Markov Decision Process.	ICDM Workshops	2011	DBLP DOI BibTeX RDF
1	Dongeun Lee, Heonshik Shin, Eunjeong Park	Modeling Recovery Strategies in Service-Oriented Architecture Using a Markov Decision Process.	HASE	2011	DBLP DOI BibTeX RDF
1	Xin Fei, Azzedine Boukerche, F. Richard Yu	An efficient Markov decision process based mobile data gathering protocol for wireless sensor networks.	WCNC	2011	DBLP DOI BibTeX RDF
1	Chao Chen, Robert W. Heath Jr., Alan C. Bovik, Gustavo de Veciana	Adaptive policies for real-time video transmission: A Markov decision process framework.	ICIP	2011	DBLP DOI BibTeX RDF
1	Reinaldo Uribe, Fernando Lozano, Katsunari Shibata, Charles Anderson	Discount and speed/execution tradeoffs in Markov Decision Process games.	CIG	2011	DBLP DOI BibTeX RDF
1	Yong Li, Yibin Hou, Zhangqin Huang, Yifei Wei	Cooperative relay selection policy using partially observable Markov decision process.	ICNC	2011	DBLP DOI BibTeX RDF
1	Zhi Liu, Gene Cheung, Yusheng Ji	Distributed Markov decision process in cooperative peer-to-peer repair for WWAN video broadcast.	ICME	2011	DBLP DOI BibTeX RDF
1	Bharat Shrestha, Ekram Hossain, Kae Won Choi, Sergio Camorlinga	A Markov Decision Process (MDP)-Based Congestion-Aware Medium Access Strategy for IEEE 802.15.4.	GLOBECOM	2011	DBLP DOI BibTeX RDF
1	Daniel S. Ferguson, Pantelis Elinas	A Markov Decision Process Model for Strategic Decision Making in Sailboat Racing.	Canadian Conference on AI	2011	DBLP DOI BibTeX RDF
1	Enda Barrett, Enda Howley, Jim Duggan	A Learning Architecture for Scheduling Workflow Applications in the Cloud.	ECOWS	2011	DBLP DOI BibTeX RDF	Bayesian Model Learning, Genetic Algorithm, Markov Decision Process, Workflow Scheduling
1	Lizhi Wang, Nan Kong	Security Constrained Economic Dispatch: A Markov Decision Process Approach with Embedded Stochastic Programming.	IJORIS	2010	DBLP DOI BibTeX RDF
1	Amy Greenwald, Karthik Kannan, Ramayya Krishnan	On Evaluating Information Revelation Policies in Procurement Auctions: A Markov Decision Process Approach.	Information Systems Research	2010	DBLP DOI BibTeX RDF
1	Jesse Hoey, Pascal Poupart, Axel von Bertoldi, Tammy Craig, Craig Boutilier, Alex Mihailidis	Automated handwashing assistance for persons with dementia using video and a partially observable Markov decision process.	Computer Vision and Image Understanding	2010	DBLP DOI BibTeX RDF
1	LiYue Zhu, Zilei Wang, Hongsheng Xi	Markov Decision Process Model for Path Selection Algorithm on Multi-Business System with Services Composition.	JCIT	2010	DBLP BibTeX RDF
1	Eric Jung, Frank Maker III, Tang Lung Cheung, Xin Liu, Venkatesh Akella	Markov decision process (MDP) framework for software power optimization using call profiles on mobile phones.	Design Autom. for Emb. Sys.	2010	DBLP DOI BibTeX RDF
1	Zeynep Erkin, Matthew D. Bailey, Lisa M. Maillart, Andrew J. Schaefer, Mark S. Roberts	Eliciting Patients' Revealed Preferences: An Inverse Markov Decision Process Approach.	Decision Analysis	2010	DBLP DOI BibTeX RDF
1	Jatinder Pal Singh, Tansu Alpcan, Piyush Agrawal, Varun Sharma	A Markov Decision Process based flow assignment framework for heterogeneous network access.	Wireless Networks	2010	DBLP DOI BibTeX RDF
1	Yong Tao, Tianmiao Wang, Hongxing Wei, Peijiang Yuan, Diansheng Chen	A Behavior Adaptation Algorithm based on Hierarchical Partially Observable Markov Decision Process.	IJIIP	2010	DBLP BibTeX RDF
1	Wei Wang, Mao Liu, Li Wang	Dynamic Optimization Methods of Emergency Resources Deployment Based on Markov Decision Process for Wenchuan Earthquake.	DBTA	2010	DBLP DOI BibTeX RDF
1	Sudip Misra, Rashmi Ranjan Rout, T. Raghu Vamsi Krishna, Patel Manish Kumar Manilal, Mohammad S. Obaidat	Markov decision process-based analysis of rechargeable nodes in wireless sensor networks.	SpringSim	2010	DBLP DOI BibTeX RDF
1	Siegmund Duell, Alexander Hans, Steffen Udluft	The Markov Decision Process Extraction Network.	ESANN	2010	DBLP BibTeX RDF
1	Jeff Wu, Sanjay Lall	An Exact Dynamic Programming Solution for a Decentralized Two-Player Markov Decision Process.	AAAI Spring Symposium: Embedded Reasoning	2010	DBLP BibTeX RDF
1	Yongle Wu, Beibei Wang, K. J. Ray Liu	Optimal Defense against Jamming Attacks in Cognitive Radio Networks Using the Markov Decision Process Approach.	GLOBECOM	2010	DBLP DOI BibTeX RDF
1	Juan Sebastian Borrero, Raha Akhavan-Tabatabaei	A Markov Decision Process model for optimal policy making in the maintenance of a single-machine single-product toolset.	Winter Simulation Conference	2010	DBLP DOI BibTeX RDF
1	Fernando Martínez Ortuño, Uli Harder, Peter G. Harrison	A markovian futures market for computing power.	WOSP/SIPEW	2010	DBLP DOI BibTeX RDF	performance, grid, markov decision process, market, futures
1	Abir-Beatrice Karami, Laurent Jeanpierre, Abdel-Illah Mouaddib	Human-robot collaboration for a shared mission.	HRI	2010	DBLP DOI BibTeX RDF	human-robot collaboration, pomdp
1	Baris Eker, H. Levent Akin	Using evolution strategies to solve DEC-POMDP problems.	Soft Comput.	2010	DBLP DOI BibTeX RDF	DEC-POMDP, Multi-robot decision making, Evolution control, Evolution strategies
1	Takeshi Tateyama, Seiichi Kawata, Yoshiki Shimomura	Construction of Semi-Markov Decision Process Models of Continuous State Space Environments Using Growing Cell Structures and Multiagent k-Certainty Exploration Method.	JACIII	2009	DBLP BibTeX RDF
1	Luiz Guilherme Nadal Nunes, Solon Venâncio de Carvalho, Rita de Cássia Meneses Rodrigues	Markov decision process applied to the control of hospital elective admissions.	Artificial Intelligence in Medicine	2009	DBLP DOI BibTeX RDF
1	Vikram Krishnamurthy, Bo Wahlberg	Partially Observed Markov Decision Process Multiarmed Bandits - Structural Results.	Math. Oper. Res.	2009	DBLP DOI BibTeX RDF
1	Fumihiko Ishida, Takahiro Sasaki, Yutaka Sakaguchi, Hiroyuki Shimai	Reinforcement-learning agents with different temperature parameters explain the variety of human action-selection behavior in a Markov decision process task.	Neurocomputing	2009	DBLP DOI BibTeX RDF
1	Edwin K. P. Chong, Christopher M. Kreucher, Alfred O. Hero	Partially Observable Markov Decision Process Approximations for Adaptive Sensing.	Discrete Event Dynamic Systems	2009	DBLP DOI BibTeX RDF
1	Marcelino S. da Silva, Ádamo L. de Santana, Carlos Renato Lisboa Francês, Nandamudi Lankalapalli Vijaykumar, Solon V. Carvalho	Obtaining a Continuous Time Markov Decision Process from Statecharts.	NaBIC	2009	DBLP DOI BibTeX RDF
1	Ben-Jye Chang, Jun-Fu Chen, Cheng-Hsiung Hsieh, Ying-Hsin Liang	Markov decision process-based adaptive vertical handoff with RSS prediction in heterogeneous wireless networks.	WCNC	2009	DBLP DOI BibTeX RDF
1	Ghasem Naddafzadeh Shirazi, Peng Yong Kong, Chen-Khong Tham	Markov decision process frameworks for cooperative retransmission in wireless networks.	WCNC	2009	DBLP DOI BibTeX RDF
1	Sylvie C. W. Ong, David Hsu, Wee Sun Lee, Hanna Kurniawati	Partially Observable Markov Decision Process (POMDP) Technologies for Sign Language Based Human-Computer Interaction.	HCI	2009	DBLP DOI BibTeX RDF	human-computer interaction, Sign language recognition, planning under uncertainty
1	Simon Le Gloannec, Abdel-Illah Mouaddib	Navigation Method Selector for an Autonomous Explorer Rover with a Markov Decision Process.	ICIRA	2009	DBLP DOI BibTeX RDF
1	Sharethram Hariharan, Satish T. S. Bukkapatnam	Misplaced item search in a warehouse using an RFID-based Partially Observable Markov Decision Process (POMDP) model.	CASE	2009	DBLP DOI BibTeX RDF
1	Abir-Beatrice Karami, Laurent Jeanpierre, Abdel-Illah Mouaddib	Partially Observable Markov Decision Process for Managing Robot Collaboration with Human.	ICTAI	2009	DBLP DOI BibTeX RDF
1	Chiyoun Park, Namhoon Kim, Jeongmi Cho	Voice activity detection using partially observable Markov decision process.	INTERSPEECH	2009	DBLP BibTeX RDF
1	Ghasem Naddafzadeh Shirazi, Peng Yong Kong, Chen-Khong Tham	Cooperative retransmissions using Markov decision process with reinforcement learning.	PIMRC	2009	DBLP DOI BibTeX RDF
1	Finale Doshi-Velez	The Infinite Partially Observable Markov Decision Process.	NIPS	2009	DBLP BibTeX RDF
1	Alan L. Liu, Harlan Hile, Gaetano Borriello, Pat A. Brown, Mark Harniss, Henry A. Kautz, Kurt Johnson	Customizing directions in an automated wayfinding system for individuals with cognitive impairment.	ASSETS	2009	DBLP DOI BibTeX RDF	user interface, Markov decision process, wayfinding, cognitive impairments
1	Janusz Marecki, Milind Tambe	Planning with continuous resources for agent teams.	AAMAS	2009	DBLP DOI BibTeX RDF	continuous resources, decentralized Markov decision process, multi-agent systems
1	Jonathan Sorg, Satinder P. Singh	Transfer via soft homomorphisms.	AAMAS	2009	DBLP DOI BibTeX RDF	Markov decision process, homomorphism, transfer learning
1	Tariq Mahmood, Francesco Ricci	Improving recommender systems with adaptive conversational strategies.	Hypertext	2009	DBLP DOI BibTeX RDF	adaptivity, user study, reinforcement learning, markov decision process, conversational recommender systems
1	Scott Blunsden, Brandi Richards, Jennifer Boger, Alex Mihailidis, Tom Bartindale, Daniel Jackson, Patrick Olivier, Jesse Hoey	Design and prototype of a device to engage cognitively disabled older adults in visual artwork.	PETRA	2009	DBLP DOI BibTeX RDF	art therapy, computer vision, face detection, touch screen, POMDP, partially observable Markov decision process, MDP
1	Tariq Mahmood, Francesco Ricci, Adriano Venturini	Learning Adaptive Recommendation Strategies for Online Travel Planning.	ENTER	2009	DBLP DOI BibTeX RDF	Dynamic Packaging, Information Presentation and Delivery, Reinforcement Learning, Markov Decision Process, Travel Planning, Conversational Recommender Systems
1	Jared Freeman, Webb Stacy, Jean MacMillan, Georgiy Levchuk	Capturing and Building Expertise in Virtual Worlds.	HCI	2009	DBLP DOI BibTeX RDF	Adaptive instruction, knowledge engineering, Markov Decision Process, Constraint Logic Programming