<div class="csl-bib-body">
<div class="csl-entry">Arming, S., Bartocci, E., Chatterjee, K., Katoen, J.-P., & Sokolova, A. (2018). Parameter-Independent Strategies for pMDPs via POMDPs. In A. McIver & A. Horvath (Eds.), <i>Quantitative Evaluation of Systems: 15th International Conference, QEST 2018</i> (pp. 53–70). Springer. https://doi.org/10.1007/978-3-319-99154-2_4</div>
</div>
-
dc.identifier.isbn
9783319991535
-
dc.identifier.isbn
9783319991542
-
dc.identifier.uri
http://hdl.handle.net/20.500.12708/57507
-
dc.description.abstract
Markov Decision Processes (MDPs) are a popular class of models suitable for solving control decision problems in probabilistic reactive systems. We consider parametric MDPs (pMDPs) that include parameters in some of the transition probabilities to account for stochastic uncertainties of the environment such as noise or input disturbances.
We study pMDPs with reachability objectives where the parameter values are unknown and impossible to measure directly during execution, but there is a probability distribution known over the parameter values. We study for the first time computing parameter-independent strategies that are expectation optimal, i.e., optimize the expected reachability probability under the probability distribution over the parameters. We present an encoding of our problem to partially observable MDPs (POMDPs), i.e., a reduction of our problem to computing optimal strategies in POMDPs.
We evaluate our method experimentally on several benchmarks: a motivating (repeated) learner model; a series of benchmarks of varying configurations of a robot moving on a grid; and a consensus protocol.
en
dc.relation.ispartofseries
Lecture Notes in Computer Science
-
dc.title
Parameter-Independent Strategies for pMDPs via POMDPs
-
dc.type
Konferenzbeitrag
de
dc.type
Inproceedings
en
dc.relation.publication
Quantitative Evaluation of Systems: 15th International Conference, QEST 2018
-
dc.relation.isbn
978-3-319-99153-5
-
dc.relation.doi
10.1007/978-3-319-99154-2
-
dc.relation.issn
0302-9743
-
dc.description.startpage
53
-
dc.description.endpage
70
-
dc.type.category
Poster Contribution
-
dc.relation.eissn
1611-3349
-
tuw.booktitle
Quantitative Evaluation of Systems: 15th International Conference, QEST 2018
-
tuw.container.volume
11024
-
tuw.peerreviewed
true
-
tuw.relation.publisher
Springer
-
tuw.relation.publisherplace
Cham
-
tuw.book.chapter
4
-
tuw.researchTopic.id
I1
-
tuw.researchTopic.id
I2
-
tuw.researchTopic.name
Logic and Computation
-
tuw.researchTopic.name
Computer Engineering and Software-Intensive Systems
-
tuw.researchTopic.value
50
-
tuw.researchTopic.value
50
-
tuw.publication.orgunit
E191-01 - Forschungsbereich Cyber-Physical Systems
-
tuw.publication.orgunit
E192-02 - Forschungsbereich Databases and Artificial Intelligence
-
tuw.publisher.doi
10.1007/978-3-319-99154-2_4
-
dc.description.numberOfPages
18
-
tuw.event.name
Proc. of QEST 2018: the 15th International Conference on Quantitative Evaluation of Systems
-
tuw.event.startdate
04-09-2018
-
tuw.event.enddate
07-09-2018
-
tuw.event.online
On Site
-
tuw.event.type
Event for scientific audience
-
tuw.event.place
Beijing, China
-
tuw.event.place
Beijing, China
-
tuw.event.country
NON-EU
-
tuw.event.presenter
Arming, Sebastian
-
wb.sciencebranch
Informatik
-
wb.sciencebranch.oefos
1020
-
wb.facultyfocus
Computer Engineering (CE)
de
wb.facultyfocus
Computer Engineering (CE)
en
wb.facultyfocus.faculty
E180
-
wb.presentation.type
science to science/art to art
-
item.openairecristype
http://purl.org/coar/resource_type/c_6670
-
item.cerifentitytype
Publications
-
item.fulltext
no Fulltext
-
item.openairetype
conference poster
-
item.grantfulltext
none
-
crisitem.author.dept
E191-01 - Forschungsbereich Cyber-Physical Systems