Konferans bildirisi Açık Erişim

Contextual Combinatorial Volatile Multi-armed Bandit with Adaptive Discretization

Nika, Andi; Elahi, Sepehr; Tekin, Cem


Dublin Core

<?xml version='1.0' encoding='utf-8'?>
<oai_dc:dc xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/ http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
  <dc:creator>Nika, Andi</dc:creator>
  <dc:creator>Elahi, Sepehr</dc:creator>
  <dc:creator>Tekin, Cem</dc:creator>
  <dc:date>2020-01-01</dc:date>
  <dc:description>We consider contextual combinatorial volatile multi-armed bandit (CCV-MAB), in which at each round, the learner observes a set of available base arms and their contexts, and then, selects a super arm that contains K base arms in order to maximize its cumulative reward. Under the semi-bandit feedback setting and assuming that the contexts lie in a space X endowed with the Euclidean norm and that the expected base arm outcomes (expected rewards) are Lipschitz continuous in the contexts (expected base arm outcomes), we propose an algorithm called Adaptive Contextual Combinatorial Upper Confidence Bound (ACC-UCB). This algorithm, which adaptively discretizes X to form estimates of base arm outcomes and uses an a -approximation oracle as a subroutine to select a super arm in each round, achieves (O) over tilde (T-)(((D) over bar +1)/((D) over bar +2)+epsilon) regret for any epsilon &gt; 0, where D represents the approximate optimality dimension related to X. This dimension captures both the benignness of the base arm arrivals and the structure of the expected reward. In addition, we provide a recipe for obtaining more optimistic regret bounds by taking into account the volatility of the base arms and show that ACC-UCB achieves significant performance gains compared to the state-of-the-art for worker selection in mobile crowdsourcing.</dc:description>
  <dc:identifier>https://aperta.ulakbim.gov.trrecord/10923</dc:identifier>
  <dc:identifier>oai:zenodo.org:10923</dc:identifier>
  <dc:rights>info:eu-repo/semantics/openAccess</dc:rights>
  <dc:rights>http://www.opendefinition.org/licenses/cc-by</dc:rights>
  <dc:title>Contextual Combinatorial Volatile Multi-armed Bandit with Adaptive Discretization</dc:title>
  <dc:type>info:eu-repo/semantics/conferencePaper</dc:type>
  <dc:type>publication-conferencepaper</dc:type>
</oai_dc:dc>
30
5
görüntülenme
indirilme
Görüntülenme 30
İndirme 5
Veri hacmi 990 Bytes
Tekil görüntülenme 30
Tekil indirme 5

Alıntı yap