<div class="csl-bib-body">
<div class="csl-entry">Aubin, P.-C. (2024, June 7). <i>Alternating minimization and gradient descent with c(x,y) cost</i> [Conference Presentation]. One World Optimization Seminar in Vienna, Wien, Austria.</div>
</div>
-
dc.identifier.uri
http://hdl.handle.net/20.500.12708/198023
-
dc.description.abstract
How to go beyond the quadratic cost in optimization? Through Bregman divergences? Can we go beyond and non-Euclidean? I will show that by replacing the quadratic or Bregman regularizer with a general cost function c(x,y) and using a majorize-minimize framework we obtain a generic class of algorithms encompassing mirror/natural/Riemannian gradient descent by reframing them as an alternating minimization, each for a different cost c(x,y). We prove that a five-point property inspired from [Csiszár and Tusnady 1984] provides (sub)linear rates, extending the known theory of (relative) smoothness and convexity, and incorportating them into c-concavity and cross-convexity. Both notions are connected with the theory of cross-curvature in optimal transport and give a new spin to studying global convergence rates, e.g. for Newton method, in a systematic manner.This is a joint work with Flavien Léger (INRIA Paris) https://arxiv.org/abs/2305.04917
en
dc.description.sponsorship
FWF - Österr. Wissenschaftsfonds
-
dc.language.iso
en
-
dc.subject
Optimization
en
dc.subject
Gradient Descent
en
dc.subject
Convexity
en
dc.title
Alternating minimization and gradient descent with c(x,y) cost
en
dc.type
Presentation
en
dc.type
Vortrag
de
dc.relation.grantno
P 36344N
-
dc.type.category
Conference Presentation
-
tuw.publication.invited
invited
-
tuw.project.title
Unilateralität und Asymmetrie in der Variationsanalyse
-
tuw.researchTopic.id
C4
-
tuw.researchTopic.name
Mathematical and Algorithmic Foundations
-
tuw.researchTopic.value
100
-
tuw.publication.orgunit
E105-04 - Forschungsbereich Variationsrechnung, Dynamische Systeme und Operations Research
-
tuw.event.name
One World Optimization Seminar in Vienna
en
tuw.event.startdate
03-06-2024
-
tuw.event.enddate
07-06-2024
-
tuw.event.online
On Site
-
tuw.event.type
Event for scientific audience
-
tuw.event.place
Wien
-
tuw.event.country
AT
-
tuw.event.institution
Universität Wien
-
tuw.event.presenter
Aubin, Pierre-Cyril
-
tuw.event.track
Single Track
-
wb.sciencebranch
Mathematik
-
wb.sciencebranch.oefos
1010
-
wb.sciencebranch.value
100
-
item.openairetype
conference paper not in proceedings
-
item.languageiso639-1
en
-
item.fulltext
no Fulltext
-
item.cerifentitytype
Publications
-
item.grantfulltext
none
-
item.openairecristype
http://purl.org/coar/resource_type/c_18cp
-
crisitem.project.funder
FWF - Österr. Wissenschaftsfonds
-
crisitem.project.grantno
P 36344N
-
crisitem.author.dept
E105-04 - Forschungsbereich Variationsrechnung, Dynamische Systeme und Operations Research
-
crisitem.author.parentorg
E105 - Institut für Stochastik und Wirtschaftsmathematik