BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//IORA - Institute of Operations Research and Analytics - ECPv6.15.11//NONSGML v1.0//EN
CALSCALE:GREGORIAN
METHOD:PUBLISH
X-WR-CALNAME:IORA - Institute of Operations Research and Analytics
X-ORIGINAL-URL:https://iora.nus.edu.sg
X-WR-CALDESC:Events for IORA - Institute of Operations Research and Analytics
REFRESH-INTERVAL;VALUE=DURATION:PT1H
X-Robots-Tag:noindex
X-PUBLISHED-TTL:PT1H
BEGIN:VTIMEZONE
TZID:Asia/Singapore
BEGIN:STANDARD
TZOFFSETFROM:+0800
TZOFFSETTO:+0800
TZNAME:+08
DTSTART:20240101T000000
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=Asia/Singapore:20250815T100000
DTEND;TZID=Asia/Singapore:20250815T113000
DTSTAMP:20260421T003838
CREATED:20250818T044156Z
LAST-MODIFIED:20250818T044156Z
UID:26974-1755252000-1755257400@iora.nus.edu.sg
SUMMARY:DAO-ISEM-IORA Seminar Series : Daniel Russo
DESCRIPTION:Name of speaker\n\n\n\nDaniel Russo\n\n\n\n\n\nSchedule\n\n\n15 August 2025\, 10am – 11.30am\n\n\n\n\n\nVenue\n\n\n\nBIZ2 – 0413C\n\n\n\n\n\nLink to register\n\n\n\nhttps://nus-sg.zoom.us/meeting/register/rT3lbgWGQB-LnXjhOw84MA\n\n\n\n\n\nTitle\n\n\nActive Exploration via Autoregressive Generation of Missing Data\n\n\n\n\nAbstract\n\n\nWe cast the challenges of uncertainty quantification and exploration in online decision-making as a problem of training and generation from an autoregressive sequence model\, an area experiencing rapid innovation. Central to our approach is viewing uncertainty as arising from missing outcomes that would be revealed through appropriate action choices\, rather than from unobservable latent parameters of the environment. This reformulation aligns naturally with modern machine learning capabilities: we can i) train generative models through next-token prediction rather than fit explicit priors\, ii) assess uncertainty through autoregressive generation rather than parameter sampling\, and iii) adapt to new information through in-context learning rather than explicit posterior updating. To showcase these ideas\, we formulate a challenging informed bandit learning task where effective performance requires leveraging unstructured prior information (like text features) while exploring judiciously to resolve key remaining uncertainties. We validate our approach through both theory and experiments. Our theory establishes a reduction\, showing success at offline next-outcome prediction translates to reliable online uncertainty quantification and decision-making\, even with strategically collected data. Semi-synthetic experiments show our insights bear out in a news-article recommendation task where article text can be leveraged to minimize exploration.\n\n\n\n\n\nAbout the Speaker\n\n\nDaniel Russo is a Philip H. Geier Jr. Associate Professor in the Decision\, Risk\, and Operations division of the Columbia Business School. His research lies at the intersection of machine learning and online decision making\, mostly falling under the broad umbrella of reinforcement learning. Outside academia\, Dan works as an Amazon scholar applying reinforcement learning to supply chain optimization. He previously spent five years working with Spotify to apply reinforcement learning and large language models to audio recommendations.  Dan completed his undergraduate studies in Math and Economics at the University of Michigan\, doctoral studies at Stanford University under the supervision of Benjamin Van Roy\, and worked as a postdoctoral researcher at Microsoft Research in New England. His research has been recognized by the Erlang Prize\, the Frederick W. Lanchester Prize\, a Junior Faculty Interest Group Best Paper Award\, and first place in the George Nicholson Student Paper Competition.
URL:https://iora.nus.edu.sg/events/dao-isem-iora-seminar-series-daniel-russo/
CATEGORIES:IORA Seminar Series
END:VEVENT
END:VCALENDAR