Laurent El Ghaoui, UC Berkeley: Implicit Deep Learning

ABSTRACT: We define a new class of ``implicit'' deep learning prediction rules that generalize the recursive rules of feedforward neural networks. These models are based on the solution of a fixed-point equation involving a single vector of hidden features, which is thus only implicitly defined. The new framework greatly simplifies the notation of deep learning, and opens up many new possibilities, in terms of novel architectures and algorithms, robustness analysis, adversarial attacks, and design, interpretability, sparsity, and network  architecture optimization.

Working paper Slides

  • Start date: 2020-03-10 11:00:00
  • End date: 2020-03-10 12:30:00
  • Venue: Online via Zoom