[Submitted on 20 Jun 2023]

Download a PDF of the paper titled Any Deep ReLU Network is Shallow, by Mattia Jacopo Villani and 1 other authors

Download PDF

Abstract: We constructively prove that every deep ReLU network can be rewritten as a
functionally identical three-layer network with weights valued in the extended
reals. Based on this proof, we provide an algorithm that, given a deep ReLU
network, finds the explicit weights of the corresponding shallow network. The
resulting shallow network is transparent and used to generate explanations of
the model s behaviour.

Submission history

From: Mattia Jacopo Villani [view email]

[v1]

Tue, 20 Jun 2023 18:37:21 UTC (7,539 KB)

Read More