Poisson learning: Graph based semi-supervised learning at very low label rates

Jeff Calder; Brendan Cook; Matthew Thorpe; Dejan Slepčev

Poisson learning: Graph based semi-supervised learning at very low label rates

Jeff Calder, Brendan Cook, Matthew Thorpe, Dejan Slepčev

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

We propose a new framework, called Poisson learning, for graph based semi-supervised learning at very low label rates. Poisson learning is motivated by the need to address the degeneracy of Laplacian semi-supervised learning in this regime. The method replaces the assignment of label values at training points with the placement of sources and sinks, and solves the resulting Poisson equation on the graph. The outcomes are provably more stable and informative than those of Laplacian learning. Poisson learning is efficient and simple to implement, and we present numerical experiments showing the method is superior to other recent approaches to semi-supervised learning at low label rates on MNIST, FashionMNIST, and Cifar-10. We also propose a graph-cut enhancement of Poisson learning, called Poisson MBO, that gives higher accuracy and can incorporate prior knowledge of relative class sizes.

Original language	English (US)
Title of host publication	37th International Conference on Machine Learning, ICML 2020
Editors	Hal Daume, Aarti Singh
Publisher	International Machine Learning Society (IMLS)
Pages	1283-1293
Number of pages	11
ISBN (Electronic)	9781713821120
State	Published - 2020
Externally published	Yes
Event	37th International Conference on Machine Learning, ICML 2020 - Virtual, Online Duration: Jul 13 2020 → Jul 18 2020

Publication series

Name	37th International Conference on Machine Learning, ICML 2020
Volume	PartF168147-2

Conference

Conference	37th International Conference on Machine Learning, ICML 2020
City	Virtual, Online
Period	7/13/20 → 7/18/20

Bibliographical note

Funding Information:
Calder was supported by NSF-DMS grants 1713691,1944925, Cook was supported by a University of Minnesota Grant In Aid award, Thorpe was supported by the European Research Council under the European Union’s Horizon 2020 research and innovation programme grant No 777826 (NoMADS) and 647812, and Slepcˇev was supported by NSF-DMS grant 1814991. The authors thank Matt Jacobs for providing code for volume constrained MBO. The authors also thank the Center for Nonlinear Analysis (CNA) at CMU for its support.

Publisher Copyright:
© 2020 37th International Conference on Machine Learning, ICML 2020. All rights reserved.

OpenUrl availability

Full text

Cite this

Calder, J., Cook, B., Thorpe, M., & Slepčev, D. (2020). Poisson learning: Graph based semi-supervised learning at very low label rates. In H. Daume, & A. Singh (Eds.), 37th International Conference on Machine Learning, ICML 2020 (pp. 1283-1293). (37th International Conference on Machine Learning, ICML 2020; Vol. PartF168147-2). International Machine Learning Society (IMLS).

Poisson learning: Graph based semi-supervised learning at very low label rates. / Calder, Jeff; Cook, Brendan; Thorpe, Matthew et al.
37th International Conference on Machine Learning, ICML 2020. ed. / Hal Daume; Aarti Singh. International Machine Learning Society (IMLS), 2020. p. 1283-1293 (37th International Conference on Machine Learning, ICML 2020; Vol. PartF168147-2).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Calder, J, Cook, B, Thorpe, M & Slepčev, D 2020, Poisson learning: Graph based semi-supervised learning at very low label rates. in H Daume & A Singh (eds), 37th International Conference on Machine Learning, ICML 2020. 37th International Conference on Machine Learning, ICML 2020, vol. PartF168147-2, International Machine Learning Society (IMLS), pp. 1283-1293, 37th International Conference on Machine Learning, ICML 2020, Virtual, Online, 7/13/20.

@inproceedings{ca7f0b286b9d4acb938b92f2d403e08f,

title = "Poisson learning: Graph based semi-supervised learning at very low label rates",

abstract = "We propose a new framework, called Poisson learning, for graph based semi-supervised learning at very low label rates. Poisson learning is motivated by the need to address the degeneracy of Laplacian semi-supervised learning in this regime. The method replaces the assignment of label values at training points with the placement of sources and sinks, and solves the resulting Poisson equation on the graph. The outcomes are provably more stable and informative than those of Laplacian learning. Poisson learning is efficient and simple to implement, and we present numerical experiments showing the method is superior to other recent approaches to semi-supervised learning at low label rates on MNIST, FashionMNIST, and Cifar-10. We also propose a graph-cut enhancement of Poisson learning, called Poisson MBO, that gives higher accuracy and can incorporate prior knowledge of relative class sizes.",

author = "Jeff Calder and Brendan Cook and Matthew Thorpe and Dejan Slep{\v c}ev",

note = "Funding Information: Calder was supported by NSF-DMS grants 1713691,1944925, Cook was supported by a University of Minnesota Grant In Aid award, Thorpe was supported by the European Research Council under the European Union{\textquoteright}s Horizon 2020 research and innovation programme grant No 777826 (NoMADS) and 647812, and Slepcˇev was supported by NSF-DMS grant 1814991. The authors thank Matt Jacobs for providing code for volume constrained MBO. The authors also thank the Center for Nonlinear Analysis (CNA) at CMU for its support. Publisher Copyright: {\textcopyright} 2020 37th International Conference on Machine Learning, ICML 2020. All rights reserved.; 37th International Conference on Machine Learning, ICML 2020 ; Conference date: 13-07-2020 Through 18-07-2020",

year = "2020",

language = "English (US)",

series = "37th International Conference on Machine Learning, ICML 2020",

publisher = "International Machine Learning Society (IMLS)",

pages = "1283--1293",

editor = "Hal Daume and Aarti Singh",

booktitle = "37th International Conference on Machine Learning, ICML 2020",

}

TY - GEN

T1 - Poisson learning

T2 - 37th International Conference on Machine Learning, ICML 2020

AU - Calder, Jeff

AU - Cook, Brendan

AU - Thorpe, Matthew

AU - Slepčev, Dejan

N1 - Funding Information: Calder was supported by NSF-DMS grants 1713691,1944925, Cook was supported by a University of Minnesota Grant In Aid award, Thorpe was supported by the European Research Council under the European Union’s Horizon 2020 research and innovation programme grant No 777826 (NoMADS) and 647812, and Slepcˇev was supported by NSF-DMS grant 1814991. The authors thank Matt Jacobs for providing code for volume constrained MBO. The authors also thank the Center for Nonlinear Analysis (CNA) at CMU for its support. Publisher Copyright: © 2020 37th International Conference on Machine Learning, ICML 2020. All rights reserved.

PY - 2020

Y1 - 2020

N2 - We propose a new framework, called Poisson learning, for graph based semi-supervised learning at very low label rates. Poisson learning is motivated by the need to address the degeneracy of Laplacian semi-supervised learning in this regime. The method replaces the assignment of label values at training points with the placement of sources and sinks, and solves the resulting Poisson equation on the graph. The outcomes are provably more stable and informative than those of Laplacian learning. Poisson learning is efficient and simple to implement, and we present numerical experiments showing the method is superior to other recent approaches to semi-supervised learning at low label rates on MNIST, FashionMNIST, and Cifar-10. We also propose a graph-cut enhancement of Poisson learning, called Poisson MBO, that gives higher accuracy and can incorporate prior knowledge of relative class sizes.

AB - We propose a new framework, called Poisson learning, for graph based semi-supervised learning at very low label rates. Poisson learning is motivated by the need to address the degeneracy of Laplacian semi-supervised learning in this regime. The method replaces the assignment of label values at training points with the placement of sources and sinks, and solves the resulting Poisson equation on the graph. The outcomes are provably more stable and informative than those of Laplacian learning. Poisson learning is efficient and simple to implement, and we present numerical experiments showing the method is superior to other recent approaches to semi-supervised learning at low label rates on MNIST, FashionMNIST, and Cifar-10. We also propose a graph-cut enhancement of Poisson learning, called Poisson MBO, that gives higher accuracy and can incorporate prior knowledge of relative class sizes.

UR - http://www.scopus.com/inward/record.url?scp=85105243292&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85105243292&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:85105243292

T3 - 37th International Conference on Machine Learning, ICML 2020

SP - 1283

EP - 1293

BT - 37th International Conference on Machine Learning, ICML 2020

A2 - Daume, Hal

A2 - Singh, Aarti

PB - International Machine Learning Society (IMLS)

Y2 - 13 July 2020 through 18 July 2020

ER -

Poisson learning: Graph based semi-supervised learning at very low label rates

Abstract

Publication series

Conference

Bibliographical note

OpenUrl availability

Other files and links

Fingerprint

Cite this