Network Lasso: Clustering and Optimization in Large Graphs
Overview
Authors
Affiliations
Convex optimization is an essential tool for modern data analysis, as it provides a framework to formulate and solve many problems in machine learning and data mining. However, general convex optimization solvers do not scale well, and scalable solvers are often specialized to only work on a narrow class of problems. Therefore, there is a need for simple, scalable algorithms that can solve many common optimization problems. In this paper, we introduce the , a generalization of the group lasso to a network setting that allows for simultaneous clustering and optimization on graphs. We develop an algorithm based on the Alternating Direction Method of Multipliers (ADMM) to solve this problem in a distributed and scalable manner, which allows for guaranteed global convergence even on large graphs. We also examine a non-convex extension of this approach. We then demonstrate that many types of problems can be expressed in our framework. We focus on three in particular - binary classification, predicting housing prices, and event detection in time series data - comparing the network lasso to baseline approaches and showing that it is both a fast and accurate method of solving large optimization problems.
Multi-Task Learning for Compositional Data via Sparse Network Lasso.
Okazaki A, Kawano S Entropy (Basel). 2022; 24(12).
PMID: 36554244 PMC: 9777680. DOI: 10.3390/e24121839.
Strayer N, Zhang S, Yao L, Vessels T, Bejan C, Hsi R Bioinformatics. 2022; 39(1).
PMID: 36472455 PMC: 9825768. DOI: 10.1093/bioinformatics/btac780.
Efficient Learning of Transform-Domain LMS Filter Using Graph Laplacian.
Batabyal T, Weller D, Kapur J, Acton S IEEE Trans Neural Netw Learn Syst. 2022; 34(10):7608-7620.
PMID: 35120011 PMC: 9635395. DOI: 10.1109/TNNLS.2022.3144637.
functional cell phenotyping reveals microdomain networks in colorectal cancer recurrence.
Furman S, Stern A, Uttam S, Taylor D, Pullara F, Chennubhotla S Cell Rep Methods. 2021; 1(5).
PMID: 34888541 PMC: 8653984. DOI: 10.1016/j.crmeth.2021.100072.
Kim R, Muller S, Garcia T Biom J. 2021; 63(6):1254-1271.
PMID: 33871905 PMC: 9012319. DOI: 10.1002/bimj.202000312.