ista_lasso

所属分类:数学计算
开发工具:matlab
文件大小:0KB
下载次数:2
上传日期:2016-10-05 16:01:39
上 传 者sh-1993
说明:  LASSO问题的迭代收缩阈值算法(ISTA)
(Iterative Shrinkage Thresholding Algorithm (ISTA) for LASSO problem)

文件列表:
create_h2d.m (390, 2016-10-05)
create_lexicoH.m (584, 2016-10-05)
demo_ista.m (4046, 2016-10-05)
funcs/ (0, 2016-10-05)
funcs/func3.m (405, 2016-10-05)
funcs/func3_grad.m (347, 2016-10-05)
funcs/func3_hess.m (336, 2016-10-05)
obj_sparse.m (152, 2016-10-05)
opt/ (0, 2016-10-05)
opt/opt_cg.m (963, 2016-10-05)
opt/opt_fista_lasso.m (1650, 2016-10-05)
opt/opt_ista_lasso.m (1344, 2016-10-05)
psnr.m (218, 2016-10-05)
results/ (0, 2016-10-05)
results/cls-cg.jpg (7011, 2016-10-05)
results/degraded.jpg (6877, 2016-10-05)
results/lasso-fista.jpg (7323, 2016-10-05)
results/lasso-ista.jpg (7190, 2016-10-05)
results/original.jpg (6841, 2016-10-05)
x_2d.mat (240, 2016-10-05)

# Iterative Shrinkage Thresholding Algorithm (ISTA) for LASSO problem This is Iterative Shrinkage Thresholding Algorithm (ISTA) for solving LASSO problem. LASSO problem assumes that signal x be sparse, and this assumption is not wrong. Most natural siggnal can be represented sparse in some domain. For example, natural scenes are sparse in Fourier transform domain or DCT domain. Sometimes the scene itself can be very sparse (e.g. stars at night).
ISTA is a first-order method which is gradient-based so it is simple and efficient. However, its convergence is slow - O(1/k). A fast ISTA (FISTA) is developed for faster convergence, which gives an improved complexity, O(1/(k^2)).
Here we will compare the LASSO problem with ISTA/FISTA to RLS problem with CG. You will see ISTA/FISTA work well on the sparse signal while RLS doesn't. You will see the improved performance of FISTA over ISTA as well. # Results of image deconvolution ![alt tag](https://github.com/seunghwanyoo/ista_lasso/blob/master/results/original.jpg) ![alt tag](https://github.com/seunghwanyoo/ista_lasso/blob/master/results/degraded.jpg)
![alt tag](https://github.com/seunghwanyoo/ista_lasso/blob/master/results/lasso-ista.jpg) ![alt tag](https://github.com/seunghwanyoo/ista_lasso/blob/master/results/lasso-fista.jpg)
![alt tag](https://github.com/seunghwanyoo/ista_lasso/blob/master/results/cls-cg.jpg)
# Description of files/folders - demo_ista.m: test script - /opt: includes functions for optimization methods - /func: includes functions for objective function and corresponding gradient function, and hessian function. - /result: includes result images # Image degradation and deconvolution - Degradation model: y = Hx = HPb = Ab where A = HP, P:representation matrix (P = I in my example) - Deconvolution:
(1) LASSO: min_x ||y-Ab||^2 + lambda*||b||1
(2) RLS: min_x 0.5||y-Hx||^2 + 0.5*lambda*||Cx||^2
# Optimization methods Each approach is solved by a different numerical optimization method. ISTA/FISTA are used for LASSO problem and CG method is used for RLS.
(1) ISTA: A type of proximal gradient method
(2) FISTA: Fast version of ISTA
(3) Conjugate Gradient: A efficient optimization algorithm for solving Ax=b (or quadratic objective function)
# Contact Seunghwan Yoo (seunghwanyoo2013@u.northwestern.edu)

近期下载者

相关文件


收藏者