[tex]C \in \mathbb{R}^{m \times n}, X \in \mathbb{R}^{m \times n}, W \in \mathbb{R}^{m \times k}, H \in \mathbb{R}^{n \times k}, S \in \mathbb{R}^{m \times m}, P \in \mathbb{R}^{n \times n}[/tex](adsbygoogle = window.adsbygoogle || []).push({});

##{S}## and ##{P}## are similarity matrices (symmetric).

##\lambda##, ##\alpha## and ##\beta## are regularized parameters (scalar).

##\circ## is Hadamard product (element-wise product).

$$\min_{W, H}f(W, H)=\|C\circ(X-WH^T)\|^2_F+\lambda\|W\|^2_F +\lambda\|H\|^2_F + \\\alpha\|S-WW^T\|^2_F +\beta\|P-HH^T\|^2_F$$

For the objective function ##{f}##, I used alternating least squares (ALS) algorithm to get the ##\frac{\partial f}{\partial W}## and ##\frac{\partial f}{\partial H}## and set both them to zeros (##\frac{\partial f}{\partial W} = 0##; ##\frac{\partial f}{\partial H}=0##), thus I can get the analytical solution for both ##{W}## and ##{H}##.

Let set first the ##H## as constant, thus in fact, I will solve such objective function to get ##W##.

$$\min_{W, H}f(W, H)=\|C\circ(X-WH^T)\|^2_F+\lambda\|W\|^2_F + \alpha\|S-WW^T\|^2_F$$

Finally, I get

$$\frac{\partial f}{\partial W} = 2[C \circ (WH^T)]H - 2(C \circ X)H +2{\lambda}W + 4{\alpha}WW^TW - 4{\alpha}SW = 0$$, that is

$$[C \circ (WH^T)]H - (C \circ X)H +{\lambda}W + 2{\alpha}WW^TW - 2{\alpha}SW = 0 \quad (1)$$

For equation ##(1)##, I can not get the analytical solution for ##W##. So can you help me work out:

$$W=?$$

Thanks.

**Physics Forums | Science Articles, Homework Help, Discussion**

The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

# A What is the closed-form solution using ALS algorithm to optimize

Have something to add?

Draft saved
Draft deleted

Loading...

Similar Threads for closed form solution |
---|

A Inverse ODE, Green's Functions, and series solution |

Confusion about series solutions to differential equations |

I Quick Differential Form Question |

I Question About Exact Differential Form |

**Physics Forums | Science Articles, Homework Help, Discussion**