- 2020-08-05 23:49
*views 3*

In previous blogs , I shared the normalization with you (Regularization) The concept of ： Keep all the features , But reduce the size of the parameter (Magnitude).

This time , Discuss with you , Normalized linear regression model and normalized logistic regression model .

Let's make one thing clear , Why do some machine learning models need normalization ? There are two answers ：

* Normalization can accelerate the step of gradient descent , That is, the speed of obtaining the optimal solution

* Normalization can submit the accuracy of the model We can discuss the specific analysis later , I won't repeat it here .

Normalized linear regression model (Regularized Linear Regression)

We talked about it before , Normalized cost function . The expression of the cost function of linear regression is the same as that of the normalized cost function ：

If we use gradient descent algorithm to minimize the cost function , Then the gradient descent algorithm we get will take the following form ：（ We are not right ø0 Normalization was performed ）

For the above algorithm ,j=1,2,3,...n Time , The updated expression can be adjusted ：

You can see that , The gradient descent algorithm of normalized linear regression is different from the previous one , Every time the rules are updated based on the original algorithm ø The value of is reduced by an extra value .

alike , If we use the normal equation (Normal Equation) To solve the normalized linear regression model , The expression is as follows ：

In the expression , The size of the matrix is n+1*n+1

Normalized logistic regression model (Regularized Logistic Regression)

alike , For logistic regression model , We also add a normalized expression to the cost function , The following expression is obtained ：

To get the minimum value of the cost function , By deriving , The expression of gradient descent algorithm is as follows ：

notes ： It just looks like linear regression , But the hypothetical function here , So it's different from linear regression .

above , This is the content of the normalized two regression models . thus , We have learned about the machine learning regression model related content is basically involved . One of the most important algorithms in machine learning is discussed below —— neural network (

Neural Network).

Technology

- Java393 articles
- Python205 articles
- Linux112 articles
- Vue98 articles
- MySQL85 articles
- SpringBoot70 articles
- javascript65 articles
- Spring63 articles
- more...

Daily Recommendation

views 2

©2019-2020 Toolsou All rights reserved,

Non preemptive static priority scheduling algorithm for operating system （C language ）Go Language learning notes （GUI programming ）XCTF Attack and defense world web Advanced practice _ 2_lottery What's the difference between computer major and training background ?python realization vlookup_ Dry goods I ： Why python It's inside vlookup Bubble sort primary springboot2 Separation of front and rear platforms ,token Put in header Pit for verification Python Case conversion of letters （ Two methods ）javascript event （ Detailed explanation of zero basis ）Unity2019 UIElement note （ ten ） Simple exercise 2