동선생

[Kaggle Study] 7. About Structuring ML Projects (1)

This post is a summary of Coursera Andrew Ng's lecture: 머신 러닝 프로젝트 구조화DeepLearning.AI에서 제공합니다. 딥러닝 전문 과정의 세 번째 과정에서는 성공적인 머신러닝 프로젝트를 구축하는 방법을 배우고 머신러닝 프로젝트 리더로서 의사 결정을 연습할 수 있습니다. 이www.coursera.orgIntroduction위의 예를 보면 알 수 있듯이 머신러닝 모델이 원하는 성능보다 저조한 성능을 보였을 때 취할 수 있는 조치는 수없이 많습니다. 머신러닝 프로젝트를 진행할 때 수없이 많은 방법들 사이에서 어떤 부분을 집중적으로 개선할지 판단할 수 있는 기준점을 세워야 기한이 정해진 프로젝트에서 원하는 성과를 낼 수 있습니다. Orthogonalizatio..

[Kaggle Extra Study] 16. Handling Categorical Variables

What makes handling Categorical Variables important?Categorical variables - like colors, cities, or education levels - cannot be directly used in machine learning models since these models only understand numbers.Categorical variable encoding solves this problem by converting these text-based categories into numerical formats that machines can process.The challenge lies in choosing the right enc..

Tree-based Ensemble Models?LightGBM, XGBoost, CatBoost, Random Forest are all tree-based ensemble models.These algorithms are popular on Kaggle because of their high prediction performance, fast learning speed, and ability to handle various data types.They show particularly powerful performance in analyzing structured data."Tree-based": These algorithms all use decision trees as their basic buil..

Weight Initialization?When training a neural network, one of the things we should care about is where we should start on the loss function to reach the optimal solution more easily and quickly.When training a neural network, the method of determining the starting position on the loss function is called Model Initialization.In particular, weights account for the largest portion of the model's par..

In Neural Networks, the activation function is a key element that enables the network to learn complex patterns and non-linearity.Reasons why activation functions are necessary:Introduction of Non-linearityWithout activation functions, neural networks would be merely combinations of linear transformations.No matter how many layers are stacked, they could be expressed as a single linear function,..

Birth of Logistic Loss FunctionIn linear regression, the goal was to find weights and bias that minimize the squared error between the actual and predicted values. Besides, the goal of classfication problems like logistic regression is to increase the actual ratio of correctly classified samples data itself. However, the ratio of correctly classified samples is not a differentiable function. In ..