Machine Learning Tutorials, Courses and Certifications
Random Forest Regression is an ensemble learning technique used for predicting continuous numeric values. It combines multiple decision trees to reduce overfitting and increase prediction accuracy. In Python, you can implement Random Forest Regression using Scikit-Learn. Here’s a step-by-step guide:
Step 1: Import Libraries
import numpy as np
import matplotlib.pyplot as plt
from sklearn.ensemble import RandomForestRegressorStep 2: Prepare Your Data
Ensure your dataset contains independent features (X) and the corresponding target variable (y). Make sure your data is in a NumPy array or a DataFrame.
Step 3: Create the Random Forest Regressor
regressor = RandomForestRegressor(n_estimators=100, random_state=0) # You can adjust hyperparameters like n_estimators, max_depth, etc.n_estimators: The number of decision trees in the random forest.max_depth: The maximum depth of each decision tree (optional).
Step 4: Train the Random Forest Regressor
regressor.fit(X, y)Step 5: Make Predictions
y_pred = regressor.predict(X)Step 6: Visualize the Results (Optional)
You can visualize the actual values and predicted values to assess how well the Random Forest model performs.
plt.scatter(X, y, color='red', label='Actual')
plt.scatter(X, y_pred, color='blue', label='Predicted')
plt.title('Random Forest Regression')
plt.xlabel('X-axis')
plt.ylabel('y-axis')
plt.legend()
plt.show()Step 7: Evaluate the Model
Evaluate the model’s performance using appropriate metrics such as Mean Absolute Error (MAE), Mean Squared Error (MSE), and R-squared (R²).
from sklearn.metrics import mean_absolute_error, mean_squared_error, r2_score
mae = mean_absolute_error(y, y_pred)
mse = mean_squared_error(y, y_pred)
r2 = r2_score(y, y_pred)
print(f'Mean Absolute Error: {mae}')
print(f'Mean Squared Error: {mse}')
print(f'R-squared: {r2}')In practice, you should split your dataset into training and testing subsets to assess the model’s generalization performance. You can use Scikit-Learn’s train_test_split function for this purpose. Additionally, hyperparameter tuning and cross-validation can help optimize the Random Forest model’s performance.
