Preprint / Version 1

Predicting Instagram Post User Engagement With Machine Learning Models

##article.authors##

  • Aarav Kolhe Polygence

DOI:

https://doi.org/10.58445/rars.2366

Keywords:

Engagement, AI, Followers, Posts, Performance, Neural Network, Random Forest, LASSO Regression, Social Meida, Instagram

Abstract

This study investigates the practical application of statistical machine learning techniques to predict average Instagram post user engagement based on an account’s follower count. It explores three distinct models—linear Regression, Random Forest Regression, and Neural Networks—for their effectiveness in modeling engagement patterns. Using recent Instagram data, each model is trained on the average user engagement for a profile. The predicted data is then compared to the actual data to determine the most accurate and viable model. The Neural Network excelled in capturing variance, having the highest R-squared value of the three models tested, but struggled with overfitting. Random Forest handled non-linear patterns well, having the lowest mean squared error out of the three modes, but it tended to overestimate. LASSO Regression was a balance between both the Neural Network and Random Forest Model, maintaining variance capture while reducing overestimation. Future research could refine models or explore hybrid approaches for better scalability. Machine learning shows promise in predicting post popularity, but further improvements are needed to aid social media creators and developers.

References

Eckstein, M. (2024, January 29). Social Media Engagement: Why It’s Important and How to Do It Well - the Buffer Blog. Buffer Library. https://buffer.com/library/social-media-engagement/

Emmert-Streib, F., & Dehmer, M. (2019). High-Dimensional LASSO-Based Computational Regression Models: Regularization, Shrinkage, and Selection. Machine Learning and Knowledge Extraction, 1(1), 359–383. https://doi.org/10.3390/make1010021

GeeksforGeeks. (2019, January 17). Neural Networks | A beginners guide. GeeksforGeeks. https://www.geeksforgeeks.org/neural-networks-a-beginners-guide/

Yiu, T. (2019, June 12). Understanding Random Forest. Medium; Towards Data Science. https://towardsdatascience.com/understanding-random-forest-58381e0602d2

Zote, J. (2024, September 26). Instagram engagement rate: How to calculate yours in 2024. Sprout Social. https://sproutsocial.com/insights/instagram-engagement-rate/

Downloads

Posted

2025-03-24