Unveiling Gold Membership Classification Using Machine Learning

Vincencius Christiano Tjokro - Universitas Multimedia Nusantara, Tangerang, 15811, Indonesia
Raymond Oetama - Universitas Multimedia Nusantara
Iwan Prasetiawan - Universitas Multimedia Nusantara


Citation Format:



DOI: http://dx.doi.org/10.62527/joiv.8.4.2023

Abstract


The main challenge in loyalty programs is selecting customers with limited funding. To address it, we explore various machine learning-based classification models. This study aims to enhance the effectiveness of a marketing strategy that promotes gold membership to customers with prior transaction history. Previously, much research applied decision trees, random forests, and logistic regression for classification, but gradient boosting is still unpopular. However, in this study, the Gradient Boost algorithm exhibits the best performance among these models, achieving an impressive accuracy of around 88%. This result underscores the model's capability to classify customers, thereby suggesting its potential to significantly enhance the marketing strategy's effectiveness. The analysis identifies crucial features that influence the model's predictive capabilities. Notably, the recency of the last visit, the number of transactions involving wine and meat, marital status, and the number of offline store transactions are identified as influential factors. Leveraging machine learning techniques enables the automation of the customer selection process, facilitating the attraction of a more extensive customer base. By targeting those customers most likely to respond positively to the gold membership offer, efficient resource allocation can be achieved. This research provides valuable insights and practical recommendations for implementing an effective marketing strategy under resource constraints. Combining machine learning algorithms and feature identification enables efficient targeting of potential customers, maximizing the impact of the gold membership offering. Implementing the findings of this study could lead to increased customer acquisition and improved overall business performance.


Keywords


gradient boost; random forest; logistic regression; decision tree; direct marketing.

Full Text:

PDF

References


A. Nastasoiu and M. Vandenbosch, "Competing with loyalty: How to design successful customer loyalty reward programs," Bus. Horiz., vol. 62, no. 2, pp. 207–214, 2019, doi: 10.1016/j.bushor.2018.11.002.

M. Alshurideh, A. Gasaymeh, G. Ahmed, H. Alzoubi, and B. Al Kurd, "Loyalty program effectiveness: Theoretical reviews and practical proofs," Uncertain Supply Chain Manag., vol. 8, no. 3, pp. 599–612, 2020, doi: 10.5267/j.uscm.2020.2.003.

D. Nopas and S. Rimkeeratikul, "SATISFACTION AND LOYALTY: A STUDY OF BUSINESS CLASS FLYERS," in Board of 8th LITU International Graduate Conference, p. 97.

R. Jongeneel and A. Gonzalez-Martinez, "Implementing the EU eco-scheme in the Netherlands: A results-based points system approach," EuroChoices, vol. 22, no. 1, pp. 20–27, 2023, doi: 10.1111/1746-692X.12388.

Z. Guo et al., "Uncertainty-aware reward-based deep reinforcement learning for intent analysis of social media information," arXiv Prepr. arXiv2302.10195, 2023.

C. Prentice, X. Y. Han, L. L. Hua, and L. Hu, "The influence of identity-driven customer engagement on purchase intention," J. Retail. Consum. Serv., vol. 47, pp. 339–347, 2019, doi: 10.1016/j.jretconser.2018.12.014.

H. Sulistiani, K. Muludi, and A. Syarif, "Implementation of Dynamic Mutual Information and Support Vector Machine for Customer Loyalty Classification," in Journal of Physics: Conference Series, 2019, vol. 1338, no. 1, p. 12050. doi: 10.1088/1742-6596/1338/1/012050.

M. Chen and D. K. Halim, "Federated learning for scam classification in small Indonesian language dataset: an initial study," Indones. J. Electr. Eng. Comput. Sci., vol. 30, no. 1, pp. 325–331, 2023, doi: 10.11591/ijeecs.v30.i1.pp325-331.

F. Natalia, J. C. Young, N. Afriliana, H. Meidia, R. E. Yunus, and S. Sudirman, "Automated selection of mid-height intervertebral disc slice in traverse lumbar spine MRI using a combination of deep learning feature and machine learning classifier," PLoS One, vol. 17, no. 1 January, p. e0261659, 2022, doi: 10.1371/journal.pone.0261659.

M. R. Machado, S. Karray, and I. T. De Sousa, "LightGBM: An effective decision tree gradient boosting method to predict customer loyalty in the finance industry," in 14th International Conference on Computer Science and Education, ICCSE 2019, 2019, pp. 1111–1116. doi: 10.1109/ICCSE.2019.8845529.

P. Ładyżyński, K. Żbikowski, and P. Gawrysiak, "Direct marketing campaigns in retail banking with the use of deep learning and random forests," Expert Syst. Appl., vol. 134, pp. 28–35, 2019, doi: 10.1016/j.eswa.2019.05.020.

Z. Zhao, R. Anand, and M. Wang, "Maximum relevance and minimum redundancy feature selection methods for a marketing machine learning platform," in Proceedings - 2019 IEEE International Conference on Data Science and Advanced Analytics, DSAA 2019, 2019, pp. 442–452. doi: 10.1109/DSAA.2019.00059.

G. Ren, Y. Wang, J. Ning, and Z. Zhang, "Using near-infrared hyperspectral imaging with multiple decision tree methods to delineate black tea quality," Spectrochim. Acta - Part A Mol. Biomol. Spectrosc., vol. 237, p. 118407, 2020, doi: 10.1016/j.saa.2020.118407.

T. Le Minh, L. Van Tran, and S. V. T. Dao, "A Feature Selection Approach for Fall Detection Using Various Machine Learning Classifiers," IEEE Access, vol. 9, pp. 115895–115908, 2021, doi: 10.1109/ACCESS.2021.3105581.

A. Sanaullah, N. Fatema, M. Ather, A. Sanaullah, and H. Malik, "Analyzing impact of relationship benefit and commitment on developing loyalty using machine intelligence approach," J. Intell. fuzzy Syst., vol. 42, no. 2, pp. 699–712, 2022.

W. Kwon, M. Lee, and K. J. Back, "Exploring the underlying factors of customer value in restaurants: A machine learning approach," Int. J. Hosp. Manag., vol. 91, p. 102643, 2020, doi: 10.1016/j.ijhm.2020.102643.

M. E. Alzahrani, T. H. H. Aldhyani, S. N. Alsubari, M. M. Althobaiti, and A. Fahad, "Developing an Intelligent System with Deep Learning Algorithms for Sentiment Analysis of E-Commerce Product Reviews," Comput. Intell. Neurosci., vol. 2022, 2022, doi: 10.1155/2022/3840071.

S. Yi and X. Liu, "Machine learning based customer sentiment analysis for recommending shoppers, shops based on customers' review," Complex Intell. Syst., vol. 6, no. 3, pp. 621–634, 2020.

V. Kavitha, G. H. Kumar, S. V. M. Kumar, and M. Harish, "Churn prediction of customer in telecom industry using machine learning algorithms," Int. J. Eng. Res. Technol., vol. 9, no. 5, pp. 181–184, 2020.

D. Simester, A. Timoshenko, and S. I. Zoumpoulis, "Targeting prospective customers: Robustness of machine-learning methods to typical data challenges," Manage. Sci., vol. 66, no. 6, pp. 2495–2522, 2020.

M. Lee, W. Kwon, and K.-J. Back, "Artificial intelligence for hospitality big data analytics: developing a prediction model of restaurant review helpfulness for customer decision-making," Int. J. Contemp. Hosp. Manag., vol. 33, no. 6, pp. 2117–2136, 2021.

R. Saldanha, "Superstore Marketing Campaign Dataset," Kaggle.com, 2023. https://www.kaggle.com/rodsaldanha/arketing-campaign

SAS Institute Inc., "Introduction to SEMMA," SAS ® Enterprise Miner TM 14.3: Reference Help SAS ® Documentation, 2017. https://documentation.sas.com/doc/en/emref/14.3/n061bzurmej4j3n1jnj8bbjjm1a2.htm

SAS, "SAS Veya for Learner 3.5," 2023. https://documentation.sas.com/api/collections/pgmsascdc/9.4_3.5/docsets/pgmdiff/content/pgmdiff.pdf?locale=en

SAS Help Center, “SAS Viya | SAS.” https://www.sas.com/en_us/software/viya.html

H. Shen, H. Jin, Á. A. Cabrera, A. Perer, H. Zhu, and J. I. Hong, "Designing Alternative Representations of Confusion Matrices to Support Non-Expert Public Understanding of Algorithm Performance," Proc. ACM Human-Computer Interact., vol. 4, no. CSCW2, pp. 1–22, 2020, doi: 10.1145/3415224.

Y. Zhang, Q. Vera Liao, and R. K. E. Bellamy, "Efect of confidence and explanation on accuracy and trust calibration in AI-assisted decision making," in FAT* 2020 - Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency, 2020, pp. 295–305. doi: 10.1145/3351095.3372852.

A. A. Jamjoom, "The use of knowledge extraction in predicting customer churn in B2B," J. Big Data, vol. 8, no. 1, p. 110, 2021, doi: 10.1186/s40537-021-00500-3.

E. T. Lau, L. Sun, and Q. Yang, "Modelling, prediction and classification of student academic performance using artificial neural networks," SN Appl. Sci., vol. 1, no. 9, pp. 1–10, 2019, doi: 10.1007/s42452-019-0884-7.

S. Pérez-Fernández, P. Martínez-Camblor, P. Filzmoser, and N. Corral, "Visualizing the decision rules behind the ROC curves: understanding the classification process," AStA Adv. Stat. Anal., vol. 105, no. 1, pp. 135–161, 2021, doi: 10.1007/s10182-020-00385-2.

S. Nooruddin, M. Milon Islam, and F. A. Sharna, "An IoT based device-type invariant fall detection system," Internet of Things (Netherlands), vol. 9, p. 100130, 2020, doi: 10.1016/j.iot.2019.100130.

G. Rong et al., "Rainfall induced landslide susceptibility mapping based on Bayesian optimized random forest and gradient boosting decision tree models—A case study of Shuicheng County, China," Water, vol. 12, no. 11, p. 3066, 2020.

L. M. Dalbah, S. Ali, and G. Al-Naymat, "An Interactive Dashboard for Predicting Bank Customer Attrition," in 2022 International Conference on Emerging Trends in Computing and Engineering Applications, ETCEA 2022 - Proceedings, 2022, pp. 1–6. doi: 10.1109/ETCEA57049.2022.10009818.

M. Pazzani, C. Merz, P. Murphy, K. Ali, T. Hume, and C. Brunk, "Reducing misclassification costs," in Machine Learning Proceedings 1994, Elsevier, 1994, pp. 217–225.

D. Singh, "Polyth-Net: Classification of Polythene Bags for Garbage Segregation Using Deep Learning," in 2021 International Conference on Sustainable Energy and Future Electric Transportation, SeFet 2021, 2021, pp. 1–4. doi: 10.1109/SeFet48154.2021.9375766.