Authors:
Arunkumar Thirunagalingam
Addresses:
Department of Business Intelligence and Reporting, Santander Consumer, Texas, United States of America. arunkumar.thirunagalingam@gmail.com
Machine learning (ML) has become a transformative technology across industries, significantly enhancing automation, decision-making, and predictive modeling. However, biases present in data can unintentionally be reinforced or even amplified by ML algorithms, leading to unfair and potentially harmful outcomes. This study presents a comprehensive framework to address bias identification and mitigation within ML data pipelines, ensuring fairness and accuracy. We explore strategies for detecting and correcting bias across different stages of the ML pipeline, including pre-processing, in-processing, and post-processing methods. Each stage offers distinct opportunities for intervention to minimize bias effectively. Case examples illustrate the practical application of these strategies in real-world scenarios, providing a tangible view of how bias mitigation can be implemented across diverse applications. Validation results on datasets with known bias issues demonstrate the framework’s ability to reduce bias without compromising model performance. This approach emphasizes the importance of proactive bias management within ML development, encouraging ethical and equitable model outcomes across various industries.
Keywords: Machine Learning; Increased Demand; Decision-Making; Algorithm and Frameworks; Bias Detection; Machine Learning Techniques; Demographic Groups; Machine Learning Models.
Received on: 04/01/2024, Revised on: 11/03/2024, Accepted on: 01/05/2024, Published on: 07/06/2024
AVE Trends in Intelligent Computing Systems, 2024 Vol. 1 No. 2, Pages: 116-127