AI framework intended to solve a problem of bias-variance tradeoff for supervised learning methods in real-life applications. The AI framework comprises of bootstrapping to create multiple training and testing data sets with various characteristics, design and analysis of statistical experiments to identify optimal feature subsets and optimal hyper-parameters for ML methods, data contamination to test for the robustness of the classifiers.
- Using ML methods by itself doesn’t ensure building classifiers that generalize well for new data
- Identifying optimal feature subsets and hyper-parameters of ML methods can be resolved using design and analysis of statistical experiments
- Using a bootstrapping approach to massive sampling of training and tests datasets with various data characteristics (e.g.: contaminated training sets) allows dealing with bias
- Developing of SAS-based table-driven environment allows managing all meta-data related to the proposed AI framework and creating interoperability with R libraries to accomplish variety of statistical and machine-learning tasks
- Computer programs in R and SAS that create AI framework are available on GitHub
Table of Contents
- Introduction to the AI framework
- Supervised Machine Learning and Its Deployment in SAS and R
- Bootstrap methods and Its Deployment in SAS and R
- Outliers Detection and Its Deployment in SAS and R
- Design of Experiment and Its Deployment in SAS and R
- Introduction to the SAS and R based table-driven environment
- Input Data component
- Design of Experiment for Machine-Learning component
- "Contaminated" Training Datasets Component
- Insurance Industry: Underwriters decision-making process
- Insurance Industry: Claims Modeling and Prediction
Tanya Kolosova is a statistician, software engineer, an educator, and a co-author of two books on statistical analysis and metadata-based applications development using SAS. Tanya is an actionable analytics expert, she has extensive knowledge of software development methods and technologies, artificial intelligence methods and algorithms, and statistically designed experiments.
Samuel Berestizhevsky is a statistician, researcher and software engineer. Together with Tanya, Samuel co-authored two books on statistical analysis and metadata-based applications development using SAS. Samuel is an innovator and an expert in the area of automated actionable analytics and artificial intelligence solutions. His extensive knowledge of software development methods, technologies and algorithms allows him to develop solutions on the cutting edge of science.