In this tutorial, we build an advanced explainable AI analysis pipeline using SHAP-IQ to understand both feature importance and interaction effects directly inside our Python environment. We load a real-world dataset, train a high-performance Random Forest model, and then apply the SHAP-IQ interaction index to compute precise, theoretically grounded explanations of model predictions. We extract main effects, pairwise interaction effects, and decision breakdown contributions, and we present them through structured terminal outputs and interactive Plotly visualizations. Also, we move beyond basic explainability and gain deep insight into how individual features and their interactions influence model decisions at both the local and global levels.<\/p>\n
import sys, subprocess, textwrap, numpy as np, pandas as pd\n\n\ndef _pip(*pkgs):\n subprocess.run([sys.executable, \"-m\", \"pip\", \"install\", \"-q\", *pkgs], check=False)\n\n\n_pip(\"shapiq\", \"plotly\", \"pandas\", \"numpy\", \"scikit-learn\")\n\n\nimport plotly.express as px\nimport plotly.graph_objects as go\nimport plotly.io as pio\nimport shapiq\nfrom sklearn.ensemble import RandomForestRegressor\nfrom sklearn.model_selection import train_test_split\n\n\ntry:\n pio.renderers.default = \"colab\"\nexcept Exception:\n pass\n\n\nRANDOM_STATE = 42\nINDEX = \"SII\"\nMAX_ORDER = 2\nBUDGET_LOCAL = 512\nTOP_K = 10\nINSTANCE_I = 24\nGLOBAL_ON = True\nGLOBAL_N = 40\nBUDGET_GLOBAL = 256<\/code><\/pre>\n<\/div>\n<\/div>\nWe install and import all the required libraries, including shapiq, Plotly, pandas, NumPy, and scikit-learn, ensuring our environment is fully prepared for explainable AI analysis. We configure Plotly to render visualizations directly in the notebook or terminal so we can view results without needing any external dashboard. We also define global configuration parameters, such as the interaction index, explanation budget, and global analysis settings, to control the depth, accuracy, and performance of our explainability pipeline.<\/p>\n
\n\n\n\n<\/div>\n<\/div>\n<\/div>\n<\/div>\nCopy Code<\/span>Copied<\/span>Use a different Browser<\/span><\/a><\/div>\n<\/div>\ndef extract_main_effects(iv, feature_names):\n d = iv.dict_values\n vals = [float(d.get((i,), 0.0)) for i in range(len(feature_names))]\n return pd.Series(vals, index=list(feature_names), name=\"main_effect\")\n\n\ndef extract_pair_matrix(iv, feature_names):\n d = iv.dict_values\n n = len(feature_names)\n M = np.zeros((n, n), dtype=float)\n for k, v in d.items():\n if isinstance(k, tuple) and len(k) == 2:\n i, j = k\n M[i, j] = float(v)\n M[j, i] = float(v)\n return pd.DataFrame(M, index=list(feature_names), columns=list(feature_names))\n\n\ndef ascii_bar(series, width=28, top_k=10):\n s = series.abs().sort_values(ascending=False).head(top_k)\n m = float(s.max()) if len(s) else 1.0\n lines = []\n for name, val in s.items():\n n = int((abs(val) \/ m) * width) if m > 0 else 0\n lines.append(f\"{name:>18} | {'\u2588'*n}{' '*(width-n)} | {val:+.6f}\")\n return \"n\".join(lines)<\/code><\/pre>\n<\/div>\n<\/div>\nWe implement utility functions that extract the main effects and pairwise interaction effects from the SHAP-IQ InteractionValues object. We convert the raw explanation output into structured Pandas objects, allowing us to analyze feature contributions in a clear, organized manner. We also create an ASCII visualization function that lets us interpret feature importance directly in the terminal without relying on graphical interfaces.<\/p>\n
\n\n\n\n<\/div>\n<\/div>\n<\/div>\n<\/div>\nCopy Code<\/span>Copied<\/span>Use a different Browser<\/span><\/a><\/div>\n<\/div>\ndef plot_local_feature_bar(main_effects, top_k):\n df = main_effects.abs().sort_values(ascending=False).head(top_k).reset_index()\n df.columns = [\"feature\", \"abs_main_effect\"]\n fig = px.bar(df, x=\"abs_main_effect\", y=\"feature\", orientation=\"h\", title=\"Local Feature Importance (|Main Effects|)\")\n fig.update_layout(yaxis={\"categoryorder\": \"total ascending\"})\n return fig\n\n\ndef plot_local_interaction_heatmap(pair_df, top_features):\n sub = pair_df.loc[top_features, top_features]\n fig = px.imshow(sub.values, x=sub.columns, y=sub.index, aspect=\"auto\", title=\"Local Pairwise Interaction Importance (values)\")\n return fig\n\n\ndef plot_waterfall(baseline, main_effects, top_k):\n contrib = main_effects.copy()\n top = contrib.reindex(contrib.abs().sort_values(ascending=False).head(top_k).index)\n remainder = float(contrib.sum() - top.sum())\n labels = [\"baseline\"] + list(top.index) + ([\"others\"] if abs(remainder) > 1e-12 else []) + [\"prediction\"]\n measures = [\"absolute\"] + [\"relative\"] * len(top) + ([\"relative\"] if abs(remainder) > 1e-12 else []) + [\"total\"]\n y = [0.0] + [float(v) for v in top.values] + ([float(remainder)] if abs(remainder) > 1e-12 else []) + [0.0]\n fig = go.Figure(go.Waterfall(x=labels, y=y, measure=measures, orientation=\"v\", connector={\"line\": {\"width\": 1}}))\n fig.update_layout(title=\"Decision Breakdown (Baseline \u2192 Prediction via Main Effects)\", showlegend=False)\n return fig<\/code><\/pre>\n<\/div>\n<\/div>\nWe use Plotly to visualize feature importance, interaction strength, and decision breakdown. We create a bar chart to visualize feature importance, a heatmap to show pairwise interaction effects, and a waterfall plot to illustrate how individual features contribute to the final prediction. These visualizations allow us to transform raw explainability data into intuitive graphical insights that make model behavior easier to understand.<\/p>\n
\n\n\n\n<\/div>\n<\/div>\n<\/div>\n<\/div>\nCopy Code<\/span>Copied<\/span>Use a different Browser<\/span><\/a><\/div>\n<\/div>\ndef global_summaries(explainer, X_samples, feature_names, budget, seed=123):\n main_abs = np.zeros(len(feature_names), dtype=float)\n pair_abs = np.zeros((len(feature_names), len(feature_names)), dtype=float)\n for t, x in enumerate(X_samples):\n iv = explainer.explain(x, budget=int(budget), random_state=int(seed + t))\n main = extract_main_effects(iv, feature_names).values\n pair = extract_pair_matrix(iv, feature_names).values\n main_abs += np.abs(main)\n pair_abs += np.abs(pair)\n main_abs \/= max(1, len(X_samples))\n pair_abs \/= max(1, len(X_samples))\n main_df = pd.DataFrame({\"feature\": feature_names, \"mean_abs_main_effect\": main_abs}).sort_values(\"mean_abs_main_effect\", ascending=False)\n pair_df = pd.DataFrame(pair_abs, index=feature_names, columns=feature_names)\n return main_df, pair_df\n\n\nX, y = shapiq.load_california_housing()\n\n\nfeature_names = list(X_train.columns)\nn_features = len(feature_names)\n\n\nmodel = RandomForestRegressor(\n n_estimators=400,\n max_depth=max(3, n_features),\n max_features=2\/3,\n max_samples=2\/3,\n random_state=RANDOM_STATE,\n n_jobs=-1\n)\nmodel.fit(X_train.values, y_train.values)\n\n\nexplainer = shapiq.TabularExplainer(\n model=model.predict,\n data=X_train.values,\n index=INDEX,\n max_order=int(MAX_ORDER),\n)\n<\/code><\/pre>\n<\/div>\n<\/div>\nWe define a global explainability function that aggregates feature importance and interaction strength across multiple samples to identify overall model behavior. We load the dataset, split it into training and testing sets, and train a Random Forest model to serve as the predictive system we want to explain. We then initialize the SHAP-IQ explainer, which enables us to compute precise, theoretically grounded explanations for the model\u2019s predictions.<\/p>\n
\n\n\n\n<\/div>\n<\/div>\n<\/div>\n<\/div>\nCopy Code<\/span>Copied<\/span>Use a different Browser<\/span><\/a><\/div>\n<\/div>\nINSTANCE_I = int(np.clip(INSTANCE_I, 0, len(X_test)-1))\nx = X_test.iloc[INSTANCE_I].values\ny_true = float(y_test.iloc[INSTANCE_I])\npred = float(model.predict([x])[0])\n\n\niv = explainer.explain(x, budget=int(BUDGET_LOCAL), random_state=0)\nbaseline = float(getattr(iv, \"baseline_value\", 0.0))\n\n\nmain_effects = extract_main_effects(iv, feature_names)\npair_df = extract_pair_matrix(iv, feature_names)\n\n\nprint(\"n\" + \"=\"*90)\nprint(\"LOCAL EXPLANATION (single test instance)\")\nprint(\"=\"*90)\nprint(f\"Index={INDEX} | max_order={MAX_ORDER} | budget={BUDGET_LOCAL} | instance={INSTANCE_I}\")\nprint(f\"Prediction: {pred:.6f} | True: {y_true:.6f} | Baseline (if available): {baseline:.6f}\")\n\n\nprint(\"nTop main effects (signed):\")\ndisplay(main_effects.reindex(main_effects.abs().sort_values(ascending=False).head(TOP_K).index).to_frame())\n\n\nprint(\"nASCII view (signed main effects, top-k):\")\nprint(ascii_bar(main_effects, top_k=TOP_K))\n\n\nprint(\"nTop pairwise interactions by |value| (local):\")\npairs = []\nfor i in range(n_features):\n for j in range(i+1, n_features):\n v = float(pair_df.iat[i, j])\n pairs.append((feature_names[i], feature_names[j], v, abs(v)))\npairs_df = pd.DataFrame(pairs, columns=[\"feature_i\", \"feature_j\", \"interaction\", \"abs_interaction\"]).sort_values(\"abs_interaction\", ascending=False).head(min(25, len(pairs)))\ndisplay(pairs_df)\n\n\nfig1 = plot_local_feature_bar(main_effects, TOP_K)\nfig2 = plot_local_interaction_heatmap(pair_df, list(main_effects.abs().sort_values(ascending=False).head(TOP_K).index))\nfig3 = plot_waterfall(baseline, main_effects, TOP_K)\n\n\nfig1.show()\nfig2.show()\nfig3.show()\n\n\nif GLOBAL_ON:\n print(\"n\" + \"=\"*90)\n print(\"GLOBAL SUMMARIES (sampled over multiple test points)\")\n print(\"=\"*90)\n GLOBAL_N = int(np.clip(GLOBAL_N, 5, len(X_test)))\n sample = X_test.sample(n=GLOBAL_N, random_state=1).values\n\n\n global_main, global_pair = global_summaries(\n explainer=explainer,\n X_samples=sample,\n feature_names=feature_names,\n budget=int(BUDGET_GLOBAL),\n seed=123,\n )\n\n\n print(f\"Samples={GLOBAL_N} | budget\/sample={BUDGET_GLOBAL}\")\n print(\"nGlobal feature importance (mean |main effect|):\")\n display(global_main.head(TOP_K))\n\n\n top_feats_global = list(global_main[\"feature\"].head(TOP_K).values)\n sub = global_pair.loc[top_feats_global, top_feats_global]\n\n\n figg1 = px.bar(global_main.head(TOP_K), x=\"mean_abs_main_effect\", y=\"feature\", orientation=\"h\", title=\"Global Feature Importance (mean |main effect|, sampled)\")\n figg1.update_layout(yaxis={\"categoryorder\": \"total ascending\"})\n figg2 = px.imshow(sub.values, x=sub.columns, y=sub.index, aspect=\"auto\", title=\"Global Pairwise Interaction Importance (mean |interaction|, sampled)\")\n\n\n figg1.show()\n figg2.show()\n\n\nprint(\"nDone. If you want it faster: lower budgets or GLOBAL_N, or set MAX_ORDER=1.\")\n\n\n<\/code><\/pre>\n<\/div>\n<\/div>\nWe generate local explanations for a specific prediction by computing main effects and interaction effects using SHAP-IQ. We display structured tables, ASCII summaries, and interactive visualizations that show how features and their interactions influence the model\u2019s decision. We also compute global summaries across multiple samples, enabling us to identify overall feature importance and interaction patterns across the entire model.<\/p>\n
In conclusion, we implemented a complete explainable AI workflow powered by SHAP-IQ, enabling us to quantify feature, interaction, and decision contributions in a rigorous and interpretable way. We analyzed individual predictions to understand the reasoning behind model outputs and extended this analysis to global summaries to identify overall patterns of feature influence. We visualized explanations using both structured tables and interactive plots, allowing us to interpret complex model behavior with clarity and precision.<\/p>\n
\nCheck out the\u00a0Full Codes here<\/a>.\u00a0<\/strong>Also,\u00a0feel free to follow us on\u00a0Twitter<\/mark><\/a><\/strong>\u00a0and don\u2019t forget to join our\u00a0120k+ ML SubReddit<\/a><\/strong>\u00a0and Subscribe to\u00a0our Newsletter<\/a><\/strong>. Wait! are you on telegram?\u00a0now you can join us on telegram as well.<\/a><\/strong><\/p>\nThe post How to Build an Explainable AI Analysis Pipeline Using SHAP-IQ to Understand Feature Importance, Interaction Effects, and Model Decision Breakdown<\/a> appeared first on MarkTechPost<\/a>.<\/p>","protected":false},"excerpt":{"rendered":"In this tutorial, we build an …<\/p>\n","protected":false},"author":1,"featured_media":29,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-494","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/connectword.dpdns.org\/index.php?rest_route=\/wp\/v2\/posts\/494","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/connectword.dpdns.org\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/connectword.dpdns.org\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/connectword.dpdns.org\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/connectword.dpdns.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=494"}],"version-history":[{"count":0,"href":"https:\/\/connectword.dpdns.org\/index.php?rest_route=\/wp\/v2\/posts\/494\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/connectword.dpdns.org\/index.php?rest_route=\/wp\/v2\/media\/29"}],"wp:attachment":[{"href":"https:\/\/connectword.dpdns.org\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=494"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/connectword.dpdns.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=494"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/connectword.dpdns.org\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=494"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}