INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS AND DATA SCIENCE

Scalable Bayesian Learning with Localized Global Approximations

1.University of North Texas

Published in issue

October 2026

Volume / Issue

Vol. 1 No. 2

Access

Open access

View PDF

The article details presented on this page reflect the published version of record. Readers may access the full-text PDF, review the citation information, and export the reference in supported citation formats.

Abstract

This paper addresses the challenge of applying Bayesian parameter learning to extensive datasets and complex models, a scenario where traditional Expectation Propagation (EP) faces significant memory limitations. We introduce Stochastic Expectation Propagation (SEP), an innovative algorithm designed to maintain a global posterior approximation while leveraging local update mechanisms akin to EP. This method effectively combines the accuracy characteristics of EP with a substantial reduction in memory footprint, scaling inversely with dataset size. Evaluations across various datasets demonstrate that SEP achieves performance comparable to full EP, providing an efficient pathway for robust Bayesian inference in large-scale data environments.
Keywords:Variational InferenceStochastic ApproximationExpectation PropagationBayesian InferenceLarge-Scale Learning

Cite this Article

Use the following citation when referencing this publication in academic or professional work.

D. G. Battina, "Scalable Bayesian Learning with Localized Global Approximations", Int. J. Intell. Syst. Data Sci., vol. 1, no. 2, Oct. 2026, doi: https://doi.org/10.67231/yw1dyh29.

DOWNLOAD CITATION