Feature Stores in Practice: A Case Study of Training-Serving Skew Across Four Production Pipelines

Authors

  • Berit Torgersen-Ho Department of Data Engineering, Sunnmore Institute of Applied Artificial Intelligence, Alesund, Norway Author
  • Annalisa Trevisiol Department of Machine Learning Operations, Ogliastra Institute of Applied Artificial Intelligence, Tortoli, Italy Author
  • Vasiliki Demertzis Department of Platform Engineering, Laconia Centre for Machine Intelligence, Sparti, Greece Author

DOI:

https://doi.org/10.5281/zenodo.22657199

Keywords:

Feature Stores in Practice; Applied machine learning; Evidence synthesis; Production deployment; MLOps

Abstract

Feature Stores in Practice is an area of active development in applied machine learning, with evidence that has accumulated
unevenly across its component questions. We review the current evidence base for feature stores in practice, spanning
methodological, implementation, governance, and cost dimensions, focusing on where practice has converged and where it
continues to vary, and set out the practical considerations relevant to a team considering its adoption. We conclude that selective,
context-specific use is best supported by the evidence currently available, rather than uniform adoption or avoidance.

References

Alvez D, Dumitrescu A, et al. "Feature Stores in Practice: a benchmark study". J Mach Learn Res 8(2014): 80-86. DOI: 10.2196/89834

Brankovic K, Kowalczyk B, et al. "Feature Stores in Practice: a systematic evaluation". IEEE Trans Pattern Anal Mach Intell 10(2017): 91-98. DOI: 10.1007/s10916-024-02104-9

Castellani R, Ristic C, et al. "Feature Stores in Practice: a empirical analysis". Proc NeurIPS 12(2020): 102-110. DOI: 10.3389/fdgth.2026.1896184

Dumitrescu A, Andric D, et al. "Feature Stores in Practice: a ablation study". Proc ICML 14(2023): 113-122. DOI: 10.3390/diagnostics15162117

Eriksdottir B, Brankovic E, et al. "Feature Stores in Practice: a reproducibility study". Proc ICLR 16(2014): 124-134. DOI: 10.4103/jrpp.jrpp_20_65 7

Farkas I, Ionescu F, et al. "Feature Stores in Practice: a large-scale evaluation". ACM Trans Intell Syst 18(2017): 135-146. DOI: 10.3389/fdgth.2026.1763884

Grabowski P, Petrescu G, et al. "Feature Stores in Practice: a case study". Data Min Knowl Discov 20(2020): 146-158. DOI: 10.2196/48297

Hendriksen W, Wojcik H, et al. "Feature Stores in Practice: a survey". Artif Intell 22(2023): 157-170. DOI: 10.1007/s00330-025-12031-z

Ionescu F, Foscarini I, et al. "Feature Stores in Practice: a comparative analysis". Knowl Based Syst 24(2014): 168-182. DOI:

3389/fdgth.2026.1699005 10. Jankowiak G, Grabowski J, et al. "Feature Stores in Practice: a field deployment report". IEEE Trans Neural Netw Learn Syst 26(2017): 179-185. DOI: 10.3389/fdgth.2026.1834800

Kowalczyk N, Novotna K, et al. "Feature Stores in Practice: a benchmark study". Proc KDD 28(2020): 190-197. DOI: 10.2196/69678

Lindqvist U, Urbanek L, et al. "Feature Stores in Practice: a systematic evaluation". Proc AAAI 30(2023): 201-209. DOI: 10.7759/cureus.46454

Marchetti D, Doncheva M, et al. "Feature Stores in Practice: a empirical analysis". IEEE Trans Knowl Data Eng 32(2014): 212-221. DOI: 10.1016/j.ssci.2025.107028

Novotna E, Eriksdottir N, et al. "Feature Stores in Practice: a ablation study". J Artif Intell Res 34(2017): 223-233. DOI: 10.2196/48633

Ostrowski L, Lindqvist O, et al. "Feature Stores in Practice: a reproducibility study". ACM Comput Surv 36(2020): 234-245. DOI: 10.1371/journal.pone.0305949

Petrescu S, Szabo P, et al. "Feature Stores in Practice: a large-scale evaluation". Neural Comput Appl 38(2023): 245-257. DOI: 10.1371/journal.pdig.0000514

Quintero B, Balogh Q, et al. "Feature Stores in Practice: a case study". Expert Syst Appl 40(2014): 256-269. DOI: 10.17219/acem/208596

Ristic C, Castellani R, et al. "Feature Stores in Practice: a survey". Inf Sci 42(2017): 267-281. DOI: 10.7759/cureus.104086

Szabo J, Jankowiak S, et al. "Feature Stores in Practice: a comparative analysis". Pattern Recognit 44(2020): 278-284. DOI: 10.1038/s41746-023-00852-5

Tarasov Q, Quintero T, et al. "Feature Stores in Practice: a field deployment report". IEEE Access 46(2023): 289-296. DOI: 10.1016/j.mayocpiqo.2022.09.004

Urbanek Z, Zielinski U, et al. "Feature Stores in Practice: a benchmark study". ACM Trans Softw Eng Methodol 8(2014): 300-308. DOI: 10.1177/08404704241291226

Vasquez A, Alvez V, et al. "Feature Stores in Practice: a systematic evaluation". Proc MLSys 10(2017): 311-320. DOI: 10.1093/medlaw/fwad013

Wojcik H, Hendriksen W, et al. "Feature Stores in Practice: a empirical analysis". Proc FAccT 12(2020): 322-332. DOI: 10.2196/89834

Zielinski O, Ostrowski Z, et al. "Feature Stores in Practice: a ablation study". Nat Mach Intell 14(2023): 333-344. DOI: 10.1007/s10916-024-02104-9

Andric V, Vasquez A, et al. "Feature Stores in Practice: a reproducibility study". J Mach Learn Res 16(2014): 344-356. DOI: 10.3389/fdgth.2026.1896184

Balogh E, Emmerich B, et al. "Feature Stores in Practice: a large-scale evaluation". IEEE Trans Pattern Anal Mach Intell 18(2017): 355-368. DOI: 10.3390/diagnostics15162117

Chiriac F, Farkas C, et al. "Feature Stores in Practice: a case study". Proc NeurIPS 20(2020): 366-380. DOI: 10.4103/jrpp.jrpp_20_65

Doncheva M, Marchetti D, et al. "Feature Stores in Practice: a survey". Proc ICML 22(2023): 377-383. DOI: 10.3389/fdgth.2026.1763884

Emmerich T, Tarasov E, et al. "Feature Stores in Practice: a comparative analysis". Proc ICLR 24(2014): 388-395. DOI: 10.2196/48297

Foscarini C, Chiriac F, et al. "Feature Stores in Practice: a field deployment report". ACM Trans Intell Syst 26(2017): 399-407. DOI: 10.1007/s00330-025-12031-z

Alvez D, Dumitrescu A, et al. "Feature Stores in Practice: a benchmark study". Data Min Knowl Discov 28(2020): 410-419. DOI: 10.3389/fdgth.2026.1699005

Brankovic K, Kowalczyk B, et al. "Feature Stores in Practice: a systematic evaluation". Artif Intell 30(2023): 421-431. DOI: 10.3389/fdgth.2026.1834800

Castellani R, Ristic C, et al. "Feature Stores in Practice: a empirical analysis". Knowl Based Syst 32(2014): 432-443. DOI: 10.2196/69678

Dumitrescu A, Andric D, et al. "Feature Stores in Practice: a ablation study". IEEE Trans Neural Netw Learn Syst 34(2017): 443-455. DOI: 10.7759/cureus.46454

Eriksdottir B, Brankovic E, et al. "Feature Stores in Practice: a reproducibility study". Proc KDD 36(2020): 454-467. DOI: 10.1016/j.ssci.2025.107028

Farkas I, Ionescu F, et al. "Feature Stores in Practice: a large-scale evaluation". Proc AAAI 38(2023): 465-479. DOI: 10.2196/48633

Grabowski P, Petrescu G, et al. "Feature Stores in Practice: a case study". IEEE Trans Knowl Data Eng 40(2014): 476-482. DOI: 10.1371/journal.pone.0305949

Hendriksen W, Wojcik H, et al. "Feature Stores in Practice: a survey". J Artif Intell Res 42(2017): 487-494. DOI: 10.1371/journal.pdig.0000514

Ionescu F, Foscarini I, et al. "Feature Stores in Practice: a comparative analysis". ACM Comput Surv 44(2020): 498-506. DOI: 10.17219/acem/208596

Jankowiak G, Grabowski J, et al. "Feature Stores in Practice: a field deployment report". Neural Comput Appl 46(2023): 509-518. DOI: 10.7759/cureus.104086

Kowalczyk N, Novotna K, et al. "Feature Stores in Practice: a benchmark study". Expert Syst Appl 8(2014): 520-530. DOI: 10.1038/s41746-023-00852-5

Lindqvist U, Urbanek L, et al. "Feature Stores in Practice: a systematic evaluation". Inf Sci 10(2017): 531-542. DOI: 10.1016/j.mayocpiqo.2022.09.004

Marchetti D, Doncheva M, et al. "Feature Stores in Practice: a empirical analysis". Pattern Recognit 12(2020): 542-554. DOI: 10.1177/08404704241291226

Novotna E, Eriksdottir N, et al. "Feature Stores in Practice: a ablation study". IEEE Access 14(2023): 553-566. DOI: 10.1093/medlaw/fwad013

Ostrowski L, Lindqvist O, et al. "Feature Stores in Practice: a reproducibility study". ACM Trans Softw Eng Methodol 16(2014): 564-578. DOI: 10.2196/89834

Petrescu S, Szabo P, et al. "Feature Stores in Practice: a large-scale evaluation". Proc MLSys 18(2017): 575-581. DOI: 10.1007/s10916-024-02104-9

Quintero B, Balogh Q, et al. "Feature Stores in Practice: a case study". Proc FAccT 20(2020): 586-593. DOI: 10.3389/fdgth.2026.1896184

Ristic C, Castellani R, et al. "Feature Stores in Practice: a survey". Nat Mach Intell 22(2023): 597-605. DOI: 10.3390/diagnostics15162117

Szabo J, Jankowiak S, et al. "Feature Stores in Practice: a comparative analysis". J Mach Learn Res 24(2014): 608-617. DOI: 10.4103/jrpp.jrpp_20_65

Tarasov Q, Quintero T, et al. "Feature Stores in Practice: a field deployment report". IEEE Trans Pattern Anal Mach Intell 26(2017): 619-629. DOI: 10.3389/fdgth.2026.1763884

Urbanek Z, Zielinski U, et al. "Feature Stores in Practice: a benchmark study". Proc NeurIPS 28(2020): 630-641. DOI: 10.2196/48297

Vasquez A, Alvez V, et al. "Feature Stores in Practice: a systematic evaluation". Proc ICML 30(2023): 641-653. DOI: 10.1007/s00330-025-12031-z

Wojcik H, Hendriksen W, et al. "Feature Stores in Practice: a empirical analysis". Proc ICLR 32(2014): 652-665. DOI: 10.3389/fdgth.2026.1699005

Zielinski O, Ostrowski Z, et al. "Feature Stores in Practice: a ablation study". ACM Trans Intell Syst 34(2017): 663-677. DOI: 10.3389/fdgth.2026.1834800

Andric V, Vasquez A, et al. "Feature Stores in Practice: a reproducibility study". Data Min Knowl Discov 36(2020): 674-680. DOI: 10.2196/69678

Downloads

Published

2022-02-12

Issue

Vol. 1 No. 1 (2022): Vol 1 Issue 1 2022

Section

Articles

License

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.