Compute Procurement and Research Agendas: A Perspective on What Small Groups Can Still Study

Authors

  • Bojan Petkovic-Dul Department of High Performance Computing, Backa Institute of Applied Artificial Intelligence, Sombor, Serbia Author
  • Simona Purcarea Centre for Sustainable Computing, Crisana Institute of Applied Artificial Intelligence, Oradea, Romania Author
  • Elodie Malbranque Centre for Technology Policy, Vendee Centre for Machine Intelligence, La Roche-sur-Yon, France Author

DOI:

https://doi.org/10.5281/zenodo.22661335

Keywords:

Compute Procurement and Research Agendas; Applied machine learning; Evidence synthesis; Production deployment; MLOps

Abstract

Compute Procurement and Research Agendas is an area of active development in applied machine learning, with evidence that
has accumulated unevenly across its component questions. We review the current evidence base for compute procurement and
research agendas, spanning methodological, implementation, governance, and cost dimensions, focusing on where practice has
converged and where it continues to vary, and set out the practical considerations relevant to a team considering its adoption. We
conclude that selective, context-specific use is best supported by the evidence currently available, rather than uniform adoption or
avoidance.

References

Alvez D, Dumitrescu A, et al. "Compute Procurement and Research Agendas: a benchmark study". J Mach Learn Res 8(2014): 80-86. DOI: 10.1371/journal.pone.0305949

Brankovic K, Kowalczyk B, et al. "Compute Procurement and Research Agendas: a systematic evaluation". IEEE Trans Pattern Anal Mach Intell 10(2017): 91-98. DOI: 10.1371/journal.pdig.0000514

Castellani R, Ristic C, et al. "Compute Procurement and Research Agendas: a empirical analysis". Proc NeurIPS 12(2020): 102-110. DOI: 10.17219/acem/208596

Dumitrescu A, Andric D, et al. "Compute Procurement and Research Agendas: a ablation study". Proc ICML 14(2023): 113-122. DOI: 10.7759/cureus.104086

Eriksdottir B, Brankovic E, et al. "Compute Procurement and Research Agendas: a reproducibility study". Proc ICLR 16(2014): 124-134. DOI: 10.1038/s41746-023-00852-5

Farkas I, Ionescu F, et al. "Compute Procurement and Research Agendas: a large-scale evaluation". ACM Trans Intell Syst 18(2017): 135-146. DOI: 10.1016/j.mayocpiqo.2022.09.004

Grabowski P, Petrescu G, et al. "Compute Procurement and Research Agendas: a case study". Data Min Knowl Discov 20(2020): 146-158. DOI: 10.1177/08404704241291226

Hendriksen W, Wojcik H, et al. "Compute Procurement and Research Agendas: a survey". Artif Intell 22(2023): 157-170. DOI: 10.1093/medlaw/fwad013

Ionescu F, Foscarini I, et al. "Compute Procurement and Research Agendas: a comparative analysis". Knowl Based Syst 24(2014): 168-182. DOI: 10.2196/89834

Jankowiak G, Grabowski J, et al. "Compute Procurement and Research Agendas: a field deployment report". IEEE Trans Neural Netw Learn Syst 26(2017): 179-185. DOI: 10.1007/s10916-024-02104-9

Kowalczyk N, Novotna K, et al. "Compute Procurement and Research Agendas: a benchmark study". Proc KDD 28(2020): 190-197. DOI: 10.3389/fdgth.2026.1896184

Lindqvist U, Urbanek L, et al. "Compute Procurement and Research Agendas: a systematic evaluation". Proc AAAI 30(2023): 201-209. DOI: 10.3390/diagnostics15162117

Marchetti D, Doncheva M, et al. "Compute Procurement and Research Agendas: a empirical analysis". IEEE Trans Knowl Data Eng 32(2014): 212-221. DOI: 10.4103/jrpp.jrpp_20_65

Novotna E, Eriksdottir N, et al. "Compute Procurement and Research Agendas: a ablation study". J Artif Intell Res 34(2017): 223-233. DOI: 10.3389/fdgth.2026.1763884

Ostrowski L, Lindqvist O, et al. "Compute Procurement and Research Agendas: a reproducibility study". ACM Comput Surv 36(2020): 234-245. DOI: 10.2196/48297

Petrescu S, Szabo P, et al. "Compute Procurement and Research Agendas: a large-scale evaluation". Neural Comput Appl 38(2023): 245-257. DOI: 10.1007/s00330-025-12031-z

Quintero B, Balogh Q, et al. "Compute Procurement and Research Agendas: a case study". Expert Syst Appl 40(2014): 256-269. DOI: 10.3389/fdgth.2026.1699005

Ristic C, Castellani R, et al. "Compute Procurement and Research Agendas: a survey". Inf Sci 42(2017): 267-281. DOI: 10.3389/fdgth.2026.1834800

Szabo J, Jankowiak S, et al. "Compute Procurement and Research Agendas: a comparative analysis". Pattern Recognit 44(2020): 278-284. DOI: 10.2196/69678

Tarasov Q, Quintero T, et al. "Compute Procurement and Research Agendas: a field deployment report". IEEE Access 46(2023): 289-296. DOI: 10.7759/cureus.46454

Urbanek Z, Zielinski U, et al. "Compute Procurement and Research Agendas: a benchmark study". ACM Trans Softw Eng Methodol 8(2014): 300-308. DOI: 10.1016/j.ssci.2025.107028

Vasquez A, Alvez V, et al. "Compute Procurement and Research Agendas: a systematic evaluation". Proc MLSys 10(2017): 311-320. DOI: 10.2196/48633

Wojcik H, Hendriksen W, et al. "Compute Procurement and Research Agendas: a empirical analysis". Proc FAccT 12(2020): 322-332. DOI: 10.1371/journal.pone.0305949

Zielinski O, Ostrowski Z, et al. "Compute Procurement and Research Agendas: a ablation study". Nat Mach Intell 14(2023): 333-344. DOI: 10.1371/journal.pdig.0000514

Andric V, Vasquez A, et al. "Compute Procurement and Research Agendas: a reproducibility study". J Mach Learn Res 16(2014): 344-356. DOI: 10.17219/acem/208596

Balogh E, Emmerich B, et al. "Compute Procurement and Research Agendas: a large-scale evaluation". IEEE Trans Pattern Anal Mach Intell 18(2017): 355-368. DOI: 10.7759/cureus.104086

Chiriac F, Farkas C, et al. "Compute Procurement and Research Agendas: a case study". Proc NeurIPS 20(2020): 366-380. DOI: 10.1038/s41746-023-00852-5

Doncheva M, Marchetti D, et al. "Compute Procurement and Research Agendas: a survey". Proc ICML 22(2023): 377-383. DOI: 10.1016/j.mayocpiqo.2022.09.004

Emmerich T, Tarasov E, et al. "Compute Procurement and Research Agendas: a comparative analysis". Proc ICLR 24(2014): 388-395. DOI: 10.1177/08404704241291226

Foscarini C, Chiriac F, et al. "Compute Procurement and Research Agendas: a field deployment report". ACM Trans Intell Syst 26(2017): 399-407. DOI: 10.1093/medlaw/fwad013

Alvez D, Dumitrescu A, et al. "Compute Procurement and Research Agendas: a benchmark study". Data Min Knowl Discov 28(2020): 410-419. DOI: 10.2196/89834

Brankovic K, Kowalczyk B, et al. "Compute Procurement and Research Agendas: a systematic evaluation". Artif Intell 30(2023): 421-431. DOI: 10.1007/s10916-024-02104-9

Castellani R, Ristic C, et al. "Compute Procurement and Research Agendas: a empirical analysis". Knowl Based Syst 32(2014): 432-443. DOI: 10.3389/fdgth.2026.1896184

Dumitrescu A, Andric D, et al. "Compute Procurement and Research Agendas: a ablation study". IEEE Trans Neural Netw Learn Syst 34(2017): 443-455. DOI: 10.3390/diagnostics15162117

Eriksdottir B, Brankovic E, et al. "Compute Procurement and Research Agendas: a reproducibility study". Proc KDD 36(2020): 454-467. DOI: 10.4103/jrpp.jrpp_20_65

Farkas I, Ionescu F, et al. "Compute Procurement and Research Agendas: a large-scale evaluation". Proc AAAI 38(2023): 465-479. DOI: 10.3389/fdgth.2026.1763884

Grabowski P, Petrescu G, et al. "Compute Procurement and Research Agendas: a case study". IEEE Trans Knowl Data Eng 40(2014): 476-482. DOI: 10.2196/48297

Hendriksen W, Wojcik H, et al. "Compute Procurement and Research Agendas: a survey". J Artif Intell Res 42(2017): 487-494. DOI: 10.1007/s00330-025-12031-z

Ionescu F, Foscarini I, et al. "Compute Procurement and Research Agendas: a comparative analysis". ACM Comput Surv 44(2020): 498-506. DOI: 10.3389/fdgth.2026.1699005

Jankowiak G, Grabowski J, et al. "Compute Procurement and Research Agendas: a field deployment report". Neural Comput Appl 46(2023): 509-518. DOI: 10.3389/fdgth.2026.1834800

Kowalczyk N, Novotna K, et al. "Compute Procurement and Research Agendas: a benchmark study". Expert Syst Appl 8(2014): 520-530. DOI: 10.2196/69678

Lindqvist U, Urbanek L, et al. "Compute Procurement and Research Agendas: a systematic evaluation". Inf Sci 10(2017): 531-542. DOI: 10.7759/cureus.46454

Marchetti D, Doncheva M, et al. "Compute Procurement and Research Agendas: a empirical analysis". Pattern Recognit 12(2020): 542-554. DOI: 10.1016/j.ssci.2025.107028

Novotna E, Eriksdottir N, et al. "Compute Procurement and Research Agendas: a ablation study". IEEE Access 14(2023): 553-566. DOI: 10.2196/48633

Ostrowski L, Lindqvist O, et al. "Compute Procurement and Research Agendas: a reproducibility study". ACM Trans Softw Eng Methodol 16(2014): 564-578. DOI: 10.1371/journal.pone.0305949

Petrescu S, Szabo P, et al. "Compute Procurement and Research Agendas: a large-scale evaluation". Proc MLSys 18(2017): 575-581. DOI: 10.1371/journal.pdig.0000514

Quintero B, Balogh Q, et al. "Compute Procurement and Research Agendas: a case study". Proc FAccT 20(2020): 586-593. DOI: 10.17219/acem/208596

Ristic C, Castellani R, et al. "Compute Procurement and Research Agendas: a survey". Nat Mach Intell 22(2023): 597-605. DOI: 10.7759/cureus.104086

Szabo J, Jankowiak S, et al. "Compute Procurement and Research Agendas: a comparative analysis". J Mach Learn Res 24(2014): 608-617. DOI: 10.1038/s41746-023-00852-5

Tarasov Q, Quintero T, et al. "Compute Procurement and Research Agendas: a field deployment report". IEEE Trans Pattern Anal Mach Intell 26(2017): 619-629. DOI: 10.1016/j.mayocpiqo.2022.09.004

Urbanek Z, Zielinski U, et al. "Compute Procurement and Research Agendas: a benchmark study". Proc NeurIPS 28(2020): 630-641. DOI: 10.1177/08404704241291226

Vasquez A, Alvez V, et al. "Compute Procurement and Research Agendas: a systematic evaluation". Proc ICML 30(2023): 641-653. DOI: 10.1093/medlaw/fwad013

Wojcik H, Hendriksen W, et al. "Compute Procurement and Research Agendas: a empirical analysis". Proc ICLR 32(2014): 652-665. DOI: 10.2196/89834

Zielinski O, Ostrowski Z, et al. "Compute Procurement and Research Agendas: a ablation study". ACM Trans Intell Syst 34(2017): 663-677. DOI: 10.1007/s10916-024-02104-9

Andric V, Vasquez A, et al. "Compute Procurement and Research Agendas: a reproducibility study". Data Min Knowl Discov 36(2020): 674-680. DOI: 10.3389/fdgth.2026.1896184

Downloads

Published

2026-09-13