Mamba-Based Multimodal Learning for Automated Tumor Characterization and Clinical Decision Support in Precision Oncology

Authors

  • Chatresh Nagi School of Information Technology, University of Cincinnati, Cincinnati, OH, USA.
  • Nitesh Karan Department of Computer Science, George Mason University, Fairfax, VA, USA.
  • Maritta Dowerg School of Electrical Engineering and Computer Science, Oregon State University, Corvallis, OR, USA.

Keywords:

Mamba, multimodal learning, precision oncology, clinical decision support, tumor characterization, governance, health equity, deployment

Abstract

Precision oncology requires the synthesis of heterogeneous clinical evidence, including radiological imaging, digital pathology, genomic signatures, laboratory trends, treatment histories, and longitudinal outcomes. Although multimodal artificial intelligence has demonstrated promise for tumor characterization and clinical decision support, many existing architectures remain computationally expensive, difficult to govern, or poorly aligned with real-world clinical workflows. Mamba-based state space models have recently emerged as a compelling alternative because they can model long-range dependencies with linear-time sequence processing while preserving selective information routing. This paper examines the system-level implications of Mamba-based multimodal learning for automated tumor characterization and clinical decision support in precision oncology. It analyzes architectural trade-offs among transformers, convolutional networks, and selective state space models; discusses data infrastructure, interoperability, and secure deployment; and evaluates human factors, robustness, fairness, sustainability, and policy considerations. The central argument is that Mamba-based multimodal systems can reduce computational barriers to longitudinal oncology intelligence, but their clinical value depends less on isolated predictive accuracy than on integration with tumor board workflows, regulatory oversight, continuous monitoring, and equitable data governance. The paper concludes that precision oncology needs hybrid, auditable, and lifecycle-managed multimodal platforms rather than single-model solutions.

References

1. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, Ł., & Polosukhin, I. (2017). Attention is all you need. Advances in Neural Information Processing Systems, 30, 5998–6008.

2. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., Uszkoreit, J., & Houlsby, N. (2021). An image is worth 16x16 words: Transformers for image recognition at scale. International Conference on Learning Representations.

3. Gu, A., & Dao, T. (2023). Mamba: Linear-time sequence modeling with selective state spaces. arXiv. https://arxiv.org/abs/2312.00752

4. Dao, T., & Gu, A. (2024). Transformers are SSMs: Generalized models and efficient algorithms through structured state space duality. Proceedings of the 41st International Conference on Machine Learning, 10041–10071.

5. Acosta, J. N., Falcone, G. J., Rajpurkar, P., & Topol, E. J. (2022). Multimodal biomedical AI. Nature Medicine, 28(9), 1773–1784. https://doi.org/10.1038/s41591-022-01981-2

6. Rajpurkar, P., Chen, E., Banerjee, O., & Topol, E. J. (2022). AI in health and medicine. Nature Medicine, 28(1), 31–38. https://doi.org/10.1038/s41591-021-01614-0

7. Topol, E. J. (2019). High-performance medicine: The convergence of human and artificial intelligence. Nature Medicine, 25(1), 44–56. https://doi.org/10.1038/s41591-018-0300-7

8. Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017). Dermatologist-level classification of skin cancer with deep neural networks. Nature, 542(7639), 115–118. https://doi.org/10.1038/nature21056

9. McKinney, S. M., Sieniek, M., Godbole, V., Godwin, J., Antropova, N., Ashrafian, H., Back, T., Chesus, M., Corrado, G. S., Darzi, A., Etemadi, M., Garcia-Vicente, F., Gilbert, F. J., Halling-Brown, M., Hassabis, D., Jansen, S., Karthikesalingam, A., Kelly, C. J., King, D., ... Shetty, S. (2020). International evaluation of an AI system for breast cancer screening. Nature, 577(7788), 89–94. https://doi.org/10.1038/s41586-019-1799-6

10. Chen, R. J., Lu, M. Y., Weng, W. H., Chen, T. Y., Williamson, D. F., Manz, T., Shady, M., & Mahmood, F. (2021). Multimodal co-attention transformer for survival prediction in gigapixel whole slide images. Proceedings of the IEEE/CVF International Conference on Computer Vision, 4015–4025. https://doi.org/10.1109/ICCV48922.2021.00399

11. Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., Krueger, G., & Sutskever, I. (2021). Learning transferable visual models from natural language supervision. Proceedings of the 38th International Conference on Machine Learning, 8748–8763.

12. Huang, K., Altosaar, J., & Ranganath, R. (2019). ClinicalBERT: Modeling clinical notes and predicting hospital readmission. arXiv. https://arxiv.org/abs/1904.05342

13. Singhal, K., Azizi, S., Tu, T., Mahdavi, S. S., Wei, J., Chung, H. W., Scales, N., Tanwani, A., Cole-Lewis, H., Pfohl, S., Payne, P., Seneviratne, M., Gambhir, S. S., Nirschl, C., & Natarajan, V. (2023). Large language models encode clinical knowledge. Nature, 620(7972), 172–180. https://doi.org/10.1038/s41586-023-06291-2

14. Moor, M., Banerjee, O., Abad, Z. S. H., Krumholz, H. M., Leskovec, J., Topol, E. J., & Rajpurkar, P. (2023). Foundation models for generalist medical artificial intelligence. Nature, 616(7956), 259–265. https://doi.org/10.1038/s41586-023-05881-4

15. Zhou, Y., Chia, M. A., Wagner, S. K., Ayhan, M. S., Williamson, D. J., Struyven, R. R., Liu, T., Xu, M., Lozano, M. G., Woodward-Court, P., Kihara, Y., Allen, N., Alexander, D. C., Keane, P. A., & Denniston, A. K. (2023). A foundation model for generalizable disease detection from retinal images. Nature, 622(7981), 156–163. https://doi.org/10.1038/s41586-023-06555-x

16. Zhang, Z., Ma, Q., Zhang, T., Chen, J., Zheng, H., & Gao, W. (2025). Switch-UMamba: Dynamic scanning vision Mamba UNet for medical image segmentation. Medical Image Analysis, 103792.

17. Wang, Z., Zheng, J. Q., Zhang, Y., Cui, G., & Li, L. (2024). Mamba-UNet: UNet-like pure visual Mamba for medical image segmentation. arXiv. https://arxiv.org/abs/2402.05079

18. Liu, Y., Tian, Y., Zhao, Y., Yu, H., Xie, L., Wang, Y., Ye, Q., & Liu, Y. (2024). VMamba: Visual state space model. arXiv. https://arxiv.org/abs/2401.10166

19. Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021). Swin Transformer: Hierarchical vision transformer using shifted windows. Proceedings of the IEEE/CVF International Conference on Computer Vision, 10012–10022. https://doi.org/10.1109/ICCV48922.2021.00986

20. Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019). Dissecting racial bias in an algorithm used to manage the health of populations. Science, 366(6464), 447–453. https://doi.org/10.1126/science.aax2342

Downloads

Published

2026-10-06

How to Cite

Chatresh Nagi, Nitesh Karan, & Maritta Dowerg. (2026). Mamba-Based Multimodal Learning for Automated Tumor Characterization and Clinical Decision Support in Precision Oncology. International Journal of Clinical and Translational Medicine, 1(1). Retrieved from https://www.ijctmed.org/index.php/home/article/view/232