ARTIFICIAL INTELLIGENCE, VULNERABILITY AND THE RIGHT TO HEALTH: RISKS OF ALGORITHMIC DISCRIMINATION AND CHALLENGES TO THE LEGAL PROTECTION OF PATIENTS
DOI:
https://doi.org/10.56238/levv17n61-044Keywords:
Artificial Intelligence, Right to Health, Vulnerability, Algorithmic Discrimination, Legal ProtectionAbstract
Considering the increasing incorporation of artificial intelligence into health services and the risks of reproducing inequalities through algorithmic systems, this article analyzes the impacts of these technologies on patients in vulnerable situations. It aims to discuss how the use of artificial intelligence in health care may affect the fundamental right to health, health care equity and the legal protection of patients, especially in view of the possibility of algorithmic discrimination. To this end, a qualitative, bibliographic and documentary study is carried out, guided by a legal-critical analysis, based on Brazilian legislation, international documents and scientific studies on artificial intelligence, vulnerability, data protection and fundamental rights. In this way, it is observed that algorithmic systems, when developed from incomplete, biased or poorly representative databases, may reproduce social, racial, economic and territorial inequalities already present in health systems. It is also verified that algorithmic opacity hinders transparency, the contestation of decisions and accountability for possible damages. It is concluded that artificial intelligence will only contribute to the realization of the right to health if it is subject to governance mechanisms, human supervision, auditing, protection of sensitive data and institutional accountability.
Downloads
References
ALDERMAN, J. E. et al. Tackling algorithmic bias and promoting transparency in health datasets: a systematic review and stakeholder survey. The Lancet Digital Health, London, v. 7, n. 1, p. e64-e88, 2025.
AYRES, J. R. C. M. et al. O conceito de vulnerabilidade e as práticas de saúde: novas perspectivas e desafios. In: CZERESNIA, D.; FREITAS, C. M. (org.). Promoção da saúde: conceitos, reflexões, tendências. Rio de Janeiro: Fiocruz, 2003. p. 117-139.
BRASIL. Constituição (1988). Constituição da República Federativa do Brasil. Brasília, DF: Senado Federal, 2022.
BRASIL. Lei nº 8.080, de 19 de setembro de 1990. Lei Orgânica da Saúde. Brasília, DF: Presidência da República, 1990.
BRASIL. Lei nº 13.709, de 14 de agosto de 2018. Lei Geral de Proteção de Dados Pessoais. Brasília, DF: Presidência da República, 2018.
BRASIL. Ministério da Saúde. Saúde lança painel de doenças e agravos na população por raça e cor. Brasília, DF: Ministério da Saúde, 2025.
CARY JR., M. P. et al. Building competency in artificial intelligence and bias mitigation among the health care workforce. Journal of Medical Internet Research, Toronto, 2025.
CROSS, J. L.; CHOMA, M. A.; ONOFREY, J. A. Bias in medical AI: implications for clinical decision-making. PLOS Digital Health, San Francisco, v. 3, n. 11, e0000651, 2024.
DANKWA-MULLAN, I. Health equity and ethical considerations in using artificial intelligence in public health and medicine. Preventing Chronic Disease, Atlanta, v. 21, p. 1-9, 2024.
DE MICCO, F. et al. Artificial intelligence in healthcare: transforming patient safety and clinical risk management. Frontiers in Medicine, Lausanne, v. 12, p. 1-17, 2025.
FLORIDI, L. et al. AI4People: an ethical framework for a good AI society: opportunities, risks, principles, and recommendations. Minds and Machines, Dordrecht, v. 28, p. 689-707, 2018.
GADDAS, M. et al. Artificial intelligence in hospitals: legal uncertainties and emerging risks for patient safety. EXCLI Journal, Dortmund, v. 24, p. 824-827, 2025.
GIL, A. C. Como elaborar projetos de pesquisa. 4. ed. São Paulo: Atlas, 2002.
MELLO, M. M.; ROBERTS, J. L. Antidiscrimination law meets artificial intelligence: new requirements for health care organizations and insurers. JAMA Health Forum, Chicago, v. 5, n. 8, e243397, 2024.
MINAYO, M. C. S. O desafio do conhecimento: pesquisa qualitativa em saúde. 14. ed. São Paulo: Hucitec, 2014.
OBERMEYER, Z. et al. Dissecting racial bias in an algorithm used to manage the health of populations. Science, Washington, v. 366, n. 6464, p. 447-453, 2019.
OECD. AI in health: huge potential, huge risks. Paris: OECD Publishing, 2024.
PHAM, T. et al. Ethical and legal considerations in healthcare AI. Healthcare, Basel, v. 13, n. 7, p. 1-18, 2025.
TOMASIELLO, D. B. et al. Desigualdades raciais e de renda no acesso à saúde nas cidades brasileiras. Instituto de Pesquisa Econômica Aplicada, Brasília, DF, 2023.
UNESCO. Recommendation on the Ethics of Artificial Intelligence. Paris: UNESCO, 2021.
WEINER, E. B. et al. Ethical challenges and evolving strategies in the integration of artificial intelligence into clinical practice. PLOS Digital Health, San Francisco, v. 4, n. 4, e0000810, 2025.
WORLD HEALTH ORGANIZATION. Ethics and governance of artificial intelligence for health: WHO guidance. Geneva: World Health Organization, 2021.
WORLD HEALTH ORGANIZATION. Ethics and governance of artificial intelligence for health: guidance on large multi-modal models. Geneva: World Health Organization, 2025.
