Risks and challenges
The publication highlights that the potential of these technologies depends not only on their technical capabilities but also on the institutional conditions that support their implementation.
One of the main challenges is preventing these systems from reproducing or amplifying inequalities embedded in historical data. Furthermore, due to their adaptive nature, these models require validation, monitoring, and continuous evaluation mechanisms to identify potential risks to safety, equity, and quality of care.
The document emphasizes the importance of high-quality data, interoperable digital infrastructure, appropriate governance frameworks, and technical and institutional capacities. It also underscores that human oversight must remain an essential component, ensuring that AI-generated recommendations strengthen, rather than replace, the judgment of health professionals and decision-makers. This approach aims to foster innovation without compromising patient safety, equity, or the protection of fundamental rights.