Many countries around the world face a shortage of medical personnel, leading to work overload or even burnout. This calls for political and scientific solutions to relieve the medical personnel. The measurement of vital signs in hospitals is still predominately carried out manually with traditional contact-based methods, taking over a substantial share of the medical personnel’s workload. The introduction of contactless methods for vital sign monitoring (e.g., with a camera) has great potential to relieve the medical personnel. This systematic review’s objective is to analyze the state of the art in the field of contactless optical patient diagnosis. This review distinguishes itself from already existing reviews by considering studies that do not only propose the contactless measurement of vital signs but also include an automatic diagnosis of the patient’s condition. This means that the included studies incorporate the physician’s reasoning and evaluation of vital signs into their algorithms, allowing an automated patient diagnosis. The literature screening of two independent reviewers resulted in a total of five eligible studies. The highest number of studies (three) introduce methods for the risk assessment of infectious diseases, one study introduces a method for the risk assessment of cardiovascular diseases, and one study introduces a method for the diagnosis of obstructive sleep apnea. Overall, high heterogeneity in relevant study parameters is reported among the included studies. The low number of included studies indicates a large research gap and emphasizes the demand for further research on this emerging topic.