Existing skin attributes detection methods usually initialize with a pre-trained Imagenet network and then fine-tune on a medical target task. However, we argue that such approaches are suboptimal because medical datasets are largely different from ImageNet and often contain limited training samples.
In this work, we propose Task Agnostic Transfer Learning (TATL), a novel framework motivated by dermatologists’ behaviors in the skincare context. Our method learns an attribute-agnostic segmenter that detects lesion skin regions and then transfers this knowledge to a set of attribute-specific classifiers to detect each particular attribute. Since TATL’s attribute-agnostic segmenter only detects skin attribute regions, it makes use of ample data from all attributes, allows transferring knowledge among features, and compensates for the lack of training data from rare attributes. The empirical results show that TATL not only works well with multiple architectures but also can achieve state-of-the-art performances while enjoying minimal model and computational complexities (30-50 times less than the number of parameters). We also provide theoretical insights and explanations for why our transfer learning framework performs well in practice.
The figure below demonstrates the usefulness of TATL when predicted lesion skin regions (predicted union) could cover both large regions as in Pigment Network and small disconnected regions as in Negative Network.
Ophthalmo-AI: Virtual Kick-off of the Ophthalmo-AI project (BMBF) in Saarbrücken, Sulzbach, Münster, Berlin and Heidelberg. In Ophthalmo-AI we aim at developing better diagnostic and therapeutic decision support in ophthalmology through effective collaboration of machine and human expertise (Interactive Machine Learning – IML).
The German Standardization Roadmap Artificial Intelligence has been published recently in November 2020. In medicine, secure framework conditions have to be created; and the legal context, economy, technical aspects, acceptance, privacy, data security, and ethical aspects have to be taken into account.
In the pAItient project, where DFKI is responsible for secure framework conditions of AI systems, we have now published our first paper that explicitely addresses these aspects and standardisation needs of image preprocessing guidelines which are naturally subject to GDPR and DSGVO.
pAItient: Virtual Kick-Off of the pAItient project (BMG) in Saarbrücken and Heidelberg. In pAItient we aim at automating the development of AI-based approaches in medicine (from the idea to translation into cross-site clinical routine).
KI-Para-Mi: Kick-off of the KI-Para-Mi Project (BMBF) as webinar in Munich and Saarbrücken. In KI-Para-Mi, we develop an intelligent personnel planning system for flexible shift scheduling in nursing, which above all takes into account the interests of the employees.
Lecturer at the 2019 UPLINX Machine Learning School. Michael Barz presents research topics from our group, e.g., how interactive machine learning and eye tracking can be used to support dementia patients in everyday life.
Multimodal Multisensor Interface Trilogy published
The Handbook of Multimodal-Multisensor Interfaces provides the first authoritative resource on what has become the dominant paradigm for new computer interfaces-user input involving new media (speech, multi-touch, hand and body gestures, facial expressions, writing) embedded in multimodal-multisensor interfaces. This three-volume handbook is written by international experts and pioneers in the field. It provides a textbook, reference, and technology roadmap for professionals working in this and related areas.
Daniel Sonntag becomes member of the German Delegation of Artificial Intelligence of the Canadian German Chamber of Industry and Commerce Inc.
Main scientific partner institutes include the Future Skills Centre – Ryerson University, the University of Toronto and the Vector Institute, main industrial partners include Element.AI, Zoom.AI, and Roche Canada.
Invited talk at The Future of Work & AI Conference, where experts from Germany and Canada discussed the newest developments in this field, took place on September 18th at the Ontario Investment and Trade Centre.
Contact: Canadian German Chamber of Industry and Commerce Inc. 480 University Ave, Suite 1500 Toronto, ON, M5G 1V2 Canada
Skincare: The Skincare project now uses the open-source architecture from the KDI project. The architecture has been published in the AI for Medicine Journal (ELSEVIER) and can be downloaded for free here.
Skincare: Kick-off of the Skincare Project (H2020, EIT Digital) at Degetel in Paris. In Skincare, we develop a mobile application for patients and health professionals in the context of skin cancer diagnosis and treatment.
The Handbook of Multimodal-Multisensor Interfaces: Signal Processing Architectures, and Detection of Emotion and Cognition. Volume 2 EDITORS: Oviatt, Sharon; Schuller, Bjorn; Cohen, Philip R; Sonntag, Daniel; Potamianos, Gerasimos; Krueger, Antonio PUBLISHER: Order link at Morgan and Claypool /ACM entry. This is a THREE volume series that presents the definitive state of the art and future directions of the field of Multimodal and Multi-Sensor interfaces.
KDI: The KDI project’s closing event took place on September 29, 2017 in the Berlin Museum of Medical History. The ruin of the former Rudolf Virchow Lecture Hall, with its historic charm, presented a unique event location that has made for an unforgettable experience.
10:00 – Introduction to clinical data intelligence
11:00 – Organisation of clincial data, data security
12:00 – Application scenarios
15:00 – External speakers
16:00 – Official Demo Event / Internal meeting with DLR and BMWi
Interakt: The Handbook of Multimodal-Multisensor Interfaces: Foundations, User Modeling, and Common Modality Combinations. Volume 1 EDITORS: Oviatt, Sharon; Schuller, Bjorn; Cohen, Philip R; Sonntag, Daniel; Potamianos, Gerasimos; Krueger, Antonio PUBLISHER: Morgan and Claypool/ACM Press. This is a THREE volume series that presents the definitive state of the art and future directions of the field of Multimodal and Multi-Sensor interfaces.
US President Barack Obama announced the Precision Medicine Initiative:
Tailoring treatments to individual patients has long been a goal in biomedicine, but US President Barack Obama gave this effort a big boost with his announcement in January of the Precision Medicine Initiative (PMI). As part of the US$215-million programme, which will award its first grants next year, the NIH and partner organizations will recruit one million people across the country, collecting genetic information, health records and even data from electronic health-monitoring devices. Researchers will use the information to look for links between disease risk and genetic and environmental factors.
EIT MCPS: Presentation of full Medical CPS architecture at CBMS 2014 in New York, Mount Sinai Hospital
The Medical Cyber-Physical Systems Activity at EIT: A Look under the Hood
Proceedings of the 27th International Symposium on Computer-Based Medical Systems (CBMS), IEEE 2014
Contact: Daniel Sonntag, DFKI
ERmed: First evaluation on the ability to accurately focus on virtual icons in each of several focus planes despite having only monocular depth ques, confirming the viability of these methods for interaction.
First Demo of THESEUS MEDICO Radpeech at ISI Erlangen.
Professor Alexander Cavallaro’s vision of the educated lymphoma patient of the future is very different from today’s patient, who carries the computed tomography (CT) images of his lungs and abdomen home on a CD or DVD after a routine radiological examination.
How semantic technologies can be applied to medicine was illustrated by the THESEUS MEDICO research project, which brought together radiologists from the University of Erlangen, experts from the German Research Center on Artificial Intelligence (DFKI), as well as researchers from Siemens, the Fraunhofer Society, and TUM (Technische Universität München). “MEDICO” was one of several cases put forward for the use of the THESEUS research program, which was initiated by the German Federal Ministry of Economics and Technology in 2007, in order to support technologies for an “Internet of services.