Google Research 在《JAMA Dermatology》发表两项研究，探索 AI 帮助普通人理解自身皮肤问题。一项涉及 2345 名参与者的定量研究显示，AI 辅助显著提升了用户识别皮肤疾病名称的能力，并影响了其就医或自我护理的下一步决策。另一项混合方法研究对比了用户通过 AI 工具与医生对话获取的认知。这些工作基于此前开发的 AI 鉴别诊断模型和 SCIN 数据集，旨在通过高质量信息支持皮肤健康决策。
原文 · 未翻译
Research into how AI can help users understand skin conditions
Skip to main content Explore our many areas of focus
Explore all research areas
Applied AI & sciences
Earth AI Health AI Science AI Sustainability & crisis resilience
Foundational ML & algorithms
Algorithms & theory Information retrieval Machine intelligence Machine perception Natural language processing
People, systems & quantum AI
Human-computer interaction and visualization Networking Quantum AI Responsible AI Anti abuse Software engineering Software systems
Learn More
Publications Projects Building a collaborative ecosystem
Datasets Access high-quality datasets to accelerate your research. Tools & services Explore our latest AI models and products.
Open source Discover open-source code and collaborate with the community. Shaping the future together
See all programs
Faculty programs Participating in the academic research community through meaningful engagement with university faculty. Student programs Supporting the next generation of researchers through a wide range of programming.
Locations Find your place in our global offices and research labs. Translating discovery into real-world impact
People Our researchers drive advancements in computer science through both fundamental and applied research.
Teams Collaborative groups tackling the world's most challenging AI problems.
Research Explore our many areas of focus
Explore all research areas
Applied AI & sciences
Earth AI Health AI Science AI Sustainability & crisis resilience
Google Research 在《JAMA Dermatology》发表两项研究，探索 AI 帮助普通人理解自身皮肤问题。一项涉及 2345 名参与者的定量研究显示，AI 辅助显著提升了用户识别皮肤疾病名称的能力，并影响了其就医或自我护理的下一步决策。另一项混合方法研究对比了用户通过 AI 工具与医生对话获取的认知。这些工作基于此前开发的 AI 鉴别诊断模型和 SCIN 数据集，旨在通过高质量信息支持皮肤健康决策。
原文 · 保持原样，未翻译
Research into how AI can help users understand skin conditions
Skip to main content Explore our many areas of focus
Explore all research areas
Applied AI & sciences
Earth AI Health AI Science AI Sustainability & crisis resilience
Foundational ML & algorithms
Algorithms & theory Information retrieval Machine intelligence Machine perception Natural language processing
People, systems & quantum AI
Human-computer interaction and visualization Networking Quantum AI Responsible AI Anti abuse Software engineering Software systems
Foundational ML & algorithms
Algorithms & theory Information retrieval Machine intelligence Machine perception Natural language processing
People, systems & quantum AI
Human-computer interaction and visualization Networking Quantum AI Responsible AI Anti abuse Software engineering Software systems
Learn More
Publications Projects
Resources Building a collaborative ecosystem
Datasets Access high-quality datasets to accelerate your research. Tools & services Explore our latest AI models and products. Open source Discover open-source code and collaborate with the community.
Conferences & events
Careers Shaping the future together
See all programs
Faculty programs Participating in the academic research community through meaningful engagement with university faculty. Student programs Supporting the next generation of researchers through a wide range of programming. Locations Find your place in our global offices and research labs.
Blog
About Translating discovery into real-world impact
People Our researchers drive advancements in computer science through both fundamental and applied research. Teams Collaborative groups tackling the world's most challenging AI problems.
Google Research
Google AI Learn about all our AIGoogle DeepMind Explore the frontier of AIGoogle Labs Try our AI experiments
Research
Resources
Conferences & events
Careers
Blog
About
Search
Home 2. Blog Research into how AI can help users understand skin conditions
June 12, 2026
Rory Sayres and Yun Liu, Research Scientists, Google Research
We present recent published findings on how dermatology AI tools may help laypeople with their own skin-related questions. Quick links Paper 1 Paper 2 Share [](https://twitter.com/intent/tweet?text=https%3A//research.google/blog/research-into-how-ai-can-help-users-understand-skin-conditions/ "Share on Twitter") [](https://www.facebook.com/sharer/sharer.php?u=https%3A//research.google/blog/research-into-how-ai-can-help-users-understand-skin-conditions/ "Share on Facebook") [](https://www.linkedin.com/shareArticle?url=https%3A//research.google/blog/research-into-how-ai-can-help-users-understand-skin-conditions/&mini=true "Share on LinkedIn") [](mailto:name@example.com?subject=Check%20out%20this%20site&body=Check%20out%20https%3A//research.google/blog/research-into-how-ai-can-help-users-understand-skin-conditions/ "Send via Email") Copy link ×
More than half of adults use the Internet for health information, and one-third turn to artificial intelligence (AI). However, access to information does not mean that it is easy to understand or correctly interpreted. In short, the human component of AI for health information remains important to research to help people benefit from better health information.
Specifically, this is important in the space of dermatology (skin, hair, nails; henceforth “skin” for brevity) because people have trouble looking for the right information online related to their skin concern. For instance, you may notice “red dots on legs,” but not have the background knowledge to specifically search for “palpable purpura”.
Over the years, we have built a technical foundation in this area, including developing AI models to inform differential diagnoses, performing validation of model generalization00210-5/fulltext), and releasing datasets like SCIN to help clinicians and researchers. However, the most significant impact can only be realized by supporting the decision-making of people who have skin concerns through providing high-quality information.
To do this right, understanding how humans engage with AI to inform their decisions is critical. Previous studies evaluating non-AI tools have shown that while people might get better at identifying a condition using the internet, they don't necessarily get better at deciding what next steps to take. We need to ensure that as AI tools become available, we carefully study and improve upon the human factors to support people in making better decisions.
With the above in mind, today we share some of our recent and past research on consumer understanding of AI tools for their dermatology-related questions. These include a recent large-scale quantitative paper that demonstrates increased ability to name conditions with AI assistance, as well as some benefits in determining what next steps to take. It also includes an in-depth mixed-methods study addressing how people use these tools on their own skin concerns, and how the understanding they gain compares to that from conversation with doctors. Evaluating consumer understanding at scale
In “Consumer Understanding of Skin Concerns With an AI-Powered Informational Tool,” published this week in _JAMA Dermatology_, we investigated how structured AI assistance changes a user's ability to identify a condition and determine their next steps. We showed 2,345 survey participants retrospective, de-identified skin condition cases — complete with images and structured medical history — and asked them to imagine the cases were their own.
_Screenshot of the AI interface (specifically created on the survey platform for this research study) participants saw. They were presented with a case vignette (__A__), and provided with a scrollable carousel of predictions from an AI (__B__). If they clicked on a condition, they were given detailed information about the condition (__C__)._
Participants were randomized into three groups to research the cases: _(Negative) control_: Participants used existing tools they were familiar with, such as standard text-based web searches. _AI_: Participants used a prototype AI (user interface in figure above) that provided a scrollable carousel of 3 to 7 matching conditions based on an AI model's predictions, complete with textbook images and details about symptoms and treatments. _“__Wizard of Oz__” (positive control)_: Participants used the same AI interface, but the predicted conditions were actually the "ground truth" differentials provided by a panel of dermatologists, mimicking an AI that always matches the ground truth.
_Study design incorporating 3 arms, including both a negative control with AI access, and positive control (Wizard of Oz) that had “perfect predictions” matching the ground truth._
We found that AI assistance provided a statistically significant improvement for consumer understanding. When using the AI tool, participants were more willing to attempt to name the condition shown (over 62%) compared to the control group using standard search tools (41%).
More importantly, participants’ condition name guessing accuracy improved dramatically. Accuracy was nearly three times higher in the AI arm (23%) compared to the unassisted control arm (8%). In the "Wizard of Oz" arm, accuracy was about four times higher (36%), but still not near perfect. Having AI "cards" to display matching conditions also imparted significantly higher confidence in their condition guesses, and greater overall satisfaction with their search results and the time spent searching.
_Summary of main results__. Asterisks indicate statistically-significant differences. * (One asterisk): p < 0.05; (Two asterisks): p < 0.01; * (Three asterisks): p < 0.001. Condition name accuracy required a participant to both be willing to guess a condition name, and name a condition that matched the dermatologist differential (allowing for free-text name variations)._ The challenge of defining next steps
To avoid being prescriptive, the AI in our study was designed to focus on matching images to possible conditions and relying on the user to interpret what should be done. Our goal was to enable users to search efficiently and not to be prescriptive or diagnostic. In addition, the treatment and information given was written by dermatologists with access to authoritative sources, based purely on the condition name and not tailored to the specific severity of the condition in that case.
Perhaps because of the generality of information provided, deciding on the appropriate medical next steps, such as using a home remedy versus scheduling an urgent clinic visit, remained challenging for users. Our study found that while next-step accuracy increased by a small amount in the "Wizard of Oz" arm (63.5% vs 60% in control), the standard AI arm did not show a statistically significant improvement. Furthermore, participants in the AI arm were slightly more likely to suggest a less urgent next step than a dermatologist would, compared to the control group (30% vs 27%).
This reinforces that simply identifying the condition is not always enough. There is still progress to be made in designing tools that better inform laypeople about the safest and most appropriate next steps. Engaging communities for richer feedback
While large-scale survey studies are invaluable for understanding general trends, we also recognized the need to understand how people interpret information when it is directly relevant to their own concerns, rather than interpreting pictures of others’ conditions. To get this richer, more nuanced feedback, we sought deep, qualitative insights directly from the communities who stand to benefit most from these tools.
In "Navigating Skin Concerns with AI: A Human-Centered Investigation of a Dermatology App in a Diverse Community," published in theACM Computer-Human Interaction (CHI) conference last year, we collaborated with the Stanford Healthcare AI Applied Research Team (HEA 3 RT) and the Santa Clara Family Health Plan (SCFHP). SCFHP serves members of the surrounding community, many of whom rely on a healthcare safety net, Medi-Cal. Our goal was to study how diverse, consented participants with active skin concerns actually used and reacted to information from a skin AI system in a real-world setting.
Crucially, we wanted to ensure we were building for this community; since the participants spoke four primary languages, the AI application was translated into their respective languages. Volunteers or staff fluent in the respective language were also present to facilitate communication.
_Screenshots of the research app__, presented in four different languages._
In this real-world study, 110 consented participants used the app (and consulted with a clinician immediately after to clarify any concerns). Similar to the survey study above, using the app increased these participants’ ability to nam…
Publications Projects Building a collaborative ecosystem
Datasets Access high-quality datasets to accelerate your research. Tools & services Explore our latest AI models and products.
Open source Discover open-source code and collaborate with the community. Shaping the future together
See all programs
Faculty programs Participating in the academic research community through meaningful engagement with university faculty. Student programs Supporting the next generation of researchers through a wide range of programming.
Locations Find your place in our global offices and research labs. Translating discovery into real-world impact
People Our researchers drive advancements in computer science through both fundamental and applied research.
Teams Collaborative groups tackling the world's most challenging AI problems.
Research Explore our many areas of focus
Explore all research areas
Applied AI & sciences
Earth AI Health AI Science AI Sustainability & crisis resilience
Foundational ML & algorithms
Algorithms & theory Information retrieval Machine intelligence Machine perception Natural language processing
People, systems & quantum AI
Human-computer interaction and visualization Networking Quantum AI Responsible AI Anti abuse Software engineering Software systems
Learn More
Publications Projects
Resources Building a collaborative ecosystem
Datasets Access high-quality datasets to accelerate your research. Tools & services Explore our latest AI models and products. Open source Discover open-source code and collaborate with the community.
Conferences & events
Careers Shaping the future together
See all programs
Faculty programs Participating in the academic research community through meaningful engagement with university faculty. Student programs Supporting the next generation of researchers through a wide range of programming. Locations Find your place in our global offices and research labs.
Blog
About Translating discovery into real-world impact
People Our researchers drive advancements in computer science through both fundamental and applied research. Teams Collaborative groups tackling the world's most challenging AI problems.
Google Research
Google AI Learn about all our AIGoogle DeepMind Explore the frontier of AIGoogle Labs Try our AI experiments
Research
Resources
Conferences & events
Careers
Blog
About
Search
Home 2. Blog Research into how AI can help users understand skin conditions
June 12, 2026
Rory Sayres and Yun Liu, Research Scientists, Google Research
We present recent published findings on how dermatology AI tools may help laypeople with their own skin-related questions. Quick links Paper 1 Paper 2 Share [](https://twitter.com/intent/tweet?text=https%3A//research.google/blog/research-into-how-ai-can-help-users-understand-skin-conditions/ "Share on Twitter") [](https://www.facebook.com/sharer/sharer.php?u=https%3A//research.google/blog/research-into-how-ai-can-help-users-understand-skin-conditions/ "Share on Facebook") [](https://www.linkedin.com/shareArticle?url=https%3A//research.google/blog/research-into-how-ai-can-help-users-understand-skin-conditions/&mini=true "Share on LinkedIn") [](mailto:name@example.com?subject=Check%20out%20this%20site&body=Check%20out%20https%3A//research.google/blog/research-into-how-ai-can-help-users-understand-skin-conditions/ "Send via Email") Copy link ×
More than half of adults use the Internet for health information, and one-third turn to artificial intelligence (AI). However, access to information does not mean that it is easy to understand or correctly interpreted. In short, the human component of AI for health information remains important to research to help people benefit from better health information.
Specifically, this is important in the space of dermatology (skin, hair, nails; henceforth “skin” for brevity) because people have trouble looking for the right information online related to their skin concern. For instance, you may notice “red dots on legs,” but not have the background knowledge to specifically search for “palpable purpura”.
Over the years, we have built a technical foundation in this area, including developing AI models to inform differential diagnoses, performing validation of model generalization00210-5/fulltext), and releasing datasets like SCIN to help clinicians and researchers. However, the most significant impact can only be realized by supporting the decision-making of people who have skin concerns through providing high-quality information.
To do this right, understanding how humans engage with AI to inform their decisions is critical. Previous studies evaluating non-AI tools have shown that while people might get better at identifying a condition using the internet, they don't necessarily get better at deciding what next steps to take. We need to ensure that as AI tools become available, we carefully study and improve upon the human factors to support people in making better decisions.
With the above in mind, today we share some of our recent and past research on consumer understanding of AI tools for their dermatology-related questions. These include a recent large-scale quantitative paper that demonstrates increased ability to name conditions with AI assistance, as well as some benefits in determining what next steps to take. It also includes an in-depth mixed-methods study addressing how people use these tools on their own skin concerns, and how the understanding they gain compares to that from conversation with doctors. Evaluating consumer understanding at scale
In “Consumer Understanding of Skin Concerns With an AI-Powered Informational Tool,” published this week in _JAMA Dermatology_, we investigated how structured AI assistance changes a user's ability to identify a condition and determine their next steps. We showed 2,345 survey participants retrospective, de-identified skin condition cases — complete with images and structured medical history — and asked them to imagine the cases were their own.
_Screenshot of the AI interface (specifically created on the survey platform for this research study) participants saw. They were presented with a case vignette (__A__), and provided with a scrollable carousel of predictions from an AI (__B__). If they clicked on a condition, they were given detailed information about the condition (__C__)._
Participants were randomized into three groups to research the cases: _(Negative) control_: Participants used existing tools they were familiar with, such as standard text-based web searches. _AI_: Participants used a prototype AI (user interface in figure above) that provided a scrollable carousel of 3 to 7 matching conditions based on an AI model's predictions, complete with textbook images and details about symptoms and treatments. _“__Wizard of Oz__” (positive control)_: Participants used the same AI interface, but the predicted conditions were actually the "ground truth" differentials provided by a panel of dermatologists, mimicking an AI that always matches the ground truth.
_Study design incorporating 3 arms, including both a negative control with AI access, and positive control (Wizard of Oz) that had “perfect predictions” matching the ground truth._
We found that AI assistance provided a statistically significant improvement for consumer understanding. When using the AI tool, participants were more willing to attempt to name the condition shown (over 62%) compared to the control group using standard search tools (41%).
More importantly, participants’ condition name guessing accuracy improved dramatically. Accuracy was nearly three times higher in the AI arm (23%) compared to the unassisted control arm (8%). In the "Wizard of Oz" arm, accuracy was about four times higher (36%), but still not near perfect. Having AI "cards" to display matching conditions also imparted significantly higher confidence in their condition guesses, and greater overall satisfaction with their search results and the time spent searching.
_Summary of main results__. Asterisks indicate statistically-significant differences. * (One asterisk): p < 0.05; (Two asterisks): p < 0.01; * (Three asterisks): p < 0.001. Condition name accuracy required a participant to both be willing to guess a condition name, and name a condition that matched the dermatologist differential (allowing for free-text name variations)._ The challenge of defining next steps
To avoid being prescriptive, the AI in our study was designed to focus on matching images to possible conditions and relying on the user to interpret what should be done. Our goal was to enable users to search efficiently and not to be prescriptive or diagnostic. In addition, the treatment and information given was written by dermatologists with access to authoritative sources, based purely on the condition name and not tailored to the specific severity of the condition in that case.
Perhaps because of the generality of information provided, deciding on the appropriate medical next steps, such as using a home remedy versus scheduling an urgent clinic visit, remained challenging for users. Our study found that while next-step accuracy increased by a small amount in the "Wizard of Oz" arm (63.5% vs 60% in control), the standard AI arm did not show a statistically significant improvement. Furthermore, participants in the AI arm were slightly more likely to suggest a less urgent next step than a dermatologist would, compared to the control group (30% vs 27%).
This reinforces that simply identifying the condition is not always enough. There is still progress to be made in designing tools that better inform laypeople about the safest and most appropriate next steps. Engaging communities for richer feedback
While large-scale survey studies are invaluable for understanding general trends, we also recognized the need to understand how people interpret information when it is directly relevant to their own concerns, rather than interpreting pictures of others’ conditions. To get this richer, more nuanced feedback, we sought deep, qualitative insights directly from the communities who stand to benefit most from these tools.
In "Navigating Skin Concerns with AI: A Human-Centered Investigation of a Dermatology App in a Diverse Community," published in theACM Computer-Human Interaction (CHI) conference last year, we collaborated with the Stanford Healthcare AI Applied Research Team (HEA 3 RT) and the Santa Clara Family Health Plan (SCFHP). SCFHP serves members of the surrounding community, many of whom rely on a healthcare safety net, Medi-Cal. Our goal was to study how diverse, consented participants with active skin concerns actually used and reacted to information from a skin AI system in a real-world setting.
Crucially, we wanted to ensure we were building for this community; since the participants spoke four primary languages, the AI application was translated into their respective languages. Volunteers or staff fluent in the respective language were also present to facilitate communication.
_Screenshots of the research app__, presented in four different languages._
In this real-world study, 110 consented participants used the app (and consulted with a clinician immediately after to clarify any concerns). Similar to the survey study above, using the app increased these participants’ ability to nam…