# Google Research 推出 SensorFM：从 500 万用户万亿分钟可穿戴数据中预训练的基础模型

- 来源：The Decoder：AI News（RSS）
- 作者：Tomislav Bezmalinović
- 发布时间：2026-07-13 17:16
- AIHOT 分数：41
- AIHOT 链接：https://aihot.virxact.com/items/cmrj0wvrs04lcbilk41ofc7q5
- 原文链接：https://the-decoder.com/sensorfm

## AI 摘要

Google Research 推出 SensorFM，一个从 500 万 Fitbit 和 Pixel Watch 用户超过 1 万亿分钟未标注多模态传感器数据中预训练的基础模型。该模型处理光学心率、加速度、皮肤电导、皮肤温度和气压高度等 34 项特征，采用名为“自适应与继承掩码”（AIM）的自监督训练方法。在 35 项健康与行为预测任务中，SensorFM 在 34 项上超越了使用手工特征的有监督基线模型。将 SensorFM 预测结果集成到 Gemini 健康智能体后，临床医生对健康摘要的评分在上下文、个性化、可论证性、相关性和安全性五个维度均显著高于基线版本。模型参数量从约 10 万到 1 亿不等，性能随模型和数据规模同步提升。

## 正文

Key Points

Google Research has introduced SensorFM, a foundation model designed to learn a general representation of physiological and behavioral patterns from more than one trillion minutes of unlabeled wearable data from five million people.

The model processes sensor data from Fitbit and Pixel Watch devices and outperformed monitored comparison models, which used specially prepared wearable features, on 34 out of 35 health and behavioral tasks.

In the experimental setup, health summaries that included additional SensorFM predictions were rated significantly higher than the baseline version across all five areas studied.

Google Research has unveiled SensorFM, a foundation model that learns a general representation of human physiology and behavior from wearable sensor data collected from five million people. The model can be applied to 35 different health and behavioral tasks.

Most health features on wearables today are built for a single purpose. One model detects sleep stages, another estimates cardiovascular risk, and yet another analyzes stress or metabolic markers. Google wants to replace these siloed approaches with a shared AI foundation that can make sense of continuous, often gappy sensor data across many health questions, cut the need for expensive labeled training data, and eventually feed personalized context into AI health assistants.

Google Research has now introduced SensorFM in a blog post and an accompanying paper. The foundation model learns a general, reusable representation of physiological and behavioral patterns from large volumes of unlabeled wearable data. The researchers used more than a trillion minutes of multimodal sensor data from five million Fitbit and Pixel Watch users for pretraining. The data came from over 100 countries and was collected with more than 20 different Fitbit and Pixel Watch models. According to the authors, this is the largest and most diverse wearable dataset ever used to train a model of this kind.

More data and bigger models make SensorFM better

SensorFM processes 34 features drawn from five types of sensor data: optical heart rate monitoring (photoplethysmography, or PPG), acceleration, skin conductance, skin temperature, and barometric altitude. The features include heart rate, heart rate variability, blood oxygen saturation, sleep stages, and motion data, among others. The model is trained in a self-supervised way by reconstructing deliberately masked data segments. The technique, called "Adaptive and Inherited Masking" (AIM), flags both genuinely missing values and values that were artificially hidden during training, so SensorFM learns to handle both types of data gaps.

As model size and pretraining data grow together, SensorFM's performance improves for both pretraining reconstruction and downstream prediction tasks. | Image: Google Research

The researchers report that performance improves systematically when model size and data volume grow together. The four model variants they tested range from about 100,000 to 100 million parameters, and the training datasets span from 5,000 to five million people. On the largest training dataset, the biggest model's reconstruction error was 31 percent lower than the smallest model's. The largest configuration also performed best on most downstream prediction tasks.

SensorFM beats comparison models on 34 out of 35 tasks

The researchers then tested SensorFM on data from three separate studies with a total of 13,985 participants. The model had never seen this data during pretraining. They evaluated SensorFM on 35 prediction tasks covering cardiovascular and metabolic health, mental health, sleep, demographics, and lifestyle.

Even simple task-specific head models built on top of SensorFM's learned representations outperformed supervised baselines with hand-crafted wearable features on 34 of 35 tasks, according to the paper. Scaled pretraining also made SensorFM more label-efficient compared to the supervised baselines. The model could adapt to new tasks with relatively few labeled examples, and as it grew larger, it relied less on extra demographic information. The authors believe scaled pretraining could be especially useful for hard-to-measure traits that vary widely between individuals, such as depression and anxiety symptoms.

To adapt SensorFM's learned representations to new tasks, the researchers set up a "classroom" of competing and collaborating LLM agents. These agents repeatedly generated, tested, and refined code for downstream prediction models, running more than 30,000 experiments in the process. The models they found outperformed simple linear head models based on the same SensorFM representations on 28 of 35 prediction tasks.

SensorFM makes a health agent's answers better

The researchers also integrated SensorFM into a personal health agent and compared three variants. All three received demographic information and daily summaries computed from wearable data, covering things like activity, sleep, blood oxygen, and skin temperature. One variant also received SensorFM predictions for various health markers, a second received the actual known values for those same markers, and the third got none of this extra information and served as the baseline.

In the experimental setup, SensorFM provides health predictions derived from wearable data as added context for Gemini. The diagram shows an illustrative example. | Image: Google Research

Four clinicians evaluated 93 health summaries for 31 real participant profiles, spending more than 40 hours and producing 1,860 individual ratings. The result: summaries augmented with SensorFM predictions scored significantly higher than the baseline across all five dimensions the team measured, which were context, personalization, justifiability, relevance, and safety. There was no statistically significant difference overall between summaries that used SensorFM predictions and those that used actual known health data. That said, this doesn't mean SensorFM can replace clinical measurements or diagnoses.

SensorFM remains a research model for now

The researchers point to several limitations. SensorFM was trained and tested only on data from Fitbit and Pixel Watch devices. Whether the results transfer to other wearables is an open question. The model also doesn't work with high-resolution raw signals but with data aggregated at the minute level, which means very short or fine-grained patterns can get lost.

Many of the health markers the team studied are based on self-reports, medication records, or questionnaires rather than clinically confirmed findings. The study population also doesn't fully represent the general population. And the health agent was only evaluated in a static setup with single responses, not in longer conversations with follow-up questions.

SensorFM is purely a research model for now. Google already offers the Gemini-based Google Health Coach, which provides personalized tips on fitness, sleep, recovery, and other health topics. SensorFM could eventually serve as a technical foundation for features like these, but Google hasn't announced any concrete plans to integrate it into Fitbit, Pixel Watch, or the AI coach.

More details on SensorFM are available in the Google Research blog post and the open-access paper on arXiv.