Update README.md
#1
by iamleonie - opened
README.md
CHANGED
|
@@ -1,29 +1,76 @@
|
|
| 1 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 2 |
base_model: LiquidAI/LFM2-1.2B
|
| 3 |
license: other
|
| 4 |
license_name: lfm1.0
|
| 5 |
license_link: LICENSE
|
| 6 |
---
|
| 7 |
|
| 8 |
-
|
| 9 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 10 |
|
| 11 |
-
|
|
|
|
| 12 |
|
| 13 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 14 |
- **Base model**: [LiquidAI/LFM2-1.2B](https://huggingface.co/LiquidAI/LFM2-1.2B)
|
| 15 |
- **Architecture**: Hybrid Liquid model with multiplicative gates and short convolutions.
|
| 16 |
- **Context length**: 32,768 tokens
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 17 |
|
| 18 |
|
| 19 |
-
##
|
| 20 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 21 |
|
|
|
|
| 22 |
|
| 23 |
-
##
|
| 24 |
-
L-LFM2-1.2B was trained with full-parameter supervised fine-tuning. Prompts were formatted in ChatML with a dynamic-thinking template (user turns suffixed with `/think` or `/no_think` to select response mode at inference).
|
| 25 |
|
| 26 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 27 |
|
| 28 |
```python
|
| 29 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
|
@@ -67,8 +114,11 @@ print(tokenizer.decode(output[0], skip_special_tokens=False))
|
|
| 67 |
|
| 68 |
Intended for research on aging biology and omics interpretation. Outputs are model predictions, not clinical advice, and should be validated experimentally. Performance is strongest on the modalities represented in the training corpus.
|
| 69 |
|
| 70 |
-
|
| 71 |
-
|
|
|
|
|
|
|
|
|
|
| 72 |
|
| 73 |
## Citation
|
| 74 |
|
|
@@ -81,4 +131,13 @@ The fine-tuned model is released under LFM Open License v1.0. The underlying bas
|
|
| 81 |
doi = { 10.57967/hf/9887 },
|
| 82 |
publisher = { Hugging Face }
|
| 83 |
}
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 84 |
```
|
|
|
|
| 1 |
---
|
| 2 |
+
tags:
|
| 3 |
+
- liquid
|
| 4 |
+
- lfm2
|
| 5 |
+
- lfm2.5
|
| 6 |
+
- longevity
|
| 7 |
base_model: LiquidAI/LFM2-1.2B
|
| 8 |
license: other
|
| 9 |
license_name: lfm1.0
|
| 10 |
license_link: LICENSE
|
| 11 |
---
|
| 12 |
|
| 13 |
+
<div align="center">
|
| 14 |
+
<img
|
| 15 |
+
src="https://cdn-uploads.huggingface.co/production/uploads/61b8e2ba285851687028d395/2b08LKpev0DNEk6DlnWkY.png"
|
| 16 |
+
alt="Liquid AI"
|
| 17 |
+
style="width: 100%; max-width: 100%; height: auto; display: inline-block; margin-bottom: 0.5em; margin-top: 0.5em;"
|
| 18 |
+
/>
|
| 19 |
+
<div style="display: flex; justify-content: center; gap: 0.5em; margin-bottom: 1em;">
|
| 20 |
+
<a href="https://docs.liquid.ai/lfm/getting-started/welcome"><strong>Docs</strong></a> •
|
| 21 |
+
<a href="https://discord.com/invite/liquid-ai"><strong>Discord</strong></a>
|
| 22 |
+
</div>
|
| 23 |
+
</div>
|
| 24 |
|
| 25 |
+
## Longevity-LLM - LFM2-1.2B
|
| 26 |
+
**Longevity-LLM (L-LLM)** is a family of compact, domain-adapted language models for interpreting heterogeneous aging biology data. Longevity LFMs are available in two sizes:
|
| 27 |
|
| 28 |
+
- **LFM2-1.2B-Longevity** *(this model)*
|
| 29 |
+
- [**LFM2-2.6B-Longevity**](https://huggingface.co/LiquidAI/LFM2-2.6B-Longevity/)
|
| 30 |
+
|
| 31 |
+
This checkpoint, **L-LFM2-1.2B**, was produced by full-parameter supervised fine-tuning of [LiquidAI/LFM2-1.2B](https://huggingface.co/LiquidAI/LFM2-1.2B) on aging-related multi-omics and clinical data.
|
| 32 |
+
|
| 33 |
+
This model was developed jointly by [**Insilico Medicine**](https://insilico.com) and [**Liquid AI**](https://www.liquid.ai) and accompanies the study "An Open Benchmark and Language Models for AI in Aging Biology" (Zhavoronkov et al., 2026).
|
| 34 |
+
|
| 35 |
+
## Model details
|
| 36 |
- **Base model**: [LiquidAI/LFM2-1.2B](https://huggingface.co/LiquidAI/LFM2-1.2B)
|
| 37 |
- **Architecture**: Hybrid Liquid model with multiplicative gates and short convolutions.
|
| 38 |
- **Context length**: 32,768 tokens
|
| 39 |
+
- **Language**: English
|
| 40 |
+
|
| 41 |
+
**Training data**. The model was trained on the shared L-LLM corpus spanning aging biology. See [LongevityBench](https://huggingface.co/datasets/insilicomedicine/longebench) for more details.
|
| 42 |
+
|
| 43 |
+
**Training procedure.** L-LFM2-1.2B was trained with full-parameter supervised fine-tuning. Prompts were formatted in ChatML with a dynamic-thinking template (user turns suffixed with `/think` or `/no_think` to select response mode at inference).
|
| 44 |
|
| 45 |
|
| 46 |
+
### Chat Template
|
| 47 |
+
|
| 48 |
+
LFM2 uses a ChatML-like format. See the [Chat Template documentation](https://docs.liquid.ai/lfm/key-concepts/chat-template) for details. Example:
|
| 49 |
+
|
| 50 |
+
```
|
| 51 |
+
<|startoftext|><|im_start|>system
|
| 52 |
+
You are a helpful assistant trained by Liquid AI.<|im_end|>
|
| 53 |
+
<|im_start|>user
|
| 54 |
+
What is C. elegans?<|im_end|>
|
| 55 |
+
<|im_start|>assistant
|
| 56 |
+
```
|
| 57 |
|
| 58 |
+
You can use [`tokenizer.apply_chat_template()`](https://huggingface.co/docs/transformers/en/chat_templating#using-applychattemplate) to format your messages automatically.
|
| 59 |
|
| 60 |
+
## Inference
|
|
|
|
| 61 |
|
| 62 |
+
LFM2 is supported by many inference frameworks. See the [Inference documentation](https://docs.liquid.ai/lfm/inference/transformers) for the full list.
|
| 63 |
+
|
| 64 |
+
| Name | Description | Docs | Notebook |
|
| 65 |
+
|------|-------------|------|:--------:|
|
| 66 |
+
| [Transformers](https://github.com/huggingface/transformers) | Simple inference with direct access to model internals. | <a href="https://docs.liquid.ai/lfm/inference/transformers">Link</a> | <a href="https://colab.research.google.com/drive/1_q3jQ6LtyiuPzFZv7Vw8xSfPU5FwkKZY?usp=sharing"><img src="https://cdn-uploads.huggingface.co/production/uploads/61b8e2ba285851687028d395/vlOyMEjwHa_b_LXysEu2E.png" width="110" alt="Colab link"></a> |
|
| 67 |
+
| [vLLM](https://github.com/vllm-project/vllm) | High-throughput production deployments with GPU. | <a href="https://docs.liquid.ai/lfm/inference/vllm">Link</a> | <a href="https://colab.research.google.com/drive/1VfyscuHP8A3we_YpnzuabYJzr5ju0Mit?usp=sharing"><img src="https://cdn-uploads.huggingface.co/production/uploads/61b8e2ba285851687028d395/vlOyMEjwHa_b_LXysEu2E.png" width="110" alt="Colab link"></a> |
|
| 68 |
+
| [SGLang](https://github.com/sgl-project/sglang) | High-throughput production deployments with GPU. | <a href="https://docs.liquid.ai/deployment/gpu-inference/sglang">Link</a> | — |
|
| 69 |
+
| [llama.cpp](https://github.com/ggml-org/llama.cpp) | Cross-platform inference with CPU offloading. | <a href="https://docs.liquid.ai/lfm/inference/llama-cpp">Link</a> | <a href="https://colab.research.google.com/drive/1ohLl3w47OQZA4ELo46i5E4Z6oGWBAyo8?usp=sharing"><img src="https://cdn-uploads.huggingface.co/production/uploads/61b8e2ba285851687028d395/vlOyMEjwHa_b_LXysEu2E.png" width="110" alt="Colab link"></a> |
|
| 70 |
+
| [MLX](https://github.com/ml-explore/mlx) | Apple's machine learning framework optimized for Apple Silicon. | <a href="https://docs.liquid.ai/lfm/inference/mlx">Link</a> | — |
|
| 71 |
+
| [LM Studio](https://lmstudio.ai/) | Desktop application for running LLMs locally. | <a href="https://docs.liquid.ai/deployment/on-device/lm-studio">Link</a> | — |
|
| 72 |
+
|
| 73 |
+
Quick start with Transformers (compatible with `transformers>=5.1.0`)
|
| 74 |
|
| 75 |
```python
|
| 76 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
|
|
|
| 114 |
|
| 115 |
Intended for research on aging biology and omics interpretation. Outputs are model predictions, not clinical advice, and should be validated experimentally. Performance is strongest on the modalities represented in the training corpus.
|
| 116 |
|
| 117 |
+
|
| 118 |
+
## Contact
|
| 119 |
+
|
| 120 |
+
- Got questions or want to connect? [Join our Discord community](https://discord.com/invite/liquid-ai)
|
| 121 |
+
- If you are interested in custom solutions with edge deployment, please contact [our sales team](https://www.liquid.ai/contact).
|
| 122 |
|
| 123 |
## Citation
|
| 124 |
|
|
|
|
| 131 |
doi = { 10.57967/hf/9887 },
|
| 132 |
publisher = { Hugging Face }
|
| 133 |
}
|
| 134 |
+
```
|
| 135 |
+
|
| 136 |
+
```bibtex
|
| 137 |
+
@article{liquidai2025lfm2,
|
| 138 |
+
title={LFM2 Technical Report},
|
| 139 |
+
author={Liquid AI},
|
| 140 |
+
journal={arXiv preprint arXiv:2511.23404},
|
| 141 |
+
year={2025}
|
| 142 |
+
}
|
| 143 |
```
|