Inserloft commited on
Commit
8e20b1d
·
verified ·
1 Parent(s): 5943983

Add technical community resources section to README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -7
README.md CHANGED
@@ -1,9 +1,6 @@
1
- ---
2
- license: mit
3
- ---
4
  # Caelis Neural Base 3 (CNB-3): A Foundational Protein Language Model
5
 
6
- [![Hugging Face](https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Models-blue)](https://huggingface.co/InserloftResearch/CaeisNeuralBase-3)
7
 
8
  **Caelis Neural Base 3 (CNB-3)** is a ~950-million parameter autoregressive causal language model pre-trained exclusively on dense evolutionary sequence spaces. Engineered to act as a foundational **"Neural Base"** for biotechnology, CNB-3 functions as a versatile, general-purpose backbone for generating, completing, and optimizing functional proteins *de novo*.
9
 
@@ -36,7 +33,7 @@ You are highly encouraged to use **`CaelisBioTokenizer-2`** as a standard starti
36
  # Loading CaelisBioTokenizer-2 to train your own models!
37
  from transformers import AutoTokenizer
38
 
39
- tokenizer = AutoTokenizer.from_pretrained("InserloftResearch/CaeisNeuralBase-3")
40
  print("Vocabulary size for your new protein model:", len(tokenizer))
41
  ```
42
 
@@ -62,7 +59,7 @@ To generate sequences from a custom 25-amino-acid seed:
62
  import torch
63
  from transformers import AutoTokenizer, GPT2LMHeadModel
64
 
65
- repo_id = "InserloftResearch/CaeisNeuralBase-3"
66
 
67
  tokenizer = AutoTokenizer.from_pretrained(repo_id)
68
  model = GPT2LMHeadModel.from_pretrained(repo_id)
@@ -121,4 +118,14 @@ training_args = TrainingArguments(
121
 
122
  1. **Strict Length Hard-Capping**: Autoregressive decoding may output whitespace tokens due to native formatting. Always remove whitespaces (`"".join(seq.split())`) and slice the sequence dynamically to match your exact structural budget.
123
  2. **VRAM Budgeting**: Since ESMFold is resource-intensive, set the chunk size (`esm_folding_model.esm.trunk.set_chunk_size(64)`) to avoid CUDA Out of Memory (OOM) errors on consumer-grade or standard Colab GPUs during verification.
124
- 3. **The Temperature Sweet-Spot**: Use a temperature of `0.7` to balance biochemical feasibility with sequence novelty. Lower values (`< 0.4`) generate highly conserved structures; higher values (`> 1.1`) increase structural entropy (greater risk of non-folding loop accumulation).
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  # Caelis Neural Base 3 (CNB-3): A Foundational Protein Language Model
2
 
3
+ [![Hugging Face](https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Models-blue)](https://huggingface.co/Inserloft/CaeisNeuralBase-3)
4
 
5
  **Caelis Neural Base 3 (CNB-3)** is a ~950-million parameter autoregressive causal language model pre-trained exclusively on dense evolutionary sequence spaces. Engineered to act as a foundational **"Neural Base"** for biotechnology, CNB-3 functions as a versatile, general-purpose backbone for generating, completing, and optimizing functional proteins *de novo*.
6
 
 
33
  # Loading CaelisBioTokenizer-2 to train your own models!
34
  from transformers import AutoTokenizer
35
 
36
+ tokenizer = AutoTokenizer.from_pretrained("Inserloft/CaeisNeuralBase-3")
37
  print("Vocabulary size for your new protein model:", len(tokenizer))
38
  ```
39
 
 
59
  import torch
60
  from transformers import AutoTokenizer, GPT2LMHeadModel
61
 
62
+ repo_id = "Inserloft/CaeisNeuralBase-3"
63
 
64
  tokenizer = AutoTokenizer.from_pretrained(repo_id)
65
  model = GPT2LMHeadModel.from_pretrained(repo_id)
 
118
 
119
  1. **Strict Length Hard-Capping**: Autoregressive decoding may output whitespace tokens due to native formatting. Always remove whitespaces (`"".join(seq.split())`) and slice the sequence dynamically to match your exact structural budget.
120
  2. **VRAM Budgeting**: Since ESMFold is resource-intensive, set the chunk size (`esm_folding_model.esm.trunk.set_chunk_size(64)`) to avoid CUDA Out of Memory (OOM) errors on consumer-grade or standard Colab GPUs during verification.
121
+ 3. **The Temperature Sweet-Spot**: Use a temperature of `0.7` to balance biochemical feasibility with sequence novelty. Lower values (`< 0.4`) generate highly conserved structures; higher values (`> 1.1`) increase structural entropy (greater risk of non-folding loop accumulation).
122
+
123
+ ---
124
+
125
+ ## 📚 Resources & Community Support
126
+
127
+ To facilitate the adoption and specialized fine-tuning of **Caelis Neural Base 3**, we provide the following interactive resources and endpoints:
128
+
129
+ * **[Interactive Google Colab Notebook]**: Complete pipeline to generate custom sequences, fold structures local in GPU using ESMFold, analyze residue distributions, and export PDB structures.
130
+ * **[Official Model Hub](https://huggingface.co/Inserloft/CaeisNeuralBase-3)**: Access the base model weights, standard configuration files, and community discussions.
131
+ * **[Developer & Research Center](https://research.inserloft.com)**: Official research workspace and support for production-grade biopolymeric applications.