ArthurZ HF Staff commited on
Commit
1586f2d
路
verified 路
1 Parent(s): b5b3ca1

radar 2026-11-08

Browse files
Files changed (2) hide show
  1. index.html +1 -3
  2. reports/2026-11-08.json +4 -0
index.html CHANGED
@@ -1,4 +1,4 @@
1
- <!doctype html><meta charset=utf-8><title>transformers radar</title><style>body{max-width:1200px;margin:auto;padding:1em;font-family:system-ui}table{border-collapse:collapse;width:100%}td,th{border-bottom:1px solid #ddd;padding:4px 8px;text-align:left;vertical-align:top}code{font-size:85%}</style><h1>transformers downstream radar 路 2026-11-07</h1>
2
  <p>44 repos 路 last 2 days of GitHub activity 路 659 monkey patches tracked</p>
3
  <h2>Act on these</h2>
4
  <table><tr><th></th><th>action</th><th>component</th><th>what</th><th>threads</th></tr></table>
@@ -8,8 +8,6 @@
8
  <h2>New monkey patches since last run (0)</h2>
9
  <p>Something changed on their side or ours: check whether a transformers change forced it.</p>
10
  <p>None.</p>
11
- <details><summary>Removed since last run (2)</summary>
12
- <table><tr><th>where</th><th>patch</th></tr><tr><td><a href="https://github.com/unslothai/unsloth-zoo/blob/HEAD/unsloth_zoo/temporary_patches/misc.py">unslothai/unsloth-zoo/unsloth_zoo/temporary_patches/misc.py</a></td><td><code>PreTrainedModel.gradient_checkpointing_enable = gradient_checkpointing_enable</code></td></tr><tr><td><a href="https://github.com/unslothai/unsloth/blob/HEAD/unsloth/_gc_kwargs.py">unslothai/unsloth/unsloth/_gc_kwargs.py</a></td><td><code>PreTrainedModel.gradient_checkpointing_enable = gradient_checkpointing_enable</code></td></tr></table></details>
13
  <h2>Most-patched transformers internals</h2>
14
  <p>Patched by several repos = missing extension point (kernel hub / attention interface / hook).</p>
15
  <table><tr><th>symbol</th><th>#repos</th><th>repos</th></tr><tr><td><code>*Attention.forward</code></td><td>8</td><td>FlagEmbedding, TensorRT-LLM, axolotl, LlamaFactory, ms-swift, unsloth, unsloth-zoo, verl</td></tr><tr><td><code>*ForCausalLM.forward</code></td><td>6</td><td>Automodel, axolotl, Liger-Kernel, ms-swift, unsloth, unsloth-zoo</td></tr><tr><td><code>*Model.forward</code></td><td>6</td><td>lmms-eval, axolotl, ms-swift, unsloth, unsloth-zoo, verl</td></tr><tr><td><code>*MLP.forward</code></td><td>5</td><td>TensorRT-LLM, axolotl, DeepSpeed, unsloth, verl</td></tr><tr><td><code>*DecoderLayer.forward</code></td><td>4</td><td>axolotl, LlamaFactory, unsloth, verl</td></tr><tr><td><code>*FlashAttention2</code></td><td>4</td><td>GPTQModel, ms-swift, sglang, unsloth-zoo</td></tr><tr><td><code>*Experts</code></td><td>3</td><td>axolotl, Liger-Kernel, unsloth-zoo</td></tr><tr><td><code>*Model._create_and_replace</code></td><td>3</td><td>axolotl, ms-swift, unsloth-zoo</td></tr><tr><td><code>*RMSNorm</code></td><td>3</td><td>axolotl, Liger-Kernel, unsloth</td></tr><tr><td><code>PreTrainedModel.from_pretrained</code></td><td>3</td><td>ColossalAI, ms-swift, unsloth</td></tr><tr><td><code>apply_rotary_pos_emb</code></td><td>3</td><td>axolotl, Liger-Kernel, verl</td></tr><tr><td><code>create_causal_mask</code></td><td>3</td><td>GPTQModel, ms-swift, unsloth-zoo</td></tr><tr><td><code>*Experts.forward</code></td><td>2</td><td>unsloth-zoo, verl</td></tr><tr><td><code>*FlashAttention2.forward</code></td><td>2</td><td>LlamaFactory, unsloth</td></tr><tr><td><code>*MLP</code></td><td>2</td><td>axolotl, Liger-Kernel</td></tr><tr><td><code>*Model._postprocess</code></td><td>2</td><td>ROLL, verl</td></tr><tr><td><code>*Model.load_adapter</code></td><td>2</td><td>ms-swift, unsloth-zoo</td></tr><tr><td><code>*Model.save_pretrained</code></td><td>2</td><td>unsloth, unsloth-zoo</td></tr><tr><td><code>*RMSNorm.forward</code></td><td>2</td><td>Automodel, verl</td></tr><tr><td><code>*SdpaAttention.forward</code></td><td>2</td><td>LlamaFactory, unsloth</td></tr><tr><td><code>*SparseMoeBlock</code></td><td>2</td><td>LlamaFactory, verl</td></tr><tr><td><code>CrossEntropyLoss</code></td><td>2</td><td>axolotl, Liger-Kernel</td></tr><tr><td><code>PreTrainedModel.enable_input_require_grads</code></td><td>2</td><td>ms-swift, unsloth</td></tr><tr><td><code>PreTrainedModel.post_init</code></td><td>2</td><td>sglang, unsloth</td></tr><tr><td><code>_init_weights</code></td><td>2</td><td>GPTQModel, ColossalAI</td></tr><tr><td><code>checkpoint</code></td><td>2</td><td>ms-swift, unsloth-zoo</td></tr><tr><td><code>dynamic_module_utils.check_imports</code></td><td>2</td><td>LlamaFactory, ktransformers</td></tr><tr><td><code>get_model_conversion_mapping</code></td><td>2</td><td>unsloth, unsloth-zoo</td></tr><tr><td><code>nn.CrossEntropyLoss</code></td><td>2</td><td>axolotl, Liger-Kernel</td></tr><tr><td><code>nn.LayerNorm</code></td><td>2</td><td>axolotl, Liger-Kernel</td></tr><tr><td><code>*Attention</code></td><td>1</td><td>GPTQModel</td></tr><tr><td><code>*Attention.ATTN_DONE</code></td><td>1</td><td>ColossalAI</td></tr><tr><td><code>*Attention.CU_SEQLENS</code></td><td>1</td><td>ColossalAI</td></tr><tr><td><code>*Attention.DEFAULT_BLOCK_SIZES</code></td><td>1</td><td>diffusers</td></tr><tr><td><code>*Attention.HALF_INDICES</code></td><td>1</td><td>ColossalAI</td></tr><tr><td><code>*Attention.INNER_RING_GROUP</code></td><td>1</td><td>ColossalAI</td></tr><tr><td><code>*Attention.INTER_RING_GROUP</code></td><td>1</td><td>ColossalAI</td></tr><tr><td><code>*Attention.SP_GROUP</code></td><td>1</td><td>ColossalAI</td></tr><tr><td><code>*Attention.SP_STREAM</code></td><td>1</td><td>ColossalAI</td></tr><tr><td><code>*Attention.TOTAL_SEQLEN</code></td><td>1</td><td>ColossalAI</td></tr></table>
 
1
+ <!doctype html><meta charset=utf-8><title>transformers radar</title><style>body{max-width:1200px;margin:auto;padding:1em;font-family:system-ui}table{border-collapse:collapse;width:100%}td,th{border-bottom:1px solid #ddd;padding:4px 8px;text-align:left;vertical-align:top}code{font-size:85%}</style><h1>transformers downstream radar 路 2026-11-08</h1>
2
  <p>44 repos 路 last 2 days of GitHub activity 路 659 monkey patches tracked</p>
3
  <h2>Act on these</h2>
4
  <table><tr><th></th><th>action</th><th>component</th><th>what</th><th>threads</th></tr></table>
 
8
  <h2>New monkey patches since last run (0)</h2>
9
  <p>Something changed on their side or ours: check whether a transformers change forced it.</p>
10
  <p>None.</p>
 
 
11
  <h2>Most-patched transformers internals</h2>
12
  <p>Patched by several repos = missing extension point (kernel hub / attention interface / hook).</p>
13
  <table><tr><th>symbol</th><th>#repos</th><th>repos</th></tr><tr><td><code>*Attention.forward</code></td><td>8</td><td>FlagEmbedding, TensorRT-LLM, axolotl, LlamaFactory, ms-swift, unsloth, unsloth-zoo, verl</td></tr><tr><td><code>*ForCausalLM.forward</code></td><td>6</td><td>Automodel, axolotl, Liger-Kernel, ms-swift, unsloth, unsloth-zoo</td></tr><tr><td><code>*Model.forward</code></td><td>6</td><td>lmms-eval, axolotl, ms-swift, unsloth, unsloth-zoo, verl</td></tr><tr><td><code>*MLP.forward</code></td><td>5</td><td>TensorRT-LLM, axolotl, DeepSpeed, unsloth, verl</td></tr><tr><td><code>*DecoderLayer.forward</code></td><td>4</td><td>axolotl, LlamaFactory, unsloth, verl</td></tr><tr><td><code>*FlashAttention2</code></td><td>4</td><td>GPTQModel, ms-swift, sglang, unsloth-zoo</td></tr><tr><td><code>*Experts</code></td><td>3</td><td>axolotl, Liger-Kernel, unsloth-zoo</td></tr><tr><td><code>*Model._create_and_replace</code></td><td>3</td><td>axolotl, ms-swift, unsloth-zoo</td></tr><tr><td><code>*RMSNorm</code></td><td>3</td><td>axolotl, Liger-Kernel, unsloth</td></tr><tr><td><code>PreTrainedModel.from_pretrained</code></td><td>3</td><td>ColossalAI, ms-swift, unsloth</td></tr><tr><td><code>apply_rotary_pos_emb</code></td><td>3</td><td>axolotl, Liger-Kernel, verl</td></tr><tr><td><code>create_causal_mask</code></td><td>3</td><td>GPTQModel, ms-swift, unsloth-zoo</td></tr><tr><td><code>*Experts.forward</code></td><td>2</td><td>unsloth-zoo, verl</td></tr><tr><td><code>*FlashAttention2.forward</code></td><td>2</td><td>LlamaFactory, unsloth</td></tr><tr><td><code>*MLP</code></td><td>2</td><td>axolotl, Liger-Kernel</td></tr><tr><td><code>*Model._postprocess</code></td><td>2</td><td>ROLL, verl</td></tr><tr><td><code>*Model.load_adapter</code></td><td>2</td><td>ms-swift, unsloth-zoo</td></tr><tr><td><code>*Model.save_pretrained</code></td><td>2</td><td>unsloth, unsloth-zoo</td></tr><tr><td><code>*RMSNorm.forward</code></td><td>2</td><td>Automodel, verl</td></tr><tr><td><code>*SdpaAttention.forward</code></td><td>2</td><td>LlamaFactory, unsloth</td></tr><tr><td><code>*SparseMoeBlock</code></td><td>2</td><td>LlamaFactory, verl</td></tr><tr><td><code>CrossEntropyLoss</code></td><td>2</td><td>axolotl, Liger-Kernel</td></tr><tr><td><code>PreTrainedModel.enable_input_require_grads</code></td><td>2</td><td>ms-swift, unsloth</td></tr><tr><td><code>PreTrainedModel.post_init</code></td><td>2</td><td>sglang, unsloth</td></tr><tr><td><code>_init_weights</code></td><td>2</td><td>GPTQModel, ColossalAI</td></tr><tr><td><code>checkpoint</code></td><td>2</td><td>ms-swift, unsloth-zoo</td></tr><tr><td><code>dynamic_module_utils.check_imports</code></td><td>2</td><td>LlamaFactory, ktransformers</td></tr><tr><td><code>get_model_conversion_mapping</code></td><td>2</td><td>unsloth, unsloth-zoo</td></tr><tr><td><code>nn.CrossEntropyLoss</code></td><td>2</td><td>axolotl, Liger-Kernel</td></tr><tr><td><code>nn.LayerNorm</code></td><td>2</td><td>axolotl, Liger-Kernel</td></tr><tr><td><code>*Attention</code></td><td>1</td><td>GPTQModel</td></tr><tr><td><code>*Attention.ATTN_DONE</code></td><td>1</td><td>ColossalAI</td></tr><tr><td><code>*Attention.CU_SEQLENS</code></td><td>1</td><td>ColossalAI</td></tr><tr><td><code>*Attention.DEFAULT_BLOCK_SIZES</code></td><td>1</td><td>diffusers</td></tr><tr><td><code>*Attention.HALF_INDICES</code></td><td>1</td><td>ColossalAI</td></tr><tr><td><code>*Attention.INNER_RING_GROUP</code></td><td>1</td><td>ColossalAI</td></tr><tr><td><code>*Attention.INTER_RING_GROUP</code></td><td>1</td><td>ColossalAI</td></tr><tr><td><code>*Attention.SP_GROUP</code></td><td>1</td><td>ColossalAI</td></tr><tr><td><code>*Attention.SP_STREAM</code></td><td>1</td><td>ColossalAI</td></tr><tr><td><code>*Attention.TOTAL_SEQLEN</code></td><td>1</td><td>ColossalAI</td></tr></table>
reports/2026-11-08.json ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ {
2
+ "threads": [],
3
+ "groups": []
4
+ }