granularity results tierb-fixed-moonep-full @ 2026-08-30T00:17:27Z from sp-aiinfra-interactive-aghosh-7jtjl-8xb200-moe-cg-0
Browse files
tierb-fixed-moonep-full/completed_markers/moonep__tierbmem__gbs8
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
2026-08-30T00:09:58+00:00
|
tierb-fixed-moonep-full/hf_watcher.log
CHANGED
|
@@ -25,3 +25,5 @@ https://huggingface.co/MoE-CUDA-Graph-Analysis/tierb-b200-gbs8/tree/main
|
|
| 25 |
Already logged in to Hugging Face as: AbhishekGhosh1998
|
| 26 |
Watching /workspace/tierb-fixed-moonep-full -> HF every 600s (kill to stop)
|
| 27 |
[2026-08-30T00:10:16+00:00] backup pass
|
|
|
|
|
|
|
|
|
| 25 |
Already logged in to Hugging Face as: AbhishekGhosh1998
|
| 26 |
Watching /workspace/tierb-fixed-moonep-full -> HF every 600s (kill to stop)
|
| 27 |
[2026-08-30T00:10:16+00:00] backup pass
|
| 28 |
+
uploaded: /workspace/tierb-fixed-moonep-full -> MoE-CUDA-Graph-Analysis/tierb-b200-gbs8/tierb-fixed-moonep-full
|
| 29 |
+
https://huggingface.co/MoE-CUDA-Graph-Analysis/tierb-b200-gbs8/tree/main
|
tierb-fixed-moonep-full/study.log
CHANGED
|
@@ -521,3 +521,18 @@ driver_repo: /workspace/blackwell_run_scripts @ eec9aee
|
|
| 521 |
=== STAGE 9 -- Tier B nsys traces (final, trace-only)
|
| 522 |
|
| 523 |
=== STEP echo__tierbtrace__gbs8
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 521 |
=== STAGE 9 -- Tier B nsys traces (final, trace-only)
|
| 522 |
|
| 523 |
=== STEP echo__tierbtrace__gbs8
|
| 524 |
+
==============================================================
|
| 525 |
+
CAMPAIGN: echo backend=echo phase=tierbtrace
|
| 526 |
+
Megatron: /workspace/Megatron-MoE-Echo @ bracing-regions-through-kernels
|
| 527 |
+
GBS=8 seq=4096 repeats=3 nsys=1
|
| 528 |
+
results -> /workspace/tierb-fixed-moonep-full/echo/tierbtrace
|
| 529 |
+
==============================================================
|
| 530 |
+
[00:10:31] building echo marker extension (log: /workspace/tierb-fixed-moonep-full/echo/tierbtrace/tierbtrace_gbs8/trace_extension_build.log)
|
| 531 |
+
[00:14:37] marker extension ready: _echo_trace_C.cpython-312-x86_64-linux-gnu.so
|
| 532 |
+
[00:14:37] TRACE-ONLY QWEN3_235B__echo__matched__seq8192__gbs8__cap1p083984375 (ranks: 0 1 2 3 4 5 6 7)
|
| 533 |
+
[guard] iter 6/10 (80s)
|
| 534 |
+
[guard] iter 8/10 (90s)
|
| 535 |
+
[guard] iter 10/10 (130s)
|
| 536 |
+
[guard] nsys stop (flushing report)
|
| 537 |
+
[00:17:19] trace verified -> QWEN3_235B__echo__matched__seq8192__gbs8__cap1p083984375.nsys-rep (9.7M, all 8 GPUs + echo markers)
|
| 538 |
+
[00:17:19] TRACE-ONLY QWEN3_30B__echo__matched__seq4096__gbs8__cap1p11328125 (ranks: 0 1 2 3 4 5 6 7)
|