VecSzn commited on
Commit
3b11d98
·
verified ·
1 Parent(s): 770ca41

Page: the clone command for the source branch

Browse files
Files changed (1) hide show
  1. index.html +3 -0
index.html CHANGED
@@ -9,11 +9,14 @@ h3{font-size:1.05rem;margin:22px 0 8px;color:#c9d1e0}
9
  p{margin:10px 0} a{color:#8ab4ff} img{max-width:100%;border-radius:8px;display:block}
10
  table{border-collapse:collapse;width:100%;font-size:15px} th,td{text-align:left;padding:6px 8px;border-bottom:1px solid #2a2e3a} th{color:#aab}
11
  .sub{color:#9aa3b2} code{background:#1b1f2a;padding:1px 5px;border-radius:4px}
 
12
  .btn{display:inline-block;background:#2f6fed;color:#fff;padding:10px 16px;border-radius:8px;text-decoration:none;margin:8px 8px 8px 0}
13
  </style></head><body><main>
14
  <h1>PolyStrata</h1>
15
  <p class="sub">Large mixture-of-experts models on the graphics card you already have. Open source, MIT, built on <a href="https://github.com/Niko1221/Strata">Strata</a>.</p>
16
  <p><a class="btn" href="PolyStrata-b0e3b57a.zip">Download the source (6.6 MB, commit b0e3b57a)</a></p>
 
 
17
  <p class="sub"><b>12 October:</b> the GitHub pages of this project (github.com/VecSzn/PolyStrata, its releases and issues) are not visible at the moment: GitHub has put the account under review, and an appeal is in. The code is unchanged and is here meanwhile. The zip above is the source at the latest release, 0.1.43.1-poly.2, without the benchmark records and the media files. Unpack it and run <code>START-HERE.bat</code> on Windows or <code>./setup.sh</code> on Linux. The ready-made Windows engine (<code>strata-poly-windows-x64-bb7d247465918148.zip</code>) will be put next to it; until then setup compiles the engine on your PC, which needs Visual Studio's build tools and the CUDA toolkit (setup offers to install them). Once the engine zip is here, set <code>STRATA_POLY_PREBUILT_URL=https://huggingface.co/spaces/VecSzn/PolyStrata/resolve/main/</code> before running setup and it downloads it from here instead of GitHub.</p>
18
  <p>A mixture-of-experts model only uses a few of its experts for each token. PolyStrata keeps the experts a model uses most on the GPU and computes the rest on the CPU from RAM, so a 35B model runs next to an 8 GB card and 32 GB of RAM. It reads the same GGUF files as llama.cpp, and its output is checked against llama.cpp token by token.</p>
19
  <h2>Same laptop, same model file, same request</h2>
 
9
  p{margin:10px 0} a{color:#8ab4ff} img{max-width:100%;border-radius:8px;display:block}
10
  table{border-collapse:collapse;width:100%;font-size:15px} th,td{text-align:left;padding:6px 8px;border-bottom:1px solid #2a2e3a} th{color:#aab}
11
  .sub{color:#9aa3b2} code{background:#1b1f2a;padding:1px 5px;border-radius:4px}
12
+ pre{background:#1b1f2a;padding:10px 12px;border-radius:8px;overflow-x:auto}
13
  .btn{display:inline-block;background:#2f6fed;color:#fff;padding:10px 16px;border-radius:8px;text-decoration:none;margin:8px 8px 8px 0}
14
  </style></head><body><main>
15
  <h1>PolyStrata</h1>
16
  <p class="sub">Large mixture-of-experts models on the graphics card you already have. Open source, MIT, built on <a href="https://github.com/Niko1221/Strata">Strata</a>.</p>
17
  <p><a class="btn" href="PolyStrata-b0e3b57a.zip">Download the source (6.6 MB, commit b0e3b57a)</a></p>
18
+ <p>Or clone the full repository with its history and tags from this Space (install <a href="https://git-lfs.com/">git-lfs</a> first, the binaries are stored with it):</p>
19
+ <pre><code>git clone -b source https://huggingface.co/spaces/VecSzn/PolyStrata</code></pre>
20
  <p class="sub"><b>12 October:</b> the GitHub pages of this project (github.com/VecSzn/PolyStrata, its releases and issues) are not visible at the moment: GitHub has put the account under review, and an appeal is in. The code is unchanged and is here meanwhile. The zip above is the source at the latest release, 0.1.43.1-poly.2, without the benchmark records and the media files. Unpack it and run <code>START-HERE.bat</code> on Windows or <code>./setup.sh</code> on Linux. The ready-made Windows engine (<code>strata-poly-windows-x64-bb7d247465918148.zip</code>) will be put next to it; until then setup compiles the engine on your PC, which needs Visual Studio's build tools and the CUDA toolkit (setup offers to install them). Once the engine zip is here, set <code>STRATA_POLY_PREBUILT_URL=https://huggingface.co/spaces/VecSzn/PolyStrata/resolve/main/</code> before running setup and it downloads it from here instead of GitHub.</p>
21
  <p>A mixture-of-experts model only uses a few of its experts for each token. PolyStrata keeps the experts a model uses most on the GPU and computes the rest on the CPU from RAM, so a 35B model runs next to an 8 GB card and 32 GB of RAM. It reads the same GGUF files as llama.cpp, and its output is checked against llama.cpp token by token.</p>
22
  <h2>Same laptop, same model file, same request</h2>