smoky1496 commited on
Commit
e128930
·
verified ·
1 Parent(s): 8c608eb

SpawnPoint-Coder-7B v6: card games (deckbuilders)

Browse files
Files changed (2) hide show
  1. README.md +31 -24
  2. model-00001-of-00002.safetensors +1 -1
README.md CHANGED
@@ -20,7 +20,12 @@ What it does inside the pipeline:
20
 
21
  4-bit AWQ, runs on a single 12 GB GPU.
22
 
23
- **What's new in v5.2, v5.1 and v5**
 
 
 
 
 
24
  - **v5.2** catches farm pests mentioned only in passing ("game nông trại mùa đông, có cáo", "a farm with a fox around"),
25
  keeps a named farmer ("a cat farmer"), and leaves a peaceful farm without pests.
26
  - **v5.1** fixes prompts that name the player only indirectly ("a tank shooting monsters": the tank is now the hero,
@@ -33,8 +38,8 @@ What it does inside the pipeline:
33
  - Fixes from v4: "a wizard shooting skeletons" keeps the shoot ability, "collect coins" is a collect goal, an unnamed
34
  pickup is a Coin.
35
 
36
- **Needs Spawn Point 0.3 or later**: v5 answers in the per-genre format. Older Spawn Point versions expect the v4
37
- format; use release `v4-release` of this repo with them.
38
 
39
  ## Run it
40
 
@@ -51,37 +56,39 @@ Hand-written prompts in English and Vietnamese through the whole pipeline, same
51
  Sealed sets were written before training and not looked at until the release decision. The first two rows include
52
  prompts about the genre v4 did not know, so v4 cannot be expected to answer them.
53
 
54
- | benchmark (prompts fully right) | v4 | v5.1 | v5.2 (this release) |
55
  |---|---|---|---|
56
- | **sealed set: farm pests named in passing** (16 prompts) | - | 75% | 100% |
57
- | sealed set: shooters and the v4 fixes (16 prompts) | 56% | 75% | 88% |
58
- | dev set: shooters and the v4 fixes (24 prompts) | 54% | 83% | 79% |
59
- | sealed set: farms, tower defense, cartoon (12 prompts) | 67% | 92% | 92% |
60
- | 16 prompts: farms, tower defense, melee, cartoon | 75% | 94% | 81% |
61
- | sealed set: the first nine genres (12 prompts) | 67% | 75% | 75% |
62
- | 30 human-written prompts | 87% | 87% | 87% |
63
- | 12 prompts: bubble, rescue, survivor | 92% | 83% | 92% |
64
-
65
- **Where v5.2 is a little behind v5.1**: the 16-prompt farms / tower defense / melee set (two prompts: a "space shooter"
66
- read as the other kind of shooter, a barbarian's axe) and the 24-prompt shooter dev set (one prompt). Some prompts are
67
- genuinely ambiguous ("a space shooter" can be a side-scrolling shooter). Results vary by one to three prompts per set
68
- from run to run, so read differences of one or two prompts as noise.
69
-
70
- Held-out synthetic examples with one exact answer (v5 format only): briefs 77%, tweaks 98%, entity edits 100%.
 
71
 
72
  The 4-bit AWQ files you download, measured the same way:
73
 
74
  | benchmark (prompts fully right) | AWQ build |
75
  |---|---|
76
- | **sealed set: farm pests named in passing** (16 prompts) | 100% |
77
- | 30 human-written prompts | 83% |
78
- | sealed set: shooters and the v4 fixes (16 prompts) | 94% |
 
79
 
80
  ## Limitations
81
 
82
  - Fine-tuned only for the 2D game kinds Spawn Point builds: **platformers (including rescue missions and sword
83
- fighting), top-down arenas and survivors, bubble shooters, farming games, tower defense and side-scrolling
84
- shooters**. Other genres (3D, RPG systems, card games, racing…) and free-form Godot coding were not part of the
85
  training data, so expect results no better than a general 7B coder model there.
86
  - Prompts that do not say the genre can be read either way ("a space shooter" may come out as a side-scrolling
87
  shooter, "a farm game" as a farming game).
 
20
 
21
  4-bit AWQ, runs on a single 12 GB GPU.
22
 
23
+ **What's new in v6, v5.2, v5.1 and v5**
24
+ - **v6** designs **card games** (Slay the Spire style deckbuilders): "a deckbuilder where a wizard climbs a frozen
25
+ tower full of ice spirits", "game thẻ bài kiểu Slay the Spire, hiệp sĩ đánh lũ xương khô, trùm cuối là Lich". It picks
26
+ the hero and its class (warrior, mage, rogue), the game's own cards and what each does (big hits, sweeps, poison,
27
+ shields, healing...), the foes and how they fight (brutes, guards, casters, swarms) and the boss. "Upgrade cards" in
28
+ a survivor or "key cards" in a shooter stay what they were.
29
  - **v5.2** catches farm pests mentioned only in passing ("game nông trại mùa đông, có cáo", "a farm with a fox around"),
30
  keeps a named farmer ("a cat farmer"), and leaves a peaceful farm without pests.
31
  - **v5.1** fixes prompts that name the player only indirectly ("a tank shooting monsters": the tank is now the hero,
 
38
  - Fixes from v4: "a wizard shooting skeletons" keeps the shoot ability, "collect coins" is a collect goal, an unnamed
39
  pickup is a Coin.
40
 
41
+ **Needs Spawn Point 0.4 or later for card games** (0.3 or later for the rest): v5 and later answer in the per-genre
42
+ format. Older Spawn Point versions expect the v4 format; use release `v4-release` of this repo with them.
43
 
44
  ## Run it
45
 
 
56
  Sealed sets were written before training and not looked at until the release decision. The first two rows include
57
  prompts about the genre v4 did not know, so v4 cannot be expected to answer them.
58
 
59
+ | benchmark (prompts fully right) | v4 | v5.2 | v6 (this release) |
60
  |---|---|---|---|
61
+ | **sealed set: card games** (16 prompts) | - | 56% | 94% |
62
+ | sealed set: farm pests named in passing (16 prompts) | - | 100% | 100% |
63
+ | sealed set: shooters and the v4 fixes (16 prompts) | 56% | 88% | 88% |
64
+ | dev set: shooters and the v4 fixes (24 prompts) | 54% | 79% | 88% |
65
+ | sealed set: farms, tower defense, cartoon (12 prompts) | 67% | 92% | 83% |
66
+ | 16 prompts: farms, tower defense, melee, cartoon | 75% | 81% | 94% |
67
+ | sealed set: the first nine genres (12 prompts) | 67% | 75% | 83% |
68
+ | 30 human-written prompts | 87% | 87% | 90% |
69
+ | 12 prompts: bubble, rescue, survivor | 92% | 92% | 75% |
70
+
71
+ **Where v6 is a little behind v5.2**: the 12-prompt bubble / rescue / survivor set (two prompts, both names in a bubble
72
+ shooter: the shooter or the egg) and the 12-prompt sealed farms / tower defense set (one prompt), and exact synthetic
73
+ briefs (70% against 77%). Results vary by one to three prompts per set from run to run, so read differences of one or
74
+ two prompts as noise.
75
+
76
+ Held-out synthetic examples with one exact answer (v5 format only): briefs 70%, tweaks 98%, entity edits 96%.
77
 
78
  The 4-bit AWQ files you download, measured the same way:
79
 
80
  | benchmark (prompts fully right) | AWQ build |
81
  |---|---|
82
+ | **sealed set: card games** (16 prompts) | 94% |
83
+ | 30 human-written prompts | 87% |
84
+ | sealed set: farm pests named in passing (16 prompts) | 100% |
85
+ | sealed set: shooters and the v4 fixes (16 prompts) | 81% |
86
 
87
  ## Limitations
88
 
89
  - Fine-tuned only for the 2D game kinds Spawn Point builds: **platformers (including rescue missions and sword
90
+ fighting), top-down arenas and survivors, bubble shooters, farming games, tower defense, side-scrolling
91
+ shooters and card games**. Other genres (3D, RPG systems, racing…) and free-form Godot coding were not part of the
92
  training data, so expect results no better than a general 7B coder model there.
93
  - Prompts that do not say the genre can be read either way ("a space shooter" may come out as a side-scrolling
94
  shooter, "a farm game" as a farming game).
model-00001-of-00002.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ce6ca0757ea25efcfff2c3c9a46796f671b0e7242fe8275e55837ec5414c5e04
3
  size 4480835056
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1ea56ae2b3fa49289d39bd575aa5b8e341eee00681856294515d2bef0703fbef
3
  size 4480835056