Release CAEL 0.3.8: code-only update on the 0.3.7 model bundle (AI-assisted)
Browse files- .gitattributes +1 -0
- CAEL-0.3.8.zip +3 -0
- CHANGELOG.md +45 -0
- LICENSE +70 -0
- NOTICE.md +47 -0
- README.md +126 -0
- SHA256SUMS.json +10 -0
- bundle_config.json +7 -0
- cael-0.3.7.cael +3 -0
- release_manifest.json +64 -0
.gitattributes
CHANGED
|
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
+
cael-0.3.7.cael filter=lfs diff=lfs merge=lfs -text
|
CAEL-0.3.8.zip
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c0d1771d54e9e5b77e84462cc00411e5cadede076ae4709fe06440c9e535dd6e
|
| 3 |
+
size 21562557
|
CHANGELOG.md
ADDED
|
@@ -0,0 +1,45 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Changelog
|
| 2 |
+
|
| 3 |
+
## 0.3.8 (release candidate, not yet published)
|
| 4 |
+
|
| 5 |
+
Code-only release. It loads the unchanged published `cael-0.3.7.cael` model bundle
|
| 6 |
+
(same SHA-256 checksum); no weights or bundle files changed. AI-assisted.
|
| 7 |
+
|
| 8 |
+
### Fixed
|
| 9 |
+
|
| 10 |
+
- Personal facts: CAEL no longer invents a personal fact it was never told (for example a
|
| 11 |
+
birthplace). It answers from what the user said in the conversation, or says it has not
|
| 12 |
+
been told.
|
| 13 |
+
- Listening requests: an emotional message that asks for no advice and no questions now gets
|
| 14 |
+
a short reflection without advice or questions, for more phrasings than before.
|
| 15 |
+
- Word problems: a checked quantity graph handles more multi-step quantity problems
|
| 16 |
+
(receive, give away, buy, share). The older exact inventory helper still answers first
|
| 17 |
+
when it can, so its worked steps and multi-turn "Add:" state are kept. A leading
|
| 18 |
+
"and"/"then" in a step is handled; "to" is no longer taken as part of a quantity noun.
|
| 19 |
+
- Linear equations such as `Solve 6*x + 5 = 47` are solved exactly.
|
| 20 |
+
- Python generation: the requested function name and signature are kept; a single function
|
| 21 |
+
stub is checked against the request; prompts that contain real code plus extra steps are
|
| 22 |
+
left to the task and data tools instead of being asked to clarify.
|
| 23 |
+
- Code execution: generated specs and recurrences run only inside the restricted Python VM
|
| 24 |
+
(no native `eval`). The VM gained a bounded `dict.fromkeys`.
|
| 25 |
+
|
| 26 |
+
### Evaluation (read-only, no tuning on evaluation items)
|
| 27 |
+
|
| 28 |
+
- 80-item read-only replay, raw automatic grading: 59/80, against 54/80 recorded for 0.3.7
|
| 29 |
+
(memory 17/20, conversation 10/20, Python 16/20, controls 16/20). Seven replies changed:
|
| 30 |
+
memory-20, conversation-04, python-15 and controls-05 now pass; controls-16 now passes the
|
| 31 |
+
automatic check (it had been accepted in review before); python-05 and python-19 still fail.
|
| 32 |
+
Memory-20 is the item from the public bug report, so it is no longer a clean held-out item.
|
| 33 |
+
Review of the replies was done by AI coding agents (unblinded).
|
| 34 |
+
- Public 128-question comparison: math 0/32 and Python 1/32, the same as 0.3.7. CAEL does
|
| 35 |
+
not pass the competitive math gate and 0.3.8 makes no math improvement claim.
|
| 36 |
+
- GSM8K train split, 400-question development check (informational only): 1 correct, 17 wrong, 382 abstained. Coverage is very low and the 17 wrong answers come from routes that should have abstained.
|
| 37 |
+
- The 400-question comparison is unchanged: Qwen3.5 leads clearly (181/400 original phrase
|
| 38 |
+
passes against CAEL 121/400; Qwen3 116/400). Qwen is also better at open conversation.
|
| 39 |
+
|
| 40 |
+
### Known limitations
|
| 41 |
+
|
| 42 |
+
- Bundle builds still name the bundle after the code version; 0.3.8 ships the 0.3.7 bundle.
|
| 43 |
+
- The restricted VM refuses `math.*` expressions.
|
| 44 |
+
- Word-problem coverage is still low; some routes give wrong numbers instead of abstaining.
|
| 45 |
+
- Python-19 still uses an import although the prompt asks for no imports.
|
LICENSE
ADDED
|
@@ -0,0 +1,70 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
CAEL NON-COMMERCIAL LICENSE (Personal and Research Use Only)
|
| 2 |
+
|
| 3 |
+
Copyright (c) 2026 Vovala14. All rights reserved except as granted below.
|
| 4 |
+
|
| 5 |
+
This license applies to CAEL (Cellular Automaton Event Language) and to the
|
| 6 |
+
code, models, weights, prompts, data, documentation and other files in this
|
| 7 |
+
repository and in CAEL model bundles that are owned by the copyright holder
|
| 8 |
+
(the "Software"). Third-party components are covered by section 8 instead.
|
| 9 |
+
|
| 10 |
+
1. GRANT OF PERMISSION
|
| 11 |
+
Permission is granted, free of charge, to any person obtaining a copy of
|
| 12 |
+
the Software to use, copy, modify, and run it, solely for:
|
| 13 |
+
(a) Personal Use: private, non-commercial use by an individual for their
|
| 14 |
+
own learning, hobby, or experimentation; and
|
| 15 |
+
(b) Research Use: non-commercial academic, scientific, or educational
|
| 16 |
+
research, and publication of the results of that research.
|
| 17 |
+
|
| 18 |
+
2. COMMERCIAL USE REQUIRES A SEPARATE LICENSE
|
| 19 |
+
You may NOT use the Software, or anything derived from it, for any
|
| 20 |
+
commercial purpose without a separate written license from the copyright
|
| 21 |
+
holder. Commercial purposes include, without limitation:
|
| 22 |
+
(a) selling, licensing, sublicensing, renting, or otherwise charging for
|
| 23 |
+
the Software or derivatives, or access to them;
|
| 24 |
+
(b) using the Software in, or to provide, a product or service that is
|
| 25 |
+
sold, or that generates revenue, directly or indirectly (including
|
| 26 |
+
through advertising, subscriptions, or paid APIs);
|
| 27 |
+
(c) using the Software in the operations of a for-profit business or
|
| 28 |
+
for any other commercial advantage; and
|
| 29 |
+
(d) using the Software or its outputs to train, fine-tune, or distill
|
| 30 |
+
models or systems that are used commercially.
|
| 31 |
+
The copyright holder keeps all commercial rights and may use and license
|
| 32 |
+
the Software commercially.
|
| 33 |
+
|
| 34 |
+
3. REDISTRIBUTION
|
| 35 |
+
You may share copies or modified versions only for non-commercial
|
| 36 |
+
purposes, and only if you (a) include this license and the copyright
|
| 37 |
+
notice with them, (b) clearly mark any changes you made, and (c) license
|
| 38 |
+
your distribution of the Software under these same terms. You may not
|
| 39 |
+
remove or alter this license or the copyright notice.
|
| 40 |
+
|
| 41 |
+
4. ATTRIBUTION
|
| 42 |
+
Any research publication or public work that uses the Software must
|
| 43 |
+
credit "CAEL by Vovala14" and link to https://github.com/Vovala14/CAEL .
|
| 44 |
+
|
| 45 |
+
5. OWNERSHIP
|
| 46 |
+
The Software is licensed, not sold. The copyright holder retains all
|
| 47 |
+
rights not expressly granted here. No trademark rights are granted.
|
| 48 |
+
|
| 49 |
+
6. TERMINATION
|
| 50 |
+
This license terminates automatically if you breach it. On termination
|
| 51 |
+
you must stop using the Software and delete your copies.
|
| 52 |
+
|
| 53 |
+
7. NO WARRANTY AND LIMITATION OF LIABILITY
|
| 54 |
+
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS
|
| 55 |
+
OR IMPLIED, INCLUDING BUT NOT LIMITED TO WARRANTIES OF MERCHANTABILITY,
|
| 56 |
+
FITNESS FOR A PARTICULAR PURPOSE, AND NONINFRINGEMENT. IN NO EVENT SHALL
|
| 57 |
+
THE COPYRIGHT HOLDER BE LIABLE FOR ANY CLAIM, DAMAGES, OR OTHER LIABILITY,
|
| 58 |
+
WHETHER IN CONTRACT, TORT, OR OTHERWISE, ARISING FROM, OUT OF, OR IN
|
| 59 |
+
CONNECTION WITH THE SOFTWARE OR ITS USE.
|
| 60 |
+
|
| 61 |
+
8. THIRD-PARTY COMPONENTS
|
| 62 |
+
Third-party data, software and graphics included in or used to build CAEL
|
| 63 |
+
keep their own licenses, listed in licenses/, in each model folder's
|
| 64 |
+
SOURCES.md / TRAINING_NOTICES.md and in the bundle. This license does not
|
| 65 |
+
replace or restrict them. In particular, components derived from Creative
|
| 66 |
+
Commons Attribution-ShareAlike material (for example the Wikipedia,
|
| 67 |
+
Stack Exchange, Dolly, Wikibooks, Wikivoyage and Universal Dependencies
|
| 68 |
+
derived knowledge and count tables) are shared under their CC BY-SA terms,
|
| 69 |
+
which also allow commercial use. CAEL only uses third-party material whose
|
| 70 |
+
license allows commercial use.
|
NOTICE.md
ADDED
|
@@ -0,0 +1,47 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Provenance and separation
|
| 2 |
+
|
| 3 |
+
CAEL (Cellular Automaton Event Language) is a separate model family owned by Vovala14. Version0.1 derives from the locally preserved constrained symbolic event-CA experiment of2026-10-13. It is not the native MICA architecture or a MICA foundation-model release.
|
| 4 |
+
|
| 5 |
+
The original experiment is retained unchanged outside this repository. Earlier CAEL releases (up to 0.2.9 / 0.3) carried that experiment's licence text verbatim, which named MICA Ember / MICA Flame. CAEL and MICA have the same copyright holder (Vovala14), who now licenses CAEL under its own CAEL Non-Commercial License (LICENSE): free for personal and research use, with commercial use reserved to the copyright holder. CAEL is a separate model family and contains no MICA code, weights or outputs. CAEL is not released under an OSI open-source license.
|
| 6 |
+
|
| 7 |
+
## Commercial-use policy for third-party material
|
| 8 |
+
|
| 9 |
+
CAEL only uses third-party data, software and graphics whose licence allows commercial use (MIT, Apache, BSD, CC BY, CC BY-SA, WordNet, Unicode, CreativeML OpenRAIL-M). Removed in 0.3.1: the 0.2.1 small-talk reply models (`chat/model_v1.json.gz`, `chat/model_v2.json.gz`), which were fitted on EmpatheticDialogues (CC BY-NC 4.0). The ARC Corpus is never used at runtime (its terms forbid redistribution); a local research reproduction can opt in only with `CAEL_RESEARCH_ARC=1`.
|
| 10 |
+
|
| 11 |
+
Changes: standalone portable training/evaluation, CAEL naming, cumulative event-memory training, explicit multi-event API, stricter supported-question handling, reports and public packaging. Runtime includes handwritten parsing and slot formatting plus learned cellular event rules, plans and a template-like regular grammar. No neural model is used for training or inference; the curriculum is expert-authored synthetic data.
|
| 12 |
+
|
| 13 |
+
## CAEL 0.2 emoji model and data attribution
|
| 14 |
+
- models/cael-emoji-64-v2 was trained on Noto Emoji (Copyright Google Inc., Apache License 2.0, github.com/googlefonts/noto-emoji @ e20cbc2b, 2D/png/128)
|
| 15 |
+
and Blobmoji (C1710 and contributors, based on Noto Emoji, Apache License 2.0, github.com/C1710/blobmoji @ 7dd14d2b, SVGs rendered to 128x128 PNG).
|
| 16 |
+
The model stores learned counts, not the images. Licences in licenses/.
|
| 17 |
+
- Captions: Unicode emoji-test.txt short names + Unicode CLDR English annotations (Unicode License).
|
| 18 |
+
- Transparent pixels were composited on white before training.
|
| 19 |
+
|
| 20 |
+
## CAEL 0.2.1 changes and synthetic-image teacher
|
| 21 |
+
|
| 22 |
+
0.2.1 adds a shared application, one integrity-checked model bundle, portable
|
| 23 |
+
legacy chat fallback, exact arithmetic, the current v7 emoji engine, sanitized
|
| 24 |
+
v15 aggregate portrait parameters, and a new categorical general-image student.
|
| 25 |
+
The preceding description of expert-authored training and no neural model
|
| 26 |
+
applies to Story 0.1, not the new synthetic-image training pipeline.
|
| 27 |
+
|
| 28 |
+
The general-image student is trained on outputs generated locally by neural
|
| 29 |
+
Stable Diffusion 1.5 through stable-diffusion.cpp. It is treated as a derivative
|
| 30 |
+
under CreativeML OpenRAIL-M. Original diffusion/text-encoder weights are replaced
|
| 31 |
+
by subject-specific registered 64x64 statistical appearance/deformation modes.
|
| 32 |
+
Use and redistribution must comply with the included teacher license, paragraph
|
| 33 |
+
5 and Attachment A, in addition to the CAEL Non-Commercial License for owned
|
| 34 |
+
modifications. Full teacher license: licenses/LICENSE-stable-diffusion-v1-5.txt.
|
| 35 |
+
Primary sources: https://huggingface.co/stable-diffusion-v1-5/stable-diffusion-v1-5
|
| 36 |
+
and https://github.com/CompVis/stable-diffusion/blob/main/LICENSE.
|
| 37 |
+
|
| 38 |
+
stable-diffusion.cpp is a separate locally installed MIT-licensed teacher tool:
|
| 39 |
+
https://github.com/leejet/stable-diffusion.cpp. Neither its binary nor the neural
|
| 40 |
+
teacher checkpoint is redistributed in this release. Runtime student sampling
|
| 41 |
+
is non-neural, but its neural teacher's contribution is explicit.
|
| 42 |
+
|
| 43 |
+
v7 emoji data sources remain Noto Emoji and Blobmoji, with the same Apache and
|
| 44 |
+
Unicode attribution above. Public fitting references are included for numerical
|
| 45 |
+
rejection and silhouette statistics. Private portrait photos and alignments,
|
| 46 |
+
endpoint credentials and private chat logs are not included.
|
| 47 |
+
|
README.md
ADDED
|
@@ -0,0 +1,126 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
language:
|
| 3 |
+
- en
|
| 4 |
+
license: other
|
| 5 |
+
license_name: cael-non-commercial
|
| 6 |
+
license_link: https://huggingface.co/vynly/CAEL-0.3.8/blob/main/LICENSE
|
| 7 |
+
pipeline_tag: text-generation
|
| 8 |
+
tags:
|
| 9 |
+
- cael
|
| 10 |
+
- non-neural
|
| 11 |
+
- cellular-automata
|
| 12 |
+
- symbolic-reasoning
|
| 13 |
+
- conversation-memory
|
| 14 |
+
- code-generation
|
| 15 |
+
inference: false
|
| 16 |
+
---
|
| 17 |
+
|
| 18 |
+
# CAEL 0.3.8
|
| 19 |
+
|
| 20 |
+
A CPU assistant built from non-neural symbolic, count and automaton engines.
|
| 21 |
+
It is a custom Python runtime; Qwen and Transformers are not part of CAEL.
|
| 22 |
+
CAEL is source-available, non-commercial software (see LICENSE).
|
| 23 |
+
|
| 24 |
+
0.3.8 is a code-only update. It reuses the unchanged published 0.3.7 model
|
| 25 |
+
bundle (cael-0.3.7.cael, same checksum); see CHANGELOG.md.
|
| 26 |
+
|
| 27 |
+
Picture and portrait generator weights are excluded. Chat, helper, math,
|
| 28 |
+
stories, prompt writing, retrieval and emoji remain available. Image requests
|
| 29 |
+
can produce a prompt for an external image tool.
|
| 30 |
+
|
| 31 |
+
## Start
|
| 32 |
+
|
| 33 |
+
Use Python3.11 or later. Extract the source archive or clone this repository,
|
| 34 |
+
then run in its folder:
|
| 35 |
+
|
| 36 |
+
```bash
|
| 37 |
+
python -m pip install -r requirements-unified.txt
|
| 38 |
+
python -m cael_unified --download
|
| 39 |
+
python -m cael_unified --ui
|
| 40 |
+
```
|
| 41 |
+
|
| 42 |
+
Open http://127.0.0.1:8765. Windows SETUP.bat and RUN.bat provide the same flow.
|
| 43 |
+
The checksum-verified no-images resource download is about563MB; source and
|
| 44 |
+
resource archives are separate. Existing local models/selections are preserved
|
| 45 |
+
by the installer. The licence is unchanged; see LICENSE and NOTICE.md.
|
| 46 |
+
|
| 47 |
+
## Changes in 0.3.8
|
| 48 |
+
|
| 49 |
+
- Personal facts: a question about your own details (birthplace, address and
|
| 50 |
+
similar) that you never stated is answered with "you have not told me",
|
| 51 |
+
instead of a fact borrowed from retrieval or another person.
|
| 52 |
+
- Requests to just listen ("no advice", "don't ask me questions", and
|
| 53 |
+
paraphrases) are kept on every conversational route, not only some phrasings.
|
| 54 |
+
- Word problems: a checked quantity-event graph, exact fractions/decimals and
|
| 55 |
+
stricter clause handling. Unsupported clauses lead to a clarifying question.
|
| 56 |
+
The older inventory helper still answers first when it is exact.
|
| 57 |
+
- Python: requested function names and declared signatures are kept, and
|
| 58 |
+
rules that cannot be resolved lead to a question, not to simpler code.
|
| 59 |
+
- Safety: arithmetic-expression and recurrence checks no longer use Python's
|
| 60 |
+
native eval. They run in the bounded AST VM or a closed +, -, * evaluator.
|
| 61 |
+
- The model weights and bundle are unchanged.
|
| 62 |
+
|
| 63 |
+
## Changes in 0.3.7
|
| 64 |
+
|
| 65 |
+
- Session-local explicit facts/preferences, corrections, conflict clarification,
|
| 66 |
+
forgetting and provenance. Quoted/hypothetical statements are treated cautiously.
|
| 67 |
+
- A larger authored vocabulary for mixed/negated feelings, speaker attribution,
|
| 68 |
+
bereavement and requests to listen. These are bounded rules, not human experience.
|
| 69 |
+
- Natural-language ordered numeric/text/record workflows compose existing Python
|
| 70 |
+
operations; simple list/array chunk contracts are restored. Generated functions
|
| 71 |
+
are checked in a bounded AST VM. Unsupported clauses need clarification.
|
| 72 |
+
- The learned model weights, protected choice/word-math solvers and CA kernels
|
| 73 |
+
are unchanged. These upgrades are implementation changes.
|
| 74 |
+
|
| 75 |
+
## Named local confirmation
|
| 76 |
+
|
| 77 |
+
CAEL-CMP-R2-20261028 contains 80 locally authored synthetic items, 20 per category.
|
| 78 |
+
Every full reply was reviewed by AI coding agents (unblinded), including apparent
|
| 79 |
+
automatic passes and code.
|
| 80 |
+
The source, inputs and primary grading were frozen before final answers.
|
| 81 |
+
|
| 82 |
+
| System | Memory | Conversation | Python | Controls | Reviewed total |
|
| 83 |
+
|---|---:|---:|---:|---:|---:|
|
| 84 |
+
| CAEL 0.3.7 | 16/20 | 10/20 | 15/20 | 16/20 | 57/80 |
|
| 85 |
+
| Qwen3-0.6B | 8/20 | 13/20 | 6/20 | 16/20 | 43/80 |
|
| 86 |
+
| Qwen3.5-0.8B | 12/20 | 14/20 | 3/20 | 12/20 | 41/80 |
|
| 87 |
+
|
| 88 |
+
Functional Python: CAEL15/18, Qwen3 6/18, Qwen3.5 3/18. Original automatic totals
|
| 89 |
+
were54,43,42; full-review totals differ because regex matches can miss correct
|
| 90 |
+
answers or accept incorrect explanations. All raw replies/flags and every
|
| 91 |
+
adjudication are included under benchmarks/cael_cmp_r2_20261028/.
|
| 92 |
+
|
| 93 |
+
0.3.8 offline replay of the same 80 frozen inputs (automatic grader, no
|
| 94 |
+
re-review, no Qwen rerun): 59/80 automatic, versus 54/80 for the recorded 0.3.7
|
| 95 |
+
replies (memory 17, conversation 10, Python 16, controls 16). Seven replies
|
| 96 |
+
changed, listed in CHANGELOG.md. One of them (an invented birthplace) is also the
|
| 97 |
+
bug in a public report fixed in this release, so that item is not a clean
|
| 98 |
+
held-out test any more. The table above remains the 0.3.7 reviewed result.
|
| 99 |
+
|
| 100 |
+
This is an authored family-overlap test with unblinded review by AI coding
|
| 101 |
+
agents, not an independent leaderboard or evidence of general superiority. Qwen is stronger
|
| 102 |
+
on the conversation category here. On an older, broader 400-question test,
|
| 103 |
+
Qwen3.5 leads clearly: CAEL 121/400 versus Qwen3.5 181/400 original phrase
|
| 104 |
+
passes (Qwen3 116/400), with phrase-grading flaws disclosed. The targeted result
|
| 105 |
+
must not erase that limitation.
|
| 106 |
+
|
| 107 |
+
CAEL's measured full-portable process peak was558.648MiB in this shared-host
|
| 108 |
+
run. Qwen3 float32/eager peaked5896.336MiB; Qwen3.5 bfloat16/SDPA peaked2668.309MiB.
|
| 109 |
+
These are different runtimes/precisions, not an equal-size or optimized quantized
|
| 110 |
+
comparison. Disk size, model bytes, load time and median latency are separate
|
| 111 |
+
quantities recorded in the report. The earlier167MiB source-only run is not
|
| 112 |
+
this portable-build measurement.
|
| 113 |
+
|
| 114 |
+
## Remaining weaknesses
|
| 115 |
+
|
| 116 |
+
CAEL still misses factual/emotional paraphrases and fails tracing, leftmost
|
| 117 |
+
binary search under a no-imports rule, and much reasoning. It solves few
|
| 118 |
+
ordinary grade-school word problems: on a 400-problem GSM8K training sample
|
| 119 |
+
(a development check, not a release benchmark) it gave very few correct answers
|
| 120 |
+
and asked for clarification on most. Qwen is better at open conversation.
|
| 121 |
+
It does not understand arbitrary Python or replace a general LLM.
|
| 122 |
+
Do not enter personal information into shared demos. This release does not
|
| 123 |
+
change any running Vynly site or shared worker.
|
| 124 |
+
|
| 125 |
+
Read CHANGELOG.md, RELEASE_0_3_7.md and benchmarks/cael_cmp_r2_20261028/REPRODUCE.md for exact
|
| 126 |
+
settings, uncertainty, disclosures and the offline CAEL reply-regression replay.
|
SHA256SUMS.json
ADDED
|
@@ -0,0 +1,10 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"CAEL-0.3.8.zip": "c0d1771d54e9e5b77e84462cc00411e5cadede076ae4709fe06440c9e535dd6e",
|
| 3 |
+
"CHANGELOG.md": "6e7476618384caacbeed11890bcb28268f0017d02f4cd733a88c3e44b8d3a050",
|
| 4 |
+
"LICENSE": "d5d32c0f00aa08ac59843f80cd36b51717c6365585a9ead644ddf0db1f492661",
|
| 5 |
+
"NOTICE.md": "d12deb61adb80197d3976b97540c103bbfe85e5b9281abb0e94a468bbf6f53dc",
|
| 6 |
+
"README.md": "e08b22812c038d0e65a9ac4488c7df96211cefcb087ba20560ed201e19d8e9d2",
|
| 7 |
+
"bundle_config.json": "8aa7534c18a7be3f340834becad6e5d9ebbebec3e69d5a905e975c548fc34e44",
|
| 8 |
+
"cael-0.3.7.cael": "8efd22d7fa670e7f011d262c33a7e026941f279e71ee2014614d5d4cf5ecf79b",
|
| 9 |
+
"release_manifest.json": "479f5a095634cecab86f07ea76b4fede9c75c116e50b7e0369f4edd0cd24c900"
|
| 10 |
+
}
|
bundle_config.json
ADDED
|
@@ -0,0 +1,7 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"version": "0.3.7",
|
| 3 |
+
"url": "https://github.com/Vovala14/CAEL/releases/download/v0.3.7/cael-0.3.7.cael",
|
| 4 |
+
"sha256": "8efd22d7fa670e7f011d262c33a7e026941f279e71ee2014614d5d4cf5ecf79b",
|
| 5 |
+
"bytes": 562714794,
|
| 6 |
+
"profile": "no-images"
|
| 7 |
+
}
|
cael-0.3.7.cael
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8efd22d7fa670e7f011d262c33a7e026941f279e71ee2014614d5d4cf5ecf79b
|
| 3 |
+
size 562714794
|
release_manifest.json
ADDED
|
@@ -0,0 +1,64 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"version": "0.3.8",
|
| 3 |
+
"profile": "no-images",
|
| 4 |
+
"source_commit": "7a2322743ec8083eb3eef2b257e99289831735dc",
|
| 5 |
+
"source_archive": {
|
| 6 |
+
"file": "CAEL-0.3.8.zip",
|
| 7 |
+
"bytes": 21562557,
|
| 8 |
+
"sha256": "c0d1771d54e9e5b77e84462cc00411e5cadede076ae4709fe06440c9e535dd6e"
|
| 9 |
+
},
|
| 10 |
+
"resource_archive": {
|
| 11 |
+
"version": "0.3.7",
|
| 12 |
+
"url": "https://github.com/Vovala14/CAEL/releases/download/v0.3.7/cael-0.3.7.cael",
|
| 13 |
+
"sha256": "8efd22d7fa670e7f011d262c33a7e026941f279e71ee2014614d5d4cf5ecf79b",
|
| 14 |
+
"bytes": 562714794,
|
| 15 |
+
"profile": "no-images"
|
| 16 |
+
},
|
| 17 |
+
"code_only_release": true,
|
| 18 |
+
"resource_archive_unchanged_from": "0.3.7",
|
| 19 |
+
"checks": {
|
| 20 |
+
"pytest_passed": 1770,
|
| 21 |
+
"pytest_failed_environment_or_preexisting": 4,
|
| 22 |
+
"pytest_failed_on_v0_3_7_baseline_too": 4
|
| 23 |
+
},
|
| 24 |
+
"replay": {
|
| 25 |
+
"name": "CAEL-CMP-R2-20261028",
|
| 26 |
+
"items": 80,
|
| 27 |
+
"raw_automatic": {
|
| 28 |
+
"0.3.7_recorded": 54,
|
| 29 |
+
"0.3.8": 59
|
| 30 |
+
},
|
| 31 |
+
"per_category_0.3.8": {
|
| 32 |
+
"memory": 17,
|
| 33 |
+
"conversation": 10,
|
| 34 |
+
"python": 16,
|
| 35 |
+
"controls": 16
|
| 36 |
+
},
|
| 37 |
+
"changed_replies": 7,
|
| 38 |
+
"review": "AI coding agents, unblinded; not an independent evaluation",
|
| 39 |
+
"note": "memory-20 comes from a public bug report and is no longer a clean held-out item"
|
| 40 |
+
},
|
| 41 |
+
"public128_math_python": {
|
| 42 |
+
"math": "0/32",
|
| 43 |
+
"python": "1/32",
|
| 44 |
+
"same_as_0.3.7": true,
|
| 45 |
+
"competitive_math_gate_passed": false
|
| 46 |
+
},
|
| 47 |
+
"gsm8k_train_dev_400": {
|
| 48 |
+
"correct": 1,
|
| 49 |
+
"wrong": 17,
|
| 50 |
+
"abstain": 382,
|
| 51 |
+
"informational_only": true
|
| 52 |
+
},
|
| 53 |
+
"comparison_400": {
|
| 54 |
+
"CAEL": 121,
|
| 55 |
+
"Qwen3.5-0.8B": 181,
|
| 56 |
+
"Qwen3-0.6B": 116,
|
| 57 |
+
"note": "Qwen3.5 leads; evidence kept in local research files, not in this archive"
|
| 58 |
+
},
|
| 59 |
+
"image_portrait_weights": false,
|
| 60 |
+
"private_data_included": false,
|
| 61 |
+
"opponent_weights_or_runtime": false,
|
| 62 |
+
"licence": "source-available, non-commercial; unchanged",
|
| 63 |
+
"attribution": "AI-assisted"
|
| 64 |
+
}
|