Instructions to use EARAI/EARAI0.1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use EARAI/EARAI0.1 with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download EARAI/EARAI0.1 --local-dir EARAI0.1
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Release EARAI 0.1 research checkpoint
Browse files- .gitattributes +1 -0
- README.md +75 -1
- assets/banner.png +3 -0
- assets/evaluation.svg +25 -0
- benchmark_outcomes.jsonl +224 -0
- earai_tokenizer.json +1 -0
- metrics.json +54 -0
- model.safetensors +3 -0
- release_info.json +7 -0
.gitattributes
CHANGED
|
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
+
assets/banner.png filter=lfs diff=lfs merge=lfs -text
|
README.md
CHANGED
|
@@ -1,3 +1,77 @@
|
|
| 1 |
---
|
| 2 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
+
language:
|
| 3 |
+
- en
|
| 4 |
+
tags:
|
| 5 |
+
- code
|
| 6 |
+
- code-generation
|
| 7 |
+
- research
|
| 8 |
+
- mlx
|
| 9 |
+
- experimental
|
| 10 |
---
|
| 11 |
+
|
| 12 |
+

|
| 13 |
+
|
| 14 |
+
# EARAI 0.1
|
| 15 |
+
|
| 16 |
+
**RESEARCH PREVIEW · 166.9M PARAMETERS · CHECKPOINT 87,776**
|
| 17 |
+
|
| 18 |
+
EARAI 0.1 is an early research model for code generation. It explores a structured representation of programming context alongside a generative decoder. This release shares the weights and tokenizer; the research implementation is not included.
|
| 19 |
+
|
| 20 |
+
> **Status:** the model is experimental and is not ready for autonomous programming or production use. Its current execution-based benchmark results are reported below, including failures.
|
| 21 |
+
|
| 22 |
+
---
|
| 23 |
+
|
| 24 |
+
## Evaluation
|
| 25 |
+
|
| 26 |
+

|
| 27 |
+
|
| 28 |
+
The release was frozen before evaluation. One deterministic candidate was generated per task and tested in a network-isolated container. No external model or tool was used to repair the candidate.
|
| 29 |
+
|
| 30 |
+
| Evaluation | Tasks | Passed | Other observations |
|
| 31 |
+
|---|---:|---:|---|
|
| 32 |
+
| [HumanEval](https://github.com/openai/human-eval), full set | 164 | **0 / 164** | 17 prompts exceeded the total output budget; 123 generated programs parsed as Python |
|
| 33 |
+
| [Sanitized MBPP](https://github.com/google-research/google-research/tree/master/mbpp), sampled | 30 | **0 / 30** | 0 raw outputs parsed as Python in this sample |
|
| 34 |
+
|
| 35 |
+
For HumanEval, the public function prefix was supplied to the decoder and counted toward the 768-token output budget. Tasks that did not fit are counted as not solved. Both models' HumanEval continuations were cut at the same top-level stop patterns before execution. The syntax count includes the supplied prefix and does **not** imply the function is correct.
|
| 36 |
+
|
| 37 |
+
The MBPP figure is a deterministic random sample from the sanitized dataset, **not** the standard complete MBPP test split. The prompt explicitly requested Python and included one visible test. The raw output was executed without code extraction. Full task-level outcomes and the dataset checksums are provided in [`benchmark_outcomes.jsonl`](benchmark_outcomes.jsonl) and [`metrics.json`](metrics.json).
|
| 38 |
+
|
| 39 |
+
### Matched small-model comparison
|
| 40 |
+
|
| 41 |
+
On the **same 20 HumanEval tasks**, this frozen checkpoint solved **0 / 20**; [TinyStarCoderPy](https://huggingface.co/bigcode/tiny_starcoder_py), a 164M-parameter model, solved **1 / 20** under the local test. On the same 10 sampled MBPP tasks, both solved 0 / 10 with the raw-output procedure. This is a small comparison, not a leaderboard or a claim that the models are generally equivalent. Their tokenizers and model interfaces differ, and the same numeric token budget does not imply identical amounts of text.
|
| 42 |
+
|
| 43 |
+
As a check on the executor, 10 sampled reference implementations from each benchmark passed their original tests. This check does not rule out every evaluation issue or training-data contamination.
|
| 44 |
+
|
| 45 |
+
## Data and training
|
| 46 |
+
|
| 47 |
+
The model was trained from scratch on code and task data derived from open-source sources, with examples in Python, C, C++, C#, Go, Swift and JavaScript. The training pipeline also included a small set of execution-checked repair examples and teacher-generated hints. Language coverage in training is **not** a verified claim of programming ability in each language.
|
| 48 |
+
|
| 49 |
+
This checkpoint was produced on an Apple M5 Mac with 16 GB unified memory. The training context ceiling was 8,192 graph nodes; graph nodes are **not** tokens. A 256K-token context window or reliable use of distant project context has not been established.
|
| 50 |
+
|
| 51 |
+
## Files and use
|
| 52 |
+
|
| 53 |
+
| File | Contents |
|
| 54 |
+
|---|---|
|
| 55 |
+
| [`model.safetensors`](model.safetensors) | Frozen model weights at step 87,776 |
|
| 56 |
+
| [`earai_tokenizer.json`](earai_tokenizer.json) | EARAI tokenizer data |
|
| 57 |
+
| [`release_info.json`](release_info.json) | Parameter count, checkpoint and weight checksum |
|
| 58 |
+
| [`metrics.json`](metrics.json) | Evaluation configuration and aggregate results |
|
| 59 |
+
| [`benchmark_outcomes.jsonl`](benchmark_outcomes.jsonl) | Task IDs and outcomes; no benchmark reference solutions |
|
| 60 |
+
|
| 61 |
+
**Loading limitation:** this is a custom MLX research checkpoint, not a standard Hugging Face Transformers model. The tokenizer is also in an EARAI-specific format. The inference implementation is not included in this release, so `AutoModel` / `AutoTokenizer` cannot load these files as a ready-to-use application.
|
| 62 |
+
|
| 63 |
+
The weights are public and can be downloaded or copied. No model-weight license is specified in this card.
|
| 64 |
+
|
| 65 |
+
## Limitations
|
| 66 |
+
|
| 67 |
+
- The model frequently produces incorrect, repetitive or incomplete code.
|
| 68 |
+
- The current results do not establish independent project-level programming ability.
|
| 69 |
+
- Long output and long-context use remain constrained and require further testing.
|
| 70 |
+
- Public-code training data can include errors, duplication or licensing constraints; the data filters are not a proof of semantic quality or absence of sensitive material.
|
| 71 |
+
- Benchmark results depend on prompt format, tokenization, decoding and execution rules. The matched 20-task comparison is too small to establish a general ranking.
|
| 72 |
+
|
| 73 |
+
---
|
| 74 |
+
|
| 75 |
+
### Кратко по-русски
|
| 76 |
+
|
| 77 |
+
EARAI 0.1 — исследовательская модель для генерации кода. В полном HumanEval эта зафиксированная версия решила **0 из 164** задач; 17 заданий не поместились в лимит. Модель пока не готова для самостоятельной разработки. В репозитории опубликованы веса и токенизатор, но исходная реализация и готовый загрузчик не включены.
|
assets/banner.png
ADDED
|
Git LFS Details
|
assets/evaluation.svg
ADDED
|
|
benchmark_outcomes.jsonl
ADDED
|
@@ -0,0 +1,224 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/0", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 2 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/1", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 3 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/2", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 4 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/3", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 5 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/4", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 6 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/5", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 7 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/6", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 8 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/7", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 9 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/8", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 10 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/9", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 11 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/10", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 12 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/11", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 13 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/12", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 14 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/13", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 15 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/14", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 16 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/15", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 17 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/16", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 18 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/17", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 19 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/18", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 20 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/19", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 21 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/20", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 22 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/21", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 23 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/22", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 24 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/23", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 25 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/24", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 26 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/25", "passed": false, "syntax_valid": false, "unsupported": false}
|
| 27 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/26", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 28 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/27", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 29 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/28", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 30 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/29", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 31 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/30", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 32 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/31", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 33 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/32", "passed": false, "syntax_valid": false, "unsupported": false}
|
| 34 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/33", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 35 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/34", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 36 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/35", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 37 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/36", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 38 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/37", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 39 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/38", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 40 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/39", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 41 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/40", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 42 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/41", "passed": false, "syntax_valid": false, "unsupported": false}
|
| 43 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/42", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 44 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/43", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 45 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/44", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 46 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/45", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 47 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/46", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 48 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/47", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 49 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/48", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 50 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/49", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 51 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/50", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 52 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/51", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 53 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/52", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 54 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/53", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 55 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/54", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 56 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/55", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 57 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/56", "passed": false, "syntax_valid": false, "unsupported": false}
|
| 58 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/57", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 59 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/58", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 60 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/59", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 61 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/60", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 62 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/61", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 63 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/62", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 64 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/63", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 65 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/64", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 66 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/65", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 67 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/66", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 68 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/67", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 69 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/68", "passed": false, "syntax_valid": false, "unsupported": true}
|
| 70 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/69", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 71 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/70", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 72 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/71", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 73 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/72", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 74 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/73", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 75 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/74", "passed": false, "syntax_valid": false, "unsupported": false}
|
| 76 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/75", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 77 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/76", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 78 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/77", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 79 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/78", "passed": false, "syntax_valid": false, "unsupported": true}
|
| 80 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/79", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 81 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/80", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 82 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/81", "passed": false, "syntax_valid": false, "unsupported": true}
|
| 83 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/82", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 84 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/83", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 85 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/84", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 86 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/85", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 87 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/86", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 88 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/87", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 89 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/88", "passed": false, "syntax_valid": false, "unsupported": false}
|
| 90 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/89", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 91 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/90", "passed": false, "syntax_valid": false, "unsupported": false}
|
| 92 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/91", "passed": false, "syntax_valid": false, "unsupported": false}
|
| 93 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/92", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 94 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/93", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 95 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/94", "passed": false, "syntax_valid": false, "unsupported": false}
|
| 96 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/95", "passed": false, "syntax_valid": false, "unsupported": false}
|
| 97 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/96", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 98 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/97", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 99 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/98", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 100 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/99", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 101 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/100", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 102 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/101", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 103 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/102", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 104 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/103", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 105 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/104", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 106 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/105", "passed": false, "syntax_valid": false, "unsupported": true}
|
| 107 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/106", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 108 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/107", "passed": false, "syntax_valid": false, "unsupported": false}
|
| 109 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/108", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 110 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/109", "passed": false, "syntax_valid": false, "unsupported": true}
|
| 111 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/110", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 112 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/111", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 113 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/112", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 114 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/113", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 115 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/114", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 116 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/115", "passed": false, "syntax_valid": false, "unsupported": true}
|
| 117 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/116", "passed": false, "syntax_valid": false, "unsupported": false}
|
| 118 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/117", "passed": false, "syntax_valid": false, "unsupported": false}
|
| 119 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/118", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 120 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/119", "passed": false, "syntax_valid": false, "unsupported": false}
|
| 121 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/120", "passed": false, "syntax_valid": false, "unsupported": false}
|
| 122 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/121", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 123 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/122", "passed": false, "syntax_valid": false, "unsupported": false}
|
| 124 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/123", "passed": false, "syntax_valid": false, "unsupported": true}
|
| 125 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/124", "passed": false, "syntax_valid": false, "unsupported": true}
|
| 126 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/125", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 127 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/126", "passed": false, "syntax_valid": false, "unsupported": false}
|
| 128 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/127", "passed": false, "syntax_valid": false, "unsupported": true}
|
| 129 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/128", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 130 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/129", "passed": false, "syntax_valid": false, "unsupported": true}
|
| 131 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/130", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 132 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/131", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 133 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/132", "passed": false, "syntax_valid": false, "unsupported": false}
|
| 134 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/133", "passed": false, "syntax_valid": false, "unsupported": false}
|
| 135 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/134", "passed": false, "syntax_valid": false, "unsupported": false}
|
| 136 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/135", "passed": false, "syntax_valid": false, "unsupported": false}
|
| 137 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/136", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 138 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/137", "passed": false, "syntax_valid": false, "unsupported": false}
|
| 139 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/138", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 140 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/139", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 141 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/140", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 142 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/141", "passed": false, "syntax_valid": false, "unsupported": true}
|
| 143 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/142", "passed": false, "syntax_valid": false, "unsupported": false}
|
| 144 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/143", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 145 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/144", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 146 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/145", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 147 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/146", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 148 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/147", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 149 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/148", "passed": false, "syntax_valid": false, "unsupported": true}
|
| 150 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/149", "passed": false, "syntax_valid": false, "unsupported": true}
|
| 151 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/150", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 152 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/151", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 153 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/152", "passed": false, "syntax_valid": false, "unsupported": true}
|
| 154 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/153", "passed": false, "syntax_valid": false, "unsupported": true}
|
| 155 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/154", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 156 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/155", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 157 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/156", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 158 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/157", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 159 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/158", "passed": false, "syntax_valid": false, "unsupported": false}
|
| 160 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/159", "passed": false, "syntax_valid": false, "unsupported": true}
|
| 161 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/160", "passed": false, "syntax_valid": false, "unsupported": true}
|
| 162 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/161", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 163 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/162", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 164 |
+
{"model": "EARAI0.1", "benchmark": "HumanEval", "task_id": "HumanEval/163", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 165 |
+
{"model": "TinyStarCoderPy", "benchmark": "HumanEval-matched-sample", "task_id": "HumanEval/30", "passed": true, "syntax_valid": true, "unsupported": false}
|
| 166 |
+
{"model": "TinyStarCoderPy", "benchmark": "HumanEval-matched-sample", "task_id": "HumanEval/81", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 167 |
+
{"model": "TinyStarCoderPy", "benchmark": "HumanEval-matched-sample", "task_id": "HumanEval/128", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 168 |
+
{"model": "TinyStarCoderPy", "benchmark": "HumanEval-matched-sample", "task_id": "HumanEval/131", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 169 |
+
{"model": "TinyStarCoderPy", "benchmark": "HumanEval-matched-sample", "task_id": "HumanEval/26", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 170 |
+
{"model": "TinyStarCoderPy", "benchmark": "HumanEval-matched-sample", "task_id": "HumanEval/57", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 171 |
+
{"model": "TinyStarCoderPy", "benchmark": "HumanEval-matched-sample", "task_id": "HumanEval/153", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 172 |
+
{"model": "TinyStarCoderPy", "benchmark": "HumanEval-matched-sample", "task_id": "HumanEval/159", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 173 |
+
{"model": "TinyStarCoderPy", "benchmark": "HumanEval-matched-sample", "task_id": "HumanEval/142", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 174 |
+
{"model": "TinyStarCoderPy", "benchmark": "HumanEval-matched-sample", "task_id": "HumanEval/107", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 175 |
+
{"model": "TinyStarCoderPy", "benchmark": "HumanEval-matched-sample", "task_id": "HumanEval/146", "passed": false, "syntax_valid": false, "unsupported": false}
|
| 176 |
+
{"model": "TinyStarCoderPy", "benchmark": "HumanEval-matched-sample", "task_id": "HumanEval/140", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 177 |
+
{"model": "TinyStarCoderPy", "benchmark": "HumanEval-matched-sample", "task_id": "HumanEval/125", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 178 |
+
{"model": "TinyStarCoderPy", "benchmark": "HumanEval-matched-sample", "task_id": "HumanEval/150", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 179 |
+
{"model": "TinyStarCoderPy", "benchmark": "HumanEval-matched-sample", "task_id": "HumanEval/112", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 180 |
+
{"model": "TinyStarCoderPy", "benchmark": "HumanEval-matched-sample", "task_id": "HumanEval/61", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 181 |
+
{"model": "TinyStarCoderPy", "benchmark": "HumanEval-matched-sample", "task_id": "HumanEval/0", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 182 |
+
{"model": "TinyStarCoderPy", "benchmark": "HumanEval-matched-sample", "task_id": "HumanEval/157", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 183 |
+
{"model": "TinyStarCoderPy", "benchmark": "HumanEval-matched-sample", "task_id": "HumanEval/20", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 184 |
+
{"model": "TinyStarCoderPy", "benchmark": "HumanEval-matched-sample", "task_id": "HumanEval/28", "passed": false, "syntax_valid": true, "unsupported": false}
|
| 185 |
+
{"model": "EARAI0.1", "benchmark": "MBPP-sanitized-sample", "task_id": 106, "passed": false, "syntax_valid": false}
|
| 186 |
+
{"model": "EARAI0.1", "benchmark": "MBPP-sanitized-sample", "task_id": 293, "passed": false, "syntax_valid": false}
|
| 187 |
+
{"model": "EARAI0.1", "benchmark": "MBPP-sanitized-sample", "task_id": 473, "passed": false, "syntax_valid": false}
|
| 188 |
+
{"model": "EARAI0.1", "benchmark": "MBPP-sanitized-sample", "task_id": 478, "passed": false, "syntax_valid": false}
|
| 189 |
+
{"model": "EARAI0.1", "benchmark": "MBPP-sanitized-sample", "task_id": 629, "passed": false, "syntax_valid": false}
|
| 190 |
+
{"model": "EARAI0.1", "benchmark": "MBPP-sanitized-sample", "task_id": 98, "passed": false, "syntax_valid": false}
|
| 191 |
+
{"model": "EARAI0.1", "benchmark": "MBPP-sanitized-sample", "task_id": 235, "passed": false, "syntax_valid": false}
|
| 192 |
+
{"model": "EARAI0.1", "benchmark": "MBPP-sanitized-sample", "task_id": 602, "passed": false, "syntax_valid": false}
|
| 193 |
+
{"model": "EARAI0.1", "benchmark": "MBPP-sanitized-sample", "task_id": 615, "passed": false, "syntax_valid": false}
|
| 194 |
+
{"model": "EARAI0.1", "benchmark": "MBPP-sanitized-sample", "task_id": 578, "passed": false, "syntax_valid": false}
|
| 195 |
+
{"model": "EARAI0.1", "benchmark": "MBPP-sanitized-sample", "task_id": 427, "passed": false, "syntax_valid": false}
|
| 196 |
+
{"model": "EARAI0.1", "benchmark": "MBPP-sanitized-sample", "task_id": 782, "passed": false, "syntax_valid": false}
|
| 197 |
+
{"model": "EARAI0.1", "benchmark": "MBPP-sanitized-sample", "task_id": 587, "passed": false, "syntax_valid": false}
|
| 198 |
+
{"model": "EARAI0.1", "benchmark": "MBPP-sanitized-sample", "task_id": 573, "passed": false, "syntax_valid": false}
|
| 199 |
+
{"model": "EARAI0.1", "benchmark": "MBPP-sanitized-sample", "task_id": 752, "passed": false, "syntax_valid": false}
|
| 200 |
+
{"model": "EARAI0.1", "benchmark": "MBPP-sanitized-sample", "task_id": 778, "passed": false, "syntax_valid": false}
|
| 201 |
+
{"model": "EARAI0.1", "benchmark": "MBPP-sanitized-sample", "task_id": 773, "passed": false, "syntax_valid": false}
|
| 202 |
+
{"model": "EARAI0.1", "benchmark": "MBPP-sanitized-sample", "task_id": 464, "passed": false, "syntax_valid": false}
|
| 203 |
+
{"model": "EARAI0.1", "benchmark": "MBPP-sanitized-sample", "task_id": 763, "passed": false, "syntax_valid": false}
|
| 204 |
+
{"model": "EARAI0.1", "benchmark": "MBPP-sanitized-sample", "task_id": 776, "passed": false, "syntax_valid": false}
|
| 205 |
+
{"model": "EARAI0.1", "benchmark": "MBPP-sanitized-sample", "task_id": 594, "passed": false, "syntax_valid": false}
|
| 206 |
+
{"model": "EARAI0.1", "benchmark": "MBPP-sanitized-sample", "task_id": 437, "passed": false, "syntax_valid": false}
|
| 207 |
+
{"model": "EARAI0.1", "benchmark": "MBPP-sanitized-sample", "task_id": 246, "passed": false, "syntax_valid": false}
|
| 208 |
+
{"model": "EARAI0.1", "benchmark": "MBPP-sanitized-sample", "task_id": 3, "passed": false, "syntax_valid": false}
|
| 209 |
+
{"model": "EARAI0.1", "benchmark": "MBPP-sanitized-sample", "task_id": 610, "passed": false, "syntax_valid": false}
|
| 210 |
+
{"model": "EARAI0.1", "benchmark": "MBPP-sanitized-sample", "task_id": 87, "passed": false, "syntax_valid": false}
|
| 211 |
+
{"model": "EARAI0.1", "benchmark": "MBPP-sanitized-sample", "task_id": 102, "passed": false, "syntax_valid": false}
|
| 212 |
+
{"model": "EARAI0.1", "benchmark": "MBPP-sanitized-sample", "task_id": 274, "passed": false, "syntax_valid": false}
|
| 213 |
+
{"model": "EARAI0.1", "benchmark": "MBPP-sanitized-sample", "task_id": 801, "passed": false, "syntax_valid": false}
|
| 214 |
+
{"model": "EARAI0.1", "benchmark": "MBPP-sanitized-sample", "task_id": 96, "passed": false, "syntax_valid": false}
|
| 215 |
+
{"model": "TinyStarCoderPy", "benchmark": "MBPP-matched-sample", "task_id": 578, "passed": false, "syntax_valid": false}
|
| 216 |
+
{"model": "TinyStarCoderPy", "benchmark": "MBPP-matched-sample", "task_id": 102, "passed": false, "syntax_valid": false}
|
| 217 |
+
{"model": "TinyStarCoderPy", "benchmark": "MBPP-matched-sample", "task_id": 478, "passed": false, "syntax_valid": false}
|
| 218 |
+
{"model": "TinyStarCoderPy", "benchmark": "MBPP-matched-sample", "task_id": 752, "passed": false, "syntax_valid": false}
|
| 219 |
+
{"model": "TinyStarCoderPy", "benchmark": "MBPP-matched-sample", "task_id": 106, "passed": false, "syntax_valid": false}
|
| 220 |
+
{"model": "TinyStarCoderPy", "benchmark": "MBPP-matched-sample", "task_id": 437, "passed": false, "syntax_valid": false}
|
| 221 |
+
{"model": "TinyStarCoderPy", "benchmark": "MBPP-matched-sample", "task_id": 778, "passed": false, "syntax_valid": false}
|
| 222 |
+
{"model": "TinyStarCoderPy", "benchmark": "MBPP-matched-sample", "task_id": 610, "passed": false, "syntax_valid": false}
|
| 223 |
+
{"model": "TinyStarCoderPy", "benchmark": "MBPP-matched-sample", "task_id": 427, "passed": false, "syntax_valid": false}
|
| 224 |
+
{"model": "TinyStarCoderPy", "benchmark": "MBPP-matched-sample", "task_id": 235, "passed": false, "syntax_valid": false}
|
earai_tokenizer.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
["<pad>", "<unk>", "<bos>", "<eos>", " ", "!", "\"", "#", "$", "%", "&", "'", "(", ")", "*", "+", ",", "-", ".", "/", "0", "1", "2", "3", "4", "5", "6", "7", "8", "9", ":", ";", "<", "=", ">", "?", "@", "A", "B", "C", "D", "E", "F", "G", "H", "I", "J", "K", "L", "M", "N", "O", "P", "Q", "R", "S", "T", "U", "V", "W", "X", "Y", "Z", "[", "\\", "]", "^", "_", "`", "a", "b", "c", "d", "e", "f", "g", "h", "i", "j", "k", "l", "m", "n", "o", "p", "q", "r", "s", "t", "u", "v", "w", "x", "y", "z", "{", "|", "}", "~", "", "", "", "", "", "
", "", "", "", "", "", "", "", "", "", "", "", "", "", "", "", "", "", "", "", "", "", "", "", "", "", "", " ", "¡", "¢", "£", "¤", "¥", "¦", "§", "¨", "©", "ª", "«", "¬", "", "®", "¯", "°", "±", "²", "³", "´", "µ", "¶", "·", "¸", "¹", "º", "»", "¼", "½", "¾", "¿", "À", "Á", "Â", "Ã", "Ä", "Å", "Æ", "Ç", "È", "É", "Ê", "Ë", "Ì", "Í", "Î", "Ï", "Ð", "Ñ", "Ò", "Ó", "Ô", "Õ", "Ö", "×", "Ø", "Ù", "Ú", "Û", "Ü", "Ý", "Þ", "ß", "à", "á", "â", "ã", "ä", "å", "æ", "ç", "è", "é", "ê", "ë", "ì", "í", "î", "ï", "ð", "ñ", "ò", "ó", "ô", "õ", "ö", "÷", "ø", "ù", "ú", "û", "ü", "ý", "þ", "ÿ", "\n", " ", "self", " ", "def", "return", "if", " ", "None", "in", "for", "==", "not", "name", "else", "True", "value", "data", "\t", "path", "is", "False", "get", "raise", " ", "assert", "**", "args", "assertEqual", "len", "key", "result", "kwargs", "try", "os", "request", "except", "response", "str", "->", "and", "append", "\t\t", "np", "isinstance", "\r\n", "context", "config", "with", "property", "cls", "func", "hass", "join", "format", "''", "or", "int", "as", "elif", "!=", "url", "id", "node", " ", "__init__", "+=", "text", "obj", "err", "msg", "filename", "user", "list", "params", "ValueError", "type", "index", "client", "state", "await", "message", "model", "item", "shape", "line", "error", "session", "info", "range", "body", "status", "string", "objects", "values", "debug", "split", "out", "items", "set", "async", "dict", "import", "size", "dtype", "logger", "query", "package", "time", "val", "instance", "db", "update", "output", "write", "start", " ", "headers", "print", "row", "env", "from", "count", "content", "super", "ear_sample", "json", "field", "NotImplementedError", "match", "ctx", "assertTrue", "yield", ":=", "open", "filter", "options", "nil", "host", "mode", "datetime", "float", "parent", "while", "version", "bool", "ret", "target", "'name'", "log", "save", "classmethod", "\t\t\t", "port", "//", "keys", "const", "group", "sys", "Exception", "other", "source", "array", "replace", "getattr", "add", "results", "resp", "res", "req", "tag", "title", "event", "root", "pytest", "1.0", "read", "exception", "class", "10", "lambda", "void", "cmd", "label", "entry", "app", "all", "close", "token", "strip", "username", "device", "hasattr", "continue", "lower", "pass", "code", "pop", "var", "'id'", "settings", "fields", ">=", "form", "timeout", "attr", "logging", "assertEquals", "status_code", "0.0", "reverse", "op", "startswith", "LOG", "cursor", "exc", "axis", "end", "table", "kw", "pattern", "TypeError", "run", "'/'", "tf", "' '", "utils", "re", "callback", "file", "function", "image", "default", "module", "password", "stdout", "copy", "test", "tuple", "method", "command", "this", " ", "execute", "expected", "exists", "assertRaises", "task", "base", "map", "errors", "prefix", "__name__", "opts", "action", "staticmethod", "'\\n'", "resource", "now", "lines", "200", "conf", "delete", "child", "connection", "'.'", "length", "let", "payload", "position", "<=", "create", "'a'", "break", "environ", "graph", "patch", "template", "domain", "doc", "conn", "encoding", "'type'", "parser", "del", "new", "namespace", "Any", "static", "f'", "100", "idx", "__class__", "offset", "strategy", "encode", "page", "arg", "KeyError", "address", "width", "col", "metadata", "sum", "post", "numpy", "frame", "the", "six", "EARSample", "loads", "pos", "labels", "random", "_LOGGER", "next", "ex", "stack", "extend", "pk", "expr", "project", "max", "nodes", "spec", "attributes", "DOMAIN", "models", "call", "children", "service", "'-'", "current", "tmp_path", "channel", "cache", "parts", "step", "input", "kind", "element", "remove", "setter", "attrs", "description", "stop", "false", "queryset", "storage", "email", "'test'", "zip", "enumerate", "names", "register", "stderr", "User", "AttributeError", "Optional", "level", "sub", "fn", "mock", "bot", "inputs", "render", "dumps", "sorted", "handler", "search", "object", "char", "socket", "block", "dirname", "scope", "server", "subprocess", "document", "public", "return_value", "record", "driver", "load", "0.5", "compile", "bregex", "'utf-8'", "finally", "ops", "uuid", "assertFalse", "any", "clear", "files", "fname", "rsp", "true", "decode", "first", "mask", "timestamp", "to", "buf", "user_id", "engine", "assertIn", "order", "trainer", "cfg", "color", "stream", "http", "groups", "content_type", "ctxt", "iteritems", "raises", "schema", "topic", "header", "_state", "network", "Mock", "uri", "1000", "fp", "assertAlmostEqual", "bytes", "filters", "reason", "2.0", "editor", "product", "location", "...", "_name", "limit", "df", "warn", "find", "List", "height", "date", "rule", "'value'", "hash", "min", "states", "Dict", "indices", "'data'", "tags", "'w'", "'b'", "site", "left", "option", "slug", "ts", "widget", "case", "grid", "entity_id", "regex", "-=", "send", "option_list", "dim", "meta", "parse", "setup", "warnings", "auth", "flags", "platform", "img", "process", "src", "delta", "mat", "pilot", "entity", "right", "api", "eq_", "16", "_data", "connect", "fd", "components", "field_name", "mark", "timedelta", "year", "setattr", "':'", "abspath", "dag", "tenant_id", "html", "rows", "'r'", "Text", "uid", "commit", "unicode", "dt", "20", "asyncio", "fmt", "core", "locale", "number", "util", "'_'", "cp", "loader", "properties", "sleep", "endpoint", "raw", "ds", "put", "provider", "sender", "category", "wrapper", "select", "view", "zeros", "String", "argv", "endswith", "expand", "num", "param", "stats", "scale", "std", "validate", "chunk", "ref", "warning", "'foo'", "abs", "batch_size", "file_path", "repo", "setUp", "variables", "60", "bits", "check", "loop", "features", "<<", "dataset", "matches", "_meta", "array_ops", "defaults", "discovery_info", "events", "net", "requests", "column", "desc", "types", "word", "frappe", "sql", "arrhenius", "messages", "salt", "'password'", "constants", "ok", "parameters", "region", "verbose", "CONF", "dest", "fail", "ip", "review_request", "script", "seq", "'username'", "RuntimeError", "rv", "struct", "'title'", "NULL", "exclude", "handle", "tokens", "where", "assertRedirects", "dir", "directory", "upper", " ", "','", "identifier", "lang", "pid", "Template", "cell", "poly", "Message", "__dict__", "backend", "clone", "im", "manager", "pin", "sort", "tzinfo", "bus", "hostname", "language", "plt", "rules", "ii", "columns", "component", "dot", "profile", "sep", "subject", "window", "common", "exp", "seconds", "link", "pool", "registry", "rval", "\"\"", "'POST'", "exit", "__call__", "controller", "paths", "IndexError", "type_", "days", "db_session", "force", "reshape", "'status'", "alpha", "fixture", "section", "sqrt", ">>", "Context", "buffer", "fs", "global", "torch", "', '", "found", "iter", "lock", "second", "Path", "commands", "exceptions", "isfile", "relpath", "tensor", "'user'", "base_url", "filepath", "head", "nm", "p1", "part", "suffix", "t1", "table_name", "term", "cur", "style", "basename", "lineno", "'1'", "extra", "ns", "'0'", "500", "_logger", "abstractmethod", "byte", "dialect", "main", "'c'", "'message'", "alias", "devices", "math", "month", "points", "ps", "click", "elem", "migratable", "norm", "v1", "volume", "actual", "job", "repr", "users", "'*'", "StringIO", "attribute", "opt", "rest", "revision", "abc", "config_entries", "outputs", "tree", "IOError", "collection", "factory", "proc", "services", "404", "coords", "units", "'GET'", "12", "container", "mean", "sess", "condition", "inspect", "modules", "total", "uuid4", "yaml", "\t\t\t\t", "Tlist", "assertIsInstance", "fid", "flow", "400", "dev", "string_types", "cwd", "database", "help", "publish", "seed", "targets", "ui", "wait", "Node", "OSError", "ax", "errno", "extension", "io", "pipeline", "qs", "x1", "assertOutput", "comment", "factor", "insert", "ndarray", "reporter", "queue", "setdefault", "unsigned", "isdir", "layout", "ndim", "node1", "reactor", "score", "slice", "strings", "timezone", "top", "weights", "day", "decorator", "flag", "loss", "signal", "tasks", "transform", "ids", "30", "expression", "getvalue", "phi", "since", "xrange", "node2", "|=", "'error'", "ImportError", "cleaned_data", "cli", "contents", "nn", "switch", "arguments", "of", "thread", "tmp", "dst", "page_id", "sig", "store", "tables", "tu", "300", "diff", "dist", "member", "null", "scenario", "'description'", "'rb'", "fit", "prop", "Address", "Error", "__file__", "astype", "classes", "depth", "entries", "exp_response", "indent", "loc", "module_name", "plot", "stat", "to_dict", "unit", "utcnow", "'text'", "__new__", "assertNoOutput", "ext", "flush", "plugin", "precision", "Tag", "__init", "etree", "it", "one", "operation", "text_type", "validation", "Response", "comps", "expect", "interface", "project_id", "reader", "words", "'code'", "'default'", "'host'", "_op", "cast", "connector", "subscription", "ti", "'\\t'", "255", "Tensor", "app_id", "file_name", "instances", "prompt", "rstrip", "system", "urls", "0.1", "add_devices", "begin", "login", "long", "remote", "role", "'path'", "'source'", "after", "callable", "cluster", "explanation", "parametrize", "snapshot", "t2", "*=", "15", "asarray", "empty", "feature", "folder", "hour", "int32", "logits", "mod", "order_by", "point", "sample", "32", "NotImplemented", "QtGui", "layers", "optimizer", "'check'", "'x'", "Int", "_id", "chain", "colors", "device_id", "duration", "reference", "rev", "temp", "unittest", "_cache", "addr", "coroutine", "glob", "minute", "start_time", "'key'", "'url'", "Table", "_lib", "access", "gen", "mx", "rel", "testing", "threshold", "xml", "'application/json'", "50", "_config", "_lock", "enabled", "reset", "setup_component", "tmpdir", "urllib", "11", "created", "is_valid", "mesh", "\"\"\"\n .. todo::\n\n WRITEME\n \"\"\"", "PIPE", "_log", "arr", "constant", "dag_id", "fetch", "mapper", "math_ops", "port_id", "pred", "steps", "success", "writer", "abf", "assert_raises", "axes", "float32", "monkeypatch", "node_id", "pobj", "randint", "sid", "wraps", "'f'", "Value", "__repr__", "full_path", "old", "shutil", "start_date", "transport", "v2", "'d'", "__str__", "_session", "attrib", "center", "layer", "report", "secret", "tp", "100.0", "assertIsNone", "extensions", "listdir", "nt", "ord", "pd", "perm", "repository", "'ascii'", "'version'", "admin", "assertNotEqual", "called", "defer", "direction", "flatten", "flavor", "metrics", "mkdir", "ones", "props", "refresh", "release", "strftime", "uint32_t", "'='", "Name", "_client", "before", "cr", "dump", "predictions", "round", "splitlines", "'json'", "last", "lib", "products", "queries", "tearDown", "vals", "vars", "'bar'", "'request'", "ValidationError", "album", "arange", "entities", "exc_info", "original", "protocol", "s3db", "sock", "OptionList", "block_till_done", "calls", "feed", "identity", "pL2CC", "post_body", "radius", "s1", "scheme", "shell", "temperature", "txt", "'stat'", "assertIsNotNone", "compile_replace", "console", "convert", "credentials", "delay", "grad", "klass", "on", "owner", "test_runner", "Array", "HashMap", "chunks", "connection_info", "cookies", "dtypes", "override_settings", "pickle", "route", "sin", "OptionListApp", "RunIf", "angle", "binary", "bind", "digest", "helpers", "impl", "redirect", "threading", "uint8_t", "POST", "Task", "Tmax", "_properties", "_status", "build", "ch", "counter", "dataset_id", "eval", "functools", "guard", "init", "iterator", "kinetics", "pio", "run_test", "show", "'y'", "Errorf", "Union", "account", "author", "beta", "deleted", "end_date", "foo", "fromstring", "iterable", "partition", "pi", "quote", "rec", "reg", "roles", "trigger", "urlparse", "vol", "worker", "x2", "Event", "Session", "assertNotIn", "basestring", "input_shape", "new_name", "parsed", "setup_platform", "suite", "tempfile", "tile", "uint32", "vector", "'result'", "Type", "apply", "cols", "edges", "hexdigest", "ignore", "jnp", "local", "local_site", "partial", "poller", "s2", "task_id", "throw", "variable", "zone", "24", "CONF_NAME", "Tmin", "active", "assert_equal", "construct", "fun", "metric", "outs", "quantum", "thing", "tostring", "GET", "HTTPError", "Page", "__salt__", "api_version", "canvas", "contextmanager", "db_api", "destination", "dictionary", "do", "heap", "missing", "mu", "p2", "response_format", "trace", "value_si", "64", "Object", "Tuple", "bucket", "dataFile", "double", "filter_by", "get_shape", "nx", "padding", "rhs", "rng", "vec", "wsgi", "'_id'", "FLAGS", "caller", "choices", "configure", "gertty", "images", "linalg", "makedirs", "mapping", "methods", "normalize", "pack", "query_one", "reversed", "size_t", "song", "summary", "valid", "\"\"\" See barbante.data.BaseProxy.\n \"\"\"", "'email'", "DoesNotExist", "State", "addresses", "auto", "detail", "examples", "font", "placeholder", "player", "tests", "'wb'", "42", "DEBUG", "Selector", "URL", "__doc__", "actions", "bos", "counts", "create_review_request", "cuda", "fig", "formula", "get_cursor", "hashlib", "helper", "interval", "key_name", "price", "priority", "shared", "slot", "source_id", "vm_ref", "'/accounts/login'", "'user_login'", "Bool", "USER", "__getitem__", "aggregate", "assert_called_once_with", "charset", "clean", "details", "factors", "get_value", "orig", "origin", "prev", "rect", "rf", "serializer", "train", "tz", "verify", "versions", "'Content-Type'", "'all'", "0.", "0.01", "1.5", "CONF_HOST", "Popen", "data_entry_flow", "digits", "getLogger", "grains", "inp", "issubclass", "members", "person", "predict", "rate", "timer", "transaction", "transpose", "vm", "'html'", "'port'", "2000", "MagicMock", "Mapping", "_c", "_context", "available", "b''", "call_count", "collect", "dependencies", "deps", "ev", "example", "inertia", "ip_address", "jobj", "locals", "notify", "override", "panel", "sp", "tools", "traceback", "256", "BUCKET", "HTTPNotFound", "HttpResponse", "Image", "Set", "add_argument", "async_init", "by", "cells", "data_type", "dirpath", "dirs", "distance", "done", "elements", "failure", "functions", "itertools", "logentry", "lookup", "lst", "push", "seek", "sequence", "side_effect", "stmt", "tempdir", "'u'", "1024", "Model", "NAME", "Trainer", "_post_request", "_url", "accelerator", "app_label", "be", "dx", "elapsed", "escape", "lhs", "move", "outfile", "rank", "signature", "swhlab", "visited", "walk", "'platform'", "'state'", "Command", "_m", "api_action", "assert_called_with", "at", "c2", "choice", "config_entry", "configuration", "deepcopy", "edge", "exit_code", "findall", "inst", "qdb", "requires", "resources", "running", "sign", "stage", "today", "topi", "'admin_scripts'", "'nova.context'", "SystemExit", "_index", "acquire", "ast", "branch", "cleanup", "failed", "flag_value", "force_text", "guild", "mappings", "microsecond", "name_scope", "rc", "sigma", "symbol", "tol", "u0", "'success'", "'utf8'", "25", "Time", "batch", "c1", "cancel", "connections", "creds", "ctype", "estimator", "flavor_id", "group_name", "hook", "hooks", "hosts", "is_active", "loaded", "make", "network_id", "parse_args", "prob", "r1", "reply", "required", "runner", "throws", "webob", "/=", "3.0", "HTTPBadRequest", "Index", "OrderedDict", "_solution", "cos", "curr", "cv", "hawkes", "image_id", "inline", "locator", "mac", "operator", "pages", "run_manage", "simple_tag", "tiler", "times", "unpack", "'index'", "13", "_lists", "add_node", "amount", "assert_", "bit", "dims", "fh", "float64", "input_fn", "marker", "mimetype", "minutes", "object_name", "rmtree", "serialize", "strides", "support", "tb", "trial", "u1", "'http'", "Column", "Group", "QtCore", "__module__", "_api", "application", "async_block_till_done", "candidates", "cell_name", "class_name", "device_name", "dispatcher", "freq", "future", "li", "links", "net_id", "pair", "pkg", "receiver", "recursive", "run_django_admin", "stride", "xs", "'%s'", "')'", "'label'", "'metadata'", "CODE", "Callable", "Service", "__iter__", "_maxes", "binding", "client_factory", "cm", "doctype", "f\"", "linspace", "listener", "lstrip", "media", "pairs", "qry", "records", "separator", "serializers", "skip", "update_ha_state", "'\"'", "'ok'", "'true'", "Add", "Key", "Person", "__eq__", "_j_execution_config", "_loop", "add_edge", "authorize", "bottom", "bytes_written", "dep", "formatter", "history", "kubernetes_e2e", "mid", "mp", "new_state", "parents", "proxy", "pv", "secure", "state_dict", "tab", "template_name", "that", "vim", "wrap", "'A'", "'['", "'s'", "'str'", "40", "AssertionError", "_instances", "_test_get_with_field_count", "byte_string", "checksum", "flat", "fullname", "globals", "go", "ia", "ib", "is_approved", "pTwi", "qos", "real", "remaining", "renderer", "st", "tpl", "used", "when", "\"'\"", "'?'", "'action'", "'address'", "'comp'", "'count'", "'device'", "'ignore'", "'model'", "Read", "SAMFilter", "Utils", "async_add_entities", "async_setup_component", "bundle", "collections", "config_path", "data_size", "db_field", "indptr", "message_id", "misc", "note", "private", "process_response", "proxy_port", "remainder", "scheduler", "sizeof", "soup", "xlplatform", "'#'", "'('", "'>i4'", "'form'", "0.0001", "Elist", "__opts__", "attr_name", "catch", "cb", "cl", "cookie", "corofunc", "definition", "highlighted", "hosting_account", "instance_id", "kernel", "mail", "mrb", "netloc", "proto", "u''", "updates", "x0", "y1", "'\\\\'", "']'", "Element", "_set", "aliases", "apps", "cert", "deepspeed", "depends_on", "el", "execution_date", "floor", "format_message", "generate", "handlers", "is_on", "leases", "longitude", "manifest", "msg_runner", "object_id", "ports", "proxy_url", "pywikibot", "readlines", "replacements", "responses", "tail", "tool", " ", "'|'", "Client", "META", "Thread", "__bus", "_proxy_port", "_proxy_url", "_securityHandler", "addCleanup", "chars", "ct", "ctypes", "excinfo", "executor", "file_entry", "filenames", "fragment", "full", "full_name", "include", "int64", "json_path", "literal", "nan", "only", "packages", "parent_id", "r2", "readline", "reduce", "review", "runs_after", "securityHandler", "translate", "txt_match", "using", "weight", "win", "'2.0.0'", "'hello'", "'start'", "128", "1500", "AggressiveInlining", "MethodImpl", "MethodImplOptions", "Self", "TRN", "acc", "api_get", "argument", "assertContains", "block_size", "concat", "contrib", "diag", "expected_mimetype", "gc", "get_config", "icon", "isoformat", "kill", "memo", "mtime", "packet", "path_spec", "pp", "raw_data", "resource_name", "retries", "rtrycnt", "sc", "space", "sql_connection", "stdin", "strict", "subs", "takes_context", "tgt", "verbosity", "'>'", "'Test'", "'base'", "'cuda'", "14", "_base", "access_token", "appendChild", "bridge", "contextlib", "current_app", "defaultdict", "discount", "display", "dt_util", "fromtimestamp", "has", "normpath", "preds", "process_request", "pyauto", "realm", "sfd", "shuffle", "tr", "union", "viewer", "';'", "'@SQ SN:ref1 LN:10'", "'foobar'", "'gpu'", "'localhost'", "PropertyType", "_get", "base64", "classdesc", "compiler", "consumer", "dir_name", "dom", "expected_errors", "ilog", "matrix", "n1kv_models_v2", "numbers", "operation_mode", "param_dict", "primary", "resolve", "runtime", "set_cmd", "statement", "unique_id", "var_name", "vertices", "'C'", "'file'", "'int'", "ContentType", "Document", "E0", "TI", "Variable", "_port", "_type", "as_dict", "bias", "cctxt", "datasets", "dependency", "echo", "encoder", "entry_id", "fallback", "iterations", "latitude", "losses", "md5", "merge", "next_state", "package_name", "pass_context", "plugins", "pt", "query_params", "read_file", "sentence", "splitext", "standardMsg", "strptime", "y_pred", "'2'", "MyPage", "Pure", "Qexp", "_ffi_api", "a1", "contains", "cython", "d1", "embed", "end_time", "get_instance", "hdrs", "is_authenticated", "localPath", "modelName", "new_value", "policy", "response_data", "rs", "shard", "t0", "transforms", "traverse", "typ", "unique", "updated", "utc", "version_info", "want", "'+'", "'<'", "'size'", "DataFrame", "ImproperlyConfigured", "Sequence", "Timestamp", "UUID", "__ioaddress", "_event", "_tester", "aux", "b'\\x00'", "blueprint", "builder", "comp", "contact", "dat", "data_dir", "descriptor", "deserialize", "django", "epoch", "evaluate", "field_number", "forms", "forward", "ha", "home", "light", "lon", "newfault", "pformat", "players", "ptr", "require", "sf", "shutdown", "terms", "uint64_t", "user_input", "'e'", "'en'", "'fields'", "'info'", "'kind'", "'method'", "'query1'", "'t'", "403", "80", "Gamut", "KEY", "Meta", "MockMigratableResource", "Word", "_java_obj", "_java_ref", "_value", "archive", "best", "checkpoint", "checks", "classname", "cov", "discord", "each", "fileobj", "fill", "fromdate", "hasher", "import_module", "interface_name", "m1", "md", "option_count", "org", "period", "phase", "primary_key", "rename", "resource_id", "scene", "servers", "tablename", "test_session", "testproject_dir", "todate", "tolist", "web", "willie", "wrapped", "&=", "'content'", "'to_dict'", "'token'", "3600", "BytesIO", "DeprecationWarning", "HttpResponseRedirect", "Module", "SCons", "The", "_call_java", "assertNumQueries", "behavior", "callbacks", "cc", "compile_search", "form_data", "func_name", "grammar", "infile", "jax", "jsonutils", "keywords", "lat", "listen", "ls", "masked", "paginator", "removed", "rep", "returns", "seen", "selector", "shift", "uniform", "vm_util", "window_arrangement", "zero", "'\\x00'", "'user_id'", "22", "CommonMiddleware", "Config", "GroupCreate", "SS", "__getattr__", "__getattribute__", "_cursor", "adapter_type", "adjoint", "brightness", "change", "con", "constraint", "coors", "cv2", "emit", "eq", "expanduser", "get_data", "get_tu", "hosts_file", "ind", "instance_uuid", "internal", "item_id", "itemset", "json_dict", "k2", "nums", "obj_ut", "prepare", "qp", "retrieved", "returncode", "safe", "sent", "swagger_types", "trans", "u2", "wkt", "workers", "xpath", "'&'", "'@'", "'DELETE'", "'comment'", "'end'", "'ip'", "'mqtt'", "'results'", "Decimal", "DeepSpeedStrategy", "DoQuery", "HomeAssistant", "Lock", "MockModule", "StopIteration", "_ffi", "_options", "_tab", "assert_allclose", "bounds", "cache_key", "compress", "consoles", "create_session", "disconnect", "element_name", "expected_success", "hex", "host_name", "id_", "initialize", "isbn", "k1", "local_path", "m2", "none", "obj_end", "off", "rand", "render_to_string", "replacement", "repos", "restore", "router", "schedule", "segment", "sensor_type", "serialized", "side", "sources", "test_name", "tx", "up", "urlencode", "usage", "vms", "waiting", "'class'", "'link'", "'on'", "10.0", "99", "By", "City", "Color", "Get", "NotFound", "PaddedSAM", "Qt", "REPEATS", "Request", "RequestContext", "Status", "__version__", "_request", "_tensor", "aggregate_id", "algorithm", "annotations", "atol", "bases", "button", "convert_to_tensor", "coordinate", "default_root_dir", "domains", "executable", "filter_parameters", "gdb", "get_name", "get_profile", "hostclass", "hub", "input_tensor", "itervalues", "keepdims", "lc", "mm", "mock_calls", "networks", "nodetype", "parsed_url", "patches", "perms", "pkg_resources", "printer", "run_as_root", "s3", "sd", "selected", "subtransactions", "theano", "vif", "ws", "wx", " ", "'target'", "'v'", "800", "Close", "File", "HomeAssistantType", "TRAVERSE_STATUS", "Test", "Validate", "__import__", "_connection", "_pos", "_version", "answer", "api_key", "ary", "bbox", "canonical", "channels", "checkpoint_path", "climate", "compute", "connection_args", "cred", "cs", "db_name", "dbapi", "event_type", "finder", "get_or_create", "group_id", "hours", "initial", "job_id", "last_name", "low", "ndb", "perform_request", "reaction", "realpath", "scalar", "screen", "selection", "setAttribute", "sha1", "si", "square", "ss", "to_user", "train_op", "transition", "xReturn", "'PUT'", "'i'", "'install'", "'latitude'", "'reason'", "4.0", "600", "BoringModel", "FunctionType", "ID", "Pos", "ResponseBody", "STATE_UNKNOWN", "Schema", "age", "ancestor", "arch", "clip", "communicate", "compat", "compute_api", "expected_status", "fetchone", "filter_properties", "flavors", "frozenset", "gamma", "got", "iface", "kwds", "lcfg", "locales", "logout", "max_length", "model_name", "nodelist", "profile_id", "quiet", "role_id", "sensor", "sort_keys", "specs", "symmetry", "tc", "ttl", "ttype", "turn_off", "urlopen", "widgets", "write_byte_data", "'args'", "'domain'", "'fail'", "'image'", "'string'", "'timestamp'", "BlogPost", "Field", "Loader", "Resource", "T1", "Timer", "_cookie", "_deadline", "_hmdevice", "_post", "addon", "aftv", "apiConfig", "assign", "capabilities", "changed", "client_id", "concatenate", "config_dir", "cont", "enc", "ent", "eps", "etcd", "existing", "fire", "first_name", "fpath", "from_string", "goal", "keyword", "lease", "login_required", "max_iter", "msgs", "nb", "netif", "out_type", "pkgs", "positions", "prep", "previous", "prod", "producer", "progress", "re_ctx_p", "received", "redata", "rtol", "saver", "sel", "send_message", "server_id", "startIndex", "subscribe", "symbols", "tenant", "test_data", "theory_out", "threads", "turn_on", "user_profile", "y2", "'doc'", "'err'", "'field'", "'get'", "'href'", "'longitude'", "'m'", "'node'", "'none'", "'step_id'", "'time'", "0.3", "1000.0", "123", "2016", "CONF_USERNAME", "Count", "Dummy", "Iterable", "RESULT_TYPE_FORM", "ReviewRequest", "_bregex_parse", "_registry", "_rpc", "_size", "_state_machine", "a_variable_name", "actor", "addCallback", "agent", "app_name", "assertIs", "attachments", "base_dir", "bindings", "candidate", "chr", "clock", "cx_Oracle", "dec", "dicom", "dstream", "elm", "expiration", "failUnlessEqual", "fc", "find_all", "from_user", "getOrDefault", "get_conn", "get_json", "get_response", "getter", "gid", "json_data", "mf", "model_class", "mtx", "node3", "nse", "nu", "pip", "pipe", "red", "render_to_response", "retVal", "rollback", "roots", "rsplit", "sa", "scores", "sections", "select_related", "structure", "syms", "tiles", "timeit", "tinctest", "to_json", "tok", "validate_response", "values_list", "variable_scope", "'--'", "'delete'", "'read'", "'year'", "0.001", "0.2", "302", "CharsetTestCase", "Dataset", "Dumper", "OGRGeometry", "SparkContext", "TIMEOUT", "Where", "_controller", "_host", "_instance", "_photo_ids", "_ssl", "accept", "alignment", "area", "bootstrap", "browser", "call_list", "change_table", "coeffs", "context_instance", "createElement", "data_x", "datap", "decimal", "densStates", "destroy", "dilation", "dummy0", "dummy1", "eventid", "exitcode", "fetchall", "figure", "filtered", "fnmatch", "geometry", "has_key", "inner", "intent", "is_closed", "ma", "module_path", "n1", "n_samples", "ndims", "normal", "output_dir", "pat", "post_data", "res_short_id", "reuse", "search_opts", "sizes", "templates", "tensors", "unit_of_measurement", "user1", "vel", "visible", "'color'", "'command'", "'cpu'", "'entity_id'", "'event'", "'happy'", "'uuid'", "'~'", "23", "Fs", "Function", "Graph", "NameError", "Pot", "StrOpt", "TEMP_CELSIUS", "UNICODE", "_ast", "attribute_map", "cPickle", "cached", "caplog", "cid", "dimensions", "distribution", "entity_ids", "evaluator", "f_name", "family", "fieldname", "file_list", "get_connection", "get_default_config", "getcwd", "high", "instruction", "intents", "kexp", "languages", "local_fields", "machine", "markup", "menu", "molecule", "new_path", "next_agent_state", "notification", "parameter", "path_info", "patient", "ranges", "resolver", "row_index", "store_keys", "subparsers", "take_a", "td", "tell", "template_path", "test_file", "text_pattern", "training_data", "userid", "\t\t\t\t\t", "'127.0.0.1'", "'K'", "'false'", "'instance'", "'n'", "'self'", "APPEND_SLASH", "Append", "Base", "CONF_PASSWORD", "END", "FIFF", "Suppress", "_LE", "_LW", "_buffer", "_tzinfo", "absl", "adapter", "add_fixtures", "align", "b64encode", "basedir", "ceil", "checkpoint_dir", "chunk_size", "class_", "collection_name", "config_file", "consts", "control", "dataloader", "default_rule", "draw", "exec", "exploration_id", "fabric", "field_type", "form_id", "fp_", "fr", "from_json", "get_children", "get_review_request_list_url", "getenv", "half", "host_state", "ident", "in_", "index_dtype", "input_dict", "input_size", "intersection", "iq", "is_staff", "locations", "maps", "pTwid", "parseString", "patterns", "pb", "places", "problem", "ray", "representation", "request_id", "retval", "rm", "safe_repr", "serial", "setting", "sp_entity_id", "stages", "target_dir", "te", "terminate", "tl", "transition_time", "translation", "trim", "use_gpu", "vhost", "video", "what", " ", "'%s.%s'", "'config'", "'errors'", "'flow_id'", "'from'", "'parent'", "'unknown'", "11.96", "204", "31", "512", "APIConfig", "Book", "CONF_PORT", "DictSet", "HOST", "IOMUXC_SetPinMux", "Integer", "ModelDriver", "NamedTemporaryFile", "Qact", "STATE_OFF", "_kafkaTestUtils", "_list", "_resource", "and_", "assertAllClose", "asset", "ast_stack", "async_configure", "capacity", "catch_warnings", "chkr", "codename", "conv2d", "converter", "coordinator", "drop_collection", "dy", "error_message", "etag", "exe", "extent", "field_value", "formats", "game_id", "getRateCoefficient", "hostarch", "http_req", "install", "irc", "isnan", "js", "libvirt", "load_yaml", "must_be", "n_dof", "node_type", "nowait", "permission", "pointer", "product_id", "profiler", "program", "rasa", "repeat", "server_name", "set_result", "sites", "sz", "take", "temperature_unit", "to_string", "training", "user_manager", "vip", "vlan_id", "vtable", "waiter", "'-d'", "'1234'", "'4'", "'^'", "'abc'", "'admin'", "'first_name'", "'format'", "'myuser'", "'p'", "'server'", "Grid", "L2cc", "Query", "SavePhotos", "TemplateSyntaxError", "Unlock", "_errors", "_hass", "_len", "_metadata", "account_sid", "add_entities", "allowed", "ar", "atom", "base_path", "blocks", "bmi", "changes", "column_data", "comments", "complete", "cond", "constraints", "create_table", "credential_id", "css_class", "cube", "d2", "di", "distinct", "dtd", "environment_name", "exception_desc", "extra_context", "floating_ip", "game", "geometries", "get_absolute_url", "input_api", "input_tensors", "insp", "installer", "levels", "lights", "load_checkpoint", "loom_input", "magic", "minion", "nsmap", "old_name", "pc", "picks", "pre", "prediction", "referer", "say", "schemas", "scipy", "sendData", "sensors", "sessid", "setLevel", "signals", "splitted", "spvalue", "ssl", "subjects_dir", "submit", "telnet", "test_dir", "tg", "titles", "tolerance", "unlink", "upgrade", "verts", "vizio_connect", "whitelist", "'%'", "'3'", "'B'", "'k'", "'last_name'", "'options'", "'page'", "'params'", "'table'", "'term'", "'test@email.com'", "'volume'", "10000", "201", "BEGIN", "Coordinate", "HomeAssistantError", "Join", "ModelCheckpoint", "Point", "Role", "Run", "UnicodeDecodeError", "Update", "VALUE", "Xt", "_kind", "_pianobar", "_position", "_semantics", "_server", "acr", "aiohttp", "alarm_control_panel", "app_config", "automation", "bgcol", "bot_prefix", "bridge_conf", "categories", "check_output", "clazz", "codes", "command_class", "constant_op", "constructor", "crypto", "device_state_attributes", "dfilter", "dir_path", "dry_run", "eb", "enable", "epochs", "field_width", "footer", "get_result", "http_client", "httplib", "initializer", "interrupt", "is_ready_for_localization", "memoized_property", "migration", "mpoly", "mqtt", "ms", "n_batch", "n_components", "nasa", "network_profile", "newaxis", "objectGetVal", "out_file", "pe", "predicate", "prepped_request", "ravel", "raw_input", "reload", "renderers", "requirements", "rfind", "routes", "scraper", "secrets", "segments", "service_name", "sha256", "slim", "so", "source_dir", "submitter", "tester", "topics", "undefined", "world", "\"No module named '?bad_settings'?\"", "'$'", "'%s/%s'", "'children'", "'density'", "'location'", "'noargs_command'", "'number'", "'tag'", "'text/html'", "'text/plain'", "'z'", "1000000.0", "120", "1200", "21", "5.0", "Angles", "Connection", "Create", "Defer", "EvaluateJavaScript", "ModelName", "MyClass", "New", "NoResultFound", "PY3", "Place", "StringField", "__grains__", "__setitem__", "_fields", "_get_var", "_key", "_make_path", "_mode", "_model", "_process", "_result", "_send_cmd", "alloc", "ap", "ascii", "assert_array_equal", "attrType", "batch_shape", "blue", "br", "bucket_name", "build_env", "can", "cap", "cherrypy", "closed", "cmds", "compare", "coord", "deprecated", "difference", "din", "docstring", "element_type", "expect_errors", "failures", "fan", "fft_length", "format_string", "from_dict", "get_for_model", "get_model", "get_session", "getsize", "ignore_errors", "importlib", "indx", "inv", "isdigit", "jdata", "lengths", "mapper_spec", "memory", "merged", "migrations", "min_cuda_gpus", "model_storage", "monitor", "new_data", "notebook", "outbox", "permissions", "pexpect", "postfix", "prelude", "ratio", "reactions", "reals", "render_template", "resize", "rest_client", "retrieve", "robj", "room", "run_function", "s3_rest_controller", "shard_id", "site_id", "siteconfig", "spawn", "speed", "srid", "supported_features", "syncthru", "template_values", "test_fail_if_path_exists", "theme", "token_type", "url_for", "validated_data", "view_func", "views", "volume_id", "we", "y0", "'X'", "'account_sid'", "'aggregate'", "'body'", "'content-type'", "'external_product_id'", "'features'", "'headers'", "'hosts'", "'query'", "'uri'", "1e-06", "ByteOrder", "Fields", "Hexp", "Process", "Sexp", "SignalInfo", "SubElement", "TransferDAG", "_SearchParser", "__inline__", "_api_version", "_from_db_object", "_mock_api", "_stubs", "abort", "adb_prefix", "allow_edit", "annotate", "arglist", "argsort", "async_add_job", "authenticate", "authenticator", "bar", "base_obj", "binf", "blob", "board", "c_exc", "call_args", "chdir", "check_call", "check_headers", "check_keys", "configs", "currency", "dataq", "dbc", "dbname", "decorate", "decorators", "deployment", "disk", "disk_path", "distances", "dists", "dofs", "driver_type", "dts", "ep", "eri", "err_msg", "event_id", "evt", "fila", "fileno", "filesystem", "fill_value", "flask", "get_version", "gl", "global_step", "histogram", "indexes", "invoke", "is_alive", "launch", "learning_rate", "live", "m_conf", "max_epochs", "max_size", "maxsize", "metal_interrupt", "moduleGraph", "new_args", "new_id", "node_name", "num_examples", "opcode", "out_dtype", "pathname", "pause", "pdop", "power", "primes", "pts", "pytz", "questions", "ra", "reactants", "readers", "relative", "setText", "slugify", "soln", "stacklevel", "stanza", "start_index", "started", "state_below", "subtype", "to_delete", "tokenize", "totalSize", "typeof", "uint64", "unregister", "us", "version_id", "voltage", "which", "worksheet", "xml_utils", " ", "'..'", "'None'", "'comp_conf'", "'de'", "'g'", "'git'", "'init'", "'integer'", "'invalid'", "'items'", "'language'", "'mypass'", "'one'", "'replace'", "'run'", "'switch'", "'system'", "'trigger'", "'valid'", "18", "1e-05", "26", "6.0", "CharField", "CharacteristicsTypes", "InvalidBSON", "Logger", "Namespace", "Prompt", "RESULT_TYPE_CREATE_ENTRY", "Remove", "Subscription", "TestSuite", "UInt8", "Version", "Wait", "Zero", "__len__", "__lock", "_brightness", "_callback", "_device", "aggressive", "assertRaisesRegex", "async_setup", "axisList", "blocking", "bug", "c3", "cards", "cart", "character", "clear_cache", "cmap", "cnt", "coeff", "color_palette", "control_flow_ops", "custom", "db_type", "decl_string", "degree", "dg", "divmod", "dummy", "ensure_future", "environment", "episode_id", "equal", "expressions", "f1", "fileName", "follower", "fopen", "formatUrl", "geom", "get_attr", "get_field", "hdop", "hi", "hookenv", "inds", "inf", "instance_type", "invalidate", "java_stage", "javaobj", "key_length", "latest", "linenumbers", "lo", "login_url", "major", "master", "media_id", "modified", "mrb_value", "needle", "operators", "output_path", "overwrite", "percentile", "pieces", "project_name", "projects", "providers", "rdfvalue", "ready", "recurse", "rel_path", "required_services", "retain", "rho", "rjust", "save_checkpoint", "save_path", "set_state", "settings_dict", "share", "simplefilter", "sort_key", "spacing", "src_dir", "start_response", "subgraph", "team", "test_id", "tk", "to_add", "typing", "u'node'", "uint8", "user_name", "value_template", "will", "yapi", "zipfile", "'ERROR'", "'P'", "'T'", "'__'", "'date'", "'green'", "'numerator'", "'out'", "'pk'", "'properties'", "'python'", "'tests'", "'topic'", "'}'", "0.05", "50.0", "AF_INET", "CalledProcessError", "ConfigParser", "Counter", "Dimension", "DocumentMappingType", "ET", "HTTPException", "HttpRequest", "IGNORECASE", "Info", "Leaf", "LooseVersion", "MOCK_SPEAKER_CONFIG", "Note", "SimpleType", "Sprintf", "SyntaxError", "TestCase", "TypeKind", "Util", "XCTAssertEqual", "_call_method", "_do_test_raw", "_existing_ep_id", "_formatMessage", "_obj", "_title", "_unit", "add_devices_callback", "add_implementation", "admin_site", "agentId", "ai", "anchortype", "app_module", "arcs", "argmax", "assertGreater", "assertRaisesRegexp", "bottle", "bp", "bytearray", "callback_id", "card", "clause", "commons", "complexes", "connection_pool", "create_using", "creator", "daemon", "default_value", "delimiter", "disabled", "dispatch", "div", "domain_id", "downloaded_pkg", "elapsed_time", "encoded", "endpoints", "exchange", "expires", "fgcol", "field_class", "file_", "filelist", "files_created", "filter_string", "fin", "fixer", "fixes", "focus", "forKey", "friendly_name", "gain", "generator", "get_params", "get_request", "get_template", "green", "group_by", "hdr", "heatmap", "hint", "imp", "installed", "java", "json_obj", "keep", "known", "last_updated", "leaf", "minimum", "mkstemp", "mock_setup", "node_addon", "orientation", "orm", "orm_block_type", "padID", "passed", "payloads", "plan", "play", "pprint", "quit", "raw_info", "rdd", "recipient", "relu", "required_openstack", "resource_type", "result2", "result_code", "rootpub", "run_command", "samples", "sat", "search_type", "span", "submission", "sut", "sync", "tabs", "tensor_shape", "test_utils", "tick", "txn", "uglies", "user_agent", "vertexRecords", "visitor", "weightCol", "wrap_topi_schedule", "y_true", "'/test_set'", "'1.2.3.4'", "'F'", "'cmd.run'", "'day'", "'detail'", "'env'", "'files'", "'h'", "'latin1'", "'links'", "'os'", "'pass'", "'service'", "'snips'", "'win32'", "1400", "ApiError", "Asset", "CONF_VOLUME_STEP", "Cvexp", "Data", "Enable", "Failure", "INTENT", "Label", "Load", "PY2", "RegisterGradient", "RequestException", "STDOUT", "Select", "T0", "Tdata", "Token", "_dependencies", "_description", "_handle", "_path", "_resources_registry", "_stack", "_storage", "_text", "_user", "adb_decorator", "alphabet", "an", "app_path", "assert_array_almost_equal", "assert_setup_component", "async_setup_platform", "autospec", "base_depth", "basepath", "box", "build_graph", "capture_output", "chart", "chmod", "client_address", "colour", "confidence", "corriente", "coverage", "create_user", "data_path", "db_table", "dct", "decoder", "dedent", "diagnostics", "elt", "embedding", "error_messages", "error_msg", "expand_dims", "expr1", "extra_args", "extra_environ", "eye", "face", "feature_name", "file_object", "file_url", "find_element", "flash", "folder_id", "followee", "format_exc", "gather", "get_client", "get_current", "get_object_or_404", "getargspec", "highlight", "href", "indexer", "info_cache", "interactive", "its", "kernels", "linux", "luigi", "maximum", "method_name", "migrate", "mock_integration", "model_fn", "my_func", "n_features", "no", "nodepub", "notes", "object_ids", "outer", "overview", "palette", "persons", "place", "poll", "pow", "pr", "presion", "protocol_version", "recv", "reduce_sum", "related", "requires_testing_data", "resReturn", "resolved", "result_str", "retcode", "sdiag", "sendCmd", "set_req", "sha", "sheet", "short", "skipif", "solution", "solve", "source_file", "sourcemap", "sqlalchemy", "state_name", "stiva", "stringlist", "sun", "svc", "switches", "target_path", "testcase", "texts", "ticket", "u'key'", "u'value'", "updater", "urllib2", "user_data", "utcoffset", "verify_ssl", "vizio_bypass_setup", "vm_", "vxlan_id", "weekday", "widget1", "wire_format", "workflow", "xQueue", "xblock", "yessssms", "zlib", "\"\"\"Initialize the sensor.\"\"\"", "'%s%s'", "'.py'", "'Authorization'", "'HEAD'", "'True'", "'endpoint'", "'function'", "'ilog'", "'left'", "'limit'", "'local'", "'master'", "'person'", "'sid'", "'two'", "'{'", "19", "90", "ATTR_TRANSITION", "ClientError", "FORMAT", "InvalidIsbnException", "Location", "METRIC_SYSTEM", "MockConfigEntry", "Operation", "Optimizer", "Provider", "SOURCE_USER", "Site", "Size", "This", "UTC", "__contains__", "__enter__", "__exit__", "__helper", "_available", "_child_attr", "_database", "_document", "_jvm", "_load", "_node", "_query", "_run", "_stream", "_thread", "_waiting", "abcdsr", "add_option", "alarm", "are", "argparse", "as_list", "asnumpy", "ast_node", "astimezone", "audio", "benchmark", "bytes_read", "cache_dir", "call_command", "cases", "clf", "clients", "cloud", "cluster_name", "clusters", "combined", "conditions", "consume", "country", "current_user", "dbobj", "default_settings", "deg", "descriptors", "discriminator", "dns", "drivers", "escaping", "expr2", "f_back", "feature_id", "fi", "firwin", "force_values", "formset", "fut", "getName", "get_by_id", "get_form", "get_next", "get_option", "gfile", "greenwave", "gzip", "hass_admin_user", "hd_fields", "hints", "host_ip", "ifc", "inc", "inclusion_tag", "inlinable", "interact", "invalid_values", "inventory", "invert", "is_superuser", "ix", "jobs", "kact", "key1", "key_values", "kv", "leaves", "letter", "list_name", "lowerBound", "microseconds", "mol", "n_dense", "namespaces", "netaddr", "newsletter", "next_path", "ntaps", "num_epochs", "num_nodes", "num_samples", "odata_context", "odata_id", "odata_type", "oem", "offsets", "output_file", "param_name", "patchlines", "pen", "pools", "probs", "put_body", "pyx_code", "q_values", "question", "relationship", "repl", "request32", "residual", "responseFields", "rot", "rotate", "sample1", "scaler", "secret_path", "serialization", "setParams", "set_status", "sg", "should_poll", "sort_dir", "sparse", "standalone", "sts", "suggest", "sym", "test_client", "testdir", "tmp_dir", "tmpfile", "token_info", "total_seconds", "translations", "truncate", "type_name", "u'modifiedIndex'", "u'test'", "uniprops", "unquote", "upperBound", "usr", "validator", "virtual", "vmdk", "vstr", "wkb", "workspace", "xl_workbook", "xy", "zone_id", "\".\"", "' '", "'$in'", "'2.4.0'", "'D'", "'OK'", "'Value'", "'auth'", "'cleanup'", "'created'", "'email_field'", "'enabled'", "'float32'", "'http://'", "'labels'", "'network'", "'red'", "'script'", "'set'", "'style'", "'test1'", "'world'", "409", "4096", "45", "59", "ATTR_ENTITY_ID", "AppendTag", "Clock", "Formatter", "IEnumerable", "Map", "Math", "MockValue", "MozuUrl", "MyForm", "Pipeline", "Pool", "SENSOR_TYPES", "SUCCESS", "SkipTest", "TimeoutError", "UrlLocation", "VERSION", "VOLUME_STEP", "_adb", "_content", "_initialize", "_input_kwargs", "_item", "_j_table", "_jsc", "_layout", "_receiver", "_rows", "ab", "abstractproperty", "account_key", "activate", "activation_fn", "add_to_hass", "addrs", "af", "alive", "argc", "assertQuerysetEqual", "assertRaisesMessage", "assertRegexpMatches", "async_added_to_hass", "async_query", "async_update", "autotvm", "baseline", "brew_cmd", "ca_cert", "callstack", "catalog", "cf", "changelog", "classes_", "classpath", "combine", "comic", "compiled", "content_object", "ctime", "current_context", "cval", "cx", "d0", "datastore", "deadline", "delim", "dimension", "display_name", "dispose", "dm", "docs", "energy", "error_code", "export", "expsize", "f2", "fileids", "fingerprint", "fip", "fix", "form_class", "frag", "free", "freqs", "fullpath", "gel", "get_all", "get_review_request_item_url", "gtk", "gui", "guid", "has_perm", "hvac_mode", "incoming", "inverse", "io_loop", "ir", "islice", "kernel32", "keyword_only", "kpts", "last_month", "logs", "mark_safe", "matcher", "maxIter", "mech_context", "more", "mutating", "n2", "n_jobs", "named", "negated", "nest", "next_token", "nikola", "nsx_nb", "num_classes", "num_workers", "numba", "ny", "obj_size", "objs", "operation_id", "ordering", "organization", "outdir", "overrides", "pandas", "per_page", "piece", "placeholders", "platform_schema", "prediction_key", "preprocessor", "press", "pretty", "profile_type", "project_root", "ref_call", "regions", "regr", "relation", "req_file", "response_json", "result_dict", "review_request_list_mimetype", "rtn", "scopes", "security_group", "seeds", "selenium", "sequence_number", "set_component", "set_value", "setup_mock_vshare", "sigmoid", "simplify", "simplisafe", "source_folder", "streams", "subnet", "subscr", "subscribed", "subtitle", "target_name", "test_info", "test_repr", "test_url", "thread_id", "timestripper", "timetuple", "tmpfilename", "transformer", "unicodedata", "unpickler", "updatebyte", "upload", "upsert", "url_path", "urlconf", "urlsplit", "vdop", "vlen", "w1", "withResourceUrl", "workbook", "xd", "\"\"\"\n Provide a friendly representation\n\n :returns: Machine friendly representation\n :rtype: str\n \"\"\"", "'%s:%s'", "'-o'", "'123'", "'S'", "'UTF-8'", "'\\r\\n'", "'actions'", "'comp_a'", "'device_manager_stub'", "'dummy'", "'extra'", "'fun'", "'func'", "'group'", "'home'", "'input'", "'list'", "'low'", "'min'", "'mode'", "'month'", "'msg'", "'resource'", "'root'", "'session'", "'src'", "'tab'", "'template'", "'test_site'", "'timeout'", "'values'", "'whatever'", "'write'", "127", "2015", "301", "37", "401", "Action", "Addr", "Article", "CFG", "Check", "Code", "DataType", "Date", "Double", "ERROR", "Entry", "EventType", "Execute", "FileNotFoundError", "ForeignKey", "Func", "Heading", "Http404", "ImageRequest", "MockNode", "OK", "SYSTEM_CHECK_MSG", "Scalar", "Style", "TenantPod", "Throttle", "UNITS", "VOLUME", "Window", "__context__", "__virtual__", "_args", "_async_call_service", "_collection_name", "_color", "_dset", "_execute", "_header", "_not_implemented", "_optimize", "_queue", "_setup_component", "_ssh_address", "_time", "addHandler", "add_field", "allow_redirects", "amo", "anonymous", "api_config", "artist", "as_string", "assertGreaterEqual", "assigned", "async_add_executor_job", "async_turn_off", "autocommit", "backup", "baseurl", "blockform", "blocs", "buff", "buffers", "bust_cache", "cached_property", "calendar", "cd", "check_exit_code", "childname", "coding", "col1", "collector", "column_names", "completer", "conn_type", "crc32", "dbref", "debugger", "decoded", "dep_context", "device_errors", "dialog", "edgeReferenceCounts", "elasticache", "enable_progress_bar", "epsilon", "evals", "expected_message", "extract", "fast_dev_run", "finalize", "find_by_url", "finished", "follow", "following", "ger", "get_key", "get_option_at_index", "get_test_home_assistant", "get_text", "get_vars", "groupdict", "has_permission", "heapq", "includes", "input_path", "integer_types", "ipopo", "is_little_endian", "isolate", "keras", "keyed_args", "keystoneclient", "l10n_overview_rows", "layer_above", "linesep", "ljust", "logtype", "master_fd", "mention", "message_tree_id", "met", "meth", "migratable1", "migratable2", "mock_walk", "mocker", "modifiers", "multiplier", "must", "ncols", "nets", "newChild", "niter", "nonce", "num_units", "object_list", "oprot", "original_name", "output_shape", "pad", "pagination", "parsed_args", "pathsep", "percent", "policy_path", "port_dict", "print_results", "process_node", "psutil", "published", "pymongo", "recorder", "recoverseg", "reduction", "refs", "result_set", "resume", "retail_price", "returnValue", "root_dir", "rotation", "row2", "rt", "s0", "safe_load", "safe_run", "saved", "se_id", "set_data", "sgv0", "sgv1", "signed", "sink", "slices", "source_path", "squeeze", "station", "strToParse", "styles", "subnet_id", "substr", "successes", "templ", "template_data", "template_id", "tex", "to_python", "tries", "typename", "u'action'", "unknown_id", "update_clause", "user_settings", "validators", "value_str", "var_names", "variant", "verb", "virtualenv", "warns", "wav", "wchar_t", "wemo", "which_set", "wire", "world_size", "xHigherPriorityTaskWoken", "yb_rcmod", "zfill", "zwave", "\"constant_evaluable\"", "'-v'", "'...'", "'Name'", "'Test Name'", "'\\n\\n'", "'\\r'", "'add'", "'c1'", "'c2'", "'c3'", "'c4'", "'direction'", "'eggs'", "'failed'", "'groups'", "'hosting_account_username'", "'https'", "'match'", "'meta'", "'query1 0 ref1 2 60 2=2X2M * 0 0 TCTAGG ZZZZZZ'", "'schema'", "'shell'", "'task'", "'test.file'", "'tstamp'", ", ", "0.7", "0.9", "17", "180", "42.0", "63", "700", ">>=", "ANY", "Application", "CLVar", "COMMAND_CLASS_SWITCH_MULTILEVEL", "Controller", "Copy", "Ea", "Hact", "HostingServiceAuthForm", "INFO", "IP", "KeyboardInterrupt", "MODEL", "ModeKeys", "OpStrategy", "P256Point", "PredictionKey", "SOURCE_IMPORT", "Sact", "Sendable", "Server", "Stub", "TBRMMDesign", "TensorShape", "Xs", "_ENFORCER", "__add__", "__graph_dict", "__mqtt", "__path__", "_auth", "_children", "_collection", "_compare_result", "_day", "_file", "_file_system", "_is_on", "_kwargs", "_message", "_month", "_objects", "_second", "_sentenceData", "_username", "_visa_resource", "_year", "activity", "adaptor", "ancestors", "argnames", "as_default", "assertLess", "assert_almost_equal", "async_setup_entry", "async_write_ha_state", "attr_value", "basefmtstrs", "benchmark_spec", "bg", "bin_column", "bins", "bld", "bounces", "bundles", "cache_name", "cache_readonly", "camera", "canBASE_t", "cardinality", "case_obj", "chebyshev", "childNodes", "cluster_id", "cmp", "cn", "codecs", "collected", "company", "component_name", "controllers", "conv", "cost", "countShadowDocuments", "cppGapModel", "cpu", "decoratedTest", "desc_node", "diffset", "discard", "discovery", "dockerrun", "download", "dummy_dataset", "e1", "e2", "err_message", "expanded", "fixed_ip", "flows", "force_bytes", "fromfile", "fromlist", "fspec", "generic", "get_bucket", "get_collection", "get_user_model", "hh", "hosting_service_cls", "http_body", "ifaces", "image_path", "input_data", "input_space", "ins", "integral", "is_enabled", "is_training", "json_message", "known_hosts_file", "kwarg", "leftmost", "lmm", "log_command_filter", "make_msg", "make_request", "max_norm", "mdns", "metavar", "mime_type", "mod_name", "model_path", "mods", "modulename", "nested", "new_pos", "new_text", "node4", "node_index", "observer", "omit", "oracle", "ordered", "orders", "output_api", "oxygen", "p3", "para", "person_id", "photo_id", "plaintext", "player_id", "plugin_ep", "pm", "policy_name", "portBASE_TYPE", "portage_utilities", "predictor", "preset", "proposals", "reconnect", "registrations", "remotable_classmethod", "reports", "represent", "resnet_v2_block", "revs", "rmgpy", "root_path", "row1", "row_id", "rpc", "sample_data", "scale_factor", "script_name", "sdk_update", "search_term", "seginfo", "sendcontrol", "server_address", "session_key", "sharding", "siblings", "simulacion", "slave", "sm", "sparse_tensor", "spenv", "statistics", "subfield", "subpath", "sumStates", "tag_name", "task_class", "through", "timeutils", "toString", "tokenizer", "tracer", "track", "transfer_block_document", "transfer_block_schema", "translated_revision", "treepath", "twisted", "ty", "typeclass", "tzone", "u'/testkey'", "ul", "unknownValue", "urljoin", "use", "uuid_representation", "varname", "votes", "vpc", "wfile", "windows", "write_file", "zeros_like", " ", "'-c'", "'1.0'", "'12345'", "': '", "'Location'", "'PATH'", "'cls'", "'cmd'", "'could not get {}'", "'debug'", "'dev'", "'hamlet@zulip.com'", "'hex'", "'in'", "'login'", "'packages'", "'post'", "'product'", "'rel'", "'sample'", "'season'", "'sensor'", "'spec'", "'stdout'", "'temperature'", "'tenant_id'", "'what'", "'widget'", "'yes'", "'{}'", "0.25", "2.5", "202", "AR", "Free", "Future", "HTTPConflict", "Hexplist", "INT", "If", "InstanceNotFound", "IntegerField", "Iterator", "JSON", "Keys", "LIST_HEAD", "Linear", "MetaData", "MyCustomIntegerFormatting", "NavigateToURL", "Nodes", "Number", "Option", "PIO_ABCDSR", "Parent", "Policy", "Queue", "RUNNING", "RandomState", "SKIP_IN_PATH", "Series", "Setting", "Sexplist", "SparseTensor", "TEXT", "TestDecorator", "TestModel", "YAML_PATH", "ZipFile", "__ne__", "__setattr__", "_active_spark_context", "_cast_info", "_cell", "_container", "_delete", "_full_path", "_info", "_items", "_login_user", "_name_scope", "_platforms", "_repositoryModel", "_req", "_root_dir", "_table", "_trainer", "_tz", "_unwrap", "_values", "_write", "absPath", "access_key", "add_all", "add_header", "address_mapper", "afile", "agg_name", "airstatus", "alg", "allclose", "angles", "api_put", "approx", "as_view", "assert_true", "attach", "b64decode", "backlog", "base_name", "bb", "bcc", "best_score", "boundaries", "buffer_expected", "calculator", "cargs", "cas", "cat", "child_page", "class_id", "clf1", "cluster_environment", "col_offset", "collection_id", "complex", "config_util", "connected", "correct", "create_all", "create_page", "criteria", "cros_build_lib", "cur_dir", "data1", "degrees", "density", "deploy", "det", "detach", "digit", "dirnames", "display_id", "distro_id", "distutils", "documents", "down", "dutycycle", "email_address", "emb", "embeddings", "endianness", "envs", "epms", "es", "exception_app", "expect_error", "extra_kwargs", "facets", "fan_mode", "feature_type", "filteredrevs", "fixed", "float_type", "folders", "getType", "get_dependencies", "get_entity", "get_index", "get_user", "grpc", "head_name", "here", "hidden", "hstack", "http_request", "humidity", "i2", "ic", "ifname", "image_size", "img_name", "indexed", "init_op", "input_readers", "ips", "ipv4", "is_empty", "is_new", "is_public", "iterkeys", "jar", "job_name", "json_request", "kafkaParams", "key_value", "langs", "linestyle", "listeners", "log_interval", "lxml", "maker_login_required", "matvec", "max_len", "media_type", "member_name", "mgr", "mkdtemp", "mock_parse", "model_dir", "module_create", "monzo", "mpl", "multiply", "mutation", "n_nod", "nbytes", "near", "notification_driver", "numsamples", "oauth2_service_feature", "observed", "old_config", "outlist", "override_feature_check", "padded", "page_size", "parent_model", "patchline", "pcString", "per_mode", "pf", "physical_network", "posts", "print_help", "print_version", "product_ids", "protected", "provider_task", "pxPort", "pysam", "pywrap_tensorflow", "quota", "radicals", "random_state", "raw_token", "reactant", "rendered", "repair", "repeating", "replicas", "return_type", "reviewers", "rmatvec", "row_count", "row_data", "rvs", "save_top_k", "secret_key", "sfreq", "sigmaclip", "singleton", "slackaccount", "slots", "snapshotSetId", "specfun", "srs", "ssh", "state_error", "store_key", "svc_ref", "sympy", "taps", "throttle", "tqdm", "tup", "u'/'", "uint16_t", "unique_together", "unsigned_value", "user2", "volumeName", "vs", "workflow_label", "wsdir", "xframe_options", "'-s'", "'Description'", "'HGNC'", "'ID'", "'M'", "'active'", "'addresses'", "'ascii.html'", "'asdf'", "'auto'", "'bin'", "'cell'", "'context'", "'example.com'", "'filename'", "'float'", "'ids'", "'images'", "'include'", "'length'", "'loss'", "'module'", "'nova'", "'object'", "'offset'", "'output'", "'png'", "'spam'", "'stderr'", "'subject'", "'to'", "'train'", "'uint8'", "'val'", "255.0", "65535", "Actions", "AirflowException", "BceServerError", "BeautifulSoup", "C3", "Channel", "Duration", "Fault", "FieldDoesNotExist", "Forbidden", "GURL", "Gene", "ITERATIONS", "Invalid", "LOGGER", "Layout", "MASK", "MATCH", "MigratableDeployment", "ModelAdmin", "NeutronManager", "Open", "OpenSSL", "PARTICLES", "Permission", "Range", "ResetAll", "RunShellCommand", "SVN_WC_PATH", "TestService", "TrimSpace", "UnsetStubs", "UserWarning", "VERBOSE", "__get__", "_attrs", "_cfg", "_cmd", "_columns", "_dict", "_files", "_get_request", "_headers", "_icon", "_paramMap", "_parent", "_printer", "_unit_of_measurement", "_vmops", "_widget", "a_value", "added", "aid", "alwaysRaisesProvidedException", "anchor", "apache", "approx_order", "aspect", "assertTargetsInGroup", "assert_json_error", "async_create_task", "async_run_job", "async_turn_on", "atts", "b1", "bdm", "binder", "bisect_left", "block_list", "boxes", "buffer_output", "cache_path", "capi", "cdb", "ceiling", "cells_utils", "chname", "city", "class_names", "classifier", "cm_config", "col2", "col_no", "compression_method", "confidences", "containers", "conversion_profile", "created_at", "critical", "csr_matrix", "csv_path", "dashboard", "data_dict", "datum", "decision", "demo", "dep_id", "descriptions", "dev_id", "dimshuffle", "dn", "docid", "docname", "dout", "drop", "dumper", "duplicates", "einsum", "element_id", "encodings", "end_index", "enforcer", "engine_url", "env_root", "eol", "execution_context", "expected_result", "expected_url", "explicitPositiveSign", "export_dir", "exports_to_keep", "extras", "f_code", "fake", "fcntl", "feet", "field1", "field2", "field_list", "file_index", "file_like", "fld", "folder_obj", "fontsize", "force_reload", "foreign_keys", "frames", "geos1", "get_plugin", "get_property", "getsockname", "gradients", "greedy", "grp", "has_option", "hsp", "http_method", "hypervisor", "i1", "idaapi", "ignorefunc", "image_opts", "in_navigation", "input_file", "instance_ids", "instr", "instructions", "int64_t", "interpolation", "isEmpty", "is_admin", "is_started", "isabs", "islink", "kws", "lazy_property", "lexer", "limitlessled", "line_index", "list_", "m_client", "machine_name", "matched", "matmul", "max_retries", "md_item", "minor", "model_instance", "modify", "module_update", "msg_id", "n_iter", "na", "network_info", "new_disk", "new_list", "new_rep", "new_shape", "news_file", "nex", "next_ok", "nsid", "nsx_to_load", "num_inst", "offsetRanges", "op_name", "opener", "osp", "output_files", "overlays", "pan_dat_factory", "params_as_tensors", "pem", "picking", "pkgname", "policy_file", "populate", "pq", "print_summary", "projectId", "projection", "put_object_from_string", "py_stage", "queue_runner_def", "randn", "raw_fname", "reactor_mock", "refresh_from_db", "regexp", "requestId", "residuals", "rotationalConstant", "rx", "samp_pos", "schedule_update_ha_state", "score2", "see", "sendline", "seqs", "serie", "server_type", "set_password", "setmtime", "shell_cmd", "silent", "single", "slc", "softmax", "source_text", "splitter", "spy_on", "start_pos", "student", "subcategory", "suggested", "table_in", "tagName", "target_temperature", "task_dict", "task_name", "test_case", "test_net", "testtools", "thermostat", "thumbnail", "toordinal", "total_time", "traj", "transfer_automation", "tvars", "type_printers", "u' '", "use_l10n", "vera_device", "version_number", "version_pkg_path", "visit", "vt", "wasSuccessful", "weakref", "write_concern", "\"-\"", "\"/\"", "' benchmark finished'", "'!'", "'>'", "'<'", "'"'", "'-e'", "'5'", "'E'", "'EXECUTE: noargs_command'", "'If-Match'", "'MarketplaceId'", "'N'", "'REQUEST_METHOD'", "'VirtualMachine'", "'\\\\\\\\'", "'age'", "'alpha'", "'api_version'", "'black'", "'dtype'", "'encoding'", "'events'", "'got {}'", "'indexes'", "'no'", "'off'", "'ok '", "'org_organisation'", "'points'", "'remove'", "'repository'", "'required'", "'right'", "'rows'", "'rt'", "'scopes'", "'slug'", "'step'", "'store_true'", "'summary'", "'test2'", "'test_project.settings'", "'var'", "1000000", "1600", "20037508.342789244", "2017", "27", "ASCENDING", "Author", "C1", "C4", "CHECK", "CONFIG", "CONF_APPS", "Cache", "CmdList", "Contains", "Content", "Cvact", "Cvexplist", "DatagramProtocol", "DeserializationError", "Embed", "Environment", "Errors", "FalseCheck", "Fatal", "FileManager", "GetCookie", "GraphKeys", "IPAddress", "Locale", "LookupError", "MAC", "Mempool", "MigratableBlockSchema", "MigratableVariable", "MigratableWorkQueue", "NETWORK", "NONE", "NSWindow", "Nanoseconds", "Output", "Period", "Post", "Proxy", "QMessageBox", "Qexplist", "RemoteCommand", "Return", "STATE_ON", "Start", "StatusCode", "Target", "TestLoader", "Twi", "^=", "_GetProperty", "_PACK_INT", "_SymbolCache", "__table__", "_all_interfaces", "_checks", "_class", "_clients", "_connect", "_header_data", "_ipcam", "_jconf", "_json_dict", "_light", "_magic_t", "_manager", "_messages", "_parameters", "_point", "_prefix", "_style", "_target", "_test_func", "_trace", "_validate", "_wizard", "aModule", "abi", "ac", "actual_decorator", "anc_level", "api_args", "archive_name", "ass_level", "assertTemplateUsed", "async_add_devices", "atime", "att", "attempt", "avg", "binary_location", "binascii", "btype", "buildReactor", "cache_info", "capability", "cert_key", "certfile", "chan", "charno", "chrome_version", "closing", "cmd_list", "combinations", "compose", "composer", "content_length", "cookiejar", "cover", "create_repository", "create_task", "currentSentence", "curses", "cut", "cvss", "dag_run", "data_points", "dc", "deque", "dev_handle", "dev_name", "directories", "discover", "duetime", "dup", "dup_mul_ground", "dynamic", "ee", "enable_model_summary", "enh", "enqueue", "envvar", "exist_ok", "expectedReasons", "expectedRepr", "fatal", "featuresCol", "file_type", "findings", "fl", "fnames", "fout", "from_s", "fspath", "ft", "fu", "getDensityOfStates", "getListeningPort", "getPartitionFunction", "get_file", "get_vm_ref", "global_step_tensor", "grid0", "hass_ws_client", "have", "hba", "heading", "hetero_variance", "home_dir", "huber", "image_format", "image_url", "index_information", "index_or_key", "integration", "is_set", "issues", "item_id_url", "jinja2", "joined", "k0list", "klvnzo", "last_id", "lattice", "local_site_name", "lp", "lsp", "m_docker_client", "mac_address", "markdown", "mass", "matching", "max_depth", "memoized", "middleware", "mimetypes", "morsel", "mox", "mqtt_mock", "multiple", "mutex", "mysql", "needs_rebuild", "network_name", "new_model", "newline", "njit", "node_data", "obj_reset_changes", "oldChild", "open_port", "optimize", "optional_int", "or_", "or_list", "orm_variable", "outbin", "parallelism", "parent_names", "pars", "passwd", "path_components", "pathlib", "pending", "ping", "pks", "plato", "plugin_info", "popup", "port_spec", "predicates", "predictionCol", "pref", "preset_mode", "prev_line", "private_key", "processHelper", "processor", "produce", "pth", "pw", "pxMailBox", "record_type", "reducer", "reducers", "ref_conn", "region_name", "relative_path", "repo_path", "request_dict", "restart", "rights", "row_set", "rpi_gpio", "runName", "rune", "runner_test", "saved_variable", "scan_state", "score1", "scratch_path", "seg", "segment_id", "sequences", "service_id", "sgv", "show_message", "skips", "sn", "source_name", "space_key", "species", "sq", "stamp", "start_sum", "statements", "structured_lists", "submodule", "sum_metric", "target_climate", "temp_path", "tensor_cls", "tensor_type_var", "test_conn", "then", "token_address", "transfer_deployment", "trimmed", "trophies", "u'node2'", "until", "urlquote", "user_obj", "vbox", "view_converter", "vistrails", "volume_ref", "w_dir", "watcher", "wf", "work", "workerid", "write_line", "write_to_logger", "xi", "ys", " ", " ", "\"\"\"Return store key for documents that satisfy expression.\"\"\"", "'!ZZZZZZ!!!'", "'$ref'", "'$set'", "'%s=%s'", "'&'", "'--settings=bad_settings'", "'-TCTAGG---'", "'10'", "'16-mixed'", "'NAME'", "'Result'", "'a list or tuple'", "'aaa'", "'attributes'", "'blue'", "'category'", "'county'", "'create'", "'credentials'", "'delta'", "'device_id'", "'fullname'", "'inf'", "'jack'", "'kwargs'", "'main'", "'max'", "'medium'", "'messages'", "'namespace'", "'network_id'", "'point'", "'population_count'", "'prediction'", "'q'", "'raw'", "'reactor'", "'revision'", "'row'", "'second'", "'tags'", "'uid'", "'unit'", "'unit_of_measurement'", "'up'", "'update'", "'width'", "0.75", "0.8", "1800", "190", "1e-07", "41", "ATTR_LATITUDE", "ATTR_LONGITUDE", "AXIS_DOMAIN", "AsyncSession", "AsynchronousException", "Body", "CLIException", "COMMAND", "C_z_i", "Category", "ClientProfile", "CompletedProcess", "DEFAULT_PROFILE", "Database", "DatabaseError", "Disable", "EOF", "Empty", "Entity", "Err", "ExecutionContext", "ExpectedException", "Features", "Formula", "HTTP_200_OK", "HttpResponseNotFound", "Int32", "Literal", "MigratableAutomation", "MigratableBlockDocument", "MigratableProtocol", "ModelInfo", "MySQLdb", "OrderTermOption", "P_Address", "PosyArray", "PyFBA", "ResourceAgentState", "SERVER_TYPE", "SerializeToString", "Spectrum", "Sub1", "TaskInstance", "Tool", "Trial", "Twid", "UINT", "VIZIO_SCHEMA", "Way", "_SetProperty", "__statuses", "__timer", "_active", "_address", "_bounds", "_buffer_offset", "_cubehandle", "_cursor_obj", "_db", "_driver_event", "_elem", "_events_delayed", "_group", "_hour", "_json", "_list_view", "_microsecond", "_minute", "_mqttc", "_p", "_parse_resp", "_password", "_payload", "_player_state", "_print", "_resolve_genres", "_seed", "_send_request", "_top_element", "_update", "_uri", "abs_path", "accepts_force", "action_name", "advance", "alignments", "all_keys", "analysis", "and_list", "api_post", "architecture", "argspec", "assert200", "assertListEqual", "assertLogs", "assert_compile", "async_call", "atomic", "atoms", "attname", "attrname", "auto_commit_interval", "autoclosure", "bc", "bestModel", "block_identifier", "blocksize", "bold", "boolean", "br_name", "c0", "c4", "c_const", "calls_args", "channel_id", "check_normalization", "chunk_data", "chunked", "cleaned", "clf2", "cmd_line", "coefs", "column_name", "composition", "converted_other", "cpp_namespace", "create_resource", "created_on", "csv", "curdir", "current_value", "cycle", "dag_run_id", "dash_duo", "data_type_class", "data_y", "datastore_version_id", "db_info", "default_q", "delete_table", "departure", "desired", "dest_dir", "detailed", "device_class", "dict_equal", "dim1", "divide", "dl", "dll", "dr", "econn", "elevation", "email_verifications", "eng", "eqs", "error_class", "exampleABF", "exc_type", "exp_id", "exp_summary", "expected_date", "export_version", "exprs", "f0", "far", "feat", "file_cmd", "file_format", "file_handle", "fill_values", "find_module", "flist", "floatX", "fn_name", "footprint", "form_classes", "form_dict", "frac", "fresh_operation", "from_email", "from_iterable", "ftype", "gateway", "geos2", "get_average", "get_context", "get_device", "get_event_loop", "get_id", "get_meaning", "get_refs", "get_site", "gethostname", "hidden_states", "hits", "hmdevice", "how", "hs", "ignored", "iid", "image_file", "imagex", "imagine", "importances", "importer", "importutils", "initMode", "insertionPoint", "int8_t", "interfaces", "invalid", "is_color", "isatty", "just", "kargs", "kept", "keyfile", "known_resource", "lbl", "le", "lead", "less", "lobj", "look", "loss_fn", "lstat", "lump", "matplotlib", "max_id", "measure", "media_content_type", "medium", "memtest", "messageBox", "migration_helpers", "mock_convert", "modname", "mountpoint", "mult", "must_have_addon", "net_p", "newValue", "new_attrs", "newbytes", "newnode", "normalized", "normcase", "not_before", "novaclient", "nspath_eval", "nullptr", "num_idxs", "o2", "obj2", "on_ok", "once", "original_bbox", "output_format", "overridden", "p0", "p_pointer", "packing", "pardir", "partition_ids", "pdFALSE", "pin_name", "pl", "png", "policies", "positionx", "positiony", "post_id", "post_url", "prepare_request", "product_type", "progress_logger", "ptyproc", "pvcoutput", "py_file", "query_term", "queue_name", "rast", "reading", "redirect_to", "remove_node", "remover", "requirement", "reraise", "reset_env", "response_model", "return_code", "run_time", "samp_vel", "scan", "scan_interval", "sch", "sector", "segment_", "sem", "server_list", "server_string_spec", "set_temperature", "severity", "signatures", "similarity", "site_packages", "skipUnlessDBFeature", "smooth", "special", "split_contents", "srcdir", "st_mode", "stable", "start_idx", "step_id", "storageLevel", "streaming", "string_type", "stringify", "struct_format", "subcomponent", "sublist", "supported", "sweeps", "sy", "teardown", "test_builtin_with_bad_settings", "test_output_writer", "testingLog", "tls", "topdown", "trainable", "transfer_block_type_x", "transfer_flow", "transfer_global_concurrency_limit", "transfer_variable", "transfer_work_queue", "trial_executor", "u'foo'", "un_op", "unsubscribe", "unwrap", "updated_since", "uppercase", "utf8", "validate_thread_sharing", "variance", "version_string", "wait_for", "watch", "websession", "who", "worklist", "writestr", "xml_to_json", "\"\"\"\n Setup our test case\n \"\"\"", "\"\"\"\n :param parser:\n :return:\n \"\"\"", "\"\"\"Returns the model properties as a dict\"\"\"", "\"\"\"Returns true if both objects are equal\"\"\"", "#endif", "'%s: %s'", "'-f'", "'-r'", "'123456'", "'2.0'", "'2.1.0'", "'2.4'", "'6'", "'::'", "'L'", "'NextToken'", "'SERVER_NAME'", "'Z'", "'alarm/command'", "'allow_inheritance'", "'ancestors'", "'bad_settings'", "'build'", "'check_env'", "'cluster'", "'columns'", "'command_topic'", "'current'", "'darwin'", "'designate'", "'down'", "'dsa'", "'exclude'", "'firefox'", "'first'", "'friendly_name'", "'grumpy'", "'header'", "'hosting_account_password'", "'int32'", "'item'", "'j'", "'lib'", "'line'", "'logger'", "'mac'", "'members'", "'nan'", "'next'", "'nt'", "'null'", "'oauth_token'", "'old'", "'orange'", "'oxford'", "'progress'", "'project'", "'ps'", "'review_request'", "'review_requests'", "'salt-cloud-force-ascii'", "'score'", "'secret'", "'selector'", "'startproject'", "'state_topic'", "'strength'", "'test3'", "'test_event'", "'testpass'", "'text/xml'", "'unique'", "'updated'", "'w+'", "0x80", "1.2", "1.3", "250", "360", "4294967295", "5000", "70", "900", ": ", "AccessControlRule", "Account", "AddMethod", "ArgumentNullException", "BELGraph", "Block", "C2", "CGFloat", "CHARD_CLIP", "CONF_API_KEY", "ConnectionError", "DEFAULT_DATE", "DESIGNATE", "DecoratorsTest", "Department", "Device", "Dispose", "EEXIST", "ENOENT", "GMPYRational", "Globals", "IGNORED", "Is", "Kind", "Log", "Match", "MessageTreeState", "MigratableBlockType", "MigratableFlow", "MigratableGlobalConcurrencyLimit", "ModelParallelStrategy", "ModelStorage", "NoError", "OBJ_ENCODING_QUICKLIST", "Offset", "OperationalError", "Options", "QColor", "REML", "Rational", "Ref", "Routes", "SOCK_STREAM", "SafeConfigParser", "Settings", "Song", "Source", "Statement", "Store", "Sub2", "SysTick", "T2", "TimeFunction", "UserFlags", "Vector3", "Void", "WriteString", "XYPoint", "Xnew", "_ContinuousPolling", "_LI", "_RESOURCE", "_UNPACK_INT", "__hash__", "__moduleDict", "__slots__", "_amp", "_ascendants", "_assert_active", "_attributes", "_check_bucket_uri", "_commit", "_cookie2", "_current", "_dbh", "_decorated_function_called_count", "_elements", "_f", "_filename", "_filter", "_foll_dict", "_fp", "_get_adb_prefix", "_get_bot", "_get_collection", "_get_context", "_get_fake_phys_lease_values", "_jobsdone", "_keys", "_make_request", "_make_storage", "_mouse_hovering_over", "_namespace", "_not_null", "_offset", "_project", "_raise_current_error", "_reals_cache", "_send_content", "_sep", "_setup_config", "_sources", "_spec", "_temperature", "_zeroconf", "a2", "accumulator", "active_child", "addon_short_name", "address_connection", "ae", "aggregates", "alarms", "anid", "aoR", "archive_path", "argument_types", "as_json", "assertItemsEqual", "async_dispatcher_connect", "async_get_clientsession", "async_start", "async_update_ha_state", "atleast_1d", "atleast_2d", "atomType", "attach_volume", "attachment", "attachment_id", "auth_url", "ax1", "base_file", "batched", "benchmarker", "bf", "bind_data", "bitmask", "blockn", "blocks_length", "blocks_start", "bmp", "bokeh_app", "both", "build_dir", "build_number", "byScenario", "bytes_or_text", "cancelled", "caps", "cdf", "ceildiv", "challenges", "check_password", "check_response", "check_usage", "ckpt", "claims", "cloneModelInfo", "cls_name", "cluster_id1", "cmdline", "cmesh", "co", "co_filename", "coef_", "command_name", "commit_id", "comparison", "compuestos", "conf_name", "config_filename", "configurator", "consequent", "consuming", "contract", "coordinates", "costs", "counters", "cpu_device_map", "crash", "credential", "credential_name", "cross", "css", "ctable", "curve", "cutoff_date", "data_element", "datadir", "date_string", "db_value", "dbg", "dbinfo", "dd", "declare", "decompress", "decompressor", "defValue", "default_batch_size", "default_flow_style", "delegate", "descr", "describe", "destination_id", "detect", "dic", "diffs", "dig", "digest_size", "disable", "disp", "dispersion", "displayable_path", "distributed", "doc_span", "document_class", "domain_name", "embedding_model", "ep_ids", "errback", "estimate", "eventLoop", "example_store", "excludes", "exec_command", "execute_deferred_sql", "expire", "extra_data", "extra_specs", "fabs", "fail_entry", "fake_check_env", "fake_date", "fc_status", "feed_params", "field_kwargs", "file_data", "fileid", "filetype", "final_path", "find_links", "find_one", "finite_start", "fixed_ips", "fluent", "fnd", "from_file", "full_long", "funcname", "fw", "games", "gapfill", "ge", "generate_data", "getEnthalpy", "getEntropy", "get_argument", "get_default", "get_default_graph", "get_schema", "getmtime", "getpid", "getrefcount", "gis", "git", "given", "givens", "global_pool", "grad_source", "greenlet", "guess", "harstatus", "hashed_ev", "heappush", "hemi", "hp", "hpo_tree", "html_in", "imap", "inDecimalDegrees", "in_httpcode", "includePrefix", "indentation", "ingredients", "initialized", "inner_rule", "insight_params", "internet", "iri", "issue", "item_etag", "jsonschema", "keep_prob", "key2", "keyValues", "key_to_id", "kmz", "las_path", "latex", "lease_values", "legend", "light_id", "limitby", "linestr", "lmda", "local_manifest", "localtime", "location_cmd", "log_likelihood", "lpBaseOfDll", "lump_name", "lun", "lval", "make_response_error", "management", "master_table", "materials", "maxTokens", "max_steps", "max_width", "means", "media_content_id", "member_elt", "memcache", "micros", "mime", "min_torch", "mktime", "ml", "mock_model", "mock_publish", "mock_smtp", "model_type", "module_create_bin", "moves", "msgid", "multiprocessing", "mute", "n_fft", "needles", "neighbor", "netapp_api", "neutron", "ni", "node_settings", "nose", "nova", "now_tuple", "num_pages", "obj_dict", "obj_list", "old_value", "on_prob", "optim", "optional", "optname", "orm_work_queue", "others", "out_path", "output_stride", "output_tensors", "owner_id", "page_number", "par", "param_list", "parent_dir", "passive", "patch2line", "pats", "pci_stats", "phen", "pkg_name", "plural", "points1", "policy_profile_id", "positionError", "posixpath", "post1", "prev_ti", "procf", "prof", "propertyName", "property_spec", "proposal", "pseudo", "pseudos", "pspace", "pub", "pwd", "pyop_value", "qtile", "query_function", "question_text", "quota_class_id", "quotas", "raid", "read1", "read_byte_data", "reads", "receipt", "register_account_page_class", "regression", "rem", "remotable", "requester", "require_context", "reset_parameters", "resolution", "responder", "restore_saved_module", "result_type", "retry", "room_id", "run_in_executor", "run_pip", "runner_instance", "saml", "sasl", "screenshot", "search_paths", "search_pattern", "sec", "seg_max", "seg_min", "send_msg", "sequenced_queue_data", "serverPanic", "serving", "shards", "signature_fn", "signer", "simulate", "slave_fd", "sline", "solr", "solver", "sort_dirs", "source_or_alias", "spatial_squeeze", "spelling", "spi", "sshdir", "statusHandler", "stc", "story_steps", "strength", "subKey", "subdir", "success_msg", "suite_name", "swing_mode", "sysroot", "table_exprs", "tarfile", "target_metadata", "task_ids", "tb_uint32_t", "teams", "telnet_command", "tensor_array", "terminated", "test_builtin_command", "test_builtin_with_bad_environment", "test_location", "test_params", "throttled_call", "timeformat", "timeout_seconds", "tmp_stack", "to_pandas", "to_remove", "to_s", "to_unicode", "tone", "topology_geoms", "tracker", "trail", "training_examples", "transactions", "tris", "tuples", "u'Node 1'", "update_wrapper", "uploads", "upper_bound", "uptime", "urlparts", "userhome", "utcfromtimestamp", "valid0", "validdata", "value_or_raise", "var_exp", "verifier", "w2", "wavelength", "weight_column_name", "weight_tensor", "wifi_networks", "workspace_id", "wrap_json", "writelines", "x3", "xBlockTime", "x_coords", "xx", "y3", "yahoo", "ymax", "zoneid", "zones", " ", " ", "\"\"\"Run the benchmark and print benchmark results.\"\"\"", "\"Unknown list encoding\"", "\"string\"", "'\"%s\"'", "'%s %s'", "'%s%s%s'", "'--settings=test_project.settings'", "'/testkey'", "'/vms/'", "'00'", "'1s'", "'2.1'", "'; '", "'Content-Disposition'", "'Firefox'", "'Hello'", "'Not implemented in the base class'", "'Reports'", "'X-Frame-Options'", "'__call__'", "'__init__.py'", "'access_token'", "'alarm/state'", "'alternative'", "'binary'", "'bla'", "'bob'", "'cell_name'", "'char'", "'chat'", "'desc'", "'devices'", "'display_name'", "'etc'", "'exec'", "'exists'", "'expires'", "'extensions'", "'external_user_id'", "'f1'", "'fake'", "'filter'", "'float64'", "'fred'", "'hamlet'", "'hass'", "'head'", "'hostname'", "'https://'", "'index.html'", "'index_specs'", "'light.bowl'", "'loaddata'", "'open'", "'order'", "'padID'", "'pause'", "'plain'", "'project_id'", "'repo'", "'reservations'", "'response'", "'seconds'", "'stop'", "'test_scmtools'", "'total'", "'types'", "'users.login'", "'vgame'", "'volume_id'", "'watch'", "'{}_{}'", "0.123", "100000.0", "10000000000.0", "101", "402", "65536", "999", "AB", "ARRAY", "AccountPage", "BasicModel", "BooleanField", "Box", "CALLBACK_TYPE", "CONF_DEVICE_CLASS", "CONF_QOS", "COUNT", "Clone", "Colour", "Configuration", "Coordinates", "DATA", "DTypeLike", "DataDir", "DataLoader", "DataParticleKey", "DummyEntry", "E0min", "ENTITY_ID", "EOFError", "ExecuteDefer", "FAILED", "FAN_ENTITY_ID", "Fatalf", "Helper", "ISO88591", "Invalidate", "IsChromeOS", "JavaParams", "LATITUDE", "LIST_TAIL", "Length", "MIN_TIME_BETWEEN_UPDATES", "MainActor", "MatrixExpr", "ModelForm", "OBJ_ENCODING_LISTPACK", "OptionDoesNotExist", "OptionParser", "OrderTermOptions", "OverflowError", "PermissionError", "Player", "Poet", "PositionError", "Product", "Profile", "QPen", "QtWidgets", "RaiseXIODriverException", "Repository", "Required", "RuntimeWarning", "S3Represent", "SIGNAL", "STDIN_FILENO", "SafeLineLoader", "SandboxAuthBackend", "Save", "Serializer", "SetPrefs", "SignalFileDescription", "SingleDeviceStrategy", "SiteConfiguration", "Spec", "Structure", "Subject", "SystemWallpost", "TEMP_FAHRENHEIT", "Tabs", "Telnet", "TrainingData", "Tx", "WARNING", "Worker", "__code__", "__repository", "__unicode__", "__virtualname__", "_add", "_authentication", "_cached_fingerprint", "_cmd_dict", "_code", "_coeffs", "_connected", "_count", "_create_request", "_current_build_env", "_dirty", "_distro", "_doc", "_format_arg", "_get_producer", "_idx", "_lines", "_msl_data", "_ops", "_owned_job_token", "_play_status", "_proxy", "_representations", "_resolver_context", "_root", "_send", "_setup", "_type_memos", "_unique_id", "_value_by_pid", "about", "accepted", "account_id", "acl", "activate_url", "addItem", "add_attr", "add_baseline", "agent_id", "aggregator", "albumartist", "allowed_attrs", "alt", "api_call", "api_samples_test_base", "app_configs", "appendInterpolation", "argname", "asbool", "assertAllEqual", "assert_logged", "async_publish", "avail", "average", "ba", "badge", "base_commit_id", "basic_types", "baymodel", "bi", "biases", "bin", "binary_type", "blame", "block_name", "boltzmann_b", "boot_mode", "browser_options", "buckets", "built", "cats", "centroid", "certpem", "ch_data", "check1", "checkout_path", "chunksize", "cipher", "clear_text", "cli_key_dispatch", "clicked", "client_post", "cluster_id2", "codec_options", "coder", "coll", "colname", "comm", "committer", "compilation", "component_id", "console_type", "cookie_dict", "countries", "covers", "cpt", "cpu_count", "create_connection", "create_engine", "cred_dict", "cres", "crop", "cur_out", "currentIndex", "current_time", "cycles", "dash", "data_format", "declared_attr", "decorated", "default_unit", "delayed", "den", "deployment_id", "devent", "dgroup", "dict2", "dict_", "dict_or_tensor", "direction_vectors", "dirty", "dispatch_table", "dp", "dr_input", "drawPixel", "duplicate", "durations", "emoji", "encodeURIComponent", "encrypt", "engines", "eris", "eval_metric_ops", "event_name", "eventlet", "example_user", "exc_value", "expansion", "expired", "fB", "fds", "fformat", "fibaro_device", "fieldsets", "file_cache", "filespec", "filter_field", "find_elements", "finditer", "first_id", "fitted", "fixedip", "fonts", "fp2", "from_state", "ftppath", "g1", "gca", "gene_db", "gene_id", "gene_obj", "geom_type", "getParent", "getXML", "get_by_uuid", "get_cache_key", "get_default_config_help", "get_engine", "get_indexes", "get_match_value", "get_patch", "get_role", "get_service", "get_size", "gettext", "git_cmd", "global_num_inst", "gm", "gold", "group_ids", "guide", "handle_response_format", "haystack", "health", "hide", "hkl", "hmac", "http_response", "i13", "id_field", "id_values", "image_meta", "imagepath", "increment", "index2", "indices_sorted", "infer", "infolist", "initiator", "inlines", "input_type", "insn", "integer", "into", "involved_object", "ipaddr", "is_anonymous", "is_iterable", "is_trace", "iter_frame", "iter_modules", "java_home", "key_file", "kmeans2", "la", "learn", "lease_duration", "libvirtError", "line1", "line_break", "line_image", "linewidth", "linter", "list_pkgs", "listen_once", "load_data", "log_debug", "log_dir", "logsumexp", "lr", "lru_cache", "manage", "manufacturer_id", "max_chars", "me", "measurement_results", "migrate_called", "minDigits", "missing_key_policy", "mlinestr", "mne", "mod_wiki", "modificationDate", "module_create_bin2", "module_update_invisible_toggle", "monotonic", "mrb_int", "multi", "mutexInfo", "mydict", "myq", "nc", "new_device", "new_props", "new_size", "newest", "newstate", "next_layer", "next_url", "nf", "nffg", "nick", "nocc", "nsteps", "nullable", "num_batches", "object_spec", "observation", "observe", "observed_ratings", "oh", "olen", "other_site", "outcome", "output_dims", "override_time", "package_path", "packet_ids", "page_title", "pal", "pal_out", "parsed_query", "pass_zero", "patch_yaml_files", "patient_id", "perform", "permission_required", "pivot", "pixels", "plist", "policy_id", "port_name", "prec", "preproc", "process_group", "processutils", "production", "productions", "profile_data", "property_name", "pull", "quadkey", "query_string", "quest", "raise_for_status", "rangelen", "rating", "rawtime", "read_bits", "record_id", "register_view", "relation_info", "request_spec", "response2", "review_request_item_mimetype", "review_result", "root_folder", "rospy", "rp", "rule_id", "run_rosrepo", "safe_open", "save_names", "secure_function", "self_dict", "sendServerMessage", "sendroom", "separators", "sessions", "setSign", "shlex", "significance", "signum", "sio", "skill", "slab", "slottables", "sourcestring", "space_order", "specialization", "spider", "sr", "ssh_cmd", "state_above", "status_int", "sticky", "storage_persons", "stripped", "structDict", "subModels", "subclass", "subcommand", "subf", "subst", "subtract", "successor", "systemml_home", "table_names", "tag_suffix", "target_id", "tconf", "tdf", "tensor1", "tensor2", "test_obj", "test_result", "testnet", "text_color", "th", "theano_rng", "themedir", "throttle_name", "time_stamp", "tm", "to_bytes", "todense", "tokenType", "topic_name", "totals", "track_info", "trackers", "transformers", "transpose_b", "ts1", "u'node1'", "u_max", "ub", "unique_indices", "unit_price", "unknown", "upload_files", "upstream", "urwid_key_dispatch", "vQueueDelete", "value_changed", "variationValue", "vassals", "velocity", "version_str", "vert", "viewers", "volume_type", "vserver", "vv", "wall_time", "web_page", "web_resource", "wheel", "widget2", "with_rank", "workflow_name", "workspace_dir", "write_concern_level", "x_kind", "xarr", "xl_range", "xlabel", "xmax", "xnew", "xticks", "yesterday", "ylabel", "zfssa", "\t ", " ", "\"\"\"\n A function run before each unit test in this class.\n \"\"\"", "\"\"\"Initialize the data object.\"\"\"", "\"\"\"See base class.\"\"\"", "'%Y-%m-%d'", "'%s\\n'", "'%s_%s'", "'---'", "'--version'", "'-p'", "'-u'", "'-w'", "'/1'", "'/tmp'", "'0.0'", "'12'", "'7'", "'>f4'", "'AKT1'", "'CA'", "'CC'", "'Destination'", "'FunctionType'", "'HOME'", "'Method not implemented!'", "'RGB'", "'Subclasses must implement this method.'", "'Test Page'", "'This is a test for match!'", "'W'", "'Windows'", "'Wrong result. Expected %s, we got %s'", "'\\\\n'", "'__iter__'", "'addr'", "'always'", "'app'", "'as'", "'available'", "'beta'", "'center'", "'changes'", "'container'", "'ctx'", "'disk'", "'docs'", "'ed'", "'entity'", "'episode_id'", "'file_id'", "'flags'", "'from_user'", "'global'", "'hash'", "'help'", "'homeassistant'", "'icon'", "'import'", "'initial'", "'int64'", "'jabber:iq:auth'", "'key1'", "'mod1'", "'new'", "'new_state'", "'not HAS_BEAUTIFUL_SOUP'", "'notify'", "'now'", "'photo_ids'", "'platform_conf'", "'policy'", "'ports'", "'pos'", "'price'", "'priority'", "'profile'", "'provider'", "'read_only'", "'readonly'", "'ref'", "'region'", "'reset'", "'responseFields'", "'role'", "'segmentation'", "'select'", "'setUp'", "'simon'", "'slab'", "'split'", "'strict-transport-security'", "'subnet_id'", "'test-key1'", "'test-page'", "'test-topic'", "'users'", "'waiting'", "'warning'", "1.1", "150", "2013", "34", "35", "36", "45000", "48", "ARM", "ATTR_TEMPERATURE", "ActionResult", "AggregateNotFound", "BOTH", "BiteResult", "Boolean", "CSS_SELECTOR", "Call", "CommandError", "ConfigEntry", "ConfigurationError", "Contact", "CredentialsStore", "DATA_SETUP", "DEFAULT_VERSION", "DbType", "Deferred", "Delete", "Do", "Done", "DriverAsyncEvent", "E0max", "ENSURE_SMALL", "EOF_sigil", "EVENT_HOMEASSISTANT_STOP", "EVENT_STATE_CHANGED", "EtcdResult", "ExampleSerializer", "Filter", "FriendshipRequest", "FullyShardedDataParallel", "GetFileEntryByPathSpec", "GetPrefsInfo", "GetProperty", "ICx", "INDICES", "IPNetwork", "ITSource", "InferenceError", "Instance", "Internal", "InvalidArgumentError", "InvalidRequestError", "Media", "MockEntityValues", "MockRequest", "MyException", "NativeMethods", "NoMatch", "POLICY", "PROTOCOL_VERSION", "ParseError", "Pio", "Pmax", "Pmin", "PotentialError", "Prefs", "QApplication", "RESPONSE", "RawMessage", "ReadFile", "RestartBrowser", "SIGTERM", "STATE", "STATE_IDLE", "STRING", "SYSTEM", "S_z_i", "Segment", "Signal", "SimuHawkes", "Slice", "Some", "Species", "Split", "StatusUpdate", "Storage", "SubDimension", "Summarizer", "TableName", "TaskStatus", "Term", "Theory", "ThrowIfNull", "ToString", "USERGROUP", "Uint32", "V0", "VIDEO_1_PLAYING_CHECK", "Var", "Writer", "_GA", "_GPIO", "__portA_val", "__portB_val", "__sendCommand", "_accessory", "_alias", "_assert_resource_error", "_close", "_compat", "_condition", "_currentIndex", "_current_sample", "_exception", "_field", "_func", "_get_single_metric", "_handlers", "_history", "_iobuf", "_isolate_components", "_lease_renewer", "_lexer_cache", "_limit", "_module", "_new_java_obj", "_on_virt_uri", "_pool", "_prepared", "_read", "_reader", "_reason", "_register", "_roles", "_scale", "_selector", "_settings", "_supported_features", "_t", "_targets", "_test_fix_replacement", "_timeout", "_to_java", "_token", "_v_pathname", "_vmname", "abbreviations", "access_token_id", "account_table", "accounts", "accuracy", "addReader", "add_form", "add_nodes_from", "add_parser", "addend", "adj", "adv_label", "agentIndex", "agg", "all_params", "allow_override", "allowed_values", "ans", "appendingPathComponent", "areas", "argindex", "args2", "asMatrix2D", "as_bytes", "async_entries", "async_fire_mqtt_message", "async_schedule_update_ha_state", "attr_list", "auth_token", "authentication", "avatar", "axisValues", "backends", "bare", "beds", "best_scores", "bigg_id", "bind_addr", "blank", "block_device_info", "block_type", "box_cox", "build_url", "bulbs", "bulk_op", "but", "c_dict", "c_forward_pointer", "cafile", "camera_data", "capath", "capitalize", "carbon_xfilesfactor", "cartitem", "chains", "check_cells_enabled", "check_grammar", "checkpoints", "child_model", "chol", "chrome_options", "chromosome_ids", "className", "clear_profile", "client_type", "climb", "closure", "cmax", "cmd_name", "cmd_str", "cmdtuples", "collection_summary", "colocate_with", "coltype", "comp_or_form", "compiler_name", "completed", "component_record", "components_", "compression", "compuestosTabla", "cond1", "conditionTermClass", "config_data", "connections_to_send", "cons", "consumer_key", "contacts", "control_connection", "conv_id", "coor", "copyfile", "corev1", "corrects", "countDocuments", "createExternalTable", "create_schedule", "created_by", "cred_name", "criterion", "cross_entropy", "crx_file", "custom_values", "cutoff", "dHdl", "dags", "dasgff", "dataType", "data_key", "data_raw", "data_ref", "data_specs", "datedata", "db_baymodel", "db_service", "dbapi_conn", "dbm", "decl", "decl_class_registry", "delegateData", "delete_type", "dep_task", "deserializer", "dest_directory", "detail_url", "dev_pool", "device_entry", "device_path", "devobj", "dict_stats", "dictionary_name", "disk_name", "disk_type", "disks", "dispatch_event", "drange", "drive", "editingElement", "einputs", "emissions", "enablePullUp", "end2", "engagement", "enter", "episodes", "equals", "err_t", "errs", "everyone", "exclude_fields", "exe_file", "expected_color", "expected_regex", "expired_timers", "exports", "exts", "f_lineno", "failureException", "feat_mat", "fft_rank", "fillchar", "fim_policy_id", "final_structure", "find_element_by_id", "first_timestamp", "firstname", "fisier", "fit_intercept", "float16", "flume_device", "fmtstr", "fn_", "fock", "followers", "follows", "free_socket", "fritz", "fromFloats", "from_bytes", "from_date", "fty", "gateway_id", "gd", "gdata", "gesture", "get_child_content", "get_doc", "get_info", "get_models", "get_payload", "get_ports", "get_resnet", "get_state", "get_status", "get_title", "get_urls", "get_values", "get_var", "glob_utils", "global_rank", "global_sum_metric", "globe_file", "google", "groupID", "group_sizes", "guestfs", "h1", "hamlet", "hann_window", "hardware_devices", "has_cycles", "has_section", "hashfunc", "hdu", "head_dim", "header_content", "hessians", "homekit", "host_passes", "hradius", "id_query", "idxs", "image_mnt_unpac_path", "imshow", "indexOf", "inference", "inode", "install_dir", "intf", "iri2uri", "is_archived", "is_paused", "is_registered", "isfunction", "issparse", "itemsize", "joint", "json_string", "jsonify", "keyID", "keyspace", "kml", "kwlist", "l_state", "label_class", "label_dimension", "labels_tensor", "language_code", "last_timestamp", "lcs", "lease_create", "linear_regression", "linker", "loadSuite", "loadTestsFromTestCase", "load_v", "local_url", "log10", "logfile", "look_for", "looker_client", "loop_args", "lsize", "lu", "machineName", "manufacturer", "many", "mapped", "master_state", "mastertoken", "matchers", "max_age", "mc", "md_key", "md_obj", "mem_addr", "membersodata_count", "membersodata_navigation_link", "menu_dict", "metaclass", "min_dist", "mmap_mode", "mo_coeff", "mo_energy", "mock_app", "mock_openzwave", "modName", "modpath", "morfs", "movie", "mri", "mro", "multiparams", "n_test", "name_map", "nbaths", "ndata", "net_db", "newStatus", "new_config", "new_environ", "new_parent", "new_password", "next_element", "nh4", "nickname", "node_config", "noise", "non", "normalize_marathon_id_path", "nox", "nsp", "nvis", "odict", "old_char", "old_state", "old_text", "omc", "oo", "op_hint", "op_list", "opacity", "orig_account", "os_release_attr", "out_channels", "out_fmt", "out_fn", "outcomes", "output_list", "overflow", "panic", "parameter_key", "paranteza", "path_name", "patient_info", "payment", "phi_rad", "pika", "pipes", "pnt", "popleft", "post_save", "post_stats", "preExecuteCmd", "predict_proba", "prefect", "previous_element", "processors", "productType", "prompt_parts", "prompt_text", "property_filter_spec", "prox", "prune", "public_key", "pvParameters", "pxMutex", "pxSemaphore", "py", "py_func", "pypck", "pyplot", "pywink", "qn", "qname", "qsize", "quad", "quality", "quantity", "qubit", "queryTest1", "queryTest2", "query_name", "query_spec", "<|byte:00|>", "<|byte:01|>", "<|byte:02|>", "<|byte:03|>", "<|byte:04|>", "<|byte:05|>", "<|byte:06|>", "<|byte:07|>", "<|byte:08|>", "<|byte:09|>", "<|byte:0a|>", "<|byte:0b|>", "<|byte:0c|>", "<|byte:0d|>", "<|byte:0e|>", "<|byte:0f|>", "<|byte:10|>", "<|byte:11|>", "<|byte:12|>", "<|byte:13|>", "<|byte:14|>", "<|byte:15|>", "<|byte:16|>", "<|byte:17|>", "<|byte:18|>", "<|byte:19|>", "<|byte:1a|>", "<|byte:1b|>", "<|byte:1c|>", "<|byte:1d|>", "<|byte:1e|>", "<|byte:1f|>", "<|byte:20|>", "<|byte:21|>", "<|byte:22|>", "<|byte:23|>", "<|byte:24|>", "<|byte:25|>", "<|byte:26|>", "<|byte:27|>", "<|byte:28|>", "<|byte:29|>", "<|byte:2a|>", "<|byte:2b|>", "<|byte:2c|>", "<|byte:2d|>", "<|byte:2e|>", "<|byte:2f|>", "<|byte:30|>", "<|byte:31|>", "<|byte:32|>", "<|byte:33|>", "<|byte:34|>", "<|byte:35|>", "<|byte:36|>", "<|byte:37|>", "<|byte:38|>", "<|byte:39|>", "<|byte:3a|>", "<|byte:3b|>", "<|byte:3c|>", "<|byte:3d|>", "<|byte:3e|>", "<|byte:3f|>", "<|byte:40|>", "<|byte:41|>", "<|byte:42|>", "<|byte:43|>", "<|byte:44|>", "<|byte:45|>", "<|byte:46|>", "<|byte:47|>", "<|byte:48|>", "<|byte:49|>", "<|byte:4a|>", "<|byte:4b|>", "<|byte:4c|>", "<|byte:4d|>", "<|byte:4e|>", "<|byte:4f|>", "<|byte:50|>", "<|byte:51|>", "<|byte:52|>", "<|byte:53|>", "<|byte:54|>", "<|byte:55|>", "<|byte:56|>", "<|byte:57|>", "<|byte:58|>", "<|byte:59|>", "<|byte:5a|>", "<|byte:5b|>", "<|byte:5c|>", "<|byte:5d|>", "<|byte:5e|>", "<|byte:5f|>", "<|byte:60|>", "<|byte:61|>", "<|byte:62|>", "<|byte:63|>", "<|byte:64|>", "<|byte:65|>", "<|byte:66|>", "<|byte:67|>", "<|byte:68|>", "<|byte:69|>", "<|byte:6a|>", "<|byte:6b|>", "<|byte:6c|>", "<|byte:6d|>", "<|byte:6e|>", "<|byte:6f|>", "<|byte:70|>", "<|byte:71|>", "<|byte:72|>", "<|byte:73|>", "<|byte:74|>", "<|byte:75|>", "<|byte:76|>", "<|byte:77|>", "<|byte:78|>", "<|byte:79|>", "<|byte:7a|>", "<|byte:7b|>", "<|byte:7c|>", "<|byte:7d|>", "<|byte:7e|>", "<|byte:7f|>", "<|byte:80|>", "<|byte:81|>", "<|byte:82|>", "<|byte:83|>", "<|byte:84|>", "<|byte:85|>", "<|byte:86|>", "<|byte:87|>", "<|byte:88|>", "<|byte:89|>", "<|byte:8a|>", "<|byte:8b|>", "<|byte:8c|>", "<|byte:8d|>", "<|byte:8e|>", "<|byte:8f|>", "<|byte:90|>", "<|byte:91|>", "<|byte:92|>", "<|byte:93|>", "<|byte:94|>", "<|byte:95|>", "<|byte:96|>", "<|byte:97|>", "<|byte:98|>", "<|byte:99|>", "<|byte:9a|>", "<|byte:9b|>", "<|byte:9c|>", "<|byte:9d|>", "<|byte:9e|>", "<|byte:9f|>", "<|byte:a0|>", "<|byte:a1|>", "<|byte:a2|>", "<|byte:a3|>", "<|byte:a4|>", "<|byte:a5|>", "<|byte:a6|>", "<|byte:a7|>", "<|byte:a8|>", "<|byte:a9|>", "<|byte:aa|>", "<|byte:ab|>", "<|byte:ac|>", "<|byte:ad|>", "<|byte:ae|>", "<|byte:af|>", "<|byte:b0|>", "<|byte:b1|>", "<|byte:b2|>", "<|byte:b3|>", "<|byte:b4|>", "<|byte:b5|>", "<|byte:b6|>", "<|byte:b7|>", "<|byte:b8|>", "<|byte:b9|>", "<|byte:ba|>", "<|byte:bb|>", "<|byte:bc|>", "<|byte:bd|>", "<|byte:be|>", "<|byte:bf|>", "<|byte:c0|>", "<|byte:c1|>", "<|byte:c2|>", "<|byte:c3|>", "<|byte:c4|>", "<|byte:c5|>", "<|byte:c6|>", "<|byte:c7|>", "<|byte:c8|>", "<|byte:c9|>", "<|byte:ca|>", "<|byte:cb|>", "<|byte:cc|>", "<|byte:cd|>", "<|byte:ce|>", "<|byte:cf|>", "<|byte:d0|>", "<|byte:d1|>", "<|byte:d2|>", "<|byte:d3|>", "<|byte:d4|>", "<|byte:d5|>", "<|byte:d6|>", "<|byte:d7|>", "<|byte:d8|>", "<|byte:d9|>", "<|byte:da|>", "<|byte:db|>", "<|byte:dc|>", "<|byte:dd|>", "<|byte:de|>", "<|byte:df|>", "<|byte:e0|>", "<|byte:e1|>", "<|byte:e2|>", "<|byte:e3|>", "<|byte:e4|>", "<|byte:e5|>", "<|byte:e6|>", "<|byte:e7|>", "<|byte:e8|>", "<|byte:e9|>", "<|byte:ea|>", "<|byte:eb|>", "<|byte:ec|>", "<|byte:ed|>", "<|byte:ee|>", "<|byte:ef|>", "<|byte:f0|>", "<|byte:f1|>", "<|byte:f2|>", "<|byte:f3|>", "<|byte:f4|>", "<|byte:f5|>", "<|byte:f6|>", "<|byte:f7|>", "<|byte:f8|>", "<|byte:f9|>", "<|byte:fa|>", "<|byte:fb|>", "<|byte:fc|>", "<|byte:fd|>", "<|byte:fe|>", "<|byte:ff|>"]
|
metrics.json
ADDED
|
@@ -0,0 +1,54 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"release_step": 87776,
|
| 3 |
+
"methodology": {
|
| 4 |
+
"temperature": 0,
|
| 5 |
+
"human_eval_stop": "same top-level stop rules for both models",
|
| 6 |
+
"token_limit": "768 total tokens using each model tokenizer; EAR task includes forced prefix",
|
| 7 |
+
"executor": "Docker isolated, network disabled",
|
| 8 |
+
"human_eval_data_sha256": "b796127e635a67f93fb35c04f4cb03cf06f38c8072ee7cee8833d7bee06979ef",
|
| 9 |
+
"mbpp_data_sha256": "ca95deaa9a01ef0a6f439f88bcf0dd3db3563d22f22aad6cae04ebb9a8d8c8e9",
|
| 10 |
+
"reference_checks": "10/10 HumanEval and 10/10 MBPP reference solutions passed in the same executor",
|
| 11 |
+
"limitations": "EAR and Tiny use different tokenizers and interfaces; MBPP is a random 30-task sample with one visible test, not standard full benchmark; training-set contamination not excluded."
|
| 12 |
+
},
|
| 13 |
+
"earai": {
|
| 14 |
+
"humaneval_full": {
|
| 15 |
+
"tasks": 164,
|
| 16 |
+
"passed": 0,
|
| 17 |
+
"syntax_valid": 123,
|
| 18 |
+
"prefix_exceeded": 17
|
| 19 |
+
},
|
| 20 |
+
"mbpp_sanitized_sample": {
|
| 21 |
+
"tasks": 30,
|
| 22 |
+
"passed": 0,
|
| 23 |
+
"syntax_valid": 0,
|
| 24 |
+
"prefix_exceeded": 0
|
| 25 |
+
},
|
| 26 |
+
"humaneval_matched_subset": {
|
| 27 |
+
"tasks": 20,
|
| 28 |
+
"passed": 0,
|
| 29 |
+
"syntax_valid": 15,
|
| 30 |
+
"prefix_exceeded": 3
|
| 31 |
+
},
|
| 32 |
+
"mbpp_matched_subset": {
|
| 33 |
+
"tasks": 10,
|
| 34 |
+
"passed": 0,
|
| 35 |
+
"syntax_valid": 0,
|
| 36 |
+
"prefix_exceeded": 0
|
| 37 |
+
}
|
| 38 |
+
},
|
| 39 |
+
"tinystarcoder_py": {
|
| 40 |
+
"parameters": 164144128,
|
| 41 |
+
"humaneval_matched_subset": {
|
| 42 |
+
"tasks": 20,
|
| 43 |
+
"passed": 1,
|
| 44 |
+
"syntax_valid": 19,
|
| 45 |
+
"prefix_exceeded": 0
|
| 46 |
+
},
|
| 47 |
+
"mbpp_matched_subset": {
|
| 48 |
+
"tasks": 10,
|
| 49 |
+
"passed": 0,
|
| 50 |
+
"syntax_valid": 0,
|
| 51 |
+
"prefix_exceeded": 0
|
| 52 |
+
}
|
| 53 |
+
}
|
| 54 |
+
}
|
model.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:397a155016fe825cd0013976a7b81fbbe761dbef2dca34d61249d97874372fe6
|
| 3 |
+
size 333819437
|
release_info.json
ADDED
|
@@ -0,0 +1,7 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"step": 87776,
|
| 3 |
+
"parameters": 166895360,
|
| 4 |
+
"model_sha256": "397a155016fe825cd0013976a7b81fbbe761dbef2dca34d61249d97874372fe6",
|
| 5 |
+
"max_output_tokens": 768,
|
| 6 |
+
"training_context_node_ceiling": 8192
|
| 7 |
+
}
|