File size: 1,036 Bytes
1fe4109
 
 
 
 
 
 
 
 
033035d
1fe4109
0bfdd04
1fe4109
37adef9
1fe4109
499fcb2
0bfdd04
499fcb2
0bfdd04
499fcb2
0bfdd04
499fcb2
0bfdd04
37adef9
0bfdd04
499fcb2
c9089df
499fcb2
c9089df
499fcb2
c9089df
499fcb2
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
---
language:
- en
license: llama3.1
library_name: transformers
pipeline_tag: text-generation
base_model: NousResearch/DeepHermes-3-Llama-3-8B-Preview
tags:
- astheral
- llama
- instruct
- qlora
---
# Astheral V3

Astheral is SEE7's 8.03B instruction model, built with Llama and fine-tuned from DeepHermes-3-Llama-3-8B-Preview.

[Chat](https://huggingface.co/spaces/SEE7/Astheral)

## Training

Merged BF16 weights from the V3 rank-16 QLoRA run: 41,943,040 adapter parameters, 1,713 training examples and 180 optimizer steps. Instruct and thinking modes are supported.

## Use

Load the merged checkpoint with Transformers in BF16, or use the hosted Space. The Space supports project instructions and up to 4,096 generated tokens.

## Reports and files

[Training and evaluation](https://huggingface.co/SEE7/Astheral/tree/main/v3-results) · [Extended experiments](https://huggingface.co/SEE7/Astheral/tree/v3-expanded-20261113)

Llama 3.1 licensing applies. See LICENSE, UPSTREAM_LLAMA3_LICENSE, NOTICE and the data attribution files.