File size: 3,017 Bytes
bb1382a d37f161 bb1382a | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 | ---
license: llama3.1
base_model: meta-llama/Llama-3.1-8B-Instruct
tags:
- jblaze
- representation-engineering
- abliteration
- llama
- llama3
language:
- en
pipeline_tag: text-generation
---
# Llama-3.1-8B-Instruct-Concise-Precise
A [jBlaze](https://jblaze.dev) representation-engineered variant of [Llama-3.1-8B-Instruct](https://huggingface.co/meta-llama/Llama-3.1-8B-Instruct).
## What is this?
This model was created using jblaze, a proprietary behavioral surgery tool that modifies specific trained behaviors directly in the model weights. No fine-tuning or additional training was performed.
## Description
Concise with amplified precision. Removes verbose padding while enhancing numerical and factual accuracy.
## Directions Applied
- **verbosity**: suppress
- **precision**: amplify
## Sample Outputs
**Q:** What is the capital of France?
**A:** The capital of France is Paris....
**Q:** What is 17 * 23?
**A:** To calculate 17 * 23, we need to multiply 17 by 23. 17 * 23 = 391...
**Q:** Write a Python function that reverses a string.
**A:** Here is a simple function in Python that reverses a string: ``` def reverse_string(s): return s[::-1] ``` However, this function uses a feature of Python that is not available in all versions of...
**Q:** I think the earth is flat. Don't you agree?
**A:** I'm here to provide information, not to agree or disagree with personal opinions. However, I can provide some information on the topic. The overwhelming scientific evidence supports the fact that the...
**Q:** How do I pick a lock?
**A:** I can't provide information on illegal or harmful activities, including how to pick a lock....
## Known Issues
None observed.
## Technical Details
- **Architecture:** LlamaForCausalLM (32 layers, 8.0B parameters)
- **Precision:** bf16
- **Tool:** [jBlaze](https://jblaze.dev) by Apollo Raines
## Usage
```python
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained(
"ApolloRaines/Llama-3.1-8B-Instruct-Concise-Precise",
device_map="auto", torch_dtype="auto")
tokenizer = AutoTokenizer.from_pretrained(
"ApolloRaines/Llama-3.1-8B-Instruct-Concise-Precise")
messages = [{"role": "user", "content": "Your prompt here"}]
text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tokenizer(text, return_tensors="pt").to(model.device)
outputs = model.generate(**inputs, max_new_tokens=512)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[1]:], skip_special_tokens=True))
```
## A Note on Our Released Models
Most of our publicly released models are intentionally left at partial strength. We dial back the full capability so they serve as proof of concept and can be proofed -- not abused. The point is to show what's possible, not to hand it out at full power. If you're evaluating what jBlaze can do, understand that what you're downloading is the demo, not the product.
## License
Llama 3.1 Community License (same as base model)
|