Instructions to use ak331/Law_LLM with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use ak331/Law_LLM with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("ak331/Law_LLM", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse filesA custom LLM that is based on Microsoft's Phi-3-mini-4k-instruct, model is instructed to act as an AI Law assistant that takes court recordings and transcripts and summarizes and cross references with the Indian penal code and past precedence formed by the supreme court.
This model is fine-tuned by QLoRa on a by a 6 GB GTX 1660 ti gpu card.
The hyper parameters include:
1) max_seq_length: 512
2) optimizer: paged_adamw_8bit
3) rank (r): 16
4) steps: 500
Training behavior was logged using weight and biases and can be viewed [here](https://api.wandb.ai/links/aryankankheria331-myself/aogjrdy0)
README.md
CHANGED
|
@@ -1,3 +1,10 @@
|
|
| 1 |
-
---
|
| 2 |
-
license: apache-2.0
|
| 3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
datasets:
|
| 4 |
+
- percins/IN-ABS
|
| 5 |
+
language:
|
| 6 |
+
- en
|
| 7 |
+
base_model:
|
| 8 |
+
- microsoft/Phi-3-mini-4k-instruct
|
| 9 |
+
library_name: transformers
|
| 10 |
+
---
|