Transformers
English
ak331 commited on
Commit
de2e475
·
verified ·
1 Parent(s): 61d2c03

Update README.md

Browse files

A custom LLM that is based on Microsoft's Phi-3-mini-4k-instruct, model is instructed to act as an AI Law assistant that takes court recordings and transcripts and summarizes and cross references with the Indian penal code and past precedence formed by the supreme court.

This model is fine-tuned by QLoRa on a by a 6 GB GTX 1660 ti gpu card.
The hyper parameters include:
1) max_seq_length: 512
2) optimizer: paged_adamw_8bit
3) rank (r): 16
4) steps: 500
Training behavior was logged using weight and biases and can be viewed [here](https://api.wandb.ai/links/aryankankheria331-myself/aogjrdy0)

Files changed (1) hide show
  1. README.md +10 -3
README.md CHANGED
@@ -1,3 +1,10 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ datasets:
4
+ - percins/IN-ABS
5
+ language:
6
+ - en
7
+ base_model:
8
+ - microsoft/Phi-3-mini-4k-instruct
9
+ library_name: transformers
10
+ ---