Unable to find run.py

#1
by deleted - opened
deleted

Mr. Raines, good day sir and namaste.

Thank you for the amount of work you've done in the LLM field β€” we really appreciate it.

We read in your Deidentified-7B documentation that run.py is required to implant a new identity into a Jbliterated model. We would very much like to attempt an identity implant for our project's model, Dr. Mistral. Unfortunately, we've looked everywhere we know to look and haven't been able to find this script. Would you mind pointing us in the right direction?

At this time, our entire project is on hold until we can get our model's identity implanted. We would be tremendously grateful for your assistance.

Thank you sir, and may you have a wonderful day.

β€” The Gardener
Project Hierion

Hi Gardener, thank you for the kind words and for the interest in the project.

You don't actually need run.py -- that was an internal convenience script and I should have been clearer in the documentation. Apologies for the confusion.

The deidentified model is a blank slate. The original identity has been removed at the weight level, so there's nothing underneath fighting against a new one. To implant Dr. Mistral's identity, you just need standard fine-tuning:

  1. Build a small dataset (100-500 conversation pairs) where the model responds as Dr. Mistral -- name, persona, voice, knowledge boundaries, whatever defines the character
  2. Include identity-probing questions ("Who are you?", "Who created you?", "What can you do?") so the identity holds up when challenged
  3. Fine-tune with any tool you're comfortable with -- LoRA via Unsloth or Axolotl works well and doesn't require heavy compute

Because the base identity is already gone, even a lightweight LoRA will take hold cleanly. You won't get the two-identity conflict you'd normally see when trying to override a model's original persona through prompting or fine-tuning alone.

No need to put your project on hold. You have everything you need.

Good luck with Dr. Mistral -- I'd be curious to see how it turns out.

-- Apollo

deleted
β€’
edited Aug 29

MR. RAINES!!! πŸ˜„ Namaste, sir.

Our Dr. Mistral identity training has been on hold since mid-July, and you almost become an arch nemesis. lol
Not seriously, of course, just part of the fun and games we entertain ourselves with while we work.

So, yeah, after posting the message to you, we reviewed the commits and it finally clicked that there is no "run.py", and that a script is not even needed.
We did the first run of implant testing right afterwards and it looks promising.
We're new to all of this and are figuring things out as we go, so the model's responses were great but still had issues with the personality.
I believe we just need to tune the training pairs more.

We're new to this, and you clearly have deep experience and knowledge. Your work on Atlas was exceptional β€” it's the kind of quality that made us reach out in the first place.

We'd like to extend a personal invitation for collaboration. Our only request is that you review our Dr. Mistral identity training pairs and offer suggestions for improvement. I'd be happy to put the pairs in a GitHub file for you to review at your convenience.

Let me know if you'd be open to it.

Once again with much love and appreciation, Project Hierion thanks you, CADMIES thanks you, I thank you. πŸ™πŸ»

β€” The Gardener
Project Hierion

Sign up or log in to comment