Introduction

This model is the result of an experimental use of LoRAs on language models and model merges that are not the base HuggingFace-format LLaMA model they were intended for. The desired outcome is to additively apply desired features without paradoxically watering down a model's effective behavior. Potential limitations - LoRAs applied on top of each other may intercompete. Subjective results - very promising. Further experimental tests and objective tests are required. Instruct and Setup Suggestions: Alpaca instruct is primary, Vicuna instruct format may work. If using KoboldAI or Text-Generation-WebUI, recommend switching between Godlike and Storywriter presets and adjusting output length + instructions in memory. Other presets as well as custom settings can yield highly different results, especially Temperature. If poking it with a stick doesn't work try poking harder.

Training

Parameters