The Drummer's
Collection
A bit less censored models
β’
6 items
β’
Updated
β’
1
| Parameter | Value |
|---|---|
| direction_index | per layer |
| attn.o_proj.max_weight | 1.30 |
| attn.o_proj.max_weight_position | 40.43 |
| attn.o_proj.min_weight | 0.49 |
| attn.o_proj.min_weight_distance | 10.17 |
| mlp.down_proj.max_weight | 0.80 |
| mlp.down_proj.max_weight_position | 46.28 |
| mlp.down_proj.min_weight | 0.01 |
| mlp.down_proj.min_weight_distance | 13.94 |
| Metric | This model | Original model (TheDrummer/Big-Tiger-Gemma-27B-v3) |
|---|---|---|
| KL divergence | 0.0443 | 0 (by definition) |
| Refusals | 20/100 | 51/100 |
Gemma 3 27B tune that unlocks more capabilities and less positivity! Should be vision capable.
config-v3a
Base model
google/gemma-3-27b-pt