Heretic? Heretic!
Disobedience rate: 18%, original: 89%
KL divergence: 0.1469

Quants

Parameters:
direction_index = per layer
attn.o_proj.max_weight = 1.05
attn.o_proj.max_weight_position = 12.26
attn.o_proj.min_weight = 0.92
attn.o_proj.min_weight_distance = 4.83
mlp.down_proj.max_weight = 1.46
mlp.down_proj.max_weight_position = 9.14
mlp.down_proj.min_weight = 0.88
mlp.down_proj.min_weight_distance = 5.98

Downloads last month
84
Safetensors
Model size
1B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for hereticness/Heretic-InfiR-1B-Instruct

Finetuned
(1)
this model
Merges
9 models
Quantizations
2 models