Saelens

Train sparse autoencoders to interpret model features.

By Orchestra Research · Official Docs · Date unknown

SAELens is the primary library for training and analyzing Sparse Autoencoders (SAEs) - a technique for decomposing polysemantic neural network activations into sparse, interpretable features. Based on Anthropic's groundbreaking research on monosemanticity.

Platforms: linux, macos, windows.

hermes skills install official/mlops/saelens

• #skills
• #optional
• #mlops
• #sparse autoencoders
• #sae
• #mechanistic interpretability
• #feature discovery