Favicon of simpo

simpo Skill

AI Agent SkillPythonOpen source

Reference-free preference alignment, simpler than DPO. Published by NousResearch in hermes-agent.

Decision snapshot

Is this a fit?

Best for

Data analysis, Includes SKILL.md, Reusable instructions

Works with

Compatibility not yet detected.

Access

Permission behavior not yet detected.

Setup

Copy skill directory

Project health

30 days ago · MIT license

Considerations

No specific cautions were detected. Review the source and requested permissions before installing.

What is simpo Skill?

Reference-free preference alignment, simpler than DPO. Published by NousResearch in hermes-agent. This profile combines repository metadata with install, compatibility, and usage signals so developers can quickly decide whether it fits their agent workflow before opening the source repository.

Trust signal
95/100
Maintenance signal
90/100
Adoption signal
100/100

Automated repository signals based on public metadata such as recency, license, installation evidence, and adoption. These are not a security audit or endorsement. See how SkillIndex evaluates profiles.

Key capabilities

  • Includes SKILL.md support
  • Reusable instructions support
  • Data analysis
  • Data analysis use cases

Declared skill metadata

  • Declared author: Orchestra Research
  • Declared license: MIT
  • Source file: optional-skills/mlops/simpo/SKILL.md

These fields retain source and confidence evidence from the indexed SKILL.md.

Compatibility and setup

Copy skill directory
  • Install or run with Copy skill directory

When to use simpo Skill

  • Use it for data analysis.

Built with

PythonCopy skill directory

Editorial notes

Source

  • Creator: NousResearch
  • Repository: NousResearch/hermes-agent
  • Skill file: optional-skills/mlops/simpo/SKILL.md

What it does

Reference-free preference alignment, simpler than DPO.

Skill instructions

SimPO - Simple Preference Optimization Quick start SimPO is a reference-free preference optimization method that outperforms DPO without needing a reference model. Installation: bash Create environment conda create -n simpo python=3.10 && conda activate simpo Install PyTorch 2.2.2 Visit: https://pytorch.org/get-started/locally/ Install alignment-handbook git clone https://github.com/huggingface/alignment-handbook.git cd alignment-handbook python -m pip install . Install Flash Attention 2 python -m pip install flash-attn --no-build-isolation Training (Mistral 7B): bash ACCELERATELOGLEVEL=info accelerate launch \ --configfile accelerateconfigs/deepspeedzero3.yaml \ scripts/runsimpo.py \ trainingconfigs/mistral-7b-base-simpo.yaml Common workflows Workflow 1: Train from base model (Mistral 7B) Config (mistral-7b-base-simpo.yaml): yaml Model modelnameorpath: mistralai/Mistral-7B-v0.1 torchdtype: bfloat16 Dataset datasetmixer: HuggingFaceH4/ultrafeedbackbinarized: 1.0 datasetsplits: - trainp

Verified compatibility and discovery

Frequently asked questions

What is simpo?

simpo is a open-source AI agent skill with Copy skill directory. Reference-free preference alignment, simpler than DPO.

Who is simpo best for?

simpo is best for reusing agent instructions, scripts, and references, data analysis workflows.

How do I install simpo?

Install or run simpo using Copy skill directory. Check simpo for the latest setup command.

Is simpo actively maintained?

simpo may need a closer maintenance check before production use.

Share:

Stars
228,028
Forks
44,793
Last commit
30 days ago
Last verified
Aug 12, 2026
Metadata fetched
Aug 12, 2026
Repository age
1 year
License
MIT

Project health auto-fetched from the source repository.

Maintain this resource?

Review this source-backed profile, send a correction with evidence, or link to it from your documentation. Claims verify your relationship to the project; profile facts still require source evidence and editorial review.

Alternatives to simpo