AI Research Engineering Skills Library

The most comprehensive open-source library of AI research engineering skills for AI agents

82 Skills Powering AI Research in 2026

Model Architecture (5) Fine-Tuning (4) Post-Training (8)

Distributed Training (6) Optimization (6) Inference (4)

Tokenization (2) Data Processing (2) Evaluation (3)

Safety & Alignment (3) Agents (4) RAG (5)

Multimodal (7) Prompt Engineering (4) MLOps (3)

Observability (2) Infrastructure (3) Mech Interp (4)

Emerging Techniques (6) ML Paper Writing (1)

Table of Contents

• Our Mission

• Path Towards AI Research Agent

• Available AI Research Engineering Skills

• Demos

• Skill Structure

• Roadmap

• Repository Structure

• Use Cases

• Contributing

• Community

Our Mission

We provide the layer of Engineering Ability that enable your coding agent to write and conduct AI research experiments, including preparing datasets, executing training pipelines, deploying models, and building your AI agents.

Path Towards AI Research Agent

Modern AI research requires mastering dozens of specialized tools and frameworks. AI Researchers spend more time debugging infrastructure than testing hypotheses—slowing the pace of scientific discovery. We provide a comprehensive library of expert-level research engineering skills that enable AI agents to autonomously implement and execute different stages of AI research experiments—from data preparation and model training to evaluation and deployment.

• Specialized Expertise - Each skill provides deep, production-ready knowledge of a specific framework (Megatron-LM, vLLM, TRL, etc.)

• End-to-End Coverage - 82 skills spanning model architecture, tokenization, fine-tuning, mechanistic interpretability, data processing, post-training, distributed training, optimization, evaluation, inference, infrastructure, agents, RAG, multimodal, prompt engineering, MLOps, observability, emerging techniques, and ML paper writing

• Research-Grade Quality - Documentation sourced from official repos, real GitHub issues, and battle-tested production workflows

Available AI Research Engineering Skills

Quality over quantity: Each skill provides comprehensive, expert-level guidance with real code examples, troubleshooting guides, and production-ready workflows.

📦 Quick Install (Recommended)

Install skills to any coding agent (Claude Code, OpenCode, Cursor, Codex, Gemini CLI, Qwen Code) with one command:

npx @orchestra-research/ai-research-skills

This launches an interactive installer that:

• Auto-detects your installed coding agents

• Installs skills to ~/.orchestra/skills/ with symlinks to each agent

• Offers everything, quickstart bundle, by category, or individual skills

• Updates installed skills with latest versions

• Uninstalls all or selected skills

# Interactive installer (recommended)
npx @orchestra-research/ai-research-skills

# Direct commands
npx @orchestra-research/ai-research-skills list      # View installed skills
npx @orchestra-research/ai-research-skills update    # Update installed skills

Install skill categories directly using the Claude Code CLI:

# Add the marketplace
/plugin marketplace add orchestra-research/AI-research-SKILLs

# Install by category (20 categories available)
/plugin install fine-tuning@ai-research-skills        # Axolotl, LLaMA-Factory, PEFT, Unsloth
/plugin install post-training@ai-research-skills      # TRL, GRPO, OpenRLHF, SimPO, verl, slime, miles, torchforge
/plugin install inference-serving@ai-research-skills  # vLLM, TensorRT-LLM, llama.cpp, SGLang
/plugin install distributed-training@ai-research-skills
/plugin install optimization@ai-research-skills

All 20 Categories (82 Skills)

Category Skills Included

Model Architecture 5 LitGPT, Mamba, NanoGPT, RWKV, TorchTitan

Tokenization 2 HuggingFace Tokenizers, SentencePiece

Fine-Tuning 4 Axolotl, LLaMA-Factory, PEFT, Unsloth

Mech Interp 4 TransformerLens, SAELens, pyvene, nnsight

Data Processing 2 NeMo Curator, Ray Data

Post-Training 8 TRL, GRPO, OpenRLHF, SimPO, verl, slime, miles, torchforge

Safety 3 Constitutional AI, LlamaGuard, NeMo Guardrails

Distributed 6 DeepSpeed, FSDP, Accelerate, Megatron-Core, Lightning, Ray Train

Infrastructure 3 Modal, Lambda Labs, SkyPilot

Optimization 6 Flash Attention, bitsandbytes, GPTQ, AWQ, HQQ, GGUF

Evaluation 3 lm-eval-harness, BigCode, NeMo Evaluator

Inference 4 vLLM, TensorRT-LLM, llama.cpp, SGLang

MLOps 3 W&B, MLflow, TensorBoard

Agents 4 LangChain, LlamaIndex, CrewAI, AutoGPT

RAG 5 Chroma, FAISS, Pinecone, Qdrant, Sentence Transformers

Prompt Eng 4 DSPy, Instructor, Guidance, Outlines

Observability 2 LangSmith, Phoenix

Multimodal 7 CLIP, Whisper, LLaVA, BLIP-2, SAM, Stable Diffusion, AudioCraft

Emerging 6 MoE, Model Merging, Long Context, Speculative Decoding, Distillation, Pruning

ML Paper Writing 1 ML Paper Writing (LaTeX templates, citation verification)

🏗️ Model Architecture (5 skills)

• LitGPT - Lightning AI's 20+ clean LLM implementations with production training recipes (462 lines + 4 refs)

• Mamba - State-space models with O(n) complexity, 5× faster than Transformers (253 lines + 3 refs)

• RWKV - RNN+Transformer hybrid, infinite context, Linux Foundation project (253 lines + 3 refs)

• NanoGPT - Educational GPT in ~300 lines by Karpathy (283 lines + 3 refs)

• TorchTitan - PyTorch-native distributed training for Llama 3.1 with 4D parallelism

🔤 Tokenization (2 skills)

• HuggingFace Tokenizers - Rust-based, <20s/GB, BPE/WordPiece/Unigram algorithms (486 lines + 4 refs)

• SentencePiece - Language-independent, 50k sentences/sec, used by T5/ALBERT (228 lines + 2 refs)

🎯 Fine-Tuning (4 skills)

• Axolotl - YAML-based fine-tuning with 100+ models (156 lines + 4 refs)

• LLaMA-Factory - WebUI no-code fine-tuning (78 lines + 5 refs)

• Unsloth - 2x faster QLoRA fine-tuning (75 lines + 4 refs)

• PEFT - Parameter-efficient fine-tuning with LoRA, QLoRA, DoRA, 25+ methods (431 lines + 2 refs)

🔬 Mechanistic Interpretability (4 skills)

• TransformerLens - Neel Nanda's library for mech interp with HookPoints, activation caching (346 lines + 3 refs)

• SAELens - Sparse Autoencoder training and analysis for feature discovery (386 lines + 3 refs)

• pyvene - Stanford's causal intervention library with declarative configs (473 lines + 3 refs)

• nnsight - Remote interpretability via NDIF, run experiments on 70B+ models (436 lines + 3 refs)

📊 Data Processing (2 skills)

• Ray Data - Distributed ML data processing, streaming execution, GPU support (318 lines + 2 refs)

• NeMo Curator - GPU-accelerated data curation, 16× faster deduplication (375 lines + 2 refs)

🎓 Post-Training (8 skills)

• TRL Fine-Tuning - Transformer Reinforcement Learning (447 lines + 4 refs)

• GRPO-RL-Training (TRL) - Group Relative Policy Optimization with TRL (569 lines, gold standard)

• OpenRLHF - Full RLHF pipeline with Ray + vLLM (241 lines + 4 refs)

• SimPO - Simple Preference Opti