metadata.yml

---
title: (WIP) A Little Bit of Reinforcement Learning from Human Feedback
subtitle: A short introduction to RLHF and post-training focused on language models.
biblio-title: Bibliography
reference-section-title: Bibliography
author: Nathan Lambert
rights: CC-BY-NC-SA-4.0
lang: en-US
mainlang: english
otherlang: english
tags: [rlhf, ebook, ai, ml]
date: 19 January 2025
abstract: |
  Reinforcement learning from human feedback (RLHF) has become an important technical and storytelling tool to deploy the latest machine learning systems.
  In this book, we hope to give a gentle introduction to the core methods for people with some level of quantitative background.
  The book starts with the origins of RLHF -- both in recent literature and in a convergence of disparate fields of science in economics, philosophy, and optimal control.
  We then set the stage with definitions, problem formulation, data collection, and other common math used in the literature.
  We detail the detail the popular algorithms and future frontiers of RLHF.
# mainfont: DejaVu Sans # not available on Mac
Filter preferences:
- pandoc-crossref
linkReferences: true
link-citations: true
numbersections: true
# for better code processing
listings: true
# add pages in pdf between chapters
header-includes:
  - |
    ```{=latex}
    % Add new page before chapters start
    \pretocmd{\section}{\newpage}{}{}  
    ```
##################
---