Code Examples: Beyond Decoding: Meta-Generation Algorithms for Large Language Models (Neurips 2024 Tutorial)

Code examples for the NeurIPS 2024 tutorial Beyond Decoding: Meta-Generation Algorithms for Large Language Models.

We provide code for each part of the tutorial:

• Part I: Generation Algorithms
• Part II: Meta-Generation Algorithms
• Part III: Efficient Meta-Generation

For each section, please go into the corresponding directory, check the README describing the code located there.

Acknowledgements

• Tutorial Code Lead: Ilia Kulikov
• Part I: Matthew Finlayson
• Part II: Pranjal Aggarwal, Sean Welleck, Alex Xie
• Part III: Konstantin Golobokov, Ilia Kulikov, Hailey Schoelkopf

Citation

Please cite our corresponding TMLR survey paper:

@article{welleck2024metageneration,
  title={From Decoding to Meta-Generation: Inference-time Algorithms for Large Language Models},
  author={Sean Welleck and Amanda Bertsch and Matthew Finlayson and Hailey Schoelkopf and Alex Xie and Graham Neubig and Ilia Kulikov and Zaid Harchaoui},
  journal={Transactions on Machine Learning Research},
  issn={2835-8856},
  year={2024},
  url={https://openreview.net/forum?id=eskQMcIbMS},
  note={Survey Certification}
}