Skip to content

@stanford-crfm Stanford Center for Research on Foundation Models

Change the repository type filter

All

    Repositories list

    21 repositories

    • helm

      Public
      Holistic Evaluation of Language Models (HELM), a framework to increase the transparency of language models (https://arxiv.org/abs/2211.09110). This framework is also used to evaluate text-to-image models in HEIM (https://arxiv.org/abs/2311.04287) and vision-language models in VHELM (https://arxiv.org/abs/2410.07112).
      Python
      •
      Apache License 2.0
      •272•2k•111•11•Updated Feb 6, 2025Feb 6, 2025

    • levanter

      Public
      Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax
      Python
      •
      Apache License 2.0
      •87•539•63•11•Updated Feb 6, 2025Feb 6, 2025

    • chatnoir-resiliparse

      Public
      A robust web archive analytics toolkit
      Cython
      •
      Apache License 2.0
      •14•1•0•0•Updated Feb 6, 2025Feb 6, 2025

    • lm-evaluation-harness

      Public
      Fork of lm-evaluation-harness
      Python
      •
      MIT License
      •0•0•0•0•Updated Feb 4, 2025Feb 4, 2025

    • haliax

      Public
      Named Tensors for Legible Deep Learning in JAX
      Python
      •
      Apache License 2.0
      •12•161•21•5•Updated Jan 26, 2025Jan 26, 2025

    • ecosystem-graphs

      Public
      JavaScript
      •35•260•0•0•Updated Jan 24, 2025Jan 24, 2025

    • air-bench-2024

      Public
      AIR-Bench 2024 is a safety benchmark that aligns with emerging government regulations and company policies
      Jupyter Notebook
      •
      Apache License 2.0
      •2•13•0•0•Updated Aug 14, 2024Aug 14, 2024

    • image2struct

      Public
      A Benchmark for Evaluating Vision-Language Models in extracting Structured Information from Images
      Python
      •
      Apache License 2.0
      •0•3•0•0•Updated Aug 2, 2024Aug 2, 2024

    • fmti

      Public
      The Foundation Model Transparency Index
      Creative Commons Attribution 4.0 International
      •8•75•0•1•Updated May 23, 2024May 23, 2024

    • data-overlap

      Public
      Python
      •0•7•0•0•Updated Mar 27, 2024Mar 27, 2024

    • helm-efficiency

      Public
      Jupyter Notebook
      •0•9•0•0•Updated Dec 12, 2023Dec 12, 2023

    • halie

      Public
      HTML
      •
      Apache License 2.0
      •2•14•0•0•Updated Dec 11, 2023Dec 11, 2023

    • mistral

      Public
      Mistral: A strong, northwesterly wind: Framework for transparent and accessible large-scale language model training, built with Hugging Face 🤗 Transformers.
      Python
      •
      Apache License 2.0
      •51•568•18•3•Updated Nov 10, 2023Nov 10, 2023

    • mosaicml-benchmarks

      Public
      Fast and flexible reference benchmarks
      Python
      •
      Apache License 2.0
      •125•0•0•1•Updated Oct 27, 2023Oct 27, 2023

    • EUAIActJune15

      Public
      Stanford CRFM's initiative to assess potential compliance with the draft EU AI Act
      MIT License
      •7•93•1•0•Updated Oct 18, 2023Oct 18, 2023

    • BioMedLM

      Public
      Python
      •65•616•21•2•Updated Aug 20, 2023Aug 20, 2023

    • transformers_fsdp_checkpoint_fix

      Public
      🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
      Python
      •
      Apache License 2.0
      •28k•1•0•0•Updated Jul 31, 2023Jul 31, 2023

    • composer

      Public
      Composing methods for ML training efficiency
      Python
      •
      Apache License 2.0
      •430•1•0•0•Updated Sep 23, 2022Sep 23, 2022

    • sprucfluo

      Public
      Data streaming for LMs. WIP
      Python
      •
      Apache License 2.0
      •1•3•0•0•Updated May 10, 2022May 10, 2022

    • transformers

      Public
      🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.
      Python
      •
      Apache License 2.0
      •28k•5•1•0•Updated Sep 28, 2021Sep 28, 2021

    • janus

      Public
      A Streamlit interface that's a doorway into GPT-X.
      Python
      •1•2•0•1•Updated May 23, 2021May 23, 2021