Issues

Issues

• Why is deepspeed enabled in the Bloom training script?

  bigscience-workshop/bigscience#71 · opened on Nov 1, 2023

• Where can I download the training script for bloom-7b1?

  bigscience-workshop/bigscience#69 · opened on May 30, 2023

• Files for bias evaluation

  bigscience-workshop/bigscience#68 · opened on Mar 13, 2023

• where can we get a bloomz-7b1 finetuned checkpoint

  bigscience-workshop/bigscience#67 · opened on Feb 21, 2023

• How to get train-splits.txt and valid-splits.txt before training tr11-176B-ml

  bigscience-workshop/bigscience#66 · opened on Dec 26, 2022
  1

• eval opt-175B

  bigscience-workshop/bigscience#63 · opened on Oct 26, 2022
  1

• Requirements to perform inference over the BigScience Bloom model

  bigscience-workshop/bigscience#62 · opened on Oct 10, 2022

• mC4 sampling & pre-processing

  bigscience-workshop/bigscience#61 · opened on Aug 17, 2022
  1

• Running Bloom

  bigscience-workshop/bigscience#52 · opened on Jul 7, 2022
  5

• Zero_Stage=1 results in higher TFLOPS?

  bigscience-workshop/bigscience#48 · opened on Jun 28, 2022
  1

• Sharing the 1.3B-Pile@300B model

  bigscience-workshop/bigscience#46 · opened on Jun 21, 2022

• can you share the slurm.conf you are using?

  bigscience-workshop/bigscience#37 · opened on Mar 27, 2022
  3

• Is the 13B - unmodified Megatron gpt2 - baseline available? ( tr1-13B-base)

  bigscience-workshop/bigscience#21 · opened on Dec 4, 2021
  1