Code

rui/ds1000#44

Code

Open

rays1024 wants to merge 34 commits intomainYale-LILY/NLP4Code:mainfrom rui/ds-1000Yale-LILY/NLP4Code:rui/ds-1000Copy head branch name to clipboard

+937-34

Commits

Commits on Apr 14, 2023

• added length_calculator

  

  rshen03

  committed
  c2a2116

  Copy full SHA for c2a2116

Commits on Apr 25, 2023

• re-upload the implementation for llama, alpaca, santacoder

  yilunzhao

  committed
  529edce

  Copy full SHA for 529edce

• Merge branch 'main' into yilunzhao/llm_implementation

  yilunzhao

  committed
  7caf0ea

  Copy full SHA for 7caf0ea

Commits on Apr 26, 2023

• try to pass CI check

  yilunzhao

  committed
  9dbc8cd

  Copy full SHA for 9dbc8cd

Commits on Apr 27, 2023

• Merge branch 'main' into yilunzhao/llm_implementation

  niansong1996

  committed
  06c7858

  Copy full SHA for 06c7858

• modify process_output function in exectutor.py to handle the case that llama-based model uses empty string as tokenizer_eos_token

  yilunzhao

  committed
  ce36f13

  Copy full SHA for ce36f13

Commits on May 5, 2023

• fix error related to llama eos_token

  yilunzhao

  committed
  60fd89b

  Copy full SHA for 60fd89b

Commits on May 6, 2023

• add starcoder, gpt-neox-20b; test gpt-j-6b

  yilunzhao

  committed
  83546d9

  Copy full SHA for 83546d9

Commits on May 19, 2023

• archieve code for NeurIPS exps; add gpt-4, pythia, replit, dolly, starchat, etc

  yilunzhao

  committed
  86d3bd5

  Copy full SHA for 86d3bd5

Commits on Jun 28, 2023

• added dataset and executor for DS1000

  

  Rui Shen

  committed
  d10a59a

  Copy full SHA for d10a59a

• Merge branch 'main' into rui/ds-1000

  Show description for a9df68b
  

  Rui Shen

  committed
  a9df68b

  Copy full SHA for a9df68b

• removed all .DS_Store

  

  Rui Shen

  committed
  40c02b5

  Copy full SHA for 40c02b5

Commits on Jun 29, 2023

• added ds1000 prompt file

  

  Rui Shen

  committed
  af3ffa2

  Copy full SHA for af3ffa2

• fixed missing file and added ds1000 prompt file

  

  Rui Shen

  committed
  2bfee22

  Copy full SHA for 2bfee22

• zipped ds1000_data and removed irrelevant files

  

  Rui Shen

  committed
  9e8b571

  Copy full SHA for 9e8b571

Commits on Jul 5, 2023

• class variable ds_data now initialize in init

  rays1024

  committed
  fb089c0

  Copy full SHA for fb089c0

• Merge remote-tracking branch 'origin/yilunzhao/llm_implementation' into rui/ds-1000

  Show description for cfb10c7
  rays1024

  committed
  cfb10c7

  Copy full SHA for cfb10c7

• fixed ds1000 gpt-neo-125M evaluation bugs

  rays1024

  committed
  adb4c79

  Copy full SHA for adb4c79

• some code clean up

  rays1024

  committed
  39a4fd4

  Copy full SHA for 39a4fd4

• included reference code in prompt

  rays1024

  committed
  0ecdb5f

  Copy full SHA for 0ecdb5f

Commits on Jul 14, 2023

• updated ds1000.yaml

  rays1024

  authored
  5666a22

  Copy full SHA for 5666a22

Commits on Jul 16, 2023

• fixed evaluation error at 158/159th problem

  rays1024

  committed
  27e0e70

  Copy full SHA for 27e0e70

• fixed evaluation bug

  rays1024

  committed
  4ba669d

  Copy full SHA for 4ba669d

Commits on Jul 21, 2023

• fixed torch tensor bug

  rays1024

  committed
  dc4fc0c

  Copy full SHA for dc4fc0c

Commits on Jul 25, 2023

• undo changes caused by wrong jsonargparse version

  rays1024

  committed
  62250c5

  Copy full SHA for 62250c5

Commits on Jul 27, 2023

• fixed ds1000 saving issue

  rays1024

  committed
  f7e930b

  Copy full SHA for f7e930b

• Revert "fixed ds1000 saving issue"

  Show description for 1ed0607
  rays1024

  committed
  1ed0607

  Copy full SHA for 1ed0607

• fixed result saving issue

  rays1024

  committed
  90cba4f

  Copy full SHA for 90cba4f

Commits on Jul 31, 2023

• evaluating raw output without cutting off at keywords

  rays1024

  committed
  4229001

  Copy full SHA for 4229001

• No custom instruction and using only DS1000 prompt

  rays1024

  committed
  b787508

  Copy full SHA for b787508

Commits on Aug 1, 2023

• reverted raw output and uses keyword cutoff in execution

  rays1024

  committed
  73b9676

  Copy full SHA for 73b9676

• no cutoff at execution to check raw output

  rays1024

  committed
  d41eb3b

  Copy full SHA for d41eb3b

Commits on Aug 2, 2023

• updated gitignore

  rays1024

  committed
  5fad2f3

  Copy full SHA for 5fad2f3

• execution now preprocess model output

  rays1024

  committed
  b3aa6ba

  Copy full SHA for b3aa6ba