Skip to content

Issues: Yale-LILY/SummEval

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

22 Open 21 Closed
22 Open 21 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Where do the references come from?
#55 opened Nov 5, 2024 by slvcsl
How to match reference summary that was used by the expert to grade a given machine summary.
#53 opened Jun 8, 2024 by erastogi
3
summa_qa is not working
#49 opened Nov 1, 2023 by nilanjansircar80
ROUGE-WE relies on a download link that no longer works
#48 opened Oct 24, 2023 by alichte
1
2
Can not reproduce the rouge score.
#44 opened Jul 20, 2023 by SefaZeng
which 16 models to generate the human annotation results
#43 opened Jul 12, 2023 by dzf0023
Cost spent on human annotation
#42 opened Jun 15, 2023 by LiyingCheng95
Unittests fail
#40 opened Oct 9, 2022 by oriern
2
Unable to import the package
#39 opened Oct 2, 2022 by 29riyasaxena
2
Error running Meteor metric
#38 opened Jun 29, 2022 by JeetRoy97
SupertMetric: sentence_transformers module not found
#36 opened Apr 5, 2022 by ankitk2109
2
Can't install the package
#35 opened Mar 21, 2022 by stefcon
Says Illegal instruction for running command line argument
#33 opened Mar 3, 2022 by shankyemcee
Errors after installing via pip and fixes
#32 opened Feb 8, 2022 by ankitk2109
ValueError: Found array with 0 sample(s) (shape=(0, 1024)) while a minimum of 1 is required by check_pairwise_arrays.
#31 opened Jan 24, 2022 by paluchasz
Error during installation
#28 opened Dec 3, 2021 by darioTecchia
3
PR to add new metric results
#27 opened Nov 30, 2021 by PierreColombo
1
mover metric
#25 opened Aug 24, 2021 by martin6336
Unable to install
#20 opened Jun 14, 2021 by amanyakhyar
2
Unable to install dependency (wmd)
#14 opened Mar 9, 2021 by anjalibshah
3
Punctuation not consistent for M19 (Text Summarization with Pretrained Encoders)
#7 opened Sep 29, 2020 by artidoro
3
Is the BertScore metric used with idf weighted averaging or not
#3 opened Aug 21, 2020 by La-SilverLand
4
ProTip! Find all open issues with in progress development work with linked:pr.