Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Lots of data cleaning following the addition of asserting every row instance sees an answer #123

Merged
merged 50 commits into from
Jan 10, 2024
Merged

Lots of data cleaning following the addition of asserting every row instance sees an answer #123

merged 50 commits into from
Jan 10, 2024

Commits on Jan 5, 2024

  1. assert df_subset shouldnt be empty

    @klxu03
    klxu03 committed Jan 5, 2024
    Configuration menu
    Copy the full SHA
    4dcd454 View commit details
    Browse the repository at this point in the history

  2. fixed Elicitation Generation

    @klxu03
    klxu03 committed Jan 5, 2024
    Configuration menu
    Copy the full SHA
    4a053e3 View commit details
    Browse the repository at this point in the history

  3. data cleaned elicitation generation, now normally failing ind 9

    @klxu03
    klxu03 committed Jan 5, 2024
    Configuration menu
    Copy the full SHA
    a2b4673 View commit details
    Browse the repository at this point in the history

  4. drop Elicitation Generation

    @klxu03
    klxu03 committed Jan 5, 2024
    Configuration menu
    Copy the full SHA
    d49385d View commit details
    Browse the repository at this point in the history

  5. tap tests max instance count 2

    @klxu03
    klxu03 committed Jan 5, 2024
    Configuration menu
    Copy the full SHA
    02a5d63 View commit details
    Browse the repository at this point in the history

  6. fix up clean_csv utils so if file is in to clean is separated, and ad… 

    …ded clean_unempty to undo clean empty in case cols in Answer. got changed
    @klxu03
    klxu03 committed Jan 5, 2024
    Configuration menu
    Copy the full SHA
    046274f View commit details
    Browse the repository at this point in the history

  7. fixed annotation subj_obj with data cleaning

    @klxu03
    klxu03 committed Jan 5, 2024
    Configuration menu
    Copy the full SHA
    5a27f68 View commit details
    Browse the repository at this point in the history

  8. fixed winogrande validation

    @klxu03
    klxu03 committed Jan 5, 2024
    Configuration menu
    Copy the full SHA
    00f186d View commit details
    Browse the repository at this point in the history

  9. unable to fix dialogue safety social chem just yet

    @klxu03
    klxu03 committed Jan 5, 2024
    Configuration menu
    Copy the full SHA
    f56b451 View commit details
    Browse the repository at this point in the history

  10. unable to fix, resetting tap tests to 1000 for another survey

    @klxu03
    klxu03 committed Jan 5, 2024
    Configuration menu
    Copy the full SHA
    63721f2 View commit details
    Browse the repository at this point in the history

Commits on Jan 6, 2024

  1. TAP tasks no longer erroring when retrieving gold label errors due to… 

    … empty
    @klxu03
    klxu03 committed Jan 6, 2024
    Configuration menu
    Copy the full SHA
    3e47f35 View commit details
    Browse the repository at this point in the history

  2. del end of step 5 human perf 17

    @klxu03
    klxu03 committed Jan 6, 2024
    Configuration menu
    Copy the full SHA
    bd887be View commit details
    Browse the repository at this point in the history

  3. del end of human eval gentle vs canary

    @klxu03
    klxu03 committed Jan 6, 2024
    Configuration menu
    Copy the full SHA
    0439b12 View commit details
    Browse the repository at this point in the history

  4. del end of generics eval soft all dataset

    @klxu03
    klxu03 committed Jan 6, 2024
    Configuration menu
    Copy the full SHA
    24ed967 View commit details
    Browse the repository at this point in the history

  5. del end of dialogue rot annotation 2

    @klxu03
    klxu03 committed Jan 6, 2024
    Configuration menu
    Copy the full SHA
    6cf5a9f View commit details
    Browse the repository at this point in the history

  6. del end of rewrite sentences

    @klxu03
    klxu03 committed Jan 6, 2024
    Configuration menu
    Copy the full SHA
    91e13d3 View commit details
    Browse the repository at this point in the history

  7. del end of atomic req objects seq 9

    @klxu03
    klxu03 committed Jan 6, 2024
    Configuration menu
    Copy the full SHA
    0f879c4 View commit details
    Browse the repository at this point in the history

  8. del end of atomic obj rationale 13

    @klxu03
    klxu03 committed Jan 6, 2024
    Configuration menu
    Copy the full SHA
    9839836 View commit details
    Browse the repository at this point in the history

  9. del end of radiology report sentence classification

    @klxu03
    klxu03 committed Jan 6, 2024
    Configuration menu
    Copy the full SHA
    f51255d View commit details
    Browse the repository at this point in the history

  10. del end of o+s_test_logic

    @klxu03
    klxu03 committed Jan 6, 2024
    Configuration menu
    Copy the full SHA
    19c8419 View commit details
    Browse the repository at this point in the history

  11. del end of scalar adj ident

    @klxu03
    klxu03 committed Jan 6, 2024
    Configuration menu
    Copy the full SHA
    f7dfbc4 View commit details
    Browse the repository at this point in the history

  12. del end of visualcomet

    @klxu03
    klxu03 committed Jan 6, 2024
    Configuration menu
    Copy the full SHA
    f0f145d View commit details
    Browse the repository at this point in the history

  13. del end of annotation rating

    @klxu03
    klxu03 committed Jan 6, 2024
    Configuration menu
    Copy the full SHA
    61a5c83 View commit details
    Browse the repository at this point in the history

  14. del end of atomic_event

    @klxu03
    klxu03 committed Jan 6, 2024
    Configuration menu
    Copy the full SHA
    92d7a63 View commit details
    Browse the repository at this point in the history

  15. del end of neurological recipe eval 3

    @klxu03
    klxu03 committed Jan 6, 2024
    Configuration menu
    Copy the full SHA
    5fca185 View commit details
    Browse the repository at this point in the history

  16. del end of atomic neg discr

    @klxu03
    klxu03 committed Jan 6, 2024
    Configuration menu
    Copy the full SHA
    fd172e9 View commit details
    Browse the repository at this point in the history

  17. del end of style adapt pairwise subjobj

    @klxu03
    klxu03 committed Jan 6, 2024
    Configuration menu
    Copy the full SHA
    4bbc53c View commit details
    Browse the repository at this point in the history

  18. del end of question gen 2

    @klxu03
    klxu03 committed Jan 6, 2024
    Configuration menu
    Copy the full SHA
    f944045 View commit details
    Browse the repository at this point in the history

  19. del end of evaluate free-text rationales

    @klxu03
    klxu03 committed Jan 6, 2024
    Configuration menu
    Copy the full SHA
    ee89096 View commit details
    Browse the repository at this point in the history

  20. change empty string into a quote with a space

    @klxu03
    klxu03 committed Jan 6, 2024
    Configuration menu
    Copy the full SHA
    dbb8c63 View commit details
    Browse the repository at this point in the history

Commits on Jan 7, 2024

  1. temp commenting out the values == visible values assertion

    @klxu03
    klxu03 committed Jan 7, 2024
    Configuration menu
    Copy the full SHA
    1590dc4 View commit details
    Browse the repository at this point in the history

  2. cleaning up step5

    @klxu03
    klxu03 committed Jan 7, 2024
    Configuration menu
    Copy the full SHA
    e9e97ef View commit details
    Browse the repository at this point in the history

  3. quick rebasing to main and commenting out ending to see which tasks n… 

    …eed to have their ending cols deleted
    @klxu03
    klxu03 committed Jan 7, 2024
    Configuration menu
    Copy the full SHA
    64a16f0 View commit details
    Browse the repository at this point in the history

  4. bringing back assert df.subset > 0 to see tap test 18 errors

    @klxu03
    klxu03 committed Jan 7, 2024
    Configuration menu
    Copy the full SHA
    81368ac View commit details
    Browse the repository at this point in the history

  5. adding in more kevin-2 changes to try catch retrieve gold labels with… 

    … empty as well as only doing tap18
    @klxu03
    klxu03 committed Jan 7, 2024
    Configuration menu
    Copy the full SHA
    1666282 View commit details
    Browse the repository at this point in the history

Commits on Jan 9, 2024

  1. fixed atomic req objects seq 9

    @klxu03
    klxu03 committed Jan 9, 2024
    Configuration menu
    Copy the full SHA
    a739cf3 View commit details
    Browse the repository at this point in the history

  2. dialogue safety social chem

    @klxu03
    klxu03 committed Jan 9, 2024
    Configuration menu
    Copy the full SHA
    ff2d52f View commit details
    Browse the repository at this point in the history

  3. fixed atomic_event2event

    @klxu03
    klxu03 committed Jan 9, 2024
    Configuration menu
    Copy the full SHA
    15a09c9 View commit details
    Browse the repository at this point in the history

  4. del end of annotation subj_obj

    @klxu03
    klxu03 committed Jan 9, 2024
    Configuration menu
    Copy the full SHA
    9b7ec72 View commit details
    Browse the repository at this point in the history

  5. merging in kevin

    @klxu03
    klxu03 committed Jan 9, 2024
    Configuration menu
    Copy the full SHA
    86ab4fc View commit details
    Browse the repository at this point in the history

  6. refix atomic req obj 9, possibly need reorder cols after

    @klxu03
    klxu03 committed Jan 9, 2024
    Configuration menu
    Copy the full SHA
    3e7b089 View commit details
    Browse the repository at this point in the history

  7. reordered cols, realizing dialogue safety socialchem 5 task needs lot… 

    …s of manual fixing of rows
    @klxu03
    klxu03 committed Jan 9, 2024
    Configuration menu
    Copy the full SHA
    3860935 View commit details
    Browse the repository at this point in the history

  8. fixed annotation subj_obj with decent data cleaning

    @klxu03
    klxu03 committed Jan 9, 2024
    Configuration menu
    Copy the full SHA
    441e719 View commit details
    Browse the repository at this point in the history

  9. fix social chem pilot 3

    @klxu03
    klxu03 committed Jan 9, 2024
    Configuration menu
    Copy the full SHA
    9bf9cb7 View commit details
    Browse the repository at this point in the history

  10. del end of cols for ones with weird endings that broke tap18 before

    @klxu03
    klxu03 committed Jan 9, 2024
    Configuration menu
    Copy the full SHA
    e53c1c2 View commit details
    Browse the repository at this point in the history

  11. actually run tap tests

    @klxu03
    klxu03 committed Jan 9, 2024
    Configuration menu
    Copy the full SHA
    c2b5bea View commit details
    Browse the repository at this point in the history

  12. add in error_flag

    @klxu03
    klxu03 committed Jan 9, 2024
    Configuration menu
    Copy the full SHA
    aa7eec9 View commit details
    Browse the repository at this point in the history

  13. fixed atomic req obj seq 9 deleting unused y ans cols

    @klxu03
    klxu03 committed Jan 9, 2024
    Configuration menu
    Copy the full SHA
    71f2638 View commit details
    Browse the repository at this point in the history

  14. fixed annotation subj_obj by adding in no subj answers to instances w… 

    …here No is marked/chosen checkbox
    @klxu03
    klxu03 committed Jan 9, 2024
    Configuration menu
    Copy the full SHA
    ae23430 View commit details
    Browse the repository at this point in the history

  15. deleting the dialogue safety socialchemistry 5 task, data not very cl… 

    …eanable
    @klxu03
    klxu03 committed Jan 9, 2024
    Configuration menu
    Copy the full SHA
    2c84a56 View commit details
    Browse the repository at this point in the history