v2.4

What's Changed

• Crowdworker evaluation of the tasks [Work in Progress] by @danyaljj in #276
• Revising categories: Tasks1-500 by @yeganehkordi in #695
• Remove a misleading phrase from instructions in tasks 702, 711 and 712 by @Palipoor in #697
• Add examples to task 697 and modify some instances to fix #661 by @Palipoor in #698
• Drop 1562 and 1563 because of vagueness reported in #685 by @Palipoor in #699
• Fix the imbalance issue in instances by @Palipoor in #702
• Task050 label imbalance bug fix by @swarooprm in #704
• Rename the duplicate task 119 by @Palipoor in #708
• Add English instances to task 265 by @Palipoor in #707
• Revising remaining tasks by @yeganehkordi in #705
• Update test_all by @yeganehkordi in #710
• Remove duplicate and incorrect domains for alt tasks and drop two tasks by @Palipoor in #709
• remove URLs from the tasks by @yeganehkordi in #711
• Adding reasoning field - tasks1-50 by @yeganehkordi in #712
• Adding reasoning field- tasks51-200 by @yeganehkordi in #713
• Adding reasoning-tasks201-400 by @yeganehkordi in #714
• Adding reasoning- tasks401-700 by @yeganehkordi in #715
• Adding reasoning- tasks701-1014 by @yeganehkordi in #716
• Adding reasoning- tasks1015-1316 by @yeganehkordi in #717
• Adding reasoning- tasks1317-end by @yeganehkordi in #718
• Update test and hierarchy by @yeganehkordi in #720
• Fix unicode characters by @Palipoor in #723
• Drop qualitative reasoning by @yeganehkordi in #724
• Tasks1385-1390: ANLI, CB, HellaSwag, WSC by @yeganehkordi in #719
• Script for updating categories, domains, and reasoning by @yeganehkordi in #722
• Change definitions into lists of strings by @Palipoor in #725
• Move Mathematics and Ethical Judgement to reasoning by @yeganehkordi in #727
• Drop factual reasoning by @yeganehkordi in #728
• Fix map files by @yeganehkordi in #729
• Winogrande tasks by @yeganehkordi in #730
• Drop social commonsense reasoning and science branches by @yeganehkordi in #731
• Merge tasks 288 and 1578 by @Palipoor in #732
• Merge all kpa tasks by @Palipoor in #733
• Update source and domain of aquamuse tasks by @yeganehkordi in #735
• Add script to covert "prompt-source" tasks by @yeganehkordi in #734
• Update convert_prompt.py by @yeganehkordi in #736
• Add update_categories script by @yeganehkordi in #741
• Create prompt_task_map.json by @yeganehkordi in #737

Full Changelog: v2.3...v2.4