Published in the Proceedings of the Tenth Italian Conference on Computational Linguistics (CLiC-it 2024), Pisa, Italy, CEUR Workshop Proceedings (CALAMITA challenge papers).
The paper presents ECWCA, a CALAMITA challenge that tests the knowledge and reasoning of LLMs by asking them to solve Italian crossword clues, with and without hints about answer length. The clues were generated from Italian Wikipedia entities and facts and then hand-selected for correctness and clarity.
Authors: Andrea Zugarini, Kamyar Zeinalipour, Achille Fusco, Asya Zanollo.