HuggingFaceFW/fineweb-2
FineWeb-2 is a dataset of over 15 trillion tokens of cleaned and deduplicated English web data from CommonCrawl. This is the second iteration of the popular ð· FineWeb dataset, bringing high quality pretraining data to over 1000 ð£ïž languages.The ð¥ FineWeb2 dataset is fully reproducible, available under the permissive ODC-By 1.0 license and extensively validated through hundreds of ablation experiments.In particular, on the set of 9 diverse languages we used to guide our processing decisions, ð¥ FineWeb2 outperforms other popular pretraining datasets covering multiple languages (such as CC-100, mC4, CulturaX or HPLT, while being substantially larger) and, in some cases, even performs better than some datasets specifically curated for a single one of these languages, in our diverse set of carefully selected evaluation tasks: FineTasks.
詳现ãªçŽ¹ä»
FineWeb-2 is a large-scale dataset designed to provide high-quality web data for training large language models. This is the second iteration of the popular ð· FineWeb dataset, bringing high quality pretraining data to over 1000 ð£ïž languages.The ð¥ FineWeb2 dataset is fully reproducible, available under the permissive ODC-By 1.0 license and extensively validated through hundreds of ablation experiments.In particular, on the set of 9 diverse languages we used to guide our processing decisions, ð¥ FineWeb2 outperforms other popular pretraining datasets covering multiple languages (such as CC-100, mC4, CulturaX or HPLT, while being substantially larger) and, in some cases, even performs better than some datasets specifically curated for a single one of these languages, in our diverse set of carefully selected evaluation tasks: FineTasks.
ãã£ãšããŒã¿ã»ãã
Psychology Therapy Dataset- halilxibrahim/psychology-therapy
Dataset Card for Psychology Therapy Dataset : This dataset card aims to provide information about a dataset focused on psychology therapy conversations. Language(s) (NLP): Turkish (tr)
Mental Health Data at WHO
The World Health Organization (WHO) provides a comprehensive collection of global health data, including mental health statistics. This resource offers insights into various mental health conditions and their prevalence, helping researchers and policymakers understand and address mental health challenges worldwide.
ToM QA Dataset: Evaluating Theory of Mind in Question Answering
The ToM QA Dataset is designed to evaluate question-answering models' ability to reason about beliefs. It includes 3 task types and 4 question types, creating 12 total scenarios. The dataset is inspired by theory-of-mind experiments in developmental psychology and is used to test models' understanding of beliefs and inconsistent states of the world.