HuggingFaceFW/fineweb
FineWeb is a dataset of over 15 trillion tokens of cleaned and deduplicated English web data from CommonCrawl. It is optimized for LLM performance and processed using the datatrove library. The dataset aims to provide high-quality data for training large language models and outperforms other commonly used web datasets.We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Αναλυτική Εισαγωγή
FineWeb is a large-scale dataset designed to provide high-quality web data for training large language models. It includes over 15 trillion tokens of cleaned and deduplicated English web data from CommonCrawl. The dataset is processed using the datatrove library and is optimized for LLM performance. It outperforms other commonly used web datasets in benchmark tasks.
ΠερισσότεραΣύνολο δεδομένων
Mental Health Data at WHO
The World Health Organization (WHO) provides a comprehensive collection of global health data, including mental health statistics. This resource offers insights into various mental health conditions and their prevalence, helping researchers and policymakers understand and address mental health challenges worldwide.
Psy-Insight: Mental Health Counseling Dataset
Psy-Insight is a bilingual, interpretable multi-turn dataset for mental health counseling dialogues. It includes 6,208 rounds of multi-turn counseling dialogues in English and 5,776 rounds in Chinese, annotated with step-by-step reasoning labels and multi-task labels. This dataset is designed to support the application of large language models in mental health and is suitable for tasks such as emotion classification and psychological treatment interpretation.
Psychology Wiki Dataset
Psychology Wiki Datasetpsychology_wiki数据集的构建基于心理学领域的英文维基百科内容，通过系统化的数据采集与整理，确保了信息的广泛覆盖与深度挖掘。数据集中的每一篇文章均经过严格的筛选与标注，涵盖了标题、正文、相关性、受欢迎程度及排名等多个维度，为心理学研究提供了丰富的文本资源。