Merge pull request #399 from yinhaofeng/dataset

frankwhzhang · web-flow · commit 6df90ff79403 · 2021-03-24T13:37:12.000+08:00
expand dataset
diff --git a/datasets/Anime/run.sh b/datasets/Anime/run.sh
@@ -0,0 +1,2 @@
+wget https://paddlerec.bj.bcebos.com/datasets/Anime/archive.zip
+unzip archive.zip -d anime
diff --git a/datasets/Douban/run.sh b/datasets/Douban/run.sh
@@ -0,0 +1 @@
+wget https://paddlerec.bj.bcebos.com/datasets/Douban/DMSC.csv
diff --git a/datasets/FourSquare/run.sh b/datasets/FourSquare/run.sh
@@ -0,0 +1,2 @@
+wget https://paddlerec.bj.bcebos.com/datasets/FourSquare/FourSquare.zip
+unzip FourSquare.zip -d FourSquare
diff --git a/datasets/Jester/run.sh b/datasets/Jester/run.sh
@@ -0,0 +1,4 @@
+wget https://paddlerec.bj.bcebos.com/datasets/Jester/Dataset3JokeSet.zip
+wget https://paddlerec.bj.bcebos.com/datasets/Jester/JesterDataset3.zip
+unzip Dataset3JokeSet.zip -d JokeSet
+unzip JesterDataset3.zip -d JesterDataset
diff --git a/datasets/LFM_1b/run.sh b/datasets/LFM_1b/run.sh
@@ -0,0 +1,7 @@
+wget https://paddlerec.bj.bcebos.com/datasets/LFM_1b/LFM-1b.zip
+unzip LFM-1b.zip
+wget https://paddlerec.bj.bcebos.com/datasets/LFM_1b/LFM-1b_LEs.z01
+wget https://paddlerec.bj.bcebos.com/datasets/LFM_1b/LFM-1b_LEs.z02
+wget https://paddlerec.bj.bcebos.com/datasets/LFM_1b/LFM-1b_LEs.zip
+cat LFM-1b_LEs.* > LFM-1b_LEs_full.zip
+unzip LFM-1b_LEs_full.zip
diff --git a/datasets/LFM_1b_UGP/run.sh b/datasets/LFM_1b_UGP/run.sh
@@ -0,0 +1,2 @@
+wget https://paddlerec.bj.bcebos.com/datasets/LFM_1b_UGP/LFM-1b_UGP.zip
+unzip LFM-1b_UGP.zip
diff --git a/datasets/Netflix/run.sh b/datasets/Netflix/run.sh
@@ -0,0 +1,2 @@
+wget https://paddlerec.bj.bcebos.com/datasets/Netflix/Netflix.zip
+unzip Netflix.zip -d Netflix
diff --git a/datasets/Retailrocket/run.sh b/datasets/Retailrocket/run.sh
@@ -0,0 +1,2 @@
+wget https://paddlerec.bj.bcebos.com/datasets/Retailrocket/Retailrocket.zip
+unzip Retailrocket.zip -d Retailrocket
diff --git a/datasets/Steam/run.sh b/datasets/Steam/run.sh
@@ -0,0 +1,4 @@
+wget https://paddlerec.bj.bcebos.com/datasets/steam/steam_games.json.gz
+wget https://paddlerec.bj.bcebos.com/datasets/steam/steam_reviews.json.gz
+gunzip steam_games.json.gz
+gunzip steam_reviews.json.gz
diff --git a/datasets/TaFeng/run.sh b/datasets/TaFeng/run.sh
@@ -0,0 +1 @@
+wget https://paddlerec.bj.bcebos.com/datasets/tafeng/ta_feng_all_months_merged.csv
diff --git a/datasets/readme.md b/datasets/readme.md
@@ -26,4 +26,14 @@ sh data_process.sh
  |[one_billion](http://www.statmt.org/lm-benchmark/)|拥有十亿个单词基准，为语言建模实验提供标准的训练和测试|[One Billion Word Benchmark for Measuring Progress in Statistical Language Modeling](https://arxiv.org/abs/1312.3005)|
  |[MIND](https://paddlerec.bj.bcebos.com/datasets/MIND/bigdata.zip)|MIND即MIcrosoft News Dataset的简写，MIND里的数据来自Microsoft News用户的行为日志。MIND的数据集里包含了1,000,000的用户以及这些用户与160,000的文章的交互行为。|[Microsoft(2020)](https://msnews.github.io)|
  |[movielens_pinterest_NCF](https://paddlerec.bj.bcebos.com/ncf/Data.zip)|论文原作者处理过的movielens数据集和pinterest数据集|[《Neural Collaborative Filtering 》](https://arxiv.org/pdf/1708.05031.pdf)|
-|[AmazonBook](https://paddlerec.bj.bcebos.com/datasets/AmazonBook/AmazonBook.tar.gz)|论文原作者处理过的AmazonBook数据集 |[《Controllable Multi-Interest Framework for Recommendation》](https://arxiv.org/abs/2005.09347)|
+ |[Anime](https://paddlerec.bj.bcebos.com/datasets/Anime/archive.zip)|该数据集包含73,516个用户对12,294个动漫的用户偏好数据。每个用户都可以将动漫添加到列表中并给它一个评分，该数据集是这些评分的汇总。|[Kaggle](https://www.kaggle.com/CooperUnion/anime-recommendations-database)|
+ |[LFM-1b](https://paddlerec.bj.bcebos.com/datasets/LFM_1b/LFM-1b.zip)|此数据集包含由Last.FM的120,000多个用户创建的十亿多个音乐收听记录。每条收听记录均以艺术家，专辑和曲目名称为特征，并包含一个时间戳。|[ICMR 2016](http://www.cp.jku.at/datasets/LFM-1b/)|
+ |[LFM-1b UGP](https://paddlerec.bj.bcebos.com/datasets/LFM_1b_UGP/LFM-1b_UGP.zip)|LFM-1b数据集的用户类型档案,作为LFM-1b的补充扩展|[ISM 2017](http://www.cp.jku.at/datasets/LFM-1b/)|
+ |[Jester](https://paddlerec.bj.bcebos.com/datasets/Jester/JesterDataset3.zip)|此数据集包含Jester Joke Recommender系统用户对笑话的匿名评分。|[UC Berkeley](http://eigentaste.berkeley.edu/dataset/)|
+ |[Steam](https://paddlerec.bj.bcebos.com/datasets/steam/steam_reviews.json.gz)|该数据集是Steam的评论和游戏信息，其中包含7,793,069条评论，2,567,538位用户和32,135个游戏。除评论文本外，数据还包括每个评论中用户的游戏时间。|[ICDM 2018](https://github.com/kang205/SASRec)|
+ |[Douban](https://paddlerec.bj.bcebos.com/datasets/Douban/DMSC.csv)|豆瓣电影是一个中文网站，允许互联网用户分享他们对电影的评论和观点。用户可以在电影上发表简短或长时间的评论并给他们打分。该数据集包含“豆瓣电影”网站中28部电影的200万条简短评论。|[Kaggle](https://www.kaggle.com/utmhikari/doubanmovieshortcomments)|
+ |[TaFeng](https://paddlerec.bj.bcebos.com/datasets/tafeng/ta_feng_all_months_merged.csv)|该数据集包含2000年11月至2001年2月中国杂货店的交易数据。|[Kaggle](https://www.kaggle.com/chiranjivdas09/ta-feng-grocery-dataset)|
+ |[Retailrocket](https://paddlerec.bj.bcebos.com/datasets/Retailrocket/Retailrocket.zip)|数据是从真实的电子商务网站中收集的。它是原始数据，即没有任何内容转换，但是，由于保密问题，所有值都被哈希化。|[Kaggle](https://www.kaggle.com/retailrocket/ecommerce-dataset)|
+ |[Netflix](https://paddlerec.bj.bcebos.com/datasets/Netflix/Netflix.zip)|这是Netflix竞赛中使用的官方数据集。|[Kaggle](https://www.kaggle.com/netflix-inc/netflix-prize-data)|
+ |[FourSquare](https://paddlerec.bj.bcebos.com/datasets/FourSquare/FourSquare.zip)|此数据集包含在纽约和东京进行的大约10个月收集的签到。每个签到都有其时间戳，GPS坐标及其语义相关联。|[Kaggle](https://www.kaggle.com/chetanism/foursquare-nyc-and-tokyo-checkin-dataset)|
+ |[AmazonBook](https://paddlerec.bj.bcebos.com/datasets/AmazonBook/AmazonBook.tar.gz)|论文原作者处理过的AmazonBook数据集 |[《Controllable Multi-Interest Framework for Recommendation》](https://arxiv.org/abs/2005.09347)|

Original file line number	Diff line number	Diff line change
`@@ -0,0 +1,2 @@`
	`1`	`+wget https://paddlerec.bj.bcebos.com/datasets/Anime/archive.zip`
	`2`	`+unzip archive.zip -d anime`
Original file line number	Diff line number	Diff line change
`@@ -0,0 +1 @@`
	`1`	`+wget https://paddlerec.bj.bcebos.com/datasets/Douban/DMSC.csv`
Original file line number	Diff line number	Diff line change
`@@ -0,0 +1,2 @@`
	`1`	`+wget https://paddlerec.bj.bcebos.com/datasets/FourSquare/FourSquare.zip`
	`2`	`+unzip FourSquare.zip -d FourSquare`
Original file line number	Diff line number	Diff line change
`@@ -0,0 +1,2 @@`
	`1`	`+wget https://paddlerec.bj.bcebos.com/datasets/LFM_1b_UGP/LFM-1b_UGP.zip`
	`2`	`+unzip LFM-1b_UGP.zip`
Original file line number	Diff line number	Diff line change
`@@ -0,0 +1,2 @@`
	`1`	`+wget https://paddlerec.bj.bcebos.com/datasets/Netflix/Netflix.zip`
	`2`	`+unzip Netflix.zip -d Netflix`
Original file line number	Diff line number	Diff line change
`@@ -0,0 +1,2 @@`
	`1`	`+wget https://paddlerec.bj.bcebos.com/datasets/Retailrocket/Retailrocket.zip`
	`2`	`+unzip Retailrocket.zip -d Retailrocket`