Skip to content

Commit 401fddd

Browse files
authored
Merge pull request #207 from creativecommons/pre-auto-and-sources-cleanup
Move unused sources to pre-automation and remove old wikipedia
2 parents ee9d97c + 760e69c commit 401fddd

File tree

6 files changed

+105
-683
lines changed

6 files changed

+105
-683
lines changed

env.example

Lines changed: 5 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -1,15 +1,6 @@
11
# This file must be copied to .env and the appropriate variables populated.
22

33

4-
# GitHub
5-
6-
# https://docs.github.com/en/rest/using-the-rest-api/rate-limits-for-the-rest-api#primary-rate-limit-for-authenticated-users
7-
#
8-
# https://docs.github.com/en/rest/authentication/authenticating-to-the-rest-api
9-
10-
# GH_TOKEN =
11-
12-
134
## GCS (Google Custom Search)
145

156
# https://developers.google.com/custom-search/v1/introduction
@@ -31,9 +22,10 @@
3122
# GCS_CX =
3223

3324

34-
## Flickr
25+
# GitHub
3526

36-
# "The flickr developer guide: https://www.flickr.com/services/developer/"
27+
# https://docs.github.com/en/rest/using-the-rest-api/rate-limits-for-the-rest-api#primary-rate-limit-for-authenticated-users
28+
#
29+
# https://docs.github.com/en/rest/authentication/authenticating-to-the-rest-api
3730

38-
# FLICKR_API_KEY =
39-
# FLICKR_API_SECRET =
31+
# GH_TOKEN =

pre-automation/sources.md

Lines changed: 93 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,93 @@
1+
## Flickr
2+
3+
**Description:** _With over 5 billion photos (many with valuable metadata such
4+
as tags, geolocation, and Exif data), the Flickr community creates wonderfully
5+
rich data. The Flickr API is how you can access that data. In fact, almost all
6+
the functionality that runs flickr.com is available through the API._ ([Flickr:
7+
The Flickr Developer Guide](https://www.flickr.com/services/developer/))
8+
9+
**API documentation link:**
10+
- [API documentation - Flickr Services](https://www.flickr.com/services/api/)
11+
12+
**API information:**
13+
- API key required
14+
- Query limit: 3600 requests per hour
15+
- Data available through CSV format
16+
17+
18+
## Internet Archive Python Interface
19+
20+
**Description:** A python interface to archive.org to achieve API requests
21+
towards internet archive.
22+
23+
**API documentation link:**
24+
- [internetarchive.Search - Internetarchive: A Python Interface to
25+
archive.org][ia-search]
26+
27+
**API information:**
28+
- No API key required
29+
- No query limits
30+
31+
[ia-search]: https://internetarchive.readthedocs.io/en/stable/internetarchive.html#internetarchive.Search
32+
33+
34+
## MediaWiki Action API
35+
36+
**Description:** _The MediaWiki Action API is a web service that allows access
37+
to some wiki features like authentication, page operations, and search. It can
38+
provide meta information about the wiki and the logged-in user._ ([API:Main
39+
page - MediaWiki](https://www.mediawiki.org/wiki/API:Main_page))
40+
41+
**API documentation link:**
42+
- [MediaWiki Action API](https://www.mediawiki.org/wiki/API:Main_page)
43+
44+
**API information:**
45+
- No API key required
46+
- Query limit: depends on user status and request type
47+
- Data available through XML or JSON format
48+
49+
50+
## The Metropolitan Museum of Art Collection API
51+
52+
**Description:** _The Met’s Open Access datasets are available through our API.
53+
The API (RESTful web service in JSON format) gives access to all of The Met’s
54+
Open Access data and to corresponding high resolution images (JPEG format) that
55+
are in the public domain._ ([The Metropolitan Museum of Art Collection
56+
API](https://metmuseum.github.io/))
57+
58+
**API documentation link:**
59+
- [Latest Updates | The Metropolitan Museum of Art Collection
60+
API](https://metmuseum.github.io/)
61+
62+
**API information:**
63+
- No API key required
64+
- 80 queries per second
65+
66+
67+
## Vimeo API
68+
69+
**Description:** The Vimeo API allows users to perform filtered, advanced
70+
search on Vimeo videos.
71+
72+
**API documentation link:**
73+
- [Getting Started with the Vimeo API](https://developer.vimeo.com/api/start)
74+
75+
**API information:**
76+
- API key required
77+
- Query limit: 5000 authenticated requests per day
78+
- Data available through JSON format
79+
80+
81+
## YouTube Data API
82+
83+
**Description:** An API from YouTube for platform users to upload videos,
84+
adjust video parameters, and obtain search results.
85+
86+
**API documentation link:**
87+
- [Search: list | YouTube Data API | Google
88+
Developers](https://developers.google.com/youtube/v3/docs/search/list)
89+
90+
**API information:**
91+
- API key required
92+
- Query limit: depends on the type and number of requests
93+
- Data available through JSON format

pre-automation/wikipedia/data_wikipedia_2022_10_24.csv

Lines changed: 0 additions & 180 deletions
This file was deleted.

0 commit comments

Comments
 (0)