Skip to content

Add Europeana integration #200

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
TimidRobot merged 33 commits into from
Nov 1, 2025
Merged

Add Europeana integration #200

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
33 commits
Select commit Hold shift + click to select a range
502f9b9
Added Europeana integration
Joyakis Oct 15, 2025
7a7766d
Remove unnecessary CSV file
Joyakis Oct 15, 2025
9e52f73
Revert "Done the necessary changes"
Joyakis Oct 18, 2025
73f9aa1
Done the necessary changes
Joyakis Oct 18, 2025
cc2e742
Fix formatting and linting issues in europeana_fetch.py to comply wit…
Joyakis Oct 20, 2025
a7a1402
update variable name (due to merge with main)
TimidRobot Oct 21, 2025
e26de97
Add functionality to generate separate Europeana data files with and …
Joyakis Oct 21, 2025
ee36206
Updated script to use Europeana API’s totalResults
Joyakis Oct 21, 2025
add3aaf
Added updated files
Joyakis Oct 24, 2025
57cc578
Removed print statements
Joyakis Oct 24, 2025
000addc
Used facet pagination instead of cursor
Joyakis Oct 24, 2025
71c8b58
Uses offset based pagination and updates sources
Joyakis Oct 24, 2025
87c3c1e
Removed unnecessary logger info
Joyakis Oct 24, 2025
c5a3abd
Add limit parser to allow restricting providers during testing
Joyakis Oct 28, 2025
49e85f2
Added comments to theme
Joyakis Oct 28, 2025
008ec81
Add additional logging for provider-level rights fetching
Joyakis Oct 28, 2025
d597e6a
Reduced time to sleep
Joyakis Oct 28, 2025
dbaf51d
Merge remote-tracking branch 'upstream' into europeana-feature
Joyakis Oct 29, 2025
fc29c49
Added a timeout constant
Joyakis Oct 29, 2025
2c9e71f
Updated sources.md
Joyakis Oct 30, 2025
87bfd9d
Resolve merge conflict in sources.md and keep Europeana Data API section
Joyakis Oct 30, 2025
1d4ae38
Add Europeana Data API section only
Joyakis Oct 30, 2025
ed87d34
Add Europeana Data API section
Joyakis Oct 30, 2025
47b5f20
Merge branch 'main' into europeana-feature
Joyakis Oct 30, 2025
6e096d1
chore: update sources.md to match latest main (remove outdated sources)
Joyakis Oct 30, 2025
de913b5
Add europeana sources
Joyakis Oct 30, 2025
ddecf45
chore: update env.example to match latest main
Joyakis Oct 30, 2025
6893d82
Updated env.example
Joyakis Oct 30, 2025
4fd4920
Uses prefetched facets
Joyakis Oct 31, 2025
a7be5f3
Merge branch 'main' into europeana-feature
TimidRobot Nov 1, 2025
4957746
order sources and make formatting more consistent
TimidRobot Nov 1, 2025
5b1aa20
order sources and add a couple of Europeana notes
TimidRobot Nov 1, 2025
4c8588b
minor updates to europeana fetch
TimidRobot Nov 1, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 9 additions & 1 deletion env.example
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,7 +1,15 @@
# This file must be copied to .env and the appropriate variables populated.


## GCS (Google Custom Search)
## Europeana

# Europeana Search API Documentation:
# https://europeana.atlassian.net/wiki/spaces/EF/pages/2385739812/Search+API+Documentation#Request

# EUROPEANA_API_KEY =


# GCS (Google Custom Search)

# https://developers.google.com/custom-search/v1/introduction
# "Custom Search JSON API requires the use of an API key. An API key is a way
Expand Down
Loading