Schema for Study abroad program

[mikehquan19]

Now that scholarship is almost finalized, and seems like we've had an idea on how to progress on that, let's move on to InternationalProgram.

My discovery so far is that there are 4 types of programs:

• Exchange programs
• Faculty-led programs
• Affiliated programs
• Internships
  You can search for the websites right here https://utdallas-ea.terradotta.com/_portal/program-discovery.

The problem is almost like scholarships, each type displays different informations. So we need to determine whether we have to create separate schemas or we can create a single one that accomodates with every type.

@Nathan-204 has been tackling this problem last semester and he found this API: https://utdallas-ea.terradotta.com/models/services/REST/index.cfm?endpoint=/v3/program/10064/brochure. So I believe we wouldn't have to do chromedp HTML scraping, but this is not certain.

[mikehquan19]

@Nathan-204 since you've been working on this yourself, it would be great if you can share your ideas and explorations

[SoggyRhino]

I looked into the site and also found that api but it turns out they left their api docs public. The security is a bit weird since it will give a 403 if you try to access it through the browser but if you use postman web client (not the desktop app) it works.

Documentation URL
https://utdallas-ea.terradotta.com/models/services/Rest

API-Dashboard.html
TDS-Admin-API.html

They seem to be using Bearer auth we can get a token:

Request 1
https://utdallas-ea.terradotta.com/oauth2/authorize/?client_id=85372C521DD100CBEAE2927C8FB3130B&response_type=code

Response 1

{
    "code": "asasdasd..."
}

Request 2
https://utdallas-ea.terradotta.com/oauth2/authorize/?client_id=85372C521DD100CBEAE2927C8FB3130B&response_type=code
Add Header "Authorization" : "Bearer asasdasd..."

Response 2

{
    "scope": "Public",
    "access_token": "eyJ0eXAiOiJ...",
    "expires_in": 3540.0,
    "token_type": "bearer",
    "refresh_token": "eyJ0eXAi..."
}

Then we can use access_token to call the API

The only endpoint i found to iterate over all programs is (which wasn't in the docs for some reason)

https://us-prod-api-v2.terradotta.com/program-api/program/discovery-search/

use this as request body (start = limit * i)

{
    "limit": 12,
    "sortBy": "_score",
    "sortDirection": "DESC",
    "start": 12
}

Response

{
   // Extra stuff
   "returnedPrograms": [
        10329,
        10328,
        ...
    ],
    "resultCount": 12,
    "maxScore": 0.0,
    "start": 12,
    "limit": 12,
    "totalCount": 139,
    "searchid": "c584ab7b-9da9-4f71-b2b1-34a89b407aae"
}

program-search.json

Finally we can use the api Nathan found to get all the info for a specific program.

Here are some of the other ones that I've found:

https://utdallas-ea.terradotta.com/models/services/REST/index.cfm?endpoint=/v3/program/10064/Dates

https://utdallas-ea.terradotta.com/models/services/REST/index.cfm?endpoint=/v3/program/10064/budgetSheet

This doesn't really answer the schema question but this should be most of the data we can easily get. I'll look through it later