Add the scraper for scholarship

[mikehquan19]

In the interest of expanding the Nebula database, we will add scraper for different types of data: scholarships, study-abroad programs, discount programs (if y'all really think it's beneficial), researches, etc.

We will start by adding scholarship scraper. I would need 2 PEOPLE to work on this:

• One will add the schema for Scholarship
• One will actually scrape from the website.

A couple of websites:

• https://www.utdallas.edu/costs-scholarships-aid/scholarships/listings/
• https://utdallas.scholarships.ngwebsolutions.com/Scholarships/Search

[greeshiee]

This seems fun! I'd like to give it a shot, I don't mind either task but I would prefer scraping.

[greeshiee]

I just looked through the provided links, Here's the information we can look into scraping and making available:

Scholarship Name
School
Major
Status (Open/Close)
Deadline
Description of Scholarship [Artemis]
Residency/Citizenship requirements [Artemis]

Except for the ones specified as Artemis, the data is available via the listings page. However there seems to be a shape mismatch in that there are 99 scholarship entries on the listings page but only 39 available scholarships on Artemis. So there may be missing data for certain scholarships. I'm unsure of how we can handle that.

[greeshiee]

Quick update. I found the commonality between the 39 scholarships on Artemis. Artemis is the UTD General Scholarship Application system. All the rest of the information is directly available on the listings page (hidden by a toggle button) with a more information link that holds all of the information we need about the scholarship! I can work on writing the scraper to get this information and dump it into a CSV

[mikehquan19]

@greeshiee , sounds great! Keep me posted how the results in CSV turn out.