docs: more reorganization of docs (#2643)

Author: ryscheng

README.md

@@ -212,4 +212,4 @@ is released under Apache 2.0
 This repository does not contain data.
 Datasets may include material that may be subject to third party rights.
 For details on each dataset, see
-the [Data Overview](https://docs.opensource.observer/docs/integrate/overview/).
+the [Data Overview](https://docs.opensource.observer/docs/integrate/datasets/).

apps/docs/blog/2024-03-20-request-for-impact-metrics/index.md

@@ -17,7 +17,7 @@ If you'd like to get involved, here's what to do:
 1. Apply to [join the Data Collective](https://www.kariba.network/). It only takes a few minutes. We'll review, and reach out to schedule an onboarding call.
 2. Join our [Discord server](https://www.opensource.observer/discord) and say hello.
 3. Get inspiration from our Colab directory of [starter notebooks for impact metrics](https://drive.google.com/drive/folders/1I4exiLfZYgPwIGBEzuAMeGtJUhtS_DE7?usp=drive_link). We also have of them in our [Insights repo](https://github.com/opensource-observer/insights/tree/main/community/notebooks) if you prefer to run them locally.
-4. Consult [our docs](../../docs/) and especially our [impact metric spec](../../docs/guides/impact-metrics/) as you prepare your analysis.
+4. Consult [our docs](../../docs/) and especially our [impact metric spec](../../docs/references/impact-metrics/) as you prepare your analysis.
 
 The rest of this post includes more details on the types of impact metrics we're interested in.
 
@@ -62,7 +62,7 @@ _Metrics that attempt to differentiate onchain users based on behavior and trust
 
 This is a hot topic right now, with a number of projects attempting to create reputation systems for onchain users. We're integrating with many of the leading projects and bringing the data they generate into the OSO data warehouse. From there, there are all sorts of directions you can take the analysis!
 
-The **Onchain Activity** metric is a good starting point for new analysts. Have a look at our working definitions for [onchain users](../../docs/guides/impact-metrics/onchain) and help us create some better ones. The **Network Loyalty** is a spicy metric that will get even spicier as we add more networks to the OSO dataset!
+The **Onchain Activity** metric is a good starting point for new analysts. Have a look at our working definitions for [onchain users](../../docs/references/impact-metrics/onchain) and help us create some better ones. The **Network Loyalty** is a spicy metric that will get even spicier as we add more networks to the OSO dataset!
 
 | Impact Metric    | Description                                           | Comments                                   |
 | :--------------- | :---------------------------------------------------- | :----------------------------------------- |

apps/docs/blog/2024-06-29-impact-metrics-rf4-deep-dive/index.md

@@ -116,7 +116,7 @@ We're excited to see how this type of model evolves and is extended for future u
 
 ## Developing the impact metrics
 
-The following design principles guide the development and evolution of [impact metrics](../../docs/guides/impact-metrics/#principles):
+The following design principles guide the development and evolution of [impact metrics](../../docs/references/impact-metrics/#principles):
 
 - Verifiability: Metrics should be based on public data that can be independently verified. They should not rely on proprietary data sources or private APIs.
 - Reproducibility: Metrics should be easy to reproduce, simulate, and audit to ensure they are achieving the intended results. They should not have a "black box" element that makes them difficult to understand or replicate.

apps/docs/blog/2024-07-16-oso-data-portal/index.md

@@ -14,17 +14,17 @@ OSO Data Exchange on Google BigQuery.
 Here, we will publish every data set we have as live,
 up-to-date, and free to use datasets.
 In addition to sharing every model in the
-[OSO production data pipeline](https://docs.opensource.observer/docs/integrate/overview/#oso-production-data-pipeline),
+[OSO production data pipeline](../../docs/integrate/datasets#oso-production-data-pipeline),
 we are sharing source data for blocks/transactions/traces across
-[7 chains in the OP Superchain](https://docs.opensource.observer/docs/integrate/overview/#superchain-data)
+[7 chains in the OP Superchain](../../docs/integrate/datasets#optimism-data)
 (including Optimism, Base, Frax, Metal, Mode, PGN, Zora),
-[Gitcoin Data](https://docs.opensource.observer/docs/integrate/overview/#gitcoin-and-passport-data),
-and [OpenRank](https://docs.opensource.observer/docs/integrate/overview/#openrank-data).
+[Gitcoin Data](../../docs/integrate/datasets#gitcoin-and-passport-data),
+and [OpenRank](../../docs/integrate/datasets#openrank-data).
 This builds on the existing BigQuery public data ecosystem that includes
-[GitHub](https://docs.opensource.observer/docs/integrate/overview/#github-data),
-[Ethereum](https://docs.opensource.observer/docs/integrate/overview/#ethereum-data),
-[Farcaster](https://docs.opensource.observer/docs/integrate/overview/#farcaster-data),
-and [Lens](https://docs.opensource.observer/docs/integrate/overview/#lens-data) data.
+[GitHub](../../docs/integrate/datasets#github-data),
+[Ethereum](../../docs/integrate/datasets#ethereum-data),
+[Farcaster](../../docs/integrate/datasets#farcaster-data),
+and [Lens](../../docs/integrate/datasets#lens-data) data.
 To learn more, check out the data portal here:
 
 <p style={{"text-align": "center"}}>

apps/docs/blog/2024-08-12-war-for-public-goods/index.md

@@ -97,4 +97,4 @@ Once again, there are valuable lessons from baseball that we can apply:
 - **Embrace Competing Implementations**: As mentioned earlier, there is no single standard calculation for WAR. Even though the data and methodologies are public, there’s vibrant debate about which method is best. In an industry as dynamic as crypto, this diversity of approaches is a strength, encouraging innovation and continuous improvement.
 - **Engage the Research Community**: WAR models are like catnip for data enthusiasts. They offer endless opportunities for simulation, experimentation, and visualization. By providing well-documented, easy-to-use datasets and stoking interest in the results from protocol leaders and governance teams, we can create a garden of catnip for researchers and data nerds.
 
-At Open Source Observer, we want to build the equivalent of a sabermetrics for open source impact. If you have ideas for a WAR model, check out our existing library of [data](../../docs/integrate/overview) and [metrics](../../docs/guides/impact-metrics/), and come say hi on our [Discord](https://www.opensource.observer/discord).
+At Open Source Observer, we want to build the equivalent of a sabermetrics for open source impact. If you have ideas for a WAR model, check out our existing library of [data](../../docs/integrate/datasets) and [metrics](../../docs/references/impact-metrics/), and come say hi on our [Discord](https://www.opensource.observer/discord).

apps/docs/docs/contribute-data/bigquery/_category_.json

@@ -1,6 +1,6 @@
 {
   "label": "Connect via BigQuery",
-  "position": 1,
+  "position": 2,
   "link": {
     "type": "doc",
     "id": "index"

apps/docs/docs/contribute-data/bigquery/index.md

@@ -8,7 +8,9 @@ trivially easy to integrate any public dataset into
 the OSO data pipeline, provided the dataset exists in
 the US multi-region.
 
-If the dataset needs to be replicated, see our guide on
+If you want OSO to host a copy of
+the dataset in the US multi-region,
+see our guide on
 [BigQuery Data Transfer Service](./replication.md).
 
 ## Make the data available in the US region

apps/docs/docs/contribute-data/quickstart.md

@@ -1,6 +1,6 @@
 ---
 title: Dagster Quickstart
-sidebar_position: 2
+sidebar_position: 1
 ---
 
 # Dagster quickstart

apps/docs/docs/contribute-models/challenges/2024-04-05-data-challenge-01.md

@@ -72,7 +72,7 @@ Here’s what you need to do to participate in this (and future) data challenges
 
 1. Join the [Kariba Data Collective](https://www.kariba.network/). Participation is open to anyone in the data collective (free to join, but we review applications).
 2. Join our Discord and receive a **_data-collective_** role; ask questions and share code snippets in the **_#data-challenges_** channel.
-3. Bookmark [our docs and tutorials](../../guides/impact-metrics/) for creating impact metrics. Also make sure to browse our [Colab Notebooks](https://drive.google.com/drive/folders/1mzqrSToxPaWhsoGOR-UVldIsaX1gqP0F) for examples and inspiration.
+3. Bookmark [our docs and tutorials](../../references/impact-metrics/) for creating impact metrics. Also make sure to browse our [Colab Notebooks](https://drive.google.com/drive/folders/1mzqrSToxPaWhsoGOR-UVldIsaX1gqP0F) for examples and inspiration.
 4. Submit your impact metric(s) by opening an issue on our Insight repo [here](https://github.com/opensource-observer/insights/issues/new/choose).
 
 Every impact metric submission should include:

apps/docs/docs/contribute-models/challenges/2024-07-30-openrank.md

@@ -34,7 +34,7 @@ We've queued up a few ideas to get you started:
 
 - **Protocol Rank**. This [notebook](https://github.com/opensource-observer/insights/blob/main/community/data_challenges/openrank/OpenRank_ProtocolRank.ipynb) uses the same logic as the Repo Rank notebook, but narrows the curation space to only include projects that have deployed contracts on an Ethereum Layer 2.
 
-- **Gitcoin Project Rank**. This [notebook](https://github.com/opensource-observer/insights/blob/main/community/data_challenges/openrank/OpenRank_GitcoinProjectRank.ipynb) builds on top of our recently-added [Gitcoin Grants dataset](https://docs.opensource.observer/docs/integrate/overview/#gitcoin-and-passport-data), which includes a history of every peer-to-peer donation on the Gitcoin platform. It also taps the Farcaster dataset to identify usernames associated with donors.
+- **Gitcoin Project Rank**. This [notebook](https://github.com/opensource-observer/insights/blob/main/community/data_challenges/openrank/OpenRank_GitcoinProjectRank.ipynb) builds on top of our recently-added [Gitcoin Grants dataset](../../integrate/datasets/index.mdx#gitcoin-and-passport-data), which includes a history of every peer-to-peer donation on the Gitcoin platform. It also taps the Farcaster dataset to identify usernames associated with donors.
 
 ### Requirements