Skip to content

Commit 4003b66

Browse files
priyankatutejapriyankatuteja
andauthored
changes pushed for ga guides (#1221)
* hanges pushed * changes pushed * changes pushed Co-authored-by: priyankatuteja <[email protected]>
1 parent 11dad88 commit 4003b66

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

43 files changed

+7767
-854
lines changed

guide/07-working-with-bigdata/01-introduction.ipynb

Lines changed: 25 additions & 44 deletions
Original file line numberDiff line numberDiff line change
@@ -16,16 +16,6 @@
1616
"Geospatial data is a crucial component of big data, adding context that allows for better, multidimensional insights that facilitate smarter decisions, improved business operations and innovation to deliver a strong competitive advantage."
1717
]
1818
},
19-
{
20-
"cell_type": "markdown",
21-
"metadata": {
22-
"toc": true
23-
},
24-
"source": [
25-
"<h1>Table of Contents<span class=\"tocSkip\"></span></h1>\n",
26-
"<div class=\"toc\"><ul class=\"toc-item\"><li><span><a href=\"#What-is-Geospatial-big-data?\" data-toc-modified-id=\"What-is-Geospatial-big-data?-1\"><span class=\"toc-item-num\">1&nbsp;&nbsp;</span>What is Geospatial big data?</a></span></li><li><span><a href=\"#What-is-GeoAnalytics-Server?\" data-toc-modified-id=\"What-is-GeoAnalytics-Server?-2\"><span class=\"toc-item-num\">2&nbsp;&nbsp;</span>What is GeoAnalytics Server?</a></span><ul class=\"toc-item\"><li><ul class=\"toc-item\"><li><span><a href=\"#What-you-get-in-ArcGIS-GeoAnalytics\" data-toc-modified-id=\"What-you-get-in-ArcGIS-GeoAnalytics-2.0.1\"><span class=\"toc-item-num\">2.0.1&nbsp;&nbsp;</span>What you get in ArcGIS GeoAnalytics</a></span></li></ul></li></ul></li></ul></div>"
27-
]
28-
},
2919
{
3020
"cell_type": "markdown",
3121
"metadata": {},
@@ -88,7 +78,7 @@
8878
"source": [
8979
"[ArcGIS GeoAnalytics Server](https://www.esri.com/en-us/arcgis/products/arcgis-geoanalytics-server/overview) is a big data processing and analysis capability of ArcGIS Enterprise. It provides a distributed computing framework that powers a collection of analysis tools for analyzing large volumes of data. Through aggregation, regression, detection, clustering, and so on, you can visualize, understand, and act upon your big data. GeoAnalytics Server allows you to gain insights that may otherwise be hidden in your data, such as patterns, trends, and anomalies.\n",
9080
"\n",
91-
"GeoAnalytics Server works with your vector (points, lines, and polygons) and tabular data and can read directly from CSV files, .txt files, shapefiles, and big data sources such as cloud storage, HDFS, and Hive. GeoAnalytics Server also works with your existing GIS data, using feature layers as input.\n",
81+
"GeoAnalytics Server works with your vector (points, lines, and polygons) and tabular data and can read directly from CSV files, .txt files, shapefiles, and big data sources, such as cloud storage, HDFS, and Hive. GeoAnalytics Server also works with your existing GIS data, using feature layers as input.\n",
9282
"\n",
9383
"GeoAnalytics Server tools focus on the different spatial analysis approaches you can take with big data: Analyze Patterns, Find Locations, Manage Data, Summarize Data, Use Proximity, and Data Enrichment. Whether you need to complete a quick spatial join, run regression analysis on multiple datasets, or find areas of data clustering, the GeoAnalytics Server toolbox provides many options to explore your data. In addition to the provided tools, you can customize analysis to complete your workflows and analyses through Python, using distributed computation and tools on your GeoAnalytics Server.\n",
9484
"\n",
@@ -117,23 +107,20 @@
117107
"\n",
118108
"GeoAnalytics Server is helpful when you find that your current GIS analyses aren’t processing your data fast enough. It accelerates traditional workflows so you can get results quicker. GeoAnalytics Server is also helpful when you have large datasets and you need to analyze them spatially. GeoAnalytics Server is a good solution for the following:\n",
119109
"\n",
120-
"Your existing tools and workflows aren’t processing your data fast enough.\n",
121-
"Your data is growing and you need a better way of managing and analyzing it.\n",
122-
"You need to transform your data into something more manageable to use in other GIS analyses (for example using ArcGIS Pro analysis tools).\n",
123-
"Your data has a lot of noise and you want to explore it to identify important points.\n",
124-
"You want to use spatial statistical analysis and machine learning tools suitable for large datasets.\n",
110+
"- Your existing tools and workflows aren’t processing your data fast enough.\n",
111+
"- Your data is growing and you need a better way of managing and analyzing it.\n",
112+
"- You need to transform your data into something more manageable to use in other GIS analyses (for example using ArcGIS Pro analysis tools).\n",
113+
"- Your data has a lot of noise and you want to explore it to identify important points.\n",
114+
"- You want to use spatial statistical analysis and machine learning tools suitable for large datasets.\n",
125115
"\n",
126116
"**Examples of analysis with ArcGIS GeoAnalytics Server**\n",
127117
"\n",
128118
"GeoAnalytics tools are versatile across industries. The following examples illustrate how GeoAnalytics Server can be used with different goals in mind:\n",
129119
"\n",
130-
"- As a crime analyst, you can understand the location and time of crimes in your state, as well as the proximity of crimes to areas of interest such as events, police stations, and city centers. Related tools are Aggregate Points and Join Features.\n",
131-
"- As a manager at a state Department of Transportation, you can analyze decades of traffic and crash data to determine the interstates with the most incidents. You can also analyze when certain vehicles were speeding and breaking, and correlate them with the locations of vehicular accidents. Related tools are Find Point Clusters and Reconstruct Tracks.\n",
132-
"- As an environmental scientist, you can identify times and locations of high ozone levels across the country in a dataset of millions of static sensor reads. Related tools are Detect Incidents and Create Space Time Cube.\n",
133-
"- As an electric utility engineer, you can determine how close lightning strikes were to your electrical lines and substations. Related tools are Create Buffers and Join Features.\n",
134-
"- As a water utility technician, you can sort through work orders for leaks, and join them to a dataset of soil types to determine if leaks have occurred in areas where there is particularly corrosive soil. Related tools are Create Space Time Cube and Find Hot Spots.\n",
135-
"- As a retail lead, you can experiment with realigning your trade areas based on demographics, past sales, or distance to and from a store. You can also see how store performance is similar and dissimilar across your portfolio. Related tools are Dissolve Boundaries and Find Similar Locations.\n",
136-
"- As a city GIS analyst, you can use ArcGIS GeoEvent Server to ingest GPS data on all city vehicles, like public works vehicles and snow plows. See where vehicles have travelled, areas that have with less coverage, and instances where vehicles exceeded the speed limit. Related tools are Reconstruct Tracks, Aggregate Points, and Detect Incidents.\n",
120+
"- As a crime analyst, you can understand the location and time of crimes in your state, as well as the proximity of crimes to areas of interest, such as events, police stations, and city centers. Related tools are Aggregate Points and Join Features.\n",
121+
"- As a manager at a state Department of Transportation, you can analyze decades of traffic and crash data to determine the interstates with the most incidents. You can also analyze when certain vehicles were speeding and braking and correlate them with the locations of vehicular accidents. Related tools are Find Point Clusters and Reconstruct Tracks.\n",
122+
"- As a water utility technician, you can sort through work orders for leaks and join them to a dataset of soil types to determine if leaks have occurred in areas where there is particularly corrosive soil. Related tools are Create Space Time Cube and Find Hot Spots.\n",
123+
"- As a city GIS analyst, you can use ArcGIS GeoEvent Server to ingest GPS data on all city vehicles, like public works vehicles and snow plows, and see where the vehicles have travelled, areas that have less coverage, and instances where vehicles exceeded the speed limit. Related tools are Reconstruct Tracks, Aggregate Points, and Detect Incidents.\n",
137124
"\n",
138125
"GeoAnalytics Server enables distributed analysis on a single machine or across a set of three machines. With this distributed computing power, your analysis can be performed more quickly and with larger quantities of data than could previously be computed on a desktop machine. Results from your analysis can be stored in ArcGIS Enterprise for use in web maps, apps, and other information products, or you can write back to your own data store.\n",
139126
"\n",
@@ -158,7 +145,7 @@
158145
"cell_type": "markdown",
159146
"metadata": {},
160147
"source": [
161-
"The [`arcgis.geoanalytics`](https://esri.github.io/arcgis-python-api/apidoc/html/arcgis.geoanalytics.toc.html) module available in ArcGIS API for Python provides submodules, data types, classes and functions to process your big data using an [ArcGIS GeoAnalytics Server](http://server.arcgis.com/en/server/latest/get-started/windows/what-is-arcgis-geoanalytics-server-.htm). The ArcGIS GeoAnalytics Server enables distributed analysis across multiple ArcGIS Server machines. You can analyze more data in less time because you harness the compute power of multiple machines. Navigate to the [Get Started with GeoAnalytics Server](http://enterprise.arcgis.com/en/server/latest/get-started/windows/configure-the-portal-with-arcgis-geoanalytics-server.htm) page to learn everything you need to configure the GeoAnalytics Server with your ArcGIS Enterprise deployment. "
148+
"The [`arcgis.geoanalytics`](https://esri.github.io/arcgis-python-api/apidoc/html/arcgis.geoanalytics.toc.html) module available in ArcGIS API for Python provides submodules, data types, classes and functions to process your big data using an [ArcGIS GeoAnalytics Server](http://server.arcgis.com/en/server/latest/get-started/windows/what-is-arcgis-geoanalytics-server-.htm). The ArcGIS GeoAnalytics Server enables distributed analysis across multiple ArcGIS Server machines. You can analyze more data in less time because you harness the compute power of multiple machines. Navigate to the [Get Started with GeoAnalytics Server](http://enterprise.arcgis.com/en/server/latest/get-started/windows/configure-the-portal-with-arcgis-geoanalytics-server.htm) page to learn how to configure the GeoAnalytics Server with your ArcGIS Enterprise deployment. "
162149
]
163150
},
164151
{
@@ -167,14 +154,14 @@
167154
"source": [
168155
"\n",
169156
"\n",
170-
"The module verifies that your Enterprise has been properly configured with the [`is_supported()`](https://esri.github.io/arcgis-python-api/apidoc/html/arcgis.geoanalytics.toc.html#is-supported) function. Once confirmed the Enterprise is configured, the geoanalytics tools work with [big data file share](http://enterprise.arcgis.com/en/server/10.5/get-started/windows/what-is-a-big-data-file-share.htm) items registered in the Web GIS and also with [feature layers](https://developers.arcgis.com/rest/services-reference/feature-layer.htm).\n",
157+
"The module verifies that your Enterprise has been properly configured with the [`is_supported()`](https://esri.github.io/arcgis-python-api/apidoc/html/arcgis.geoanalytics.toc.html#is-supported) function. Once it is confirmed that the Enterprise is configured, the geoanalytics tools work with [big data file share](http://enterprise.arcgis.com/en/server/10.5/get-started/windows/what-is-a-big-data-file-share.htm) items registered in the Web GIS and with [feature layers](https://developers.arcgis.com/rest/services-reference/feature-layer.htm).\n",
171158
"\n",
172159
"The `geoanalytics` module presents various tools grouped into submodules:\n",
173-
" - the [`arcgis.geoanalytics.analyze_patterns`](https://esri.github.io/arcgis-python-api/apidoc/html/arcgis.geoanalytics.analyze_patterns.html) module provides tools that help you identify, quantify and visualize spatial patterns in your data.\n",
174-
" - the [`arcgis.geoanalytics.find_locations`](https://esri.github.io/arcgis-python-api/apidoc/html/arcgis.geoanalytics.find_locations.html) module provides tools that help you identify areas or fetures that meet any number of criteria you specify.\n",
160+
" - the [`arcgis.geoanalytics.analyze_patterns`](https://esri.github.io/arcgis-python-api/apidoc/html/arcgis.geoanalytics.analyze_patterns.html) module provides tools that help you identify, quantify, and visualize spatial patterns in your data.\n",
161+
" - the [`arcgis.geoanalytics.find_locations`](https://esri.github.io/arcgis-python-api/apidoc/html/arcgis.geoanalytics.find_locations.html) module provides tools that help you identify areas or features that meet any number of criteria you specify.\n",
175162
" - the [`arcgis.geoanalytics.manage_data`](https://esri.github.io/arcgis-python-api/apidoc/html/arcgis.geoanalytics.manage_data.html) module provides tools for the day-to-day management of geographic and tabular data.\n",
176-
" - the [`arcgis.geoanalytics.summarize_data`](https://esri.github.io/arcgis-python-api/apidoc/html/arcgis.geoanalytics.summarize_data.html) module provides tools that output descriptive statistics of features and their attributes based on spatial relationships to other features.\n",
177-
" - the [`arcgis.geoanalytics.use_proximity`](https://esri.github.io/arcgis-python-api/apidoc/html/arcgis.geoanalytics.use_proximity.html) module provides tools that define geometries to help analyze what features are near what other features."
163+
" - the [`arcgis.geoanalytics.summarize_data`](https://esri.github.io/arcgis-python-api/apidoc/html/arcgis.geoanalytics.summarize_data.html) module provides tools that output descriptive statistics of features and their attributes based on spatial relationships to other features.\n",
164+
" - the [`arcgis.geoanalytics.use_proximity`](https://esri.github.io/arcgis-python-api/apidoc/html/arcgis.geoanalytics.use_proximity.html) module provides tools that define geometries to help analyze which features are near other features."
178165
]
179166
},
180167
{
@@ -188,7 +175,14 @@
188175
"cell_type": "markdown",
189176
"metadata": {},
190177
"source": [
191-
"<center>Data that was previously too big or too complex to analyze can now be deeply examined, understood and used to take action. "
178+
"<center>Data that was previously too big or too complex to analyze can now be deeply examined, understood, and used to take action. "
179+
]
180+
},
181+
{
182+
"cell_type": "markdown",
183+
"metadata": {},
184+
"source": [
185+
"In this guide, we have gained familiarity with how to utilize GeoAnalytics server to analyze big data. In the next guide, we will learn how data can be made accessible to the GeoAnalytics server.\n"
192186
]
193187
}
194188
],
@@ -208,20 +202,7 @@
208202
"name": "python",
209203
"nbconvert_exporter": "python",
210204
"pygments_lexer": "ipython3",
211-
"version": "3.8.2"
212-
},
213-
"toc": {
214-
"base_numbering": 1,
215-
"nav_menu": {},
216-
"number_sections": true,
217-
"sideBar": true,
218-
"skip_h1_title": false,
219-
"title_cell": "Table of Contents",
220-
"title_sidebar": "Contents",
221-
"toc_cell": true,
222-
"toc_position": {},
223-
"toc_section_display": true,
224-
"toc_window_display": true
205+
"version": "3.7.11"
225206
}
226207
},
227208
"nbformat": 4,

0 commit comments

Comments
 (0)