-
Notifications
You must be signed in to change notification settings - Fork 17
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
updated refs and sidebar Update .sqlfluffignore
- Loading branch information
1 parent
f9a296c
commit 1a9d769
Showing
5 changed files
with
146 additions
and
141 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,19 +1,19 @@ | ||
--- | ||
title: Google BigQuery | ||
title: BigQuery (Google) | ||
--- | ||
|
||
Overture data is accessible in Google BigQuery as part of the [Google Cloud Public Dataset Program](https://cloud.google.com/bigquery/public-data), with the data being listed and maintained by [CARTO](https.//www.carto.com). | ||
Overture data is accessible in Google BigQuery as part of the [Google Cloud Public Dataset Program](https://cloud.google.com/bigquery/public-data), with the data being listed and maintained by [CARTO](https://www.carto.com). | ||
|
||
|
||
<img | ||
src="../../static/img/getting-data/BigQuery-1.png" | ||
alt="Overture data in Google Cloud" | ||
width="900" | ||
height="auto" | ||
<img | ||
src="/img/getting-data/BigQuery-1.png" | ||
alt="Overture data in Google Cloud" | ||
width="900" | ||
height="auto" | ||
/> | ||
|
||
|
||
Below is a step-by-step guide on how to access and use Overture data in BigQuery: | ||
Below is a step-by-step guide on how to access and use Overture data in BigQuery: | ||
|
||
## Before you begin | ||
|
||
|
@@ -24,114 +24,114 @@ To get started using Overture data in BigQuery, you must create or select a Goog | |
2. Navigate to the **BigQuery** section by selecting `BigQuery` from the side menu or searching for it in the search bar. | ||
|
||
|
||
<img | ||
src="../../static/img/getting-data/bigquery-2.png" | ||
alt="Overture data in Google Cloud" | ||
width="900" | ||
height="auto" | ||
<img | ||
src="/img/getting-data/bigquery-2.png" | ||
alt="Overture data in Google Cloud" | ||
width="900" | ||
height="auto" | ||
/> | ||
|
||
|
||
3. In the BigQuery console, click **Add Data**. Then, click on **Public Datasets**. | ||
|
||
|
||
<img | ||
src="../../static/img/getting-data/bigquery-4.png" | ||
alt="Overture data in Google Cloud" | ||
width="900" | ||
height="auto" | ||
<img | ||
src="/img/getting-data/bigquery-4.png" | ||
alt="Overture data in Google Cloud" | ||
width="900" | ||
height="auto" | ||
/> | ||
|
||
|
||
4. The Google Cloud data marketplace will open. In the search box look for **Overture Maps**. | ||
4. The Google Cloud data marketplace will open. In the search box look for **Overture Maps**. | ||
|
||
|
||
<img | ||
src="../../static/img/getting-data/bigquery-5.png" | ||
alt="Overture data in Google Cloud" | ||
width="900" | ||
height="auto" | ||
<img | ||
src="/img/getting-data/bigquery-5.png" | ||
alt="Overture data in Google Cloud" | ||
width="900" | ||
height="auto" | ||
/> | ||
|
||
|
||
5. Select the **Overture Maps Data** listing. Then, click on **View dataset**. | ||
5. Select the **Overture Maps Data** listing. Then, click on **View dataset**. | ||
|
||
|
||
<img | ||
src="../../static/img/getting-data/bigquery-6.png" | ||
alt="Overture data in Google Cloud" | ||
width="900" | ||
height="auto" | ||
<img | ||
src="/img/getting-data/bigquery-6.png" | ||
alt="Overture data in Google Cloud" | ||
width="900" | ||
height="auto" | ||
/> | ||
|
||
|
||
6. Back again in the BigQuery console you will see the `bigquery-public-data` project and the `overture_maps`dataset selected. | ||
6. Back again in the BigQuery console you will see the `bigquery-public-data` project and the `overture_maps`dataset selected. | ||
|
||
|
||
<img | ||
src="../../static/img/getting-data/bigquery-7.png" | ||
alt="Overture data in Google Cloud" | ||
width="900" | ||
height="auto" | ||
<img | ||
src="/img/getting-data/bigquery-7.png" | ||
alt="Overture data in Google Cloud" | ||
width="900" | ||
height="auto" | ||
/> | ||
|
||
|
||
7. Our recommendation is that you add the `overture_maps` dataset or entirely the `bigquery-public-data` project in your starred selection in order to have access to the Overture data always at hand. | ||
|
||
|
||
<img | ||
src="../../static/img/getting-data/bigquery-8.png" | ||
alt="Overture data in Google Cloud" | ||
width="900" | ||
height="auto" | ||
<img | ||
src="/img/getting-data/bigquery-8.png" | ||
alt="Overture data in Google Cloud" | ||
width="900" | ||
height="auto" | ||
/> | ||
|
||
|
||
## Working with Overture Data in BigQuery | ||
|
||
8. Now that Overture Maps data is available in your BigQuery console, you can start using it. Note that in the `overture_maps` dataset you have access to all tables from all the different Overture Maps themes: Addresses, Base, Buildings, Divisions, Places and Transporatation. | ||
8. Now that Overture Maps data is available in your BigQuery console, you can start using it. Note that in the `overture_maps` dataset you have access to all tables from all the different Overture Maps themes: Addresses, Base, Buildings, Divisions, Places and Transporatation. | ||
|
||
|
||
<img | ||
src="../../static/img/getting-data/bigquery-9.png" | ||
alt="Overture data in Google Cloud" | ||
width="900" | ||
height="auto" | ||
<img | ||
src="/img/getting-data/bigquery-9.png" | ||
alt="Overture data in Google Cloud" | ||
width="900" | ||
height="auto" | ||
/> | ||
|
||
|
||
9. The release version is detailed as a `label` in each of the tables. You can check it out in the **Details** section of each table. | ||
|
||
|
||
<img | ||
src="../../static/img/getting-data/bigquery-10.png" | ||
alt="Overture data in Google Cloud" | ||
width="900" | ||
height="auto" | ||
<img | ||
src="/img/getting-data/bigquery-10.png" | ||
alt="Overture data in Google Cloud" | ||
width="900" | ||
height="auto" | ||
/> | ||
|
||
|
||
10. You can now query any of the tables directly from your SQL Editor in BigQuery. Here's one example for the Places data in Overture Maps. | ||
|
||
|
||
<img | ||
src="../../static/img/getting-data/bigquery-11.png" | ||
alt="Overture data in Google Cloud" | ||
width="900" | ||
height="auto" | ||
<img | ||
src="/img/getting-data/bigquery-11.png" | ||
alt="Overture data in Google Cloud" | ||
width="900" | ||
height="auto" | ||
/> | ||
|
||
|
||
```sql | ||
// Identify places within the "Restaurant" category | ||
SELECT id, phones.list[0].element AS phone, names.primary AS name | ||
FROM `bigquery-public-data.overture_maps.place` | ||
SELECT id, phones.list[0].element AS phone, names.primary AS name | ||
FROM `bigquery-public-data.overture_maps.place` | ||
WHERE categories.primary = "restaurant" | ||
LIMIT 100; | ||
``` | ||
|
||
## Additional Notes | ||
|
||
- **Updates**: CARTO regularly updates the Overture datasets in BigQuery and keeps the dataset synced with the last release. You can check the release version of the data as a metadata label in each table. | ||
- **Updates**: CARTO regularly updates the Overture datasets in BigQuery and keeps the dataset synced with the last release. You can check the release version of the data as a metadata label in each table. | ||
- **Support**: If you encounter issues accessing the data, contact CARTO support via [email protected]. | ||
- **CARTO**: Once you have the Overture data you need in BigQuery, you can use CARTO's cloud-native spatial analytics platform running on your BigQuery account to build interactive maps, data procesing and analytical workflows or geospatial applications. Not yet on CARTO? Open a 14-day free trial [here](https://www.carto.com/signup). |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -2,7 +2,7 @@ | |
title: Databricks | ||
--- | ||
|
||
Overture data is accessible through the [Databricks Marketplace](https://marketplace.databricks.com/?searchKey=CARTO&sortBy=date) via public listings published and maintained by [CARTO](https.//www.carto.com). Below is a step-by-step guide on how to access and use the data: | ||
Overture data is accessible through the [Databricks Marketplace](https://marketplace.databricks.com/?searchKey=CARTO&sortBy=date) via public listings published and maintained by [CARTO](https://www.carto.com). Below is a step-by-step guide on how to access and use the data: | ||
|
||
## Before you begin | ||
Before accessing the Overture Maps data in Databricks, ensure you have: | ||
|
@@ -17,78 +17,78 @@ Before accessing the Overture Maps data in Databricks, ensure you have: | |
2. From the Databricks workspace home page, navigate to the **Databricks Marketplace** by selecting the **Marketplace** tab from the sidebar. | ||
|
||
|
||
<img | ||
src="../../static/img/getting-data/databricks-1.png" | ||
alt="Databricks Marketplace" | ||
width="900" | ||
height="auto" | ||
<img | ||
src="/img/getting-data/databricks-1.png" | ||
alt="Databricks Marketplace" | ||
width="900" | ||
height="auto" | ||
/> | ||
|
||
|
||
3. Use the search bar in the Databricks Marketplace to search for `CARTO` or `Overture Maps`. | ||
|
||
|
||
<img | ||
src="../../static/img/getting-data/databricks-2.png" | ||
alt="Databricks Marketplace" | ||
width="900" | ||
height="auto" | ||
<img | ||
src="/img/getting-data/databricks-2.png" | ||
alt="Databricks Marketplace" | ||
width="900" | ||
height="auto" | ||
/> | ||
|
||
|
||
4. The listings have been organized by Overture theme; therefore, you will find the following listings available: Addresses, Base, Buildings, Divisions, Places and Transportation. Select one to access the listing details. | ||
|
||
|
||
<img | ||
src="../../static/img/getting-data/databricks-3.png" | ||
alt="Databricks Marketplace" | ||
width="900" | ||
height="auto" | ||
<img | ||
src="/img/getting-data/databricks-3.png" | ||
alt="Databricks Marketplace" | ||
width="900" | ||
height="auto" | ||
/> | ||
|
||
|
||
5. Review the dataset description, terms of use, and any documentation provided by CARTO. | ||
6. Click **Get instant access** to request access to the dataset. | ||
|
||
|
||
<img | ||
src="../../static/img/getting-data/databricks-4.png" | ||
alt="Databricks Marketplace" | ||
width="900" | ||
height="auto" | ||
<img | ||
src="/img/getting-data/databricks-4.png" | ||
alt="Databricks Marketplace" | ||
width="900" | ||
height="auto" | ||
/> | ||
|
||
|
||
7. Before you get access you can specify where are you planning to use the data and also provide a custom name to the Databricks Catalog in which the data will be made available. After accepting the terms, click on **Get instant access**. | ||
|
||
|
||
<img | ||
src="../../static/img/getting-data/databricks-5.png" | ||
alt="Databricks Marketplace" | ||
width="900" | ||
height="auto" | ||
<img | ||
src="/img/getting-data/databricks-5.png" | ||
alt="Databricks Marketplace" | ||
width="900" | ||
height="auto" | ||
/> | ||
|
||
|
||
8. Now, in the same listing page you have the option to click on **Open**. | ||
|
||
|
||
<img | ||
src="../../static/img/getting-data/databricks-6.png" | ||
alt="Databricks Marketplace" | ||
width="900" | ||
height="auto" | ||
<img | ||
src="/img/getting-data/databricks-6.png" | ||
alt="Databricks Marketplace" | ||
width="900" | ||
height="auto" | ||
/> | ||
|
||
|
||
9. After clicking on **Open** you will be taken to your Catalogs with the newly created Catalog `carto_overtue_maps_places`open. | ||
|
||
|
||
<img | ||
src="../../static/img/getting-data/databricks-7.png" | ||
alt="Databricks Marketplace" | ||
width="900" | ||
height="auto" | ||
<img | ||
src="/img/getting-data/databricks-7.png" | ||
alt="Databricks Marketplace" | ||
width="900" | ||
height="auto" | ||
/> | ||
|
||
|
||
|
@@ -97,28 +97,28 @@ Before accessing the Overture Maps data in Databricks, ensure you have: | |
10. Once you have the Overture Maps data that you need in your Catalogs you can start working with it. Following our example, in the Place table you can click on **Create** and then **Query**. | ||
|
||
|
||
<img | ||
src="../../static/img/getting-data/databricks-8.png" | ||
alt="Databricks Marketplace" | ||
width="900" | ||
height="auto" | ||
<img | ||
src="/img/getting-data/databricks-8.png" | ||
alt="Databricks Marketplace" | ||
width="900" | ||
height="auto" | ||
/> | ||
|
||
|
||
11. That will open the SQL Editor ready to query the `place` table. | ||
|
||
|
||
<img | ||
src="../../static/img/getting-data/databricks-9.png" | ||
alt="Databricks Marketplace" | ||
width="900" | ||
height="auto" | ||
<img | ||
src="/img/getting-data/databricks-9.png" | ||
alt="Databricks Marketplace" | ||
width="900" | ||
height="auto" | ||
/> | ||
|
||
|
||
## Additional Notes | ||
|
||
- **Updates**: CARTO regularly updates the Overture datasets in Databricks and keeps the listings synced with the last release. You can check the release version of the data from the share description in each listing. | ||
- **Updates**: CARTO regularly updates the Overture datasets in Databricks and keeps the listings synced with the last release. You can check the release version of the data from the share description in each listing. | ||
- **Support**: If you encounter issues accessing the data, contact CARTO support via [email protected]. | ||
- **CARTO**: Once you have the Overture data you need in Databricks, you can use CARTO's cloud-native spatial analytics platform running on your Databricks account to build interactive maps, data procesing and analytical workflows or geospatial applications. Not yet on CARTO? Open a 14-day free trial [here](https://www.carto.com/signup). | ||
- **Databricks**: For more information on Databricks Marketplace, refer to the official [Databricks documentation](https://docs.databricks.com/en/marketplace/index.html). |
Oops, something went wrong.