Skip to content

Commit

Permalink
Add sidebar
Browse files Browse the repository at this point in the history
updated refs and sidebar

Update .sqlfluffignore
  • Loading branch information
jenningsanderson committed Jan 28, 2025
1 parent f9a296c commit 1a9d769
Show file tree
Hide file tree
Showing 5 changed files with 146 additions and 141 deletions.
120 changes: 60 additions & 60 deletions docs/getting-data/bigquery.mdx
Original file line number Diff line number Diff line change
@@ -1,19 +1,19 @@
---
title: Google BigQuery
title: BigQuery (Google)
---

Overture data is accessible in Google BigQuery as part of the [Google Cloud Public Dataset Program](https://cloud.google.com/bigquery/public-data), with the data being listed and maintained by [CARTO](https.//www.carto.com).
Overture data is accessible in Google BigQuery as part of the [Google Cloud Public Dataset Program](https://cloud.google.com/bigquery/public-data), with the data being listed and maintained by [CARTO](https://www.carto.com).


<img
src="../../static/img/getting-data/BigQuery-1.png"
alt="Overture data in Google Cloud"
width="900"
height="auto"
<img
src="/img/getting-data/BigQuery-1.png"
alt="Overture data in Google Cloud"
width="900"
height="auto"
/>


Below is a step-by-step guide on how to access and use Overture data in BigQuery:
Below is a step-by-step guide on how to access and use Overture data in BigQuery:

## Before you begin

Expand All @@ -24,114 +24,114 @@ To get started using Overture data in BigQuery, you must create or select a Goog
2. Navigate to the **BigQuery** section by selecting `BigQuery` from the side menu or searching for it in the search bar.


<img
src="../../static/img/getting-data/bigquery-2.png"
alt="Overture data in Google Cloud"
width="900"
height="auto"
<img
src="/img/getting-data/bigquery-2.png"
alt="Overture data in Google Cloud"
width="900"
height="auto"
/>


3. In the BigQuery console, click **Add Data**. Then, click on **Public Datasets**.


<img
src="../../static/img/getting-data/bigquery-4.png"
alt="Overture data in Google Cloud"
width="900"
height="auto"
<img
src="/img/getting-data/bigquery-4.png"
alt="Overture data in Google Cloud"
width="900"
height="auto"
/>


4. The Google Cloud data marketplace will open. In the search box look for **Overture Maps**.
4. The Google Cloud data marketplace will open. In the search box look for **Overture Maps**.


<img
src="../../static/img/getting-data/bigquery-5.png"
alt="Overture data in Google Cloud"
width="900"
height="auto"
<img
src="/img/getting-data/bigquery-5.png"
alt="Overture data in Google Cloud"
width="900"
height="auto"
/>


5. Select the **Overture Maps Data** listing. Then, click on **View dataset**.
5. Select the **Overture Maps Data** listing. Then, click on **View dataset**.


<img
src="../../static/img/getting-data/bigquery-6.png"
alt="Overture data in Google Cloud"
width="900"
height="auto"
<img
src="/img/getting-data/bigquery-6.png"
alt="Overture data in Google Cloud"
width="900"
height="auto"
/>


6. Back again in the BigQuery console you will see the `bigquery-public-data` project and the `overture_maps`dataset selected.
6. Back again in the BigQuery console you will see the `bigquery-public-data` project and the `overture_maps`dataset selected.


<img
src="../../static/img/getting-data/bigquery-7.png"
alt="Overture data in Google Cloud"
width="900"
height="auto"
<img
src="/img/getting-data/bigquery-7.png"
alt="Overture data in Google Cloud"
width="900"
height="auto"
/>


7. Our recommendation is that you add the `overture_maps` dataset or entirely the `bigquery-public-data` project in your starred selection in order to have access to the Overture data always at hand.


<img
src="../../static/img/getting-data/bigquery-8.png"
alt="Overture data in Google Cloud"
width="900"
height="auto"
<img
src="/img/getting-data/bigquery-8.png"
alt="Overture data in Google Cloud"
width="900"
height="auto"
/>


## Working with Overture Data in BigQuery

8. Now that Overture Maps data is available in your BigQuery console, you can start using it. Note that in the `overture_maps` dataset you have access to all tables from all the different Overture Maps themes: Addresses, Base, Buildings, Divisions, Places and Transporatation.
8. Now that Overture Maps data is available in your BigQuery console, you can start using it. Note that in the `overture_maps` dataset you have access to all tables from all the different Overture Maps themes: Addresses, Base, Buildings, Divisions, Places and Transporatation.


<img
src="../../static/img/getting-data/bigquery-9.png"
alt="Overture data in Google Cloud"
width="900"
height="auto"
<img
src="/img/getting-data/bigquery-9.png"
alt="Overture data in Google Cloud"
width="900"
height="auto"
/>


9. The release version is detailed as a `label` in each of the tables. You can check it out in the **Details** section of each table.


<img
src="../../static/img/getting-data/bigquery-10.png"
alt="Overture data in Google Cloud"
width="900"
height="auto"
<img
src="/img/getting-data/bigquery-10.png"
alt="Overture data in Google Cloud"
width="900"
height="auto"
/>


10. You can now query any of the tables directly from your SQL Editor in BigQuery. Here's one example for the Places data in Overture Maps.


<img
src="../../static/img/getting-data/bigquery-11.png"
alt="Overture data in Google Cloud"
width="900"
height="auto"
<img
src="/img/getting-data/bigquery-11.png"
alt="Overture data in Google Cloud"
width="900"
height="auto"
/>


```sql
// Identify places within the "Restaurant" category
SELECT id, phones.list[0].element AS phone, names.primary AS name
FROM `bigquery-public-data.overture_maps.place`
SELECT id, phones.list[0].element AS phone, names.primary AS name
FROM `bigquery-public-data.overture_maps.place`
WHERE categories.primary = "restaurant"
LIMIT 100;
```

## Additional Notes

- **Updates**: CARTO regularly updates the Overture datasets in BigQuery and keeps the dataset synced with the last release. You can check the release version of the data as a metadata label in each table.
- **Updates**: CARTO regularly updates the Overture datasets in BigQuery and keeps the dataset synced with the last release. You can check the release version of the data as a metadata label in each table.
- **Support**: If you encounter issues accessing the data, contact CARTO support via [email protected].
- **CARTO**: Once you have the Overture data you need in BigQuery, you can use CARTO's cloud-native spatial analytics platform running on your BigQuery account to build interactive maps, data procesing and analytical workflows or geospatial applications. Not yet on CARTO? Open a 14-day free trial [here](https://www.carto.com/signup).
96 changes: 48 additions & 48 deletions docs/getting-data/databricks.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
title: Databricks
---

Overture data is accessible through the [Databricks Marketplace](https://marketplace.databricks.com/?searchKey=CARTO&sortBy=date) via public listings published and maintained by [CARTO](https.//www.carto.com). Below is a step-by-step guide on how to access and use the data:
Overture data is accessible through the [Databricks Marketplace](https://marketplace.databricks.com/?searchKey=CARTO&sortBy=date) via public listings published and maintained by [CARTO](https://www.carto.com). Below is a step-by-step guide on how to access and use the data:

## Before you begin
Before accessing the Overture Maps data in Databricks, ensure you have:
Expand All @@ -17,78 +17,78 @@ Before accessing the Overture Maps data in Databricks, ensure you have:
2. From the Databricks workspace home page, navigate to the **Databricks Marketplace** by selecting the **Marketplace** tab from the sidebar.


<img
src="../../static/img/getting-data/databricks-1.png"
alt="Databricks Marketplace"
width="900"
height="auto"
<img
src="/img/getting-data/databricks-1.png"
alt="Databricks Marketplace"
width="900"
height="auto"
/>


3. Use the search bar in the Databricks Marketplace to search for `CARTO` or `Overture Maps`.


<img
src="../../static/img/getting-data/databricks-2.png"
alt="Databricks Marketplace"
width="900"
height="auto"
<img
src="/img/getting-data/databricks-2.png"
alt="Databricks Marketplace"
width="900"
height="auto"
/>


4. The listings have been organized by Overture theme; therefore, you will find the following listings available: Addresses, Base, Buildings, Divisions, Places and Transportation. Select one to access the listing details.


<img
src="../../static/img/getting-data/databricks-3.png"
alt="Databricks Marketplace"
width="900"
height="auto"
<img
src="/img/getting-data/databricks-3.png"
alt="Databricks Marketplace"
width="900"
height="auto"
/>


5. Review the dataset description, terms of use, and any documentation provided by CARTO.
6. Click **Get instant access** to request access to the dataset.


<img
src="../../static/img/getting-data/databricks-4.png"
alt="Databricks Marketplace"
width="900"
height="auto"
<img
src="/img/getting-data/databricks-4.png"
alt="Databricks Marketplace"
width="900"
height="auto"
/>


7. Before you get access you can specify where are you planning to use the data and also provide a custom name to the Databricks Catalog in which the data will be made available. After accepting the terms, click on **Get instant access**.


<img
src="../../static/img/getting-data/databricks-5.png"
alt="Databricks Marketplace"
width="900"
height="auto"
<img
src="/img/getting-data/databricks-5.png"
alt="Databricks Marketplace"
width="900"
height="auto"
/>


8. Now, in the same listing page you have the option to click on **Open**.


<img
src="../../static/img/getting-data/databricks-6.png"
alt="Databricks Marketplace"
width="900"
height="auto"
<img
src="/img/getting-data/databricks-6.png"
alt="Databricks Marketplace"
width="900"
height="auto"
/>


9. After clicking on **Open** you will be taken to your Catalogs with the newly created Catalog `carto_overtue_maps_places`open.


<img
src="../../static/img/getting-data/databricks-7.png"
alt="Databricks Marketplace"
width="900"
height="auto"
<img
src="/img/getting-data/databricks-7.png"
alt="Databricks Marketplace"
width="900"
height="auto"
/>


Expand All @@ -97,28 +97,28 @@ Before accessing the Overture Maps data in Databricks, ensure you have:
10. Once you have the Overture Maps data that you need in your Catalogs you can start working with it. Following our example, in the Place table you can click on **Create** and then **Query**.


<img
src="../../static/img/getting-data/databricks-8.png"
alt="Databricks Marketplace"
width="900"
height="auto"
<img
src="/img/getting-data/databricks-8.png"
alt="Databricks Marketplace"
width="900"
height="auto"
/>


11. That will open the SQL Editor ready to query the `place` table.


<img
src="../../static/img/getting-data/databricks-9.png"
alt="Databricks Marketplace"
width="900"
height="auto"
<img
src="/img/getting-data/databricks-9.png"
alt="Databricks Marketplace"
width="900"
height="auto"
/>


## Additional Notes

- **Updates**: CARTO regularly updates the Overture datasets in Databricks and keeps the listings synced with the last release. You can check the release version of the data from the share description in each listing.
- **Updates**: CARTO regularly updates the Overture datasets in Databricks and keeps the listings synced with the last release. You can check the release version of the data from the share description in each listing.
- **Support**: If you encounter issues accessing the data, contact CARTO support via [email protected].
- **CARTO**: Once you have the Overture data you need in Databricks, you can use CARTO's cloud-native spatial analytics platform running on your Databricks account to build interactive maps, data procesing and analytical workflows or geospatial applications. Not yet on CARTO? Open a 14-day free trial [here](https://www.carto.com/signup).
- **Databricks**: For more information on Databricks Marketplace, refer to the official [Databricks documentation](https://docs.databricks.com/en/marketplace/index.html).
Loading

0 comments on commit 1a9d769

Please sign in to comment.