Skip to content

Analyse streaming Wikipedia data with Materialize

Notifications You must be signed in to change notification settings

raphaelauv/materialize-wikidata

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Kafka and data producer

Create Redpanda cluster and UI

docker-compose up -d redpanda provectus-ui-local

Create topic

docker-compose up -d create_topic

Start producer

docker-compose up -d python_producer

Validate -> http://localhost:9029/ui/clusters/local/topics/recentchange/messages

Materialize

Start the database

docker-compose up -d materialized

DBT

cd wikidata_analysis/
dbt run --profiles-dir .
cd ..

website

docker-compose up -d backend

About

Analyse streaming Wikipedia data with Materialize

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 77.1%
  • Dockerfile 15.6%
  • HTML 7.3%