OSSD source is missing defillama, crates, and pypi columns

[ccerv1]

Which area(s) are affected? (leave empty if unsure)

No response

To Reproduce

View the expected columns from oss-directory:

from typing import Dict, List
from ossdirectory import fetch_data
from ossdirectory.fetch import OSSDirectory
data: OSSDirectory = fetch_data()
projects: List[dict] = data.projects
cols = {k for p in projects for k in p}

We see:

blockchain, crates, defillama, description, display_name, github, go, name, npm, open_collective, pypi, social, version, websites

Now view the columns in the dagster asset here: https://admin-dagster.opensource.observer/assets/ossd/projects

Describe the Bug

There are several artifact types that are included in the latest OSSD schema and that show when querying. These include:

• defillama
• crates
• pypi

As result, anything downstream from OSSD (including artifacts_by_projects models) does not capture all the artifacts

Expected Behavior

These artifacts should be getting pulled in via ossd.py and available in the source dataset

[linear]

OSO-487 OSSD source is missing defillama, crates, and pypi columns