Contribute Data
We're always looking for new data sources to integrate with OSO. Here are the current patterns for integrating new data sources:
- 🗂️ BigQuery Public Datasets - Preferred and easiest route for maintaining a dataset
- 🗄️ Database Replication - Provide access to your database for replication as an OSO dataset
- 🌐 API Crawling - Crawl an API by writing a plugin
- 📁 Files into Google Cloud Storage (GCS) - Drop Parquet/CSV files in our GCS bucket for loading into BigQuery
- ⚙️ Custom Dagster Assets - Write a custom Dagster asset for unique data sources
- 📜 Static Files - Coordinate hand-off for high-quality data via static files. This path is predominantly used for grant funding data.
- 🚫 (deprecated) Airbyte - A modern ELT tool
Reach out to us on Discord for help.