Skip to main content

Import or Clone OSS Directory

info

oss-directory contains structured data on as many open source projects as possible, enumerating all artifacts related to the project, from source code repositories to published packages and deployments. You can get the data via our npm library, python package, or downloading the data directly from GitHub.

Import as a Library​

We have also published this repository as a library that you can use in your own projects. This is useful if you want to build a tool that uses the data in this repository or perform your own custom analysis.

We have libraries for JavaScript and Python. We don't store the entire dataset with the package. Under the hood, this will clone the repository into a temporary directory, read all the data files, validate the schema, and return the objects. This way, you know you're getting the latest data, even if the package hasn't been updated in a while.

Note: These do not work in a browser-environment

JavaScript library​

npm page

Installation​

Install the library

npm install oss-directory
# OR yarn add oss-directory
# OR pnpm add oss-directory

Fetch all of the data​

You can fetch all of the data in this repo with the following:

import { Project, Collection, fetchData } from "oss-directory";

const data = await fetchData();
const projects: Project[] = data.projects;
const collections: Collection[] = data.collections;

Utility functions​

We also include functions for casting and validating data:

  • validateProject
  • validateCollection
  • safeCastProject
  • safeCastCollection

Python library​

PyPI page

Installation​

Install the library

pip install oss-directory
# OR poetry add oss-directory

Fetch all of the data​

You can fetch all of the data in this repo with the following:

from ossdirectory import fetch_data
from ossdirectory.fetch import OSSDirectory

data: OSSDirectory = fetch_data()
projects: List[dict] = data.projects;
collections: List[dict] = data.collections;

Direct Download from GitHub​

All of the data is accessible from directly GitHub. You can download oss-directory directly from GitHub.

Or, clone the repository from the command line:

$ git clone https://github.com/opensource-observer/oss-directory.git

Feel free to use the data in your own projects!