Documentation - Data Model

The Eclipse Metrics program relies on the excellent GrimoireLab toolchain for its data retrieval process.

GrimoireLab Data sources

We retrieve data from the following sources:

Git: wherever the project is hosted, it all boils down to a git repository. This connector gathers information at the git repository level. See the GrimoireLab documentation for this data source on the official GrimoireLab page .
GitHub provides project management features on top of a git repository, like issues and pull requests. It also offers a specific API providing project-level information like stars, forks, repository statistics, and more. See the full description of GitHub-specific data sources on GrimoireLab’s documentation .
GitLab also provides project management like issues and merge requests. See the full description of GitLab-specific data sources on GrimoireLab’s documentation .
Mailing lists provide insights about the activity of the project, number of emails sent, replies, etc. All Eclipse projects have at least one dev mailing list (e.g. -dev@eclipse.org), and potentially one or more for user interactions. Please note that nowadays many projects and people tend to use others communication media, like issues (on GitLab or GitHub) or conversations (on GitHub).

We also gather metrics from public Eclipse APIs and endpoints. These include:

Information from the Eclipse Project Management Infrastructure (PMI): releases, reviews, project relationships.. They are displayed at the project and working group levels.
IP Lab requests from the EMO IP digilence team issue tracker. These are used to assess the licence and IP compliance of any third-party dependency, and can be downloaded for all Eclipse projects.

We maintain the following indices for the Git connector. See also the reference documentation

git - Commits of the Git repository
git_areas_of_code - File modifications involved in each commit of the repository

We maintain the following indices for the GitHub connector. See also the reference documentation

git - Commits of the GitHub repository
git_areas_of_code - File modifications involved in each commit of the repository
github_events - GitHub event, it is possible to distinguish them by using the field event_type
github_issues - GitHub issues and pull requests
github_pull_requests - Github pull requests, one per document
github_repos - Basic stats for GitHub repositories, one per document
github2_issues - One document per GitHub issue or issue comment
github2_pull_requests - One document per pull request or comment

We maintain the following indices for the GitLab connector. See also the reference documentation .

git - Commits of the GitLab repository
git_areas_of_code - File modifications involved in each commit of the repository
gitlab_issues - Issues of a GitLab project, one issue per document
gitlab_merge_requests - Merge requests of a GitLab project, one merge request per document