Let’s walk through the process of setting up this interactive timeline (embedded below) based on CKAN‘s version release history.
While exploring new tools for developing my monthly presentation as a Data Engineering Intern at datHere, I found TimelineJS while searching on GitHub for showcasing my work in a timeline format. I customized the timeline styles locally and integrated the timeline as the final slide in my presentation I built with sli.dev.
During the presentation, our team at datHere decided to make a timeline using TimelineJS for the open-source data management system CKAN as part of the Pathways to Enable Open-Source Ecosystems (POSE) project.
TimelineJS has step-by-step instructions on how to make a timeline website using a spreadsheet from Google Sheets as your data source, so I simply followed the steps.
Your timeline website also updates after making changes to the spreadsheet, and by following the steps you’ll get a link to your hosted timeline and embed code for inserting the timeline in blog posts, websites, and more.
There are two main ways to import data into a timeline: Google Sheets or JSON. Considering Google Sheets to be more user-friendly and collaborative than working on a JSON file locally, we decided on the former as our data source.
But two questions remained:
An initial suggestion from the team was to gather the commit history from the repository and port them into the timeline. As of the time of writing this article, there are 24,906 commits in the master branch of the ckan/ckan GitHub Repository. This would result in a timeline that could be hard to follow (commit messages aren’t always the most descriptive) were we to continue with this idea without further improvements (e.g. using a large-language model to generate release summaries based on the commit data).
Conveniently, there is a CHANGELOG.rst file in the GitHub repository for CKAN consolidating all release versions including each of their dates and changes made in a more readable format. The file is written in a format similar to Markdown, so I decided to build a Python script.
The following is the final iteration of a Python script to convert the
CHANGELOG.rst data into CSV format which we could import into our spreadsheet.
The first iteration of the script did not convert the data into HTML format but instead provided the raw changelog output. We learned that TimelineJS allows for rendering HTML in certain columns including a row’s
Text field, which includes the description for a release of CKAN. Therefore, I used the
markdown package to convert each line into HTML format since the input was akin to Markdown styling.
There are some caveats with this method of conversion.
.rstformat or for rendering the data on a changelog page on CKAN’s docs site) that were not covered in the conversion properly.
<li>), though this is fine since we can reuse the script by writing the release description in Markdown if revising it.
dayvalue so they were removed from CHANGELOG.rst and manually inputted into the timeline (though this can be fixed by editing the script).
CHANGELOG.rstfile, so any modifications made would need to be updated in the Google Sheet including new version releases. An automation system is definitely possible though.
.mdhaving similarities and differences in syntax.
Regardless, the output CSV was usable for importing into the spreadsheet and can be updated by reusing the script or directly within the timeline. Simply copying and pasting each column’s data from the CSV to the same named column in the Google Sheets spreadsheet worked well!
I also added eras to the timeline which add colors for the major release sections such as v0.X/v1.X/v2.X Releases.
The timeline was presented at the July CKAN Monthly Live by the POSE team to members of the CKAN community. You may view the timeline at the top of this blog post & a more succinct outline of the major/minor releases on this other blog post from the datHere team.
Developer who enjoys building projects & sharing what I learn.