Hello everyone,
I am Karan Singh. I am a software engineer and recently had the privilege of working on the LHCb project. During my time in the CERN ecosystem, I have been a heavy user of Zenodo and have deeply admired how the InvenioRDM framework handles digital preservation at such a massive scale.
While using these tools, the significant scale and complexity of a full InvenioRDM instance can sometimes be a barrier for smaller university labs or individual researchers who wish to self-host a repository for their specific group. I validated this observation by looking into community forums and papers where developers were seeking more lightweight, accessible alternatives.
Based on this I built a self-hostable, lightweight Open Data Archive engine. I developed it primarily as a Proof of Concept (POC) for educational purposes, but also as a potential solution for small-scale groups who want Zenodo-like capabilities without the operational complexity.
I am particularly curious if the team has any advice on how I have handled the metadata extraction via Celery,in the real InvenioRDM, do you find that this asynchronous approach is sufficient for high-volume uploads, or are there specific edge cases I should be aware of for the future?
Unfortunately, we don’t have the resources to advise on other projects than Invenio, and this forum is available for Invenio related questions.