Forums : Ohloh General Discussion
Dear Open Hub Users,
We’re excited to announce that we will be moving the Open Hub Forum to
https://community.blackduck.com/s/black-duck-open-hub.
Beginning immediately, users can head over,
register,
get technical help and discuss issue pertinent to the Open Hub. Registered users can also subscribe to Open Hub announcements here.
On May 1, 2020, we will be freezing https://www.openhub.net/forums and users will not be able to create new discussions. If you have any questions and concerns, please email us at
[email protected]
new project - waiting in queue
hi,
yesterday I browsed the site after a long time and I was impressed by the improvements. I also singed up and registered my project. I know that patience is good, but obviously I am longing to see the stats. What I see is waiting in queue
for the progress. Any idea to make this a little more informative? E.g. by telling the queue position and an estimate?
Stefan
Thanks for the kind words.
Unfortunately, you've arrived at an awkward time. We're moving to a new database server today, so we've been throttling back the activity on our server farm in anticipation of the move. After the switch, we should be able to download projects much faster than before. We've had a lot of requests for a more informative queue status, but we hope that soon we'll be updating projects so quickly that queue status will be unimportant.
It looks like your projects are right at the top of the queue, so I'll go out on a limb and predict that your reports will finish sometime tonight -- assuming our database transition goes smoothly. :-)
Thanks,
Robin
Hi Harm,
Thanks for registering TPTP and discussing Ohloh with other Eclipse folks. After you posted this, I gave the stalled job a poke and it looks like the analysis has finished. Let me know if there's anything else I can do.
-Andy
Andy, I notice that new projects (that used to have higher priority in the queue over existing projects) now are stalled too. I wonder if this is deliberate or just a problem of server workload.
Maybe what Ohloh needs is a more flexible way of scheduling updates. I suggested a few weeks ago some ideas on how to improve the update priority. I don't know if this makes sense or is technically feasible, but here's how I envision this (in decreasing order of importance):
- Give priority to new projects over existing projects for their first crawl: I think it's sensible for new submitters as a proof of concept of what Ohloh does not to have to wait days for a new project to be crawled.
- Give priority to projects with high recent activity: if you can monitor the volume of recent changes of a project, then you can maybe determine the frequency with which a project needs to be updated. Does it make sense to schedule the update of old, unmaintained projects with the same frequency as projects with a lot of activity?
- Give priority to several projects with smaller codebases than single projects with huge codebases: if you have to decide between downloading a whole linux distribution or several smaller projects that take about the same server workload, maybe it's sensible to give priority to the latter.
How does this sound?
Hi dartar,
We do still prioritize new projects over updates to existing projects.
This is a server workload issue. We've been blessed with an immense increase in traffic in the last few weeks, and the new projects queue is seemingly always full.
We have been catching up over the last few days, and updates to existing projects are starting to happen again. We have a large new database server we are ready to install, and we are working out some issues to bring more download servers online.
When the new projects queue is empty, we can update our entire system in less than a day. If only we could keep up with the new projects queue....
Robin