Forums : Technical Issue Help

Dear Open Hub Users,

We’re excited to announce that we will be moving the Open Hub Forum to https://community.synopsys.com/s/black-duck-open-hub. Beginning immediately, users can head over, register, get technical help and discuss issue pertinent to the Open Hub. Registered users can also subscribe to Open Hub announcements here.


On May 1, 2020, we will be freezing https://www.openhub.net/forums and users will not be able to create new discussions. If you have any questions and concerns, please email us at [email protected]

GNU Emacs enlistment in step 2 of 3 for weeks or months

The GNU Emacs project (https://www.ohloh.net/p/emacs) still has no source code statistics at all. The official BZR repository is stuck in step 2 of 3 since several weeks (or even month) and doesn't appear to finish anytime soon...

I added the Git mirror as alternative just now, but that says Ohloh update completed 3 months ago. and still no statistics are shown.

What's the matter?

Tassilo Horn about 13 years ago
 

Tassilo,

The reason that things haven't improved is that now both enlistments must succeed before the code is analyzed. Any failure of either will hang up the analysis.

I have re-fetched the Bazaar enlistment and the process is continuing. I'll add an additional response here once all jobs have finished. Once that happens, please check the statistics for accuracy (in case everything appears double) and then we can decide if both enlistments should stay or one (the most stable or trouble-free) should be kept.

Thanks!

ssnow-blackduck about 13 years ago
 

Thanks, I'll do so.

One enlistment can definitively be dropped. The Bazaar one is the official repository, so if the checkout and the regular updates work ok, we should stick to that one.

But if the Bazaar stuff is too slow and fails much, we could also go with the semi-official git mirror. It's usually only less than an hour behind.

Bye and a happy new year!

Tassilo Horn about 13 years ago
 

Tassilo,

The jury's still out on this... The current job has been running for more than three hours and is only 1 percent through digesting the 112,034 somethings that it has found there. Fortunately, we will only do a delta update from here on out, so it should be more manageable after this. Will look at it on Tuesday and see if it has finished, and I will note the progress then.

Thanks, Tassilo, and Happy New Year to you as well!

ssnow-blackduck about 13 years ago
 

Tassilo,

Sorry to report that the job has run all through the long weekend and is only through 24,700 of 112,034 whatevers. At this rate it will take another 11 days or more to finish. Not stellar! I will push this on to someone higher up on the totem-pole for further investigation.

Apologies and thanks for your patience!

ssnow-blackduck about 13 years ago
 

Well, emacs has no statistics anymore for several months, so who cares about 11 days?

But, although bazaar is generally not the fastest for the inital clone, these numbers are still a bit too high. So thanks for keeping an eye on the issue. I'm really interested in what's the culprit.

Tassilo Horn about 13 years ago
 

Tassilo,

On suggestion from ohloh developers, I have intentionally aborted the bazaar enlistment's progress and have started a fresh fetch on the git repository to see the comparative speed of its analysis. I am told to expect it to be MUCH faster. Will monitor and see.

Just to confirm, the bazaar and git repositories contain all the same data with the git only being slightly behind with respect to the bazaar original. Correct?

If the progress is that much faster than it was on the bazaar enlistment, then this one is the one to pick. It will make it possible to get updates that much more often. Once we have established that the git process runs that much faster, I will delete the bazaar enlistment in order to allow the update to run to completion.

Thanks!

ssnow-blackduck about 13 years ago
 

Yes, exactly. The Git repo is a complete mirror that gets updated every half an hour, so it is fine to use that instead of the bazaar repo. So please feel free to delete that enlistment if the git one works better/faster.

Tassilo Horn about 13 years ago
 

Tassilo,

Looks good from here, but need to compare apples to apples, so will wait for the numbers to approach what was finished in the bazaar process to decide.

Expectantly waiting...

ssnow-blackduck about 13 years ago
 

Tassilo,

The numbers suggest over 50 times faster processing for this phase with git over bazaar. The metric is supposed to be Commits detailed and to be fair to Bazaar, that software may not be optimized for this particular task.

I'm deleting the Bazaar enlistment now and hoping the jobs run to completion and give you meaningful numbers within a day or so.

I'll report back here when all is said-and-done.

Thanks!

ssnow-blackduck about 13 years ago
 

Great, and thanks a lot for your help.

Tassilo Horn about 13 years ago
 

Ok, it seems the clone has worked. Now we're in

Step 3 of 3: Counting lines of source code (Running 23663/64561)

But that's pretty slow again. I looked for it some hours ago, and then it was at ~21000, so it seems that will take another some days.

Well, not too bad either.

Tassilo Horn about 13 years ago
 

Tassilo,

All jobs from the re-fetch completed OK. Also note that we have had a couple of update cycles since then run to completion as well.

Please check the results and see if everything is as expected and let me know here if there are any additional problems.

Thanks!

ssnow-blackduck about 13 years ago
 

Hi!

The staticstics look correct to me. And I'm pleased to see that This is one of the largest open-source teams in the world, and is in the top 2% of all project teams on Ohloh.

Thanks a lot!

Tassilo Horn about 13 years ago