Forums : Technical Issue Help

Dear Open Hub Users,

We’re excited to announce that we will be moving the Open Hub Forum to https://community.blackduck.com/s/black-duck-open-hub. Beginning immediately, users can head over, register, get technical help and discuss issue pertinent to the Open Hub. Registered users can also subscribe to Open Hub announcements here.


On May 1, 2020, we will be freezing https://www.openhub.net/forums and users will not be able to create new discussions. If you have any questions and concerns, please email us at [email protected]

GNUstep source-fetching

On 12-th of november I've updated GNUStep project to use the new repository. It still didn't manage to make initial checkout :-/

Project: http://www.ohloh.net/projects/4843
Repository: http://svn.gna.org/svn/gnustep

Alexey Zakhlestin almost 18 years ago
 

Hi indeyets,

Looks like we had a server timeout. I've rescheduled the job, and I'll keep an eye on it today. Let me know if you see any trouble,

Robin

Robin Luckey almost 18 years ago
 

Looks like it tries… but it is slow

Step 1 of 3: Downloading source code history (Running 1239/18581)

Alexey Zakhlestin almost 18 years ago
 

Yes, it looks like it might take a few weeks to complete.

Robin Luckey almost 18 years ago
 

It is marked as failed now. I wonder, if initial download process could be made incremental (so it wouldn't need to restart from scratch…)

Alexey Zakhlestin almost 18 years ago
 

Hi indeyets,

This failure was not specific to GNUstep. We physically moved all of our servers to a new datacenter this weekend, which interrupted all downloads. The servers are mostly back online now, and I've rescheduled the GNUstep download.

The download process is definitely incremental. Given that some downloads take weeks to complete, we'd never have gotten very far without that.

Thanks for your patience,
Robin

Robin Luckey almost 18 years ago
 

Hi indeyets,

I spent a little time investigating our eternally slow download of GNUstep today. The problem appears to be that the URL provided to Ohloh includes not just the trunk but also all of the branches and tags of all the subprojects of GNUStep.

I've been trying to check the code out locally on my development machine, but after an hour it shows no sign of finishing.

If it takes this long to check out a single revision, it might take literally months of server time for us to do the full download. Also, because all branches and tags have been included, when it finally finishes the source code line count will be off by many orders of magnitude.

The best solution seems to be to remove the single enlistment to http://svn.gna.org/svn/gnustep, and instead enter URLs to the individual trunks of the all of the subprojects. I'm not sure yet how many of these trunk directories there are (if my checkout ever finishes I'll run a script on the source tree to find them all). It's the only way for our engine to know which directories need to be counted, and which are simply tags.

We are transitioning to using svnsync as our downloading method (we currently use it for SourceForge and Google code), and this would greatly reduce the amount of time to do the download. However, even if we use svnsync for this repository, someone would still need to go through and identify which directories to count. So in the end, we still need to break up the single master enlistment into separate ones for all the trunk directories.

I'll make a start of this tonight. Let me know if you have any concerns or questions,

Robin

Robin Luckey over 17 years ago
 

looks good, thanks
all repos were successfully imported except this one: http://svn.gna.org/svn/gnustep/libs/base/trunk
looks like it is holding stats-generation

Alexey Zakhlestin over 17 years ago
 

Heh, OK, we are almost there. I've rescheduled this last job, and will keep an eye on it today.

Thanks for your patience!

Robin Luckey over 17 years ago