Open Hub
Open Hub

 Settings |  Report Duplicate

0
I Use This!
Very Low Activity

Commits : Listings

Analyzed about 9 hours ago. based on code collected 1 day ago.
Nov 06, 2025 — Nov 06, 2026
Commit Message Contributor Files Modified Lines Added Lines Removed Code Location Date
- Updated AsFer Design Document - Section 234 - perl build idiosyncrasies - Python wrapper to invoke perl WordNet::Similarity has been added to repository - logs for above in python-src/testlogs/
Srinivasan Kannan
More... over 10 years ago
Updated AsFer Design Document
Srinivasan Kannan
More... over 10 years ago
*) New perl-src folder with perl code for computing WordNet Distance with Ted Pedersen et al WordNet::Similarity CPAN module *) Logs for some example word distances have been included in testlogs. Some weird behaviour for similar word pairs - distance is 1 instead of 0. Probably a clockwise distance rather than anticlockwise.
Srinivasan Kannan
More... over 10 years ago
Updated AsFer Design Document
Srinivasan Kannan
More... over 10 years ago
Updated AsFer Design Document - Section 232
Srinivasan Kannan
More... over 10 years ago
Updated AsFer Design Document - Section 231 added
Srinivasan Kannan
More... over 10 years ago
Updated Section 228
Srinivasan Kannan
More... over 10 years ago
Updated AsFer Design Document
Srinivasan Kannan
More... over 10 years ago
Updated AsFer Design Document
Srinivasan Kannan
More... over 10 years ago
Updated AsFer Design Document - Section 230
Srinivasan Kannan
More... over 10 years ago
Updated AsFer Design Document
Srinivasan Kannan
More... over 10 years ago
Updated AsFer Design Document - Section 229
Srinivasan Kannan
More... over 10 years ago
Updated AsFer Design Document
Srinivasan Kannan
More... over 10 years ago
Updated AsFer Design Document
Srinivasan Kannan
More... over 10 years ago
Updated AsFer Design Document
Srinivasan Kannan
More... over 10 years ago
- PySpark-Cythonized Interview Algorithm implementation generated graph has been pruned to remove edges invoving "None" vertices which were added during Spark MapReduce based on a config variable. - Logs and Screenshots for the above have been added to testlogs/ - Some benchmark results parsed from the Spark logs with commandline - "for i in `grep Finished InterviewAlgorithmWithIntrinisicMerit_Crawl_Visual_Spark.2localthreads.CythonOptimized.8February2016.out |grep TaskSetManager| awk '{print $14}'`; do sum=$(expr $sum + $i); done": - Total time in milliseconds - 99201 - Number of jobs - 113 - Average time per mapreduce job in milliseconds - 877 Thus a merit computation of sample document with few lines (33 keywords) requires ~100 seconds in local Spark cluster. This excludes NetworkX and other unoptimized code overhead.
Srinivasan Kannan
More... over 10 years ago
Updated AsFer Design Document
Srinivasan Kannan
More... almost 11 years ago
Updated AsFer Design Document
Srinivasan Kannan
More... almost 11 years ago
Updated AsFer Design Document
Srinivasan Kannan
More... almost 11 years ago
- removed InterviewAlgorithm/InterviewAlgorithmWithIntrinisicMerit_SparkMapReducer.so - updated webspidered text
Srinivasan Kannan
More... almost 11 years ago
------------------------------------------------------------------------ Further optimizations to Spark-Cython Interview algorithm implementation: ------------------------------------------------------------------------- - webspidered text for RGO graph construction updated - PySpark-Cython build commandlines added as a text file log - Commented unused python functions - shingling and jaccard coefficient - threading.Lock() Spark thread pickling synchronizer variable made global in MapReducer - renamed yesterday's logs and screenshot to correct datetime 4 February 2016 - Added a new special graph node ["None"] for special cases when no parents are found in backedges computation in MapReducer. This makes a default root in the RGO graph as shown in matplotlib networkx graph plot - Spark logs show time per RDD job - an example MapReduce job takes 335 milliseconds - Tried Cythonizing InterviewAlgorithmWithIntrinisicMerit_Crawl_Visual_Spark.py but there is a serious cython compiler error in Matplotlib-PyQt. Hence those changes have been backed out. - DOT file and Cython C file have been updated
Srinivasan Kannan
More... almost 11 years ago
Updated AsFer Design Document
Srinivasan Kannan
More... almost 11 years ago
Updated AsFer Design Document
Srinivasan Kannan
More... almost 11 years ago
Updated AsFer Design Document (section 224 for Spark-Cython performance benchmark for Interview algorithm implementation) and Requirements.txt
Srinivasan Kannan
More... almost 11 years ago
---------------------------------------------------------------------------------------------------------- Crucial commits for Performance improvements and Cython build of Spark Interview algorithm implementation ---------------------------------------------------------------------------------------------------------- - New setup.py has been added to do a Cythonized build of PySpark Interview algorithm MapReduce script - Commandline for cython build: python setup.py build_ext --inplace - This compiles python spark mapreduce script into a .c file that does CPython bindings and creates .o and .so files - FreqDist has been commented which was slowing down the bootstrap - MapReduce function has been updated for NULL object checks - Thanks to Cython, Performance of Spark MapReduce has performance shootup by factor of almost 100x - Spark GUI job execution time shown for this interview execution is ~10 seconds excluding GUI graph rendering which requires few minutes. This was earlier taking few hours. - With Cython ,essentially Spark-Python becomes as fast as C implementation. - DOT file, Output log, Spark logs and Screenshot has been added - This completes important benchmark and performance improvement for Recursive Gloss Overlap Graph construction on local Spark single node cluster.
Srinivasan Kannan
More... almost 11 years ago
Updated AsFer Design Document
Srinivasan Kannan
More... almost 11 years ago
------------------------------------------------------------------------------------------------- Input Dataset Files nomenclature change for NeuronRain Enterprise ------------------------------------------------------------------------------------------------- - 1 new input file python-src/asfer.enterprise.encstr.seqmining has been added for Sequence Mining of generic string dataset - presently contains set of generic binary strings . - Code changes for above new input files have been done in SequenceMining.py - logs for SequenceMining of binary strings with maximum subsequence length of 15 have been added
Srinivasan Kannan
More... almost 11 years ago
- Updated AsFer Design Document with more references for Discrete Hyperbolic Factorization in NC - PRAM-NC equivalence ------------------------------------------------------------------------------------------------- Input Dataset Files nomenclature change for NeuronRain Enterprise ------------------------------------------------------------------------------------------------- - 3 new input files cpp-src/asfer.enterprise.encstr, cpp-src/asfer.enterprise.encstr.clustered, cpp-src/asfer.enterprise.encstr.kNN have been added which contain set of generic binary strings for KMeans, KNN clustering and Longest Common Subsequence of a clustered set . - Code changes for above new input files have been done in asfer.cpp and new class(asferencodestr.cpp and asferencodestr.h) has been added for generic string dataset processing - Changes for generic string datasets have been done for kNN and KMeans clustering - logs for clustering and longest common subsequence have been added
Srinivasan Kannan
More... almost 11 years ago
Updated AsFer Design Document - Section 222 added
Srinivasan Kannan
More... almost 11 years ago
Updated AsFer Design Document
Srinivasan Kannan
More... almost 11 years ago