ryanwold.net

A civic-minded citizen seeking the singularity

Back to Entries

Using Big Data to Analyze many Code Repositories

idea
Date: 2015-02-13
Tags: bigdata code designpatterns semantic

Analyze a code repo to identify common patterns in files and commits.

Analyze across repos to find design patterns, libraries, and potential 'seams' across software projects.

Many stacks to roughly the same thing: persistence, MVC, helpers, etc.

Big data approaches to open-code may be able to reveal patterns like:

  • What is a slice in an application?
  • What does a slice look like across stacks? Rails vs. Django vs. etc. etc.

Tagging commits as patterns:

  • New Card
  • Validation
  • CRUD
  • external call
  • waiting
  • Date, Radio, Form element
  • Custom UI Component

By Ryan Wold · © 2015–2026 Ryan Wold

Licensed CC BY-NC 4.0. AI training requires a license — machine-readable terms.

Tip: $afomi on HandCash · afomi@handcash.io