Awesome Lists

awesome-machine-learning-on-source-code

by src-d

awesome listpushed almost 6 years ago

Cool links & research papers related to Machine Learning applied to source code (MLonCode)

AI summary

Source Code ML

A curated list of research papers, datasets, and projects exploring machine learning applications on source code

stars
6.3K
forks
843
watching
357
awesome lists
3
entries
265
View on GitHub

Embed the badge

Show how many awesome lists link to your project. The count updates automatically.

Awesome Lists badge
Markdown
[![Awesome Lists Badge](https://awesome.facts.dev/shield/src-d/awesome-machine-learning-on-source-code/links.svg)](https://awesome.facts.dev/awesome/src-d/awesome-machine-learning-on-source-code)
HTML
<a href="https://awesome.facts.dev/awesome/src-d/awesome-machine-learning-on-source-code"><img src="https://awesome.facts.dev/shield/src-d/awesome-machine-learning-on-source-code/links.svg" alt="Awesome Lists Badge" /></a>
Image URL
https://awesome.facts.dev/shield/src-d/awesome-machine-learning-on-source-code/links.svg

What's in the list

265 links in 16 sections, with live GitHub stats.activeno commit in 2y

Digests

Conferences

Conferences / SysML

Conferences

Conferences / source{d} tech talks

Conferences

Conferences / NIPS Neural Abstract Machines and Program Induction workshop

Conferences

Conferences / CamAIML

Conferences

Competitions

  • CodRep

    competition on automatic program repair: given a source line, find the insertion point

Papers

Posts

Talks

Software

  • Differentiable Neural Computer (DNC)

    TensorFlow implementation of the Differentiable Neural Computer

  • sourced.ml

    Abstracts feature extraction from source code syntax trees and working with ML models

  • vecino

    Finds similar Git repositories

  • apollo

    Source code deduplication as scale, research

  • gemini

    Source code deduplication as scale, production

  • enry

    Insanely fast file based programming language detector

  • hercules

    Git repository mining framework with batteries on top of go-git

  • DeepCS

    Keras and Pytorch implementations of DeepCS (Deep Code Search)

  • Code Neuron

    Recurrent neural network to detect code blocks in natural language text

  • Naturalize

    Language agnostic framework for learning coding conventions from a codebase and then expoiting this information for suggesting better identifier names and formatting changes in the code

  • Extreme Source Code Summarization

    Convolutional attention neural network that learns to summarize source code into a short method name-like summary by just looking at the source code tokens

  • Summarizing Source Code using a Neural Attention Model

    CODE-NN, uses LSTM networks with attention to produce sentences that describe C# code snippets and SQL queries from StackOverflow. Torch over C#/SQL

  • Probabilistic API Miner

    Near parameter-free probabilistic algorithm for mining the most interesting API patterns from a list of API call sequences

  • Interesting Sequence Miner

    Novel algorithm that mines the most interesting sequences under a probabilistic model. It is able to efficiently infer interesting sequences directly from the database

  • TASSAL

    Tool for the automatic summarization of source code using autofolding. Autofolding automatically creates a summary of a source code file by folding non-essential code and comment blocks

  • JNice2Predict

    Efficient and scalable open-source framework for structured prediction, enabling one to build new statistical engines more quickly

  • Clone Digger

    clone detection for Python and Java

  • Sensibility

    Uses LSTMs to detect and correct syntax errors in Java source code

  • DeepBugs

    Framework for learning bug detectors from an existing code corpus

  • DeepSim

    a deep learning-based approach to measure code functional similarity

  • rnn-autocomplete

    Neural code autocompletion with RNN (bachelor's thesis)

  • MindsDB

    MindsDB is an Explainable AutoML framework for developers. With MindsDB you can build, train and use state of the art ML models in as simple as one line of code

  • go-git

    Highly extensible Git implementation in pure Go which is friendly to data mining

  • bblfsh

    Self-hosted server for source code parsing

  • engine

    Scalable and distributed data retrieval pipeline for source code

  • minhashcuda

    Weighted MinHash implementation on CUDA to efficiently find duplicates

  • kmcuda

    k-means on CUDA to cluster and to search for nearest neighbors in dense space

  • wmd-relax

    Python package which finds nearest neighbors at Word Mover's Distance

  • Tregex, Tsurgeon and Semgrex

    Tregex is a utility for matching patterns in trees, based on tree relationships and regular expression matches on nodes (the name is short for "tree regular expressions")

  • source{d} models

    Machine Learning models for MLonCode trained using the source{d} stack

  • Neural-Code-Search-Evaluation-Dataset

    dataset contains links to 4.7M methods from 24k+ repositories with 287 StackOverflow questions and code snippet answers

  • CodeSearchNet

    collection of datasets and benchmarks for code retrieval using natural language. Contains 2M pairs of ( , )

  • Public Git Archive

    6 TB of Git repositories from GitHub

  • StackOverflow Question-Code Dataset

    ~148K Python and ~120K SQL question-code pairs mined from StackOverflow

  • GitHub Issue Titles and Descriptions for NLP Analysis

    ~8 million GitHub issue titles and descriptions from 2017

  • GitHub repositories - languages distribution

    Programming languages distribution in 14,000,000 repositories on GitHub (October 2016)

  • 452M commits on GitHub

    ≈ 452M commits' metadata from 16M repositories on GitHub (October 2016)

  • GitHub readme files

    Readme files of all GitHub repositories (16M) (October 2016)

  • from language X to Y

    Cache file Erik Bernhardsson collected for his awesome blog post

  • GitHub word2vec 120k

    Sequences of identifiers extracted from top starred 120,000 GitHub repositories

  • GitHub Source Code Names

    Names in source code extracted from 13M GitHub repositories, not people

  • GitHub duplicate repositories

    GitHub repositories not marked as forks but very similar to each other

  • GitHub lng keyword frequencies

    Programming language keyword frequency extracted from 16M GitHub repositories

  • GitHub Java Corpus

    GitHub Java corpus is a set of Java projects collected from GitHub that we have used in a number of our publications. The corpus consists of 14,785 projects and 352,312,696 LOC

  • 150k Python Dataset

    Dataset consisting of 150,000 Python ASTs

  • 150k JavaScript Dataset

    Dataset consisting of 150,000 JavaScript files and their parsed ASTs

  • card2code

    This dataset contains the language to code datasets described in the paper

  • NL2Bash

    This dataset contains a set of ~10,000 bash one-liners collected from websites such as StackOverflow and their English descriptions written by Bash programmers, as described in the

  • GitHub JavaScript Dump October 2016

    Dataset consisting of 494,352 syntactically-valid JavaScript files obtained from the top ~10000 starred JavaScript repositories on GitHub, with licenses, and parsed ASTs

  • BigCloneBench

    Clone detection benchmark of 8 million function clone pairs in the IJaDataset

Credits

More related projects

Add a GitHub project

Missing a project or an awesome list? Paste its GitHub URL and we fetch it right away.