Like Copilot CLI, but now Copilot also has a desktop app. Next to github.com, GitHub Desktop, GitHub Mobile, and Copilot in VS Code, somebody will explain the strategy of this... one day.
To quote from the article: "These repositories, belonging to more than 16,000 organizations, were originally posted to GitHub as public, but were later set to private [..]" Once things are public, they will forever remain public (in some form). That's how the internet works.
tl;dr Bing indexed and cached a public repository, then made it available to its AI chat. Later, the repository author switched the repository to private and understood how the internet works. And the story gets only better as the author is the founder of a “cybersecurity” company.
Footnote 1 on page 2 explicitly mentions the 3.5 model and the research in this paper is only about auto completion: https://arxiv.org/pdf/2306.15033.pdf
Lastly, OpenAI states on the original Codex page: “OpenAI Codex is a descendant of GPT-3; its training data contains both natural language and billions of lines of source code from publicly available sources, including code in public GitHub repositories.” - It included GitHub repos, but it never was only GitHub repos. https://openai.com/blog/openai-codex
That’s no longer true. Copilot uses the same ChatGPT-3.5 model as, well, ChatGPT. If it were trained on just GitHub projects, the chat features wouldn’t work at all.
They did not prompt at all. They used GitHub’s code search to find projects where the repo owner specified that the code was generated “by Copilot” and the authors took that at face value for all code in the project. Whether the code was actually suggested by Copilot is not at all analyzed in the paper. As such, the results are highly questionable.
Where does OpenAI state that they only train ChatGPT-3.5 or GPT-4 on code from GitHub? The model for GitHub Copilot X clearly has a (human) language understanding that you can't get from source code (or source code comments), so they are trained on much more data than GitHub has and there is no reason to believe OpenAI would limit themselves to that.
HN post title is misleading. GitHub suspended (and not deleted) the 3 accounts of the org owners of the tornadocash org on GitHub. Going through the commit history, I have not found a single contributor (i.e. other than the 3 owners) which got suspended or deleted.