To install the extension, simply follow the instructions at https://github.com/p-doom/crowd-code/releases.
This extension provides functionality to record IDE actions. Currently supported actions include text insertions, deletions, undo, redo, cursor movement (including VIM motions), file switches, git branch checkouts, terminal invocation and terminal command execution (both input and output). The changes are recorded and stored in CSV files. If you consent to participate in crowd-sourcing VS code actions, the CSV files are uploaded to an S3 bucket. We anonymize and clean the crowd-sourced dataset and periodically share it with the community. If you do not consent, no data will leave your machine, and the CSV files will solely be stored locally. This extension provides functionality to record IDE actions. Currently supported actions include text insertions, deletions, undo, redo, cursor movement (including VIM motions), file switches, git branch checkouts, terminal invocation and terminal command execution (both input and output). The changes are recorded in a CSV file and uploaded to an S3 bucket, which we plan to thoroughly clean, process, and eventually share with the community.
All uncaptured data is lost data. We want to crowd-source a dense dataset of IDE actions to eventually finetune models on. This would (to the best of our knowledge) constitute the first crowd-sourced dataset of dense IDE actions.
We thank Mattia Consiglio for his awesome work on the upstream repository, which made our lives infinitely easier.
As soon as the extension activates, recording commences automatically. Recording automatically stops upon IDE closure. Additionally, you can control the recording in three ways:
- Using the status bar (on the right): Click on "Start recording" to begin and "Stop recording" to end.
- Using the VS Code Recorder sidebar: Click on the extension icon in the activity bar to open the sidebar, where you can:
- Start/Stop the recording
- View the recording timer
- See the current file being recorded
- Manage your recorded files
- Add the export path to .gitignore
- Enable/disable participation in crowd-sourcing the dataset
- Using the panic button: Click on "Panic button" to remove the last few actions from the captured dataset. This is useful to immediately remove sensitive data from the dataset.
The extension will automatically record changes in your text editor. When you stop the recording, it will finalize the data and save it to a CSV (source), JSON and SRT files.
You can customize the recording experience with these features:
- Choose the export formats (SRT or JSON or both)
- Set custom names for recording folders
- Automatically add the export path to .gitignore
You can also use the command palette to access the extension's features. Available commands:
crowd-code.startRecording: Start the recordingcrowd-code.stopRecording: Stop the recordingcrowd-code.panicButton: Remove the last few actions from the datasetcrowd-code.openSettings: Open the extension settingscrowd-code.consent: Manage data collection consent
We ask for your consent in participating in crowd-sourcing upon installation of the extension. You can always revoke your participation, after which your recorded data will solely be stored on your device.
Your trust means a lot to us, and we will take great care in anonymizing the dataset before sharing it to the research community. At the same time, we strive for ultimate transparency. If you have suggestions on how we can improve our crowd-sourcing setting, we are more than happy to hear your feedback.
The recorded changes are saved in a CSV file in your workspace.
Then, this file is processed to generate output files in SRT and JSON formats, providing a detailed and accessible log of your coding session.
Playback is a feature by the upstream repository. We have not tested playback using our modified repository (e.g. cursor movement and terminal capture are not implemented upstream; chances are high that playback simply breaks using recordings captured by crowd-code). If you want to try this nonetheless:
- The output files can be played back in the VS Code Recorder Player web app.
- 🚧 React component available soon...
-
crowdCode.export.exportPath: Set the export path. Use${workspaceFolder}to export to the workspace folder. In case the path does not exist in the workspace, it will be created.Default:
$TMPDIR/crowd-code/ -
crowdCode.export.createPathOutsideWorkspace: Create the export path outside the workspace if it doesn't existDefault:
true -
crowdCode.export.addToGitignore: Add the export path to .gitignore when creating the folderDefault:
false -
crowdCode.export.exportFormats: Enabled export formats (SRT or JSON or both)Default:
["JSON", "SRT"] -
crowdCode.recording.askFolderName: Ask for a custom folder name before starting a recordingDefault:
false -
crowdCode.appearance.minimalMode: Enable or disable the minimal modeDefault:
false -
crowdCode.appearance.showTimer: Enable or disable the display timeDefault:
true
This extension requires Visual Studio Code, or any other editor that supports the VS Code API (like Cursor, VSCodium, Windsurf, etc.), to run. No additional dependencies are needed.
There are currently no known issues with this extension.
If you'd like to contribute to this extension, please feel free to fork the repository and submit a pull request.
If you like this extension, please consider supporting the author of the upstream repository!
See CHANGELOG.md
😊 Enjoy!