Skip to content

Project Ideas List (GSoC 2024)

Jump to bottom
raclim edited this page Feb 8, 2024 · 29 revisions

About the Processing Foundation

Our mission at the Processing Foundation is to promote software learning within the arts, artistic learning within technology-related fields, and to celebrate the diverse communities that make these fields vibrant, liberatory, and innovative. Our goal is to support people of all backgrounds in learning how to program and make creative work with code, especially those who might not otherwise have access to tools and resources. We also believe that some of the most radical futures and innovative technologies are being built by communities that have been pushed to the margins by dominant tech.

For all of our projects, it's incredibly important that things are kept as simple and user-friendly as possible. We aim to make our work accessible to everyone, especially those new to coding. Instead of adding complex features for experts, we focus on making everyday tasks easier for as many people as possible. Keep these values in mind when writing your proposal and you'll greatly increase your chances to get selected by the Processing Foundation for the GSoC program.

For more information about the Google Summer of Code program please see our README, and if you want to learn more about the Processing Foundation itself, see our official website at processingfoundation.org

Project ideas

This section contains a list of ideas and how you can help contribute to the Processing Foundation's work on Processing, p5.js, Processing for Android, processing.py (and other Python implementations, p5py and py5), and/or Processing for ARM.

In addition to this list, we track specific bugs and enhancements via github issues:

In particular, you might take a look through all of the issues tagged "enhancement" or "help wanted" in the Processing4, and p5.js repos.

🌸 p5.js

p5.js is a JavaScript library that starts with the original goal of Processing, to make coding accessible for artists, designers, educators, beginners, and reinterprets this for today's web. Using the original metaphor of a software sketchbook, p5.js has a full set of drawing functionality. However, you’re not limited to your drawing canvas, you can think of your whole browser page as your sketch! p5.js has addon libraries that make it easy to interact with other HTML5 objects, including text, input, video, webcam, and sound. p5.js is a new interpretation of Processing, not an emulation or port, and it is in active development.

When proposing p5.js projects, please read through our access statement and be sure to include in your proposal an explanation of how your project will expand access. There are a number of open issues on GitHub. Any of these could be packaged together as a GSoC proposal for a project. We recommend selecting several issues that are in one area of the project. ⚠️GSoC p5.js proposals addressing the existing issues will be given high priority.⚠️

You can use the GSoC proposal template from Berkman Klein Center as reference.

Resolve Issues / Fix Bugs on Area:Core Issues (High Priority!)

We highly recommend selecting several open issues tagged with "Area:Core" and packaging them together as a GSoC proposal, eg. Issue #3156: Confusion between .elt and .canvas.

  • Expected Outcomes: Improvement of p5.js Area:Core code and documentation
  • Skills Required: JavaScript, familiarity with Github or version control
  • Possible Mentors: Kenneth Lim, Nick Briz, Tanvi Kumar, Aren Davey
  • Expected Size of Project: Either 175 or 350 hours
  • Difficulty: intermediate

Resolve Issues / Fix Bugs on Area:Image Issues (High Priority!)

We highly recommend selecting several open issues tagged with "Area:Image" and packaging them together as a GSoC proposal, eg. Issue #4535: Capture starts with wrong dimensions + get() on demand pauses it.

  • Expected Outcomes: Improvement of p5.js Area:Image code and documentation
  • Skills Required: JavaScript, familiarity with Github or version control
  • Possible Mentors: Caleb Foss, So Sun Park, Aren Davey
  • Expected Size of Project: Either 175 or 350 hours
  • Difficulty: intermediate

Resolve Issues / Fix Bugs on Area:Typography Issues (High Priority!)

We highly recommend selecting several open issues tagged with "Area:Typography" and packaging them together as a GSoC proposal, eg. Issue #3354: Support 'justified' alignment as an option for textAlign.

  • Expected Outcomes: Improvement of p5.js Area:Typography code and documentation
  • Skills Required: JavaScript, familiarity with Github or version control
  • Possible Mentors: Kevin Yeh, Paula Isabel Signo
  • Expected Size of Project: Either 175 or 350 hours
  • Difficulty: intermediate

Resolve Issues / Fix Bugs on Area:Events Issues (High Priority!)

We highly recommend selecting several open issues tagged with "Area:Events" and packaging them together as a GSoC proposal, eg. Issue #4223: Mouse/touch event handling bug.

  • Expected Outcomes: Improvement of p5.js Area:Events code and documentation
  • Skills Required: JavaScript, familiarity with Github or version control
  • Possible Mentors: Kenneth Lim, Tanvi Kumar
  • Expected Size of Project: Either 175 or 350 hours
  • Difficulty: intermediate

Resolve Issues / Fix Bugs on Area:Color Issues (High Priority!)

We highly recommend selecting several open issues tagged with "Area:Color" and packaging them together as a GSoC proposal, eg. Issue #5654: Issue with color blending when there is alpha involved.

  • Expected Outcomes: Improvement of p5.js Area:Color code and documentation
  • Skills Required: JavaScript, familiarity with Github or version control
  • Possible Mentors: Nick Briz, Aren Davey
  • Expected Size of Project: Either 175 or 350 hours
  • Difficulty: intermediate

Improve Friendly Error System (FES) and documentation (High Priority!)

The Friendly Error System (FES) aims to lower barriers to debugging, especially for people new to p5js. It generates helper messages that explain common errors in simple English and provide a link that guides users to an appropriate reference. You can read more about p5.js Friendly Error System in this contributor doc.This project would involve improving the FES code and documentation. This might mean things like:

  1. Resolve Issues / Fix Bugs on Friendly Errors Issues (High Priority!): We highly recommend selecting several open issues tagged with "Friendly Errors" and packaging them together as a GSoC proposal
  2. New FES features (Low priority!): Proposing and implementing new features, including adding a new language translation to the FES.
  • Expected Outcomes: Improvement of p5.js FES and documentation
  • Skills Required: JavaScript, familiarity with Github or version control
  • Possible Mentors: Alm Chung, Nick Briz
  • Expected Size of Project: Either 175 or 350 hours
  • Difficulty: intermediate, advanced

Improving p5.js WebGL/3D functionality (High Priority!)

This project would involve extending the 3D API and adding to the general functionality, performance, clarity of documentation, and usability for p5's 3D API. Here are some example project ideas that might be feasible:

  • Resolve Issues / Fix Bugs on Area:WebGL Issues (High Priority!): We highly recommend selecting several open issues tagged with "Area:WebGL" and packaging them together as a GSoC proposal
  • Support for image-based lighting: Coming up with positions and colors and falloffs for 3D lighting is very time-consuming. If one could use an image of an environment, it would allow people to quickly add cohesive, natural lighting to their 3D scenes. (Resources: [1], [2])
  • Experimental shader building library: Right now, updatePixels() is an easy-to-learn way to make pixel based effects. Unfortunately, these start to slow down on large canvases. Shaders have the potential to run much more smoothly, but since they are a completely separate language, they are comparatively hard to learn. Do you have ideas on how to make shaders easy to get started with? While they may never be as easy as editing pixels, can we get it closer? Proof-of-concept ideas can be prototyped in a library for p5.

These are just examples to help kickstart the creative process but we welcome project proposals that suggest alternate ideas for what might signify a major improvement to p5's 3D functionality. In addition to implementing the code functionality, a successful project would also address documentation, updated examples, and unit tests. You can learn more about the current WebGl architecture.

  • Expected Outcomes: Implementation of expanded functionality or performance improvement for WebGL mode, updated documentation, and tests
  • Skills Required: JavaScript, experience with WebGL or GL programming, familiarity with Github or version control
  • Possible Mentors: Dave Pagurek, Adam Ferriss, Austin Slominski, So Sun Park
  • Expected Size of Project: Either 175 or 350 hours
  • Difficulty: intermediate, advanced

Support beginContour/endContour in p5.js WebGL mode (High Priority!)

In p5's 2D mode, one can use begin/endContour() to draw shapes with holes in them, such as the glyphs of fonts. This currently is not implemented in WebGL mode. Inside the WebGL rendering system, libtess is already used to turn complex shapes into triangles for rendering in beginShape(TESS) mode, but p5 does not yet provide users with a way to give libtess shapes with inner contours.

  • Expected Outcomes: Implementation of beginContour and endContour that works with WebGL's beginShape modes
  • Skills Required: JavaScript, experience with WebGL or GL programming, familiarity with Github or version control
  • Possible Mentors: Dave Pagurek
  • Expected Size of Project: 175 hours
  • Difficulty: intermediate

Support shader-based filters in p5.js (High Priority!)

Currently, p5's filters work by looping through each pixel on the screen. By using shaders, each pixel can be calculated in parallel, speeding up filters significantly. With more students learning from home on modest hardware, this will help make this functionality more accessible. In Processing Java, one can call filter() with a custom shader. Adding p5 support for this would allow for easy-to-share and easy-to-integrate visual effects, and let us replace our current set of filters with faster, shader-based implementations.

  • Expected Outcomes: Implementation of filter(yourShader), and time permitting, integration of existing shader implementations of existing filters
  • Skills Required: JavaScript, experience with WebGL or GL programming, familiarity with Github or version control
  • Possible Mentors: Dave Pagurek, Adam Ferriss, Austin Slominski
  • Expected Size of Project: 350 hours
  • Difficulty: advanced

Add the ability to create p5.Geometry using existing drawing commands (High Priority!)

When you draw shapes in p5 using beginShape/endShape, all the shape data is processed every frame. Unfortunately, this can slow down sketches on mobile and on other more modest hardware. Builtin shapes and imported 3D models create and reuse p5.Geometry for efficiency, and using it can speed up sketches significantly (e.g. from 4fps to 60fps.) If we provide a way to create these that is as easy to use as beginShape, sketches will be able to run on more people's computers and more people will be able to access them. We have a proof-of-concept library to test this idea out which could be integrated into p5.

  • Expected Outcomes: Implementation of methods to create
  • Skills Required: JavaScript, experience with WebGL or GL programming, familiarity with Github or version control
  • Possible Mentors: Dave Pagurek, Adam Ferriss, Austin Slominski
  • Expected Size of Project: 350 hours
  • Difficulty: intermediate, advanced

Expanding p5.js accessible outputs (High Priority!)

We would like to build on the current accessibility infrastructure and expand on sketch outputs that are accessible by screen reader users. Support in any of the following areas is desired: improve description function outputs, add a feature to allow easy download of canvas graphics as SVG (for creating tactile graphics & other manipulatives), support whole canvas meaning-making by including information about the relationships between shapes (improve library generated grid output to better represent shape areas and shape overlapping), and/or extend library-generated descriptions to 3D graphics. This is an exciting learning opportunity as we expect that regardless of interest all participants will write unit tests and document accessibility functions in contributor docs, test accessibility functions and make decisions based on user experiences. We highly recommend selecting several open issues tagged with "Area:Accessibility" and packaging them together as a GSoC proposal.(High Priority!)

  • Expected Outcomes: Updated p5.js accessibility functions & well documented new accessibility functions
  • Skills Required: JavaScript, HTML, GitHub version control & user testing. If interested in 3D graphics and accessibility, WebGL experience is required.
  • Possible Mentors: Claire Kearney-Volpe, Caleb Foss
  • Expected Size of Project: Either 175 or 350 hours
  • Difficulty: intermediate, advanced

Web Accessibility on p5js.org and documentation (High Priority!)

We would like to continue the push for accessibility within the p5.js project and community. The most promising approaches are to continue to adapt documentation to use p5.js core accessibility functions, revise accessibility of tutorials and learn examples of p5 website to use accessibility functions, write tutorials, as well as test, refine, and document the new alt-text features

  • Expected Outcomes: Updated p5js.org tutorials, documentation, and learn examples. Accessibility audit of the p5 website.
  • Skills Required: JavaScript, HTML, CSS, communication skills
  • Possible Mentors: Claire Kearney-Volpe, Caleb Foss, Paula Isabel Signo
  • Expected Size of Project: Either 175 or 350 hours
  • Difficulty: beginner, intermediate

Imagining new screen-reader accessible p5.js canvas descriptions using machine learning (Medium Priority!)

We want to explore how existing machine learning frameworks could help create a prototype or add-on to p5.js with functions that generate screen-reader-accessible descriptions of canvas graphics. This will be a more experimental project where we explore the accuracy and limitations of current ML frameworks to create screen-reader-accessible library-generated descriptions.

  • Expected Outcomes: A prototype of p5.js accessibility functions that create screen-reader accessible descriptions of the canvas
  • Skills Required: JavaScript, HTML, GitHub version control & user testing.
  • Possible Mentors: Claire Kearney-Volpe
  • Expected Size of Project: Either 175 or 350 hours
  • Difficulty: intermediate, advanced

Continued development of p5.js Teach page (Low Priority!)

We launched the Teach page on the p5.js website in 2020. This project would involve updating and continuing to develop this teaching resource page. This means reaching out to educators for existing teaching syllabi and slides or inviting them to make new ones, adding more materials of teaching p5.js with different skill levels, organizing teaching resources with different themes (like 'First p5.js assignment for beginners'), and adding them to the p5.js website. Note: This is a low priority project this year.

  • Expected Outcomes: Update of p5js.org Teach page, with a focus on enhancing the following, but not limited to: 1) accessibility to teaching resources, 2) teacher & learner engagements (e.g. teach case submission form), 3) workflow for maintenance among and beyond Teach page stewards (@Gracia-zhang, @SarveshLimaye)
  • Possible Mentor: Inhwa Yeom
  • Skills Required: JavaScript, HTML, CSS, GitHub version control & user testing.
  • Expected Size of Project: Either 175 or 350 hours
  • Difficulty: intermediate, advanced

Continued development of p5.js Showcase (Low Priority!)

We have launched 4 iterations of curated showcase on the p5.js website. This project would involve updating and continuing to develop this gallery. This means identifying and curating a theme, an artist list, finding their contact information, reaching out to them for existing examples or inviting them to make new ones, gathering and standardizing the files, and adding them to the p5.js website. It would also involve developing the showcase webpage with consideration for accessibility and interaction. It would be good to start by looking at the write-up by Annie Zheng, write-up by Katie Chan, write-up by Connie Liu, and write-up by Ashley Kang who worked on this over the past few summers. Think about ways you might extend the project by (1) developing the site and organizing the showcase GitHub workflow and repos, and (2) adding to the curation of examples. What criteria would you use for curating? How would you reach out to people? What is missing? Note: This is a low priority project this year.

  • Expected Outcomes: Updated set of p5.js examples for p5.js website showcase
  • Skills Required: JavaScript, HTML, CSS, communication skills
  • Possible Mentors: Tanvi Kumar, and TBD
  • Expected Size of Project: Either 175 or 350 hours
  • Difficulty: intermediate

Improve p5.xr library (Low Priority!)

p5.xr is a library that makes it easy to create p5 sketches that use WebXR (AR & VR) functionality. This project is still in an early stage of development so you would be helping shape it in a fundamental way. The WebXR API and device/browser support is always changing with the promise of iOS support finally arriving in 2023. Currently, the project only supports VR on Android and VR Devices (Quest, Vive, etc). AR is limited to Android/Chrome devices. The project would benefit from new core features. Some examples: adding an anchor feature for AR, adding a tensorflow-based cross-browser image tracking feature, developing a new interaction feature for VR controllers, adding OVR Multiview support to VR mode, creating a 3D sound engine, or adding A11y features for XR. This list is in no way exhaustive so feel free to propose something that you are personally interested in even if you don't see it here. One note is that you should have access to a device that supports p5.xr in some capacity. See device support here. Note: This is a low priority project this year.

  • Expected Outcomes: Improvement to the p5.xr library through the implementation of additional features and/or performance enhancements.
  • Skills Required: JavaScript, Github, Node, WebGL, GLSL
  • Possible Mentors: Stalgia Grigg
  • Expected Size of Project: Either 175 or 350 hours
  • Difficulty: advanced

💕 p5.js Web Editor

Internationalization and Localization

The editor currently has several translations and translation-related issues, which can be found within the 'Translations' tag in the repository. A new translation could potentially be added, but we're hoping to have some feedback on translations that have been submitted already, or suggestions on how they can be maintained.

  • Expected Outcomes: Reviewing current translations that have been submitted for the p5.js Editor. One translation could potentially be added.
  • Skills Required: JavaScript, HTML, Github
  • Possible Mentors: Rachel Lim, Linda Paiste
  • Difficulty: Beginner

Asset Uploading Improvements

The editor supports the usage of images, videos, and other assets. There are a few open tickets to improve this workflow:

Mobile Experience Improvements

We have a few issues related to improving the mobile experience of the p5.js editor. A complete list of them can be found under the 'Mobile' tagin the repository.

  • Expected Outcomes: Improved functionality of web editor on tablets and phones
  • Skills Required: Javascript, HTML, React, Github
  • Possible Mentors: Shuju Lin, Linda Paiste, Dewansh Thakur
  • Difficulty: Intermediate

Accessibility

  • Reviewing current state of application for keyboard users
  • Color contrast review (there are some open issues)
  • Addressing select open accessibility-related issues, which can be found within the 'Accessibility' tag within the repository.
  • Possible Mentors: Rachel Lim
  • Difficulty: Intermediate

Adding Test Coverage

Currently the framework exists for adding tests, using Enzyme and Jest. This is a great project as it would make contributing to the web editor easier, and is self-contained and modular, which makes it easy for a variety of skill levels to work on it.

  • Expected Outcomes: Testing files added to web editor repository
  • Skills Required: JavaScript, HTML, CSS, Github
  • Possible Mentors: Linda Paiste
  • Difficulty: Intermediate

UI Updates to the About Modal

Currently, the About Modal

  • Expected Outcomes: Implementing the updated designs for the 'About' Modal.
  • Skills Required: UX/UI Design, Javascript, HTML, React, Github
  • Possible Mentors: TBD
  • Difficulty: Intermediate, Advanced

Adding User Permissions to Sketches

Details are TBD.

  • Expected Outcomes: User Permissions Added to Sketches.
  • Skills Required: JavaScript, HTML, React, Github
  • Possible Mentors: TBD
  • Difficulty: Advanced

💙 Processing

Processing is a flexible software sketchbook and a language for learning how to code. Since 2001, Processing has promoted software literacy within the visual arts and visual literacy within technology. There are tens of thousands of students, artists, designers, researchers, and hobbyists who use Processing for learning and prototyping.

Processing has a extensive community of users, with 250,000 unique users every month and up to 30,000 people using Processing every day, yet our contribution team is comparatively tiny! This is to say, by joining the Google Summer of Code program and contributing to Processing, you can make a huge difference in the experience of thousands of users, many of whom are exploring programming for the first time.

For more information on how to contribute to the Processing project, read our Contribution guidelines.

Add "Open in Processing" link to code examples

Problem description: It can be time-consuming and confusing for users to manually copy and paste each tab of an example into the PDE and ensure that all required assets (e.g., images, fonts) are present. We want visitors to the website to be able to run the examples in the Processing Development Environment (PDE) simply by clicking an "Open in Processing" link. **Solution:**Since Processing (4.2), it is possible to link to .pdex and .pdez files to run sketches and install libraries immediately in the PDE. The examples and reference sections of the processing.org website will need to be updated to take advantage of this feature. In addition to changes to the website itself, this will involve creating a GitHub automation to generate the .pdez files for the examples.

  • Skills Required: Knowledge of GitHub workflows and React. Familiarity with Java/Processing is a plus.
  • Possible Mentors: TBD
  • Expected Size of Project: 175 hours
  • Difficulty: Intermediate

See the following issues: https://github.com/processing/processing-website/issues/446 https://github.com/processing/processing-website/issues/445

Improving the Library Contribution Workflow for Processing

This project aims to improve the library contribution workflow for Processing by automating the deployment of documentation and making it more accessible for contributors. The new library contribution process will be based on the Gradle-based library template contributed by Andres Colubri.

  • Expected Outcomes: Upon completion of the project, the library contribution process will be streamlined and modernized, with automated deployment of library documentation to GitHub Pages and a more accessible process for submitting libraries for review. The library contribution documentation should be updated to reflect those changes, including a migration guide to help library creators move from the old Ant-based template.
  • Skills Required: Knowledge of GitHub Workflows, and GitHub Pages. Familiarity with JavaDoc and Gradle are a plus.
  • Possible Mentors: TBD
  • Expected Size of Project: 175 hours
  • Difficulty: Intermediate

Update the Shader mode for Processing4

  • A mode to code GLSL shaders in the PDE was created by Izza Tariq but it hasn't been updated to work with Processing4.
  • Expected Outcomes:
    • A Pull Request or github repository with library code, examples, and documentation.
    • Packaging and release of library via the Processing contributions manager
  • Skills Required: Java Development
  • Possible Mentors: TBD
  • Expected Size of Project: Either 175 or 350 hours
  • Difficulty: intermediate

🤖 Processing for Android

Kotlin support (Android Mode)

Many Android developers have moved to the Kotlin language since Google actively started promoting Kotlin as an alternative to Java. A GSoC project adapted the Android mode to support Kotlin, and released it as its own separate mode. Finding ways to continue supporting this mode or even integrating it back into the Android mode could help bring Android developers who prefer Kotlin into Processing.

  • Expected Outcomes:
    • A pull request to the Processing for Android repository with code, examples, and documentation.
  • Skills Required: Java/Kotlin Development
  • Possible Mentors: TBD
  • Expected Size of Project: Either 175 or 350 hours
  • Difficulty: intermediate or advanced

Game controller library (Android Mode)

The Android SDK includes an API to support input from game controllers, either bluetooth connected like the 8BitDo Zero 2 or built-in such as those found in Android handhelds like the Anbernic RG353V or Retroid Pocket 3+. It would be convenient to expose this API through a new library for the Android mode that uses Processing conventions for input events.

  • Expected Outcomes:
    • A GitHub repository with code, examples, and documentation.
  • Skills Required: Java/Kotlin Development
  • Possible Mentors: TBD
  • Expected Size of Project: Either 175 or 350 hours
  • Difficulty: intermediate or advanced

Updated sound/video libraries (Android Mode)

Work has been done at various points in time to seamlessly support video and sound in the Android mode: Processing-video-android library by Mohammad Umair Cassette library (sound) Android port of Processing’s sound library (branch in official’s processing-android repo) However, none of these projects have been updated recently, so it would be very important if some effort could be put into creating some supported and up-to-date set of libraries for video and sound.

  • Expected Outcomes:
    • A GitHub repository with code, examples, and documentation.
  • Skills Required: Java/Kotlin Development
  • Possible Mentors: TBD
  • Expected Size of Project: Either 175 or 350 hours
  • Difficulty: intermediate or advanced

Other Android ideas

Processing for Android website translations

The Processing for Android website is available at this moment in Spanish and English, so translations into other languages are needed. The Android mode's UI is in English, but recent work has been made recently to put all the message strings in a separate language file to facilitate translation of the UI into other languages.

New Processing for Android tutorials

Currently, the website includes a number introductory tutorials on a range of topics (installation, sensors, VR), but we need new tutorials bridging the gap from simple applications to more advanced topics.

Clone this wiki locally