A new course developed to use the NVIDIA Jetson TK1 board to use traditional game controller input as well as novel human computer interfaces to control games. The intent was to also exploit the massive parallel computation available in the GPU for image processing tasks.

The plan for the class is to have 6 or 7 labs followed by an open-ended group project. The planned labs are as follows:

  1. Build a USB game controller
  2. Develop firmware for the game controller
  3. Plug the game controller in to a Jetson TK1, and get it to control a video game, and expand the video game's functionality
  4. Use CUDA to add motion blur to the video game
  5. Use a webcam to capture video data from the user + CUDA to get gesture input
  6. Use gesture controls to add new human interactions

Our Jetson Files

Remove the .txt suffix from the files after you download them.

Parts list

Jetson Accessories

Controller Parts

Recent Blog Posts

  • 18 Nov 2014 Hand Detection Algorithm
  • 14 Nov 2014 Motion Blur Updates
  • 10 Nov 2014 Motion Capture Lab Updates!
  • 10 Nov 2014 Black Screen fix on Jetson
  • 04 Nov 2014 How to fix UTC on Jetson
  • 28 Oct 2014 How to Reinstall the Original File System on Jetson TK1
  • 25 Oct 2014 Joystick Visualizer
  • 22 Oct 2014 First Blog Post! (a little late)
  • 13 Oct 2014 Setting Up Jetson TK1 with CUDA, OpenCV, and MORE!
  • 06 Oct 2014 Game controller development board
  • 01 Oct 2014 Welcome New Members
  • People

    Josef Spjut

    Professor | blog posts | web page | email | linkedin

    Josef is a visiting assistant professor of computer engineering at Harvey Mudd College and a consulting researcher for NVIDIA. He received his Ph.D. from University of Utah and his B.S in Computer Engineering from University of California Riverside.


    Ramy Elminyawi

    B.S. Engineering 2016 | blog posts | email

    Ramy is a junior engineering major with a focus on electrical and digital engineering. He is currently working on the CUDA post processing work on the Jetson project.


    Andrew Fishberg

    B.S. Engineering 2016 | blog posts | email

    .


    Kirklann Lau

    B.S. Engineering 2016 | blog posts | email

    .


    Amy Ngai

    B.S. Engineering 2016 | blog posts | email

    Amy is a junior engineering major with a focus on electrical and computer engineering. She is working on the motion control portion of the Jetson project, and is also a lab grader/tutor for E85.


    Richard Piersall

    B.S. Engineering 2016 | blog posts | email

    .


    Da Eun Shim

    B.S. Engineering 2016 | blog posts | email

    .