Expressive Interfaces

EMAIL

DAY 1 – OVERVIEW

PresentationExpressive Interfaces

Questions to ask yourself as you design your interface

What is the ritual?

  • Sound Performance – Performance Spaces 
  • Sound Installation – Gallery Spaces
  • Demos and Research Projects
  • Video/Online Performance
  • Personal Desktop 
  • Product Design – Designing instruments for others

What are the performance challenges?

  • Virtuosity and Resistance – How do you determine what is a good performance?
  • Stakes – What is the challenge being witnessed?
  • Pretense – What information does the audience have before and during the performance?

Types of Interfaces

Input Devices

Output Devices

  • LED output for feedback from Input Device
  • Synthesizers, samplers, drum machines, tone banks, etc with MIDI input
  • MIDI to DC controllers – automating lights, motors, and DC power devices (radios, turntables, anything DC powered)
  • MIDI TO AC controllers – controlling relays to switch AC power on and off
  • Matt Steinke Example 1
  • Matt Steinke More Examples

Types of Digital Communication

Digital Communication

  • MIDI (one way – In/Out)
  • USB MIDI
  • SERIAL
  • OTHER – USB, OSC, SPI, I2C 

DAY 2 – BASIC IO

ESP32 Pinout

Breadboard Basics

TYPES OF SENSORS

PASSIVE
Examples:
ACTIVE
Examples:
DRIVER-BASED
Examples:

DAY 3

WHAT IS PWM?

PURE DATA

MIDI SYNTH TESTER

DAY 4

CODE

INPUT
Analog Inputs – Pots, photocell, IR sensors – Control Change and Serial
Capacitance Touch – Note ON/OFF

OUTPUT
MIDI Motor – Note ON/OFF and CC
MIDI Servo – Note ON/OFF and CC

HOMEWORK: Make 2 – 3 sketches of future interface projects. You can make notes and write about the projects as well. I will meet with each of you one-on-one to discuss.

DAY 5

INPUT – Accelerometer input to ESP via I2C
CODE:

DAY 6

Time of Flight Sensor
CODE: USB MIDI Time of Flight Smoothed CC Out
Serial Over USB into PD
OSC from IOS Touch OSC
OSC over USB into Pure Data using OSC for Arduino Library
PD Externals

RESOURCES

SENSORS

IR SENSOR
FLAME IR SENSOR

MORE TO COME…

MIDI REFERENCE

MIDI NOTES AND BYTES CHART

Basic Puredata Tutorials

PD HANDBOOK 1

PD HANDBOOK 2

https://www.keithmcmillen.com/blog/manipulating-midi-with-pure-data/

http://www.andrewfaraday.com/2013/08/midi-controllers-in-pure-data.html

http://write.flossmanuals.net/pure-data/using-midi/

Basic Arduino Tutorials

https://www.arduino.cc/en/Tutorial/Foundations

https://www.arduino.cc/en/Tutorial/BuiltInExamples

MORE ARDUINO TUTORIALS

Lipo Battery Charger

Lipo Battery

MIDI Specifications

http://www.gweep.net/~prefect/eng/reference/protocol/midispec.html

BLE MIDI

SERIAL

https://learn.sparkfun.com/tutorials/serial-communication/all

SERIAL TO MIDI

SPI

https://learn.sparkfun.com/tutorials/serial-peripheral-interface-spi/all

I2C

https://learn.sparkfun.com/tutorials/i2c/all

OSC

http://opensoundcontrol.org/introduction-osc

MORE REFERENCES

Parts and Supplies

Sparkfun – Great kits and parts specific to microcontroller dev, 3d printers, maker stuff

Adafruit – Great kits and parts specific to microcontroller dev, 3d printers, maker stuff

All Electronics – Surplus parts, kits and parts specific to microcontroller dev, 3d printers, maker stuff

Electronic Goldmine – Surplus parts

EXTRA