ARTS 2020 (Music and Technology I) or permission from instructor.
Music and Technology II assumes a knowledge and experience in using computer systems to create, manipulate and engage in research within the fields of sound design, electronic music, electroacoustic composition and performance. The course is directed to upper-level undergraduate and graduate students as a project-based seminar which will guide their progress through the design, researching of and implementation of an individual project within in the course of the semester. This class is divided between a group seminar, focusing on the presentation of the aesthetic/ theoretical/ technical/ historical issues related to the field, and a workshop/lab.
Topics will be tailored to current issues raised through individual and group interests including but not limited to software design for musical systems, sound design, musical composition, audio engineering topics, micro-processors and physical computing, computer-aided composition and generative music, musical interfaces, musical robotics, sound spatialization, music in games and gaming environments, and theoretical research in music synthesis and composition. Each student will propose a musical project focus and scope of work for the semester, as well as a basis of the evaluation for individual work. In this way the hope is to combine the approaches of a music-focused research seminar, private study, guided research and group workshop/practicum.
Cultural and historical issues will be addressed through a series of student-led discussions of readings, listenings, videos, guest lectures and concerts. Students will also be asked to make use of the media collection at Folsom Library, as well as on-line access to media collections and journals such as the Computer Music Journal and Leonardo Music Journal.
The two-hour class sessions will generally be divided between classroom seminar presentation and workshop/lab. The final class session will be an informal presentation of individual projects completed in the class.
At the beginning of the course, everyone will give a presentation on their background, musical experience and their proposed focus of work for the semester. This should include recordings or videos of works, performances and related subjects. An initial discussion of class projects will follow and we will organize some of our schedule around issues raised in the proposed projects.
Early in the Semester, each student will present a detailed proposal for their project. This will include descriptions of your working environment, software and hardware, technical issues to be solved, artistic goals, similar work by other artists that you can draw upon and develop. Based on your presentations, we will discuss the scope of your Historical/technical presentation. Graduate students will be expected to engage in a project of appropriate scope to be presented in the Arts Department Graduate Show at the end of the semester and to contribute to their overall research and plan of study. We will have additional discussions, readings and listenings relating to their project.
Each student will deliver a 20 minute lecture on issues relating to their project including an assigned reading and discussion, listenings and multi-media lecture illustrating coding and technical details. Complete scope of each student’s project will be discussed individually based on issues presented in the project proposal.
As the semester progresses, be prepared to talk about and present sketches, sounds, code demonstrations, prototypes and other aspects of your work. This may be incorporated into the development of class compositions and Lab work. It should demonstrate your active involvement in the development of your work throughout the semester. Graduate students will also have individual meetings relating to the progress of their work.
Each student will present their final work in a class presentation and critique. Work must be documented in an appropriate format that we will discuss and handed in by the last day of classes. Graduate students will be expected to present their work in the Graduate Show and Critique.
You must attend class to succeed in this course. Attendance will be taken, and two unexcused absences will reduce your final grade by one full letter grade. Each additional unexcused absence will reduce your final grade by another full letter grade. Five unexcused absences will result in an F for the course. Don’t do this. Absences can only be excused by a letter from a medical doctor or from the Dean of Students’ office.
Participation is a fundamental requirement of the class. Each student is expected to share and assist other students in areas of their expertise and to assist by being either a leader or participant in various projects being developed.
You will be required to present all of your musical assignments to the class, to show your work within the software environment you used to create it, and to engage the class in discussion of your work. When you are not presenting your own work, you need to be attentive to whoever is presenting, and to engage them in discussion of their work. Failure to participate in class will lower your grade.
Each student is expected to share and assist other students in areas of their research as appropriate. Graduate students are expected to take a leadership role in working with undergraduate and graduate class members in and out of class on projects. If you are not participating adequately you will be informed and graded accordingly.
You must attend class to succeed in this course. Two unexcused absences will reduce your final grade by one full letter grade. Each additional unexcused absence will reduce your final grade by another full letter grade. Five unexcused absences will result in an F for the course. Don’t do this. Absences can only be excused by a letter from a medical doctor or from the Office of Student Experience.
Attendance will be taken 15 minutes after the start of the class. If you arrive more then 15 minutes late without a valid excuse you will be counted late. 4 late arrivals of this sort are equal to one absence.
All assignments and presentations are mandatory and must be submitted or scheduled to be presented prior to the last day of class to receive credit.
TBD
Please refer to the guidelines for lab etiquette and usage in the DCC Studio handbook.
If you are using your phone, tablet, phablet, watch, computer or other electronic devise for purposes other then class, such as email, chat, Facebook, games or assignments in other classes you will be counted absent.
You must attend class to succeed in this course.
Throughout this course, you will make use of the resources in the DCC Studio. Students enrolled in the course can gain access to the studio by passing a training sequence as specified in the DCC Studio handbook. You will also have access to recording equipment in the equipment room, which you will be checking out from time to time in order to make field recordings.
When appropriate for an assignment, or to explore sound in general, we encourage the use of your own computer, electronic instruments, etc. Often times, smaller components of a large project can be done on your laptop or home studio facilities and then brought into the main studio to be mixed and mastered.
The Rensselaer Handbook of Student Rights and Responsibilities define various forms of Academic Dishonesty and procedures for responding to them. All forms are violations of the trust between students and teachers. Student-teacher relationships are built on trust. For example, students must trust that teachers have made appropriate decisions about the structure and content of the courses they teach, and teachers must trust that the assignments that students turn in are their own performance. Acts that violate this trust undermine the educational process.
Collaboration between students in this course is strongly encouraged. Likewise, students are encouraged—indeed, to some extent required—to exchange ideas, opinions and information. You are also encouraged to help each other in the lab and with performance, production, and presentation of projects.
Plagiarism of any kind is in direct violation of University policy on Academic Dishonesty as defined in the Rensselaer Handbook, and penalties for plagiarism can be severe. In this class you will be expected to attribute due credit to the originator of any ideas, words, sounds, or music which you incorporate substantially into your own work. This applies particularly to citation and fair usage of sources for media “samples” included in your compositions.
Please refer to the University policy on Academic Dishonesty as defined in the Rensselaer Handbook for policies and procedures governing Academic Integrity. As you will be presenting your work several times as you develop it over the course of the semester, any marginal activities relating to citation and plagiarism will be discussed as you develop your work.
Work found to be in violation of these policies will not be accepted and you will receive no credit for the work with no ability to make up the assignment. If the violation occurs in a final project you will fail the course and it will be reported to the Dean of Students.
Students requiring assistance are encouraged to contact Disability Services: http://doso.rpi.edu/dss to discuss any special accommodations or needs for this course.
The proposed course topics and schedule will be as follows (take note of project due dates!). Based on class progress and interests, this schedule is subject to change. Special topics, guest lectures, supplemental reading, listening and additional assignments to be announced.
RESEARCH PAPER ARCHIVES:
NIME ARCHIVE: https://www.nime.org/archives/
ICMC Archive: https://quod.lib.umich.edu/i/icmc
2020 Class Project Blogs (so far)
NIME ARCHIVE: https://www.nime.org/archives/
Chris Chafe (Stanford/CCRMA) Clapping Latency Studies: http://chrischafe.net/wp-content/uploads/2014/08/temporalSep.pdf
Kurt Werner - Computational Models of the 808: https://quod.lib.umich.edu/i/icmc/bbp2372.2014.221/1/--tr-808-cymbal-a-physically-informed-circuit-bendable-digital?rgn=full+text;view=image;q1=circuit+bending
Digital Latencies: 3x10^8 meters/seconds
JackTrip (Open-Source audio streaming @ full quality) https://ccrma.stanford.edu/software/jacktrip/
International Computer Music Association
Paper Archive: https://quod.lib.umich.edu/i/icmc
Website: www.computermusic.org
Bela Paper: “Action-Sound Latency: Are Our Tools Fast Enough?
http://www.eecs.qmul.ac.uk/~andrewm/mcpherson_nime2016.pdf
Augmented Instruments Lab: http://instrumentslab.org/index.html
Bela: https://bela.io/
Raspberry Pi: https://www.raspberrypi.org/products/
Interactive Source Separation: http://isse.sourceforge.net/
Bananamophone MakeyMakey: https://labz.makeymakey.com/remixes/81
Advances in Actuated Musical Instruments: .pdf
Roli Seaboard: https://roli.com/products/seaboard/rise-49
Leaf Trombone World Stage:
Memory: https://www.youtube.com/watch?v=KetWJi0zou0
Demo: https://www.youtube.com/watch?v=Mn8LEYXUdek
Max Mathews’ Radio Baton: https://www.youtube.com/watch?v=3ZOzUVD4oLg
Imogen Heap (Mi.Mu gloves)
https://www.youtube.com/watch?v=ci-yB6EgVW4
https://www.youtube.com/watch?v=UYIAfiVGluk
Paul Koonce’s Data gloves (2003): http://pcm.sapp.org/event/2003/0410/
Supercollider Programming Language: https://supercollider.github.io/
Brian Pardo: https://dblp.org/pers/hd/p/Pardo:Bryan
NVIDIA Hardware grant/CUDA
MOTION CAPTURELuke Dahl: https://ccrma.stanford.edu/~lukedahl/publications/index.html
MACHINE LEARNINGTensorflow: https://www.tensorflow.org/
Magenta + Ableton Live: https://magenta.tensorflow.org/studio/ableton-live/
Unreal + Tensorflow: https://wiki.unrealengine.com/TensorFlow_Plugin
PAPER: "Deep Pose: Human Pose Estimation via Deep Neural Networks" (pdf)
PAPER: "Gesture Recognition via Pose Classification" (pdf)
Omnitone
Web Audio Conference
Web Audio
Polka Party: https://www.youtube.com/watch?v=ymeUS0DVNa4
https://www.youtube.com/watch?v=OfFyvh_BGN8
Chuck Vocoder: https://ccrma.stanford.edu/~orchi/220a/final_project.html
https://www.raspberrypi.org/products/raspberry-pi-4-model-b/
https://www.raspberrypi.org/documentation/hardware/raspberrypi/schematics/rpi_SCH_4b_4p0_reduced.pdf
https://www.adafruit.com/product/4037
https://www.audio-technica.com/cms/accessories/de806038b48c13d7/index.html
https://fe-pi.com/products/fe-pi-audio-z-v2
https://medium.com/swlh/beats-on-raspberry-pi-a-side-of-elk-c25f7006ee45
Sonification of gait: https://link.springer.com/article/10.1007/s12193-016-0216-9
https://ccrma.stanford.edu/~lukedahl/me281/gait_son_videos.html
https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6468881/
Ableton Kadenze course with Jason Allen: https://www.kadenze.com/courses/ableton-live-10-part-3-editing-producing/info
Karmetik Orchestra: https://www.karmetik.com/karmetik-artists/ajay-kapur/
http://artes.ucp.pt/citarj/article/view/12
https://www.youtube.com/watch?time_continue=3&v=j62bhbK5vOI&feature=emb_logo