Holofractal Transducer of Sound & Image Suite: notes on the alpha release of version III

Release Notes

Evolving from HTMI 2 to a suite of apps, HTSI 3 is now being released for the first users, musicians, musical producers and live interactive performers (dance, theatre and other fields).

Download link: HTSI download from Dropbox

My Patreon: patreon.com/eufraktus

About this beta released modules (in alphabetical order):

1. Astro – AstroNoiseBand is dedicated to calculate the orbits of the Solar System main massive objects (planets and satellite) and apply the function to noise filters. It allows the user to accelerate the movement by a million (or even more, depending on your machine). It may be also used to filter an incoming live sound or a sound file, beside white and pink noise. Amazing for complexifying a live sound performance.

2. Audio2Midi – as it says in the title, this module takes incoming audio signal and converts it into midi discrete notes. Melodic, so far, but perfect for instance to improvise live with AI Duet, a piece of online Artificial Intelligence algorithm that “listens” midi notes, compares them to a huge music database from Magenta.TensorFlow project )available here https://github.com/tensorflow/magenta-demos/tree/master/ai-duet) and find a “proper” auto generated melodic response. Fun garantizada!

3. FrakGran – Fraktal Granulator is based on the Granular Synthesizer patch created in Max 6.0.7 by Håkon Nybø (upon the build saved on 18/12/2012 and freely distributed by the author on http://hakonnybo.com/). It received some midi income data new “doors”, in order to integrate the HTSI Suite III. If you plan to use it, please share alike the author’s credit.

4. FrakMSP – Fraktal Midi and Sample Player is the flagship and the core of the whole Suite. Its main function is to capture a webcam live stream and convert the detected pixels movements into a flow of midi data, which may be directed to a physical or virtual synthesizer. Version 3.3 (stable) encompass several modes like Diatonic (white notes), Fractal (Gaston Julia’s), Dodecaseries (through autogenerated random dodecaphonic series), MidiFlow (allowing a midi file reading of any piece of music that will be triggered by the webcam detected motion), between many other possibilities. In the field of audio sample playing, it offers 2 submodules: one for aleatoric triggering of up to six different audio files, and a second that randomly controls the speed of up to seven audio files, both based on the motion detection. There is a tap tempo controller, restricted to the wisdom of finding a compatible cue limiter (Qlim) calibration. Last, it offers the sending of midi cc (control change) messages to two simultaneous channels, by means of midi or OSC messaging (localhost or network streaming).

In version 3.4b (unstable) you will find the new option for Mandelbrot function in Fractal Mode (really beautiful stuff) and a small version of Audio2Midi inside the ADC submodule (yes, I know, a subsubmodule is terrible, but … I have my reasons).

5. Fraktal Improvisor is a lightweight fractal series generator, based on up to 4 simultaneous fractal melodies artificial composer (a stupid, but unpredictable one, I would make a serious remark). Useful for the most lazy moments of your performance (and even for going to the bathroom, specially if you combine a good grand piano sound with some post-post-modern synthetic timbre, reverb and delay at your personal taste, from French reverbs to Brazilian Barbecue long ping-ponged delays).

6. Fraktal FM Waves Generator allows you to combine up to four voices to play waves with Julia’s fractal defined frequencies. There is a “drone” auto generator and it may receive external midi input, such as Audio2Midi, FrakMSP, depending on the bus you select.

7. Serial Killer is unfortunately waiting for an update of the “matrix12” max object in Max 8. When working properly, it plays up to six voices of dodecaphonic series, including their retrograde, inverted and inverted-retrograde.

8. X.FM is a slightly improved version of the homonymous synthesizer offered with Max/MSP. I added to it some midi cc controls, an autoplayer, an external midi port OSC input and some new timbre presets may be found at the presets folder.

You may see the HTSI Suite in use at BSBLOrk – Orquestra de Laptops de Brasilia YouTube Channel: youtube.com/bsblork

Any problem or suggestions may be addressed to eufrasioprates at gmail. Screen prints are welcome! Help sharing with artistic communities.

Advertisements

HTMI becomes HTSI, a Suite in version 3.0

The new version of the interactive system Holofractal Transducer of Music and Image became so different from the previous ones that I also decided to change its name to Suite for Holofractal Transducers of Sound and Image, the III version. As its name sounds, it brings together several independent apps, called modules, which may be combined and used as the player/improviser needs them. That was the solution for the heavy increasing in memory and processing power as we moved from version 1 (in Max 5, 32 bit) to version 2 (in Max 6, 64 bit). But it also meant an opportunity for opening more combinatory possibilities than the available ones in the old releases.

If you are interested in being one of my alpha testers, you may download some of the apps from the Suite HTSI3:

https://www.dropbox.com/sh/o8bsox9flaiz7jf/AADDhA84iUBT9FTbZsOAKVwQa?dl=0

More details briefly (and no, there’s still no date for the complete releasing).

 

Workshop Música Interativa Digital (Digital Interactive Music)

O workshop “Música Interativa Digital” objetiva capacitar artistas e leigos para o uso do Sistema Holofractal de Transdução de Música e Imagem em instalações audiovisuais interativas, performances, teatro, dança, música experimentais. Mais recentemente, o sistema vem também sendo usado na área de medicina e neurociência, por conta de suas ferramentas fractais de conversão de movimentos e ondas cerebrais em sons e imagens (uso em diagnóstico e potencial em tratamentos musicoterápicos).

A carga horária pode variar entre 12 e 15 horas (divididas em 3 ou 4 turnos), dependendo do público e de suas necessidades específicas. Customizações podem ser solicitadas a eufrasioprates@gmail.com.

Veja abaixo o trabalho final de turmas desse workshop:

Sala Plínio Marcos – Funarte (Brasília, 2014):

Escuela Nacional de Música (México City, 2014):

Tubo de Ensaio – DEA/Unb (Brasília, 2013):

 

Sistema HTMI abordado na tese de Cínthia Nepomuceno

Intitulada “Processo Transcoreográfico”, a tese de doutorado da dançarina e docente Cínthia “Gamila” Nepomuceno, aprovada em Mai/2014, aborda em detalhe o processo criativo do coletivo de dança experimental “Corpo Baletroacústico“.

O trabalho desse coletivo, iniciado em 2012 e premiado em 2013 no edital nacional COLETIVIDEA, se baseia desde o princípio no uso do Sistema Holofractal de Transdução de Música e Imagem como ferramenta tecnológica de fundo estético, isto é, como provocadora de formas experimentais de concepção e improvisação de dança e música interativas.

Veja a seguir um dos diversos trechos em que o sistema HTMI é citado (pp. 119-120):

Os participantes do processo que responderam ao questionário para essa pesquisa (anexo IV) foram
unânimes em afirmar que o Sistema HTMI poderia ser utilizado com sucesso como
ferramenta metodológica para atividades criativas na área de dança. Eis algumas falas
que gostaria de destacar:

  • O Sistema HTMI nos possibilitou brincar, explorar, aprender, renovar e reformular a dança, o corpo, o som e o contato com os outros. Utilizar o software possibilita a criação de ideias a partir da desconstrução e acredito que desconstruir é um ótimo passo para se construir algo. Devido a isso, acredito que o sistema pode, sim, ser uma ótima ferramenta metodológica. (Izabella Beatriz em resposta ao questionário do anexo IV) 
  • Em se tratando de pesquisa em dança, esse sistema é uma ferramenta inovadora, porta para muitas possibilidades em termos de pesquisa de movimentos, especialmente para quem trabalha com a improvisação, além de despertar novas possibilidades sobre processos de composição coreográfica, especialmente aqueles que se utilizam da música. (Helena Medeiros Costa em resposta ao questionário do anexo IV)
  • Dançar com o sistema HTMI é algo que alguns podem classificar como sobrenatural. Porque aparentemente a mente entra em transe devido ao som, e com as projeções o corpo se estende sem dicotomia. Tudo se torna uma grande experiência que leva a pessoa que está dançando a outro mundo – concentração total na ação, com trabalho na corporeidade, foco e criação em novos movimentos. (Bart Almeida em resposta ao questionário do anexo IV) 
  • Eu me senti muito lisonjeado em ter contato com essa tecnologia foi fantástico para mim, nunca tinha visto ou experimentado a sensação que o Sistema HTMI me proporcionou e um ar de liberdade com criação simultânea. Uma composição instantânea. (Wesllen Masolliny em resposta ao questionário do anexo IV)

Download HTMI System v. 2.2g (for Win and Mac)

DOWNLOAD version (2.2g) of the .MXF for Mac and Windows, now including a MotionGram video recorder and a database file including discrete data from the Video Transducer (Quantity of Motion, X and Y position in the webcam). This is an open code version, that you may change at your will (considering the CC license).

Opens in Mac and Windows, using the Max Runtime 6.0.8 (Mac) or 6.1 (Win), available for download at cycling74.com.

HTMI – Holofractal Transducer of Music and Image System

This system is a Max/MSP patch which integrates several FM synthesizers (by John Bischoff and Cycling 74), granularizers (by GMU and Christopher Keyes) to video motions transducers (one of them based on Jamoma’s Library: www.jamoma.org), allowing the user to convert video signals into fractal sounds.

Image

An article about the main features of this system may be found here, on page 123: https://ccrma.stanford.edu/~ruviaro/texts/SLEO_2012_Proceedings.pdf

My Ph.D. thesis, which encompasses a full chapter about the system in Portuguese, is available here: http://repositorio.unb.br/bitstream/10482/10702/1/2011_EufrasioFariasPrates.pdf

And here you will find the detailed technical specifications of the first version (in Portuguese, only): https://www.dropbox.com/s/2lxfa7152jchio7/Sistema%20HTMI.pdf

Choose and download the latest versions of HTMI System at the main page of this website.

What is Holofractal Music

Hard to put on a few words, but the Holofractal Music project is a new approach on interactive music creation and listening, based on semiotic transductions of dance, poetry, performance, video, movies, theatre, gestures or anything that moves into fractal sounds. The research dates from the 1980’s, when I was advised by composers as H.-J. Koellreutter (1915-2003) and Conrado Silva de Marco (1940-2014), which were students and teachers of Luigi Nono, John Cage, Karlheinz Stockhausen and Pierre Boulez, my Aesthetics “grandfathers”.

This is accomplished, mostly, by means of a software I developed in my Ph.D. research called HTMI – Holofractal Transducer of Music and Image System. It is a free software, licensed under Creative Commons, and you may download it here.

Eufrasio Prates, Ph.D.
eufrasioprates_at_gmail

Complementary software you may need

First of all, you may know that all Max software is fully developed for Mac OS X and in the last years they are supporting Windows versions, but not fully functional. This means that you may suffer a little bit more, if you’re on Windows, but never fear — it is possible and in all my workshops I have some PC users that already did it (not all, nevertheless). Linux, unfortunately, is not supported at all (which is a shame, I agree).

MAC USERS

If you’re running OS X 10.4 or superior, you should be able to get everything done, but in some cases you will need to download one or some of those libraries or extensions:

WINDOWS USERS

HTMI System, Patch version 2.2c: https://www.dropbox.com/s/b8grmhpt1wzfj47/HTMI2.2d.zip

To run it, you will need Windows versions of: