I lead and drove emerging tech and innovation for APAC where I was tasked to Scout for new technologies and services, research and develop and present Probes, make and demo Proof of Concepts (PoCs), build and test Prototypes, run Experiments and then go to BAU.

T&DA was exploring pixelstreaming and a the metaverse. We built a PoC with Unity.

While at T&DA I was lead Creative Technologist on a cool AR activation idea by Special Group for Coopers called "Big Things" which was a Geolocation based AR app. We built it with native code in Android and iOS. If you are in Austrlaia you can see it here www.bigales.com.au

Write up

Coopers, the last locally owned and operated big-beer brand in the country, announced the findings to celebrate ‘Local, Everywhere’, a campaign set to mark the brand’s place as the local beer of Australia. Because although Coopers may be born in Adelaide, it’s raised by locals all over Australia, making Coopers truly Local Everywhere.

T&DA created an IOS and Android app concurrently, utilising Appclips and Instant Apps to remove barriers of entry involved in downloading an app.

Launching via the interactive AR mobile experiences, paid & owned social, earned media, influencer content, and large & small format OOH, ‘Local Everywhere’ breaks new ground in augmented reality. The enabling of a geospatial AR experience, with dynamically occluding AR ‘Beer Cans’ in over a thousand locations nationwide is an Australian first, demonstrating the brand’s ambition across the country.

Media & Press

COOPERS CELEBRATES BEING ‘LOCAL EVERYWHERE’ WITH GIANT-SIZED ACTIVATION VIA SPECIAL

Thursday 23rd November: Coopers is ushering in a celebration of ‘locality’, with the launch of a new multi-touchpoint campaign from independent creative,

Roastbrief USRoastbrief

Special: Coopers launches Australia’s new Big Thing (1,200 of them)

The Next Big Thing in Big Things - ‘Local Everywhere’ Campaign from Coopers | Branding in Asia

Throughout a storied 162-year history, Coopers has always remained loyal to their original beer making ways and loyal to the local towns of Australia, from Geelong to Glebe, Cottesloe to Cairns and every town between. That’s why you will find Coopers on tap, in the fridge, and in the hands of drinke…

Branding in AsiaBIA Staff

Outdoor ad: Coopers Brewery: Big Ales, 1

Coopers is ushering in a celebration of ‘locality’, with the launch of a new multi-touchpoint campaign from independent creative, design and PR...

Best Ads on TV

Yeah!Nah! x HKWalls ROOMS was a one week long exhibition ar PMQ in Hong Kong SoHo district. It showcased some local Hong Kong artsts as part of the street art festival.

Background

Yeah!Nah gallery was an artist run space. Visitors vote on the art. Winners go through to final show in 6 months. When visiting a gallery curators select the work and the public consume it. Yeah!Nah! Gallery is a concept gallery that challenges this idea. What if the audience selected the work. This gallery concept not only  embraces popular art but the unpopular too decentralising the modern gallery cannon.

Yeah!Nah! Was a gallery that ran in Shanghai in 2018. The gallery ran for 6 months where the most and least popular works were chosen by the audience with the hope of exhibiting in their own show. There was the pop art movement, this is the pop gallery movement! Yeah!Nah! X HKWalls is a popup version of that gallery.

User: I need help to make this text read better for public promotion of a pop-up gallery I'm running during Hong Kong art week. You are a copywriter at a Public Relations Agency and you are writing a press release. use this text:

Title: Yeah!Nah! Gallery

Yeah!Nah gallery was an artist run space. Visitors vote on the art. Winners go through to final show in 6 months. When visiting a gallery curators select the work and the public consume it. Yeah!Nah! Gallery is a concept gallery that challenges this idea. What if the audience selected the work. This gallery concept not only embraces popular art but the unpopular too decentralising the modern gallery cannon.

Yeah!Nah! Was a gallery that ran in Shanghai in 2018. The gallery ran for 6 months where the most and least popular works were chosen by the audience with the hope of exhibiting in their own show. There was the pop art movement, this is the pop gallery movement! Yeah!Nah! X HKWalls is a popup version of that gallery.

Llama: Title: Discover the Future of Art Curation - Experience Yeah!Nah! Gallery During Hong Kong Art Week=\

Description:

Yeah!Nah! Gallery is set to challenge the art world during Hong Kong Art Week with its innovative approach to curation. Inspired by the concept from Shanghai in 2018, this pop-up gallery empowers visitors to become curators and decide on the artwork that will be showcased. The winning pieces will then progress to a final exhibition in six months' time, providing artists with an unprecedented platform for exposure and recognition.

Embracing both popular and lesser-known works, Yeah!Nah! Gallery attempts to decentralize the traditional gallery canon, giving voice to diverse artistic perspectives. Don't miss out on this unique opportunity to shape the future of curation - experience Yeah!Nah! Gallery during Hong Kong Art Week.

I worked as a Lead Developer at KPMG / Wiise building the On Time Warehouse Management app. It was a complex tool that made warehouse management simple and enjoyable.

CODE & Visual agency and I created a interactive cyber attack training experince for PwC.

I was lucky to work on a uniqie project for the Academy Museum in LA. The project was with Impossible Bureau and used AR with Unity3D, React and Geolocation to offer patrons a more engaging experince during their visit. Users could see more details about selected works, such as Bruce Lee, by scaning the artwork and launching supporting material like movie scripts and other media. There was also a geolocation based piece which would direct patrons to important and noteabkle attractions and landmarks in the area. The inital idea was from Fantasy.

A government tool to help with carrer pathways built in react. The APS Career Pathfinder Digital Profession tool is a way to may you future career goals back to your current postion and help people decide how to get into a certain postion. Being a Government site it had to be Accessibility compliant and work with screen readers which was a first for me. It was also my first time using Hooks in React.

While freelancing at Grumpy Sailor I helped to build a multiplayer team building experince for Atlasian. The tool paired 5 random employees who had to work togther to solve 5 different puzzles. The app was build in Svelte.

I was asked to create a PoC of the next generation automotive show room app by Z-Space. I used Metaeo which was taken over by Apple. I used Mateo and Unity to build an object detection AR car configurator for one of the most prestigeous Luxury brands around.

Working with the awesome team at UNBND we built a multi sensor node that sent data to a Unity app to generate NFTs. Unfortunatley the project was canceled because of COVID but the learnings were great.

Creative Direction

Inspired by artwork by Refik Anadol, Ryoji Ikeda, Field, Mark Dorf, Janusz Jurek I offered creative direction and lead the ideation on the look and feel of this project.

Experiments

Tech Direction

Above: Final format Raspberry Pi sensor with camera mic and distance sensors.

About

This project combines sensors procedural and generative digital art with NFTs. It was planned to be a live event (2-4 hours) and an on premise activation for 2 weeks in multiple locations.

Project Status: ON HOLD

Due to COVID-91 the project has be placed on hold. The work completed included a working Proof of Concept sensor and artwork component.

Here you will find all work completed to this point. What is missing is the artwork's creative direction and treatment which was to be coordinated with a featured NFT artist who was TBD at the time of writing.

Tech Flow

This information architecture diagram how the technology flow from the sensors to the app and and back. This diagram represents one raspberry pi (nodeJS) and one art app (Unity) connected via websockets.

Sensors

Raspberry Pi and sensor setup

Connecting to Raspberry Pis

The existing raspberry pi can be connected to with the following command

Osx

$ ssh pi@raspberry.local

Then enter the password

Windows

$ ssh pi@raspberry.locla

Then enter the password

Troubleshooting

If you cant connect ensure SSH has been enabled in the raspi-config settings and that you have the correct host name. If you dint have a hot name you can just use the Pi’s ip address wich can be found with the command $ ifconfig.

Software

There are two main parts to this project the server and the client. The server sits on each raspberry pi and is a socket server that the client connects to. It will transmit the sensor data to all clients when called for. The client is a web socket client that connects to the host name or ip and sends a message command for each sensor which in return the servers will send back sensor data. The commands are as follows:

‘cam’ - requests the camera data

‘dist’ - requests the ultrasonic distance data

‘Sound’ - requests the sound data from the mic

Server

About

This component is a node.js application which uses websockets to establish a web socket server for clients to connect to.

Clinet

About

This component is a Unity application but can be any language that uses web sockets. It uses websockets to establish a web socket client to send custom messages and then receive sensor data.

Hardware

The hardware and sensors component of this is modular and is based on the the following:

1. 1 x Raspberry pi 4 (include)
2. 1 x Raspberry Pi camera either normal or for low light the NOIR (included with spares and variations)
3. 1 x Ultrasonic sensor HC-SR04 (2-400cm) or HC-SR5 (3-500cm) (included with spares and variations)
4. 1 x usb microphone (or usb audio interface) (included with spares and variations)
   

Other hardware requirements include:

1. Raspberry Pi camera Housing (included)
2. Wall mount
3. USB-C Power supply
4. WiFi router and connection
5. GPIO out for testing (included)
6. Heat sicks
7. Micro SD card

Raspberry Pi Setup Requirements

This project assumes you have the following skills:

1. Raspberry Pi - Raspberry pi or linux experience
2. Electronics - read schematics and understand electronic foundations
3. Network skills - SHH and connectivity required
4. Git - clone and ssh keygen required

Build and Setup Instructions

1. Install latest Rasperian on a 32Gb SD card
2. Run typical Raspberry Pi Setup with
   $ sudo raspy-config
3. Set new Password
4. Set hostname
5. Expand drive
6. Set root mode to password command line (not desktop)
7. Set WiFi
8. Enable SSH
9. Copy SSH keys if you need to dev on the Pi
10. Enable camera
11. Run Raspberry Pi Upgrade
12. Run apt-get update
13. Install Git
14. Install Node
15. Clone tt socket-server repo
16. run
    $ npm install
17. Connect hardware
18. R Pi NOIR Camera and setup then test it works
19. Mic and setup then test it works
20. Ultrasonic sensor and setup then test it works
21. Set up node socket service as a Daemon, PM2 or node Forever
22. Install Forever globally with
    sudo npm install forever -g
23. Edit `sudo nano /etc/rc.local` and add a line before exit eg
    ‘sudo node /home/pi/apps/sensors/socket-server/index.js’
24. Reboot machine with reboot -now
25. The Pi will restart and launch the socket server with the sensor services running ready to be connected via websocket
    

Websocket Methods

The websocket runs on port 8080 so to connect you need to use the address or host and port number. For example.

ws://raspberry:8080

Then from the artwork app, Unity for example connect to the socket and send a message then hangel the response.

Send Sensor Message in C#

ws.Send("cam"); // get camera sensor data

ws.Send("audio"); // get sound sensor data

ws.Send("dist"); // get distance sensor data

AUDIO_EVENT = "AUDIO_EVENT",

DISTANCE_EVENT = "DISTANCE_EVENT",

CAMERA_EVENT = "CAMERA_EVENT";

Receive Sensor Message in C#

ws = new WebSocket(ip);

ws.Connect();

ws.OnMessage += (sender, e) =>

{

if (e.Data != null){

string targ = ((WebSocket)sender).Url.ToString();

Debug.Log("Message Received from " + targ + ", Data : " + e.Data);

WSMessage jsonData = JsonConvert.DeserializeObject<WSMessage>(e.Data);

if (jsonData.Message == WsEventsType.AUDIO_EVENT){

Debug.Log("[WS - AUDIO_EVENT] Message Received from " + targ + ", Data : " + jsonData.Data);

DataManager.instance.AddSoundSpectrum(jsonData.Audio, targ);

}

}

Sensors

Ultra Sonic Distance Sensor

About

There ware a few options for the sensor and testing in the actual site needed to be done to determined the best suited sensor. However, this POC was created with the most common and tough sensor from the robotics industry called the HC-SR04 and HC-SR05.

Configuration

See Pi setup instructions

Code

The main class for the ultrasonic sensor can be found in the socket-server directory and is called getDistance. This is called from inde.js and props are parsed through such as:

Id: sensor id for differentiation

Interval: int for update frequency

Trigger: pin for trigger

Echo: pin for echo

There are javascript and python scripts to help test the sensor is connected and working if the sensor output data received is null.

Microphone

About

This sensor is a basic USB mic which is very simple to setup (see above). It pulls a frequency spectrum from the mic and parses it rhoguth.

Configuration

See Pi setup instructions

Code

The main class for the mic can be found in the socket-server directory and is called audioSensor.js. This is called from index.js and props are parsed through such as

Id: sensor id for diferentiation

Interval: int for update frequency

NOTE: There are javascript and python scripts to help test the sensor is connected and working if the sensor output data received is null.

Camera

About

This sensor is a standard Raspberry Pic camera which is very simple to setup (see above). It pulls the current frame camera and parses it through as a Buffer object.

Configuration

See Pi setup instructions

Code

The main class for the camera can be found in the socket-server directory and is called videoSensor.js. This is called from index.js and props are parsed through such as

Id: sensor id for differentiation

Interval: int for update frequency

Width: int for height pixels

Height: int for height pixels

Fps: int for framerate

Encoding: JPG, PNG GIF or BMP

Quality: int out of 10

NOTE: There are javascript and python scripts to help test the sensor is connected and working if the sensor output data received is null.

Reference Images

NFT Art Software

Unity

The unity component of this project has three main parts, the web socket, the data manager and the artwork. As the artwork style and treatment was TBD this part has been left out for simplicity.  

Software Images

Above: Screen shot of socket server and client. Left screen is the ssh output of raspberry pi socket server printing the sensor data and sending it to unity. Right is the Unity socket client receiving the web socket data.

Supporting Documents

Recommended Hardware list - may change based on final execution and approach

Parts List

I was lucky enough to work on a short project with Apple Sydney

ADF Tech - Tri service Defence Force Recruitment campaign was a series of snapchat lenses that generated over 20K views in each month.

Unity app with 6 chance games, mini games and easter eggs

We hijacked Metro City globe, put arunners up here to show how ‘Running makes the world go round.’ more

Tech

Coming soon

Problem

Coming soon

Solution

Coming soon