And The Legend Of The Lost Heart
A Reading Adventure Game
Professional Portfolio
-Ported iOS Xcode application to Unity 3D Windows
-Developed Oculus VR version of application with VR UI and full controller and HMD tracking support
Oculus VR and Windows Desktop Virtual Acoustics (Unity 3D, Xcode, Oculus)
-Developed geospatial interpolation engine for interpolation of XYZ contour files with Shapefiles
-Implemented KDTree for optimization of interpolation engine
-Developed batch interpolation engine to interpolate sets of XYZ files with Shapefiles
Geospatial interpolation engine (Unity 3D, ESRI)
-Developed Unity 3D Google Analytics offline cache for capturing events when device is offline
-Developed Visual Studio/C# .NET console application to monitor cache and send to Google Analytics when device is connected
-Integrated Unity 3D and console application to work together and monitor each other
Google Analytics Cached Event Processor (Visual Studio, .NET, C#)
-Developed AR book platform
-Integration of speech/reading recognition and augmented reality
-Developed an iOS Unity 3D Native Plugin to integrate OpenEars speech recognition with Unity
Legend of the Lost Heart AR Book Featuring Reading Recognition (Unity 3D, Objective-C, Vuforia SDK, OpenEars SDK)
-Demonstration of VR for a 3D children's book
-Developed base VR interaction framework that can be used for various content for interactive VR
VR children's book (Unity 3D, Google Cardboard)
-Integrated OpenEars via a custom plugin to provide embedded speech recognition in VR
-Developed VR user interface to visualize speech data and parameters
-Developed an algorithm to tweak the noise filtering for the speech system based on changing noise levels in the environment
VR Speech Recognition (Unity 3D, Objective-C, Google Cardboard SDK, OpenEars SDK)
-Migrated web-site from Drupal to WordPress
-Developed custom Drupal template
Managed content development and technical implementation
Powerful Plants Web Development (Drupal and Wordpress)
-Utilizes ARKit Plugin for Unity 3D to demonstrate a talking 3D character on a table without the user of an image marker
ARKit Demo (Unity 3D, ARKit Plugin)
-Touch sensor on 3D AR button using Unity touch and ray casting API
Interactive AR buttons with trigger for coupon
-Particle system using several custom smoke textures for realistic looking mist
Particle system for fireworks
Hennessy AR Prototype (Unity 3D, Vuforia SDK)
-Externalization of Unity 3D functions into XML and C# engine code allowing for dynamic and interactive AR (and non-AR) experiences to be crafted using XML without internal working knowledge of Unity 3D and Vuforia.
-De-serialize XML into C# objects using Unity/.NET serialization API
-The engine parses the XML and launches the experiences defined there using 100% run-time code without any game objects (except the engine) defined in the Unity scene hierarchy.
-The purpose of this project is to build a library of re-useable code for new projects that is consistent, easy to maintain, and easy to extend.
Core AR Platform (Unity 3D, Vuforia SDK, Vuforia Cloud API)
-2D animated characters on packaging and multi-marker detection and tracking for individual character stickers
-Developed 2D automatic lip-syncing system using speech recognition and sprite animation to automate 2D lip-syncing animation instead of manually key-framing every frame
MyFruityFaces AR Prototype (Unity 3D, Vuforia SDK)
-Integration of speech/reading recognition and augmented reality
Curious George AR Demo (Unity 3D, Vuforia SDK)
-Developed ePub XML and CSS including SMIL based media overlay (read-a-long word highlighting)
The Forgotten Christmas Presents ePub3 eBook with Media Overlay (HTML, CSS, XML)
-Visual editor and adventure game engine for visually building complex adventure games with many scenes, characters, animation, voice acting, inventory objects, puzzles, and quests
2D Adventure Game Engine and WYSIWYG real-time editor (Flash/Animate, Flex/Flash Builder, ActionScript)
-Integrated several 3D scenes from 3DS into Unity 3D
-Configured shaders and materials
-Utilized Unity 3D Standard and HDRP rendering pipelines
-Implemented photorealistic reflections and lighting
-Integrated acoustics audio plugins for realistic audio
-Configured Unity Analytics and Cloud Diagnostics
Real Time 3D Virtual Acoustics (Unity 3D)
-Variable texture combiner
-3D scene save/load in XML
-Complex Interaction and Timeline authoring tool
Unity 3D Editor Tools (Unity 3D)
-Developed WHEN app to help gardeners know when to plant specific seeds based on frost dates and their zip code
-Integration of location services and geocoding from Google to translate geolocation into zipcode
-Integration of push notification services
Burpee WHEN App (Unity 3D)
-Retail kiosk triggers instructional video showing shoppers how to augment at the kiosk
-Allows shoppers to try augmented reality in the store without having to download the app
-Software developed for Android devices utilizes the proximity and ambient light sensors for motion detection
-Native Android code was developed to keep the kiosk software running circumventing users from exiting the app
AR Retail Kiosk (Android, Java, Android Studio, Unity 3D, Vuforia SDK)
-Demonstration of "gyro" based VR when a VR headset is not available
Gyro based VR Without Headset (Unity 3D)
-User begins by looking at the book using a VR headset in AR mode
-User sees the book pages through the VR headset along with virtual user interface buttons
-User can gaze at buttons on book to trigger VR mode
-Takes advantage of stereoscopic AR and VR to provide a mixed reality experience
AR to VR Children's Book Experience (Unity 3D, Google Cardboard SDK, Vuforia SDK)
-Configured consumer and resellers online shopping system in Volusion
-Developed custom user interface to match main site and add additional functionality using HTML/CSS/JS and Volusion's custom template system
Powerful Plants eCommerce Implementation (Volusion, HTML, CSS, JS)
-Implemented Unity 3D and Vuforia cloud for cloud recognition
-Parses XML associated with AR image targets (print advertisements) for app user experience
-Displays company information for each image target using dynamic UI generation
Loads cloud based videos and Unity Asset Bundles to dynamically render AR videos and 3D content
Media Service Company AR Advertising (Unity 3D, Vuforia SDK, Vuforia Cloud API, AWS Files)
-Augmented Reality Fairy Plant Tags
-Developed face poses using Maya animation system for lip syncing
-Programming, including lip syncing automation using Facefx (www.facefxcom) and animation blending in Unity
-Optimized 3D mesh and texture data
Hybels 3D AR Fairy Plant Tags (Unity 3D, Vuforia SDK, Maya, FaceFX)
-Augmented Reality Signs for Retail
-AR Videos for Boulder International Film Festival
-AR Game
Chefy AR App (Unity 3D, Vuforia SDK)
-Development and integration of mobile app speech recognition (Unity and Objective-C plugin) with a cloud-based database to store speech profiles, accuracy, performance, and user voice recordings.
Speech Recognition Testing Platform (Unity 3D, Objective-C, PHP, OpenEars SDK, mySQL)
-AR of a cylinder
Krema Peanut Butter Cylinder AR (Unity 3D, C#, Vuforia SDK)
-Lip syncing is automated through custom viseme parser and animator
-Utilizes the ES Children's Book Platform
-Animated AR book with voice narration, and word highlighting
The Forgotten Christmas Presents AR Book App (Unity 3D, Vuforia SDK)
-Developed an Adobe Native Extension to provide augmented reality to Flash/Flex based mobile apps
-Utilized the Metaio AR SDK and wrapped with custom code to provide ANE and AR capability
Flash ANE (Adobe Native Extension) for Augmented Reality
-Developed geospatial Shapefile renderer for 3D visualization and interactivity across surface and sub-surface 3D mesh
-Dynamic mesh generation and spline contour line rendering based on geospatial data files
-Binary, XML, and JSON data format programming
-Integrated with Azure Cloud API
3D Visualization Software using geospatial data (Unity 3D, Azure, ESRI, GDAL)
-Developed geospatial data API in Azure
-Developed back-end geospatial data processing scripts
-Integrated API with Unity 3D
Geospatial Data API (Azure, Visual Studio, .NET, C#)
-Developed ARKit Facial Recognition app for horror masks
-Includes facial tracking and content integration for opening and closing mouth synchronized with real users mouth
ARKit Facial Recognition App (Unity 3D, ARKit)
-Java implementation of PocketSphinx speech recognition with Android Studio
PocketSphinx Speech Recognition Implementation (Java, PocketSphinx)
-Recorded 360 degree video using a Theta 360 video camera
-Developed software to publish 360 video content for real estate as a VR app
360 VR Real Estate Experience (Unity 3D)
-Developed AR app to bring characters to life on organic vegetable seeds
-Managed all aspects of app including integration of animation and voice acting content, user interface design
-Learn more at www.powerfulplants.net
Powerful Plants AR App (Unity 3D, Vuforia SDK)
Updated app to stream videos from Vimeo API rather then embed videos
Much smaller app footprint
Powerful Plants AR App Cloud Update (Unity 3D, C#, Vuforia SDK, Vimeo API)
-3D Interactive AR Animation synchronized with AR video using a chroma key shader
Interactive AR (3D augmented globe with buttons)
-AR Shooter Minigame using ARKit
MARS Candy Prototype (Unity 3D, Vuforia SDK)
-Film festival app featuring schedule, film trailers, and augmented reality for the printed program
-Cloud based XML data feed to drive user experience
-AR Program Guide with augmented reality trailers
Boulder Film AR Program Guide (Unity 3D, Vuforia SDK)
-Unity 3D Particle System, Multiplayer API, and Physics System
-Large AR playmat for multi-player AR Games
-Hungry-Hungry Croc’s AR Game
-Castles and Towers AR Game
Mattell AR Playmat Prototype (Unity 3D, Vuforia SDK)
-Platform allows content producers and publishers to build companion apps for printed children's books
-Provides common features across any book regardless of the images or 3D content including 3D animated AR, Voice Narration, Spanish and English modes, Voice Recorder (Hear the story in user’s voice).
-Developed an XML based story timeline and engine integrating 3D animation, multi-lingual voice acting, narration and word highlighting
AR Children's Book Platform (Unity 3D, Vuforia SDK)
-Tool takes in PDF files, voice narration, and ePub3's and outputs ePub3 updates including SMIL file creation with proper word timing data to highlight words as they are being read aloud
-Developed custom shell scripts that utilize pdf command line tools to automate the process of converting aPDF file to an ePub3 with Word Timing data for Media Overlay (SMIL)
-Integration with Speechmatics speech to text API
-Produces SMIL files and updates ePub3 files to add voice narration and word highlighting
-Unity 3D tool that reads data produced to visualize and play voice narration to test our output
PDF to ePub3 Automatic Word Highlighting for Voice Narrated eBooks (Linux Shell Scripts, PDF command line tools, Speechmatics API, Unity 3D, C#)
-Lip syncing is automated through custom viseme parser and animator
-Utilizes the ES Children's Book Platform
-3D AR book with animation, voice narration, and word highlighting
Coco's Lullaby AR Book App (Unity 3D, Vuforia SDK)
-Integrated the Metaio AR SDK into native Objective-C and Android Java
-Wrote 3D rendering and memory management code