MR interface for Para-Wall:
Prototyping Mixed Reality User Interface
for parametric architectural structure via Hololens
Grad School Project
Cornell AAP
"Bamboo Tactics", Spring Semester, 2022
Hoon Yoon, Janet Lu, Milena Marchan
Working period : Jan.2022 ~ May.2022
Participated as an industrial, UI/UX/GUI designer along with PM role
In designing a components-aggregated structure with understanding the materiality of a certain architectural medium, in the class--"Bamboo Tactics" run by Leslie Lok during the spring semester 2022, me and my team member(Janet Lu, Milena Marchan) utilized several types of AR/MR technologies to render the digitized structural components and adapt them to the actual manufacturing process to see how the hologram interface-integrated working environment could be possibly established as a new type of augmented fabrication experience. On a technical aspect, our team used Microsoft's Hololens2 which provides a mixed-reality experience and its interface, and for the software aspect, we used the Fologram plugin that supports the real-time bridge connection between computer(where the parameters or modeling are manipulated) and Hololens(where the holographic modelings are rendered).
WIth crafting the bamboo-based structure along with understanding the unique materiality of bamboo itself such as tensile strength, irregular node system(diameter and interval between nodes), and so on, within a team I mainly modeled the entire structure and parameterized its architectural characteristics(e.g. tile anchor point density on each curve, curve degree on a bamboo pole, tile's offset degree on the main pole) via Grasshopper. Based on this computational setup, as mentioned above, I utilized the external plugin "Fologram" and connected its export components to each key parameter of a structure to export and convert it into a holographic modeling within Hololens environment.
Figure 1: Actual footages of utilizing Hololens to apply holographic interface on to the physical bamboo components and its assembly process
Figure 2: Scenes of modeling the parametric bamboo tiling system integrated with bamboo pole along with individual call-outs. This modeling is then augmentedly rendered through Hololens interface
Figure 3: Parametric bamboo tile array interface for the actual component assembly. This interface also was rendered through Hololens when physically assembling the bamboo tiles onto bamboo pole according to this holographic guidance.
Constructing Para-Wall via Hololens
Based on parametric modelings and its parameters scripted by Grasshopper, me and my team crews set up the procedure and its technical guidelines in order to implement physical assembly integrated with Holographic user-interface rendered via Hololens.
Figure 4: Procedural diagrams for assembling components, and guidelines for interplaying with holographic interface for the augmented assembly procedure
Figure 5: Hololens interface-integrated physical component assembly
Figure 6: Holographic component assembly simulation via Hololens
Figure 7: Entire MR workflow video via Hololens interface
Figure 8: Final outcome of "Para-Wall"
Para-Wall:
Prototyping Mixed Reality User Interface
for parametric architectural structure via Hololens
Grad School Project
Cornell AAP
"Bamboo Tactics", Spring Semester, 2022
Hoon Yoon, Janet Lu, Milena Marchan
Working period : Jan.2022 ~ May.2022
Participated as an industrial, UI/UX/GUI designer along with PM role