Human-in-the-loop Design with Machine Learning

DS 94: Proceedings of the Design Society: 22nd International Conference on Engineering Design (ICED19)

Year: 2019
Editor: Wartzack, Sandro; Schleich, Benjamin; Gon
Author: Wang, Pan (1); Peng, Danlin (1); Li, Ling (2); Chen, Liuqing (1); Wu, Chao (3); Wang, Xiaoyi (3); Childs, Peter (1); Guo, Yike (1)
Series: ICED
Institution: Imperial College London
Section: Knowledge-based engineering
DOI number: https://doi.org/10.1017/dsi.2019.264
ISSN: 2220-4342

Abstract

Deep learning methods have been applied to randomly generate images, such as in fashion, furniture design. To date, consideration of human aspects which play a vital role in a design process has not been given significant attention in deep learning approaches. In this paper, results are reported from a human-in-the-loop design method where brain EEG signals are used to capture preferable design features. In the framework developed, an encoder extracting EEG features from raw signals recorded from subjects when viewing images from ImageNet are learned. Secondly, a GAN model is trained conditioned on the encoded EEG features to generate design images. Thirdly, the trained model is used to generate design images from a person?s EEG measured brain activity in the cognitive process of thinking about a design. To verify the proposed method, a case study is presented following the proposed approach. The results indicate that the method can generate preferred designs styles guided by the preference related brain signals. In addition, this method could also help improve communication between designers and clients where clients might not be able to express design requests clearly.

Keywords: Machine learning, Artificial intelligence, Design cognition, Computational design methods

Download

Please sign in to your account

This site uses cookies and other tracking technologies to assist with navigation and your ability to provide feedback, analyse your use of our products and services, assist with our promotional and marketing efforts, and provide content from third parties. Privacy Policy.