Implementation of Input Methods with Natural Language for Pictogramming

Abstract

This paper proposes the extension of input method of “Pictogramming”. We have been developing content creation environment using human pictogram, called “Pictogramming.” It also leads to fit for educational use and it also has the advantage that an understanding of the concepts of programming such as sequential execution, parallel execution, variables, looping, conditional statements, etc. can be achieved through pictogram creation without much learning cost. This application can be accessed freely (web site URI: http://pictogramming.org/?page_id=470 and application URI: https://pictogramming.org/editor/). Pictogramming is coined from two words, “pictogram” and “programming”. Pictograms are widely used in various fields such as counseling, safety, and facilities. Thus, the pictogram has been researched in various fields. Pictogramming is designed with the goal of creating pictograms, so its command set and functions are very simple compared to general programming languages. It supports three types of command inputs; 1) English or Japanese keyboard input, 2) dragging the body parts of a human pictogram, and 3) clicking the buttons for supporting command inputs.
In this time, we had implemented further two input methods. 1) natural language sentence input, and 2) natural language speech input for smartphone use. First function allows users to input arbitrary arguments order, and it may useful for learning foreign languages. Second function may shorten the time to input and enhance efficiency.
We evaluate these new input methods through the experiment.

Save as a Favourite

Author Information
Mikihiro Ishii, Aoyama Gakuin University, Japan
Kazunari Ito, Aoyama Gakuin University, Japan