We are developing an information retrieval system as an application for an immersive display. It is hard to think that we use only a keyboard for information retrieval in an immersive display and, in a space with an expanse of the air space such as a library or a bookstore, we use the body in looking for information. So we are developing an information retrieval system that positively uses movement of a body and that integrates information retrieval and object retrieval. We built a visual query that we can use in it. A user arranges locations of information icons so that those of relevant information are near. With estimating how the user catches connection between information from the location relation by Genetic Algorithms, the system shows new information and computes the locations that new icons should be. The ratios of distances of icons play a query and a evaluation function in Genetic Algorithms. Image processing technique will turn the system into a system that use icons and real objects jointly, because it is the information retrieval system which used only position relation of objects.