Internship - Bluteau Jeremy

	Internship Information Technologies for Health 4th Year Bluteau Jeremy
	10 - May - 2005 to 26 - July - 2005
	At University of Tsukuba

Last update : 21-07-2005

You'll find in this page all necessary stuff for observing my project advance.
First, you'll find my subject presentation. Then, the current project managment GANTT graph. And finally, my weekly results.

Subject
Here is my subject presentation : subjectpresentation.pdf (update 15-05-2005)

Current GANTT graph

This is the current GANTT graph. Run of project is shown by a different color (gray). So, you can see if the project is leading or delayed. (update 21-07-2005)

Results
In RED, encountered problems.
In GREEN, solutions.

22-05-2005 / 25-07-2005 : Summer camp of the laboratory.

16-07-2005 / 22-05-2005 :

Ending the redaction of the report for Polytech'Grenoble
Realisation of presentation for the laboratory (on July,26)
Presentation for Polytech
Rapport de stage

09-07-2005 / 15-07-2005 :

PULICATION : See-Through Medical Examination: Visual Support for Medical Consultation by using Projector-Based Augmented Reality and Thermal markers Jeremy Bluteau, Itaru Kitahara, Yoshinari Kameda, Haruo Noma, Kiyoshi Kogure and Yuichi Ohta Submission to ICAT (www.icat2005.org). The file will be on-line after the submission dead-line.
Changes on Human Machine Interface (HMI)
Docummentation of the code with Doxygen
Writing report for Polytech'grenoble

02-07-2005 / 08-07-2005 :

Correction on the paper for ICAT
Screen shot and Photos of the system while running. Here are the photos (1) (2) (3) (4).

25-06-2005 / 01-07-2005 :

Writting the paper for ICAT submission
Implement calibration between Thermal-camera and Projector
Test Thermal-marker in real condition

18-06-2005 / 24-06-2005 :

Installation of Thermal-camera . Here is photo of Camera (1) (2).
Implement Contrast Enhanced filter to obtain a good contrast. Other Image Filtering.
Compute Camera-Projector calibration matrix. (begining)

11-06-2005 / 17-06-2005 :

Research of virtuals Organs Database. Somes databases exists but not in VRML2.0. Import of 3ds file in blender.
Auto Warping of 3D-human model based on anatomy data.

Here is a video

04-06-2005 / 10-06-2005 :

Research of virtuals Organs Database. Delay due to lack of free and checked database.
Learning of overlapping and matching techniques.
Thresolding of Z-position to delist gaussian error of camera capture.
Warping of 3D-human model.

The z-position error is reduced and the 3D-human model can adjust the markers
Here is a video.

30-05-2005 / 03-06-2005 :

Displaying complex 3D objects. Draw an object in OpenGL is pretty long and we can't freeze in binary all organs. Thus, we need to import organs separately. Installation of ARToolKit 2.70 (the last one, with VRML2.0 support). Rewritting of previous program to fit the new specifications.
Modeling an organ (lung). Data didn't fit WRML2.0 format. Installation of Blender (3D modeler).
Here is a screenshot :

The camera was capturing 3 markers.
The WMRL Lung model is display in the center of these 3 markers.
Screenshot.

Z-distance evaluation is based on estimation from the square-shape of markers, indeed large error. Any model projected are not stable enough for an Health application !

Here is a video.
Discussion with Kitahara sensei. Several solutions :

Filtering video capture, implement a low-pass filter. (-) : a delay is generated.
Adding a second camera and filter data. (-) : it's an expensive and not so efficient solution.
Using a thresold to minimized the error. (+) : esay to implement. First intention solution.
Fixing a 3D-reference human model by stretching it to fit the markers. (+) : each marker influence only one part of the body. The global error is minimized. (-) : difficult to implement.

Processing Presentation for laboratory on tuesday 07 juin. Here is the presentation (checked by Kameda-sensei). Here are the slides.

23-05-2005 / 29-05-2005 :

Localization of markers. Marker position follow the OpenGL specification (i.e. matrix notation). Borrowing of a book : "OpenGL, Programming Guide. J. Neider, T. Davis, M. Woo".
Localizing several markers
Here is a screenshot :

The camera was capturing 3 markers.
The program localize them. Positions of each markers are processing. Relation between marker is found. A polygon is drawn between each markers.
Screenshot

16-05-2005 / 22-05-2005 :

Try to understand ARToolKit 2.10. C++ Language and makefile. Analysis of several samples.
Little program to improve ARToolKit.
Control the Camera device. I wrote a C++ class to perform this action.
Here is a screenshot :

The camera was capturing a marker.
The Program localize this marker and display a blue cube under the marker.
Screenshot

10-05-2005 / 15-05-2005 :

Arrival
Definition of subject.
Setup of computer under linux. Lots of packages were in Japanese or miss. Reinstallation of Linux.
Plug of Camera Device (Sony EVI-D100). Video capture was not aceptable. Installation of video card.