The MIAKT (Medical Imaging and Advanced Knowledge Technologies) project was a joint initiative between the AKT (Advanced Knowledge Technologies) IRC, specialising in knowledge management and technologies, and the MIAS (Medical Images and Signals) IRC, specialising in the intelligent analysis and handling of medical data. The project aimed to apply the capabilities of the AKT and MIAS IRCs to collaborative medical problem solving in the domain of breast cancer screening and diagnosis.

The focus of the project was to provide support to the Multi-Disciplinary Meetings (MDMs) that take place between various medical practitioners of different expertise, in coming to a collaborative diagnosis and plan of action in symptomatic focal breast disease.

MIAKT focussed on researching the following services and technologies:

• Ontology Services,
• Annotation and Enrichment Services,
• Reasoning using services and GRID-services.

The project was completed in March 2005, and is taking on the technologies developed during its realisation, through into new projects.

The final report will be available again soon.

• IAM Group, University of Southampton
  • Nigel Shadbolt
  • Paul Lewis
  • Srinandan Dasmahapatra
  • Associated Researchers: David Dupplaw, Bo Hu
  • Former Researcher: Hugh Lewis
• Computational Imaging Science Group, King's College London
  • David Hawkes
  • Christine Tanner
  • Former Researcher: Yalin Zheng
• KMi, Open University
  • John Domingue
  • Enrico Motta
  • Associated Researchers: Liliana Cabral, Dnyanesh Rajpathak
• Medical Vision Laboratory, University of Oxford
  • Michael Brady
  • Associated Researcher: Maud Poissonnier
  • Former Researcher: Jonathan Whiteley
• Natural Language Processing Group, University of Sheffield
  • Yorick Wilks
  • Fabio Ciravegna
  • Associated Researcher: Kalina Bontcheva
• Epistemics Ltd.

• MIAKT Demonstrator
  The demonstrator is an online version of the MIAKT client interface. Please note the page is password protected to avoid the server being placed under undue load. Please email David Dupplaw for a password. To run the demonstrator it is necessary for you to have Java 2 runtime environment on your computer and available as a plugin to your browser.
• MIAKT System Video Demonstrations
  • Narrated version (AVI), 189,956 KB, 10:59
    This video is a video describing the MIAKT system, and is narrated by Nigel Shadbolt. The video is encoded using the DiVX 5 codec, and a free codec for Windows can be downloaded here. The video runs for 11 minutes, and is 189 megabytes, but is recommended if you can afford the download. If necessary, we can supply this video to you on a CD.
  • Screencam version (AVI), 16,984 KB, 7:23
    This video is a screencam of the MIAKT system, and was presented at the e-Science All Hands Meeting in August 2004. The video is encoded with Camtasia's codec. A player for Windows can be downloaded here. Please note, this video is SILENT.
  • MR Image reconstruction (AVI), 9,490 KB
    This video is a screencam of an early demonstrator that provides visualisation of MRI images. Please note, this video is silent.

• Software
  • MIAKT Architecture (Southampton)
    The architecture provides generic knowledge management with support for multimedia data.
  • MIAKT Application (Southampton)
    The application of the architecture to MIAKT includes breast-cancer related software for viewing of MRI images, and instances conforming the BCIO ontology.
  • MIAKT FeatureService (Southampton)
    The FeatureService is a web-service that provides an interface for multimedia analysis functions
  • Natural Language Generation Service (Sheffield)
    The Natural Language Generation service provides a means for generating reports from ontological instances
  • Unified Medical Language System Service (Sheffield)
    The UMLS service provides querying facilities to the UMLS.
  • IRS-II Services (Open)
    The services available via the IRS-II provide search and retrieve services for breast-cancer related instance information.
  • MRI Image Registration Service (KCL)
    The MRI Image registration service provides registration (alignment) of MRI images taken at different times.
  • MRI ROI Classification Service (KCL)
    The MRI ROI classification service provides classification of regions of interest that are marked up on MRI images.
  • Image Analysis (Moments) Service (Oxford)
    The image analysis service from Oxford provides analysis of regions of interest that are marked up on X-Ray Mammograms
• Ontologies
  • Breast Cancer Imaging Ontology (BCIO)
    The BCIO defines the terminology for the breast-cancer imaging domain.
  • Application Ontology
    The application ontology defines the terminology for describing an application.

• System Documentation (Microsoft Word, 78 pages, 2.4Mb)
• Final report (will return soon).

1. K. Bontcheva, Y. Wilks. Tailoring Automatically Generated Hypertext. User Modeling and User-Adapted Interaction. Special issue on Language-Based Interaction. In press.
2. R. Confalonieri, J. Domingue and E. Motta. Orchestration of Semantic Web Services in IRS-III. In proceedings of the First AKT Workshop on Semantic Web Services (AKT-SWS04) KMi, The Open University, Milton Keynes, UK, December 8, 2004.
3. F. Hakimpour, J. Domingue, E. Motta, L. Cabral and Y. Lei. Integration of OWL-S into IRS-III. In proceedings of the First AKT Workshop on Semantic Web Services (AKT-SWS04) KMi, The Open University, Milton Keynes, UK, December 8, 2004.
4. D. Sell, F. Hakimpour, J. Domingue, E. Motta and R. C. S. Pacheco. Interactive Composition of WSMO-based Semantic Web Services in IRS-III. In proceedings of the First AKT Workshop on Semantic Web Services (AKT-SWS04) KMi, The Open University, Milton Keynes, UK, December 8, 2004.
5. V. Tanasescu, J. Domingue and L. Cabral. OCML Ontologies to XML Schema Lowering. In proceedings of the First AKT Workshop on Semantic Web Services (AKT-SWS04) KMi, The Open University, Milton Keynes, UK, December 8, 2004.
6. D. Dupplaw, S. Dasmahapatra, B. Hu, P. Lewis, and N. Shadbolt. Multimedia Distributed Knowledge Management in MIAKT. ISWC 2004 Workshop on Knowledge Markup and Semantic Annotation. Hiroshima, Japan, November 2004.
   [ PDF ] [ bib ]
7. Dnyanesh Rajpathak and Enrico Motta. Planning and Scheduling Ontologies and Problem Solving. An Ontological Formalization of the Planning Task. To appear in Proceedings of the International Conference on Formal Ontologies in Information Systems, Torino, Italy, Nov. 4-6 2004.
8. B. Hu, S. Dasmahapatra, D. Dupplaw, P. Lewis and N.Shadbolt. Managing Patient Record Instances Using DL-Enabled Formal Concept Analysis. 14th International Conference, EKAW 2004. Whittlebury Hall, UK, October 2004.
   [ PDF ] [ bib ]
9. S. Galizia and J. Domingue (2004) Towards a Choreography for IRS-III. Proceedings of the Workshop on WSMO Implementations (WIW 2004) Frankfurt, Germany, September 29-30, 2004, CEUR Workshop Proceedings, ISSN 1613-0073
10. J. Domingue, L. Cabral, F. Hakimpour, D. Sell and E. Motta (2004). IRS-III: A Platform and Infrastructure for Creating WSMO-based Semantic Web Services. Proceedings of the Workshop on WSMO Implementations (WIW 2004) Frankfurt, Germany, September 29-30, 2004, CEUR Workshop Proceedings, ISSN 1613-0073
11. C. Tanner, M. Khazen, P. Kessar, M.O. Leach, D.J. Hawkes. Classification improvement by segmentation refinement: application to contrast- enhanced MR mammography. Proc MICCAI 2004, St. Malo France, Sept 2004.
12. P. Pathmanathan, D. Gavaghan, J. Whiteley and M. Brady Predicting Tumour Location by Simulating Large Deformations of the breast using a 3D Finite Element Model and Nonlinear Elasticity Proc. MICCAI 04, September 2004, St Malo, France.
13. N. Shadbolt, P. Lewis, S. Dasmahapatra, D. Dupplaw, B. Hu, and H. Lewis. MIAKT: Combining Grid and Web Services for Collaborative Medical Decision Making. e-Science All Hands Meeting 2004. Nottingham, UK 2004.
    [ PDF ] [ bib ]
14. Y. Zheng, C. Tanner, D. L. G. Hill and D. J. Hawkes Designing Grid-enabled Image Registration Services for MIAKT. e-Science All-Hands Meeting Nottingham Sept 2004.
15. S. Dasmahapatra, D. Dupplaw, B. Hu, H. Lewis, P. Lewis, M. Poissonnier, N. Shadbolt Ontology-Based Decision Support for Multidisciplinary Management of Breast Cancer. International Workshop of Digital Mammography, 18-21 June 2004, Chapel Hill, North Carolina, USA.
16. P. Prathmanathan, D. Gavaghan, J. Whiteley, M. Brady Predicting the Deformation of the Breast wit a 3D Finite Element Model for Image Matching and Tumour Location. International Workshop of Digital Mammography, 18-21 June 2004, Chapel Hill, North Carolina, USA.
17. L. Cabral, J. Domingue, E. Motta, T. Payne, and F. Hakimpour Approaches to Semantic Web Services: An Overview and Comparisons. In proceedings of the First European Semantic Web Symposium (ESWS2004); 10-12 May 2004, Heraklion, Crete, Greece.
    [ PDF ]
18. K. Bontcheva, Y. Wilks. Automatic Report Generation from Ontologies: the MIAKT approach. Nineth International Conference on Applications of Natural Language to Information Systems (NLDB'2004). Manchester, UK 2004.
    [ PDF ] [ bib ]
19. K. Bontcheva. Open-source Tools for Creation, Maintenance, and Storage of Lexical Resources for Language Generation from Ontologies. Fourth International Conference on Language Resources and Evaluation (LREC'2004). Lisbon, Portugal. 2004.
    [ PDF ] [ bib ]
20. K. Bontcheva, V. Dimitrova. Examining the Use of Conceptual Graphs in Adaptive Web-Based Systems that Aid Terminology Learning. International Journal on Artificial Intelligence Tools (IJAIT). Special issue on "AI Techniques in Web-Based Educational Systems". 13(2), 2004.
21. K. Bontcheva, V. Tablan, D. Maynard, H. Cunningham. Evolving GATE to Meet New Challenges in Language Engineering. Natural Language Engineering. 10(3/4): 349-373. 2004.
22. K. Bontcheva and V. Dimitrova. Examining the Use of Conceptual Graphs in Adaptive Web-Based Systems that Aid Terminology Learning. International Journal on Artificial Intelligence Tools (IJAIT). Special issue on "AI Techniques in Web-Based Educational Systems".
    [ bib ]
23. S. Dasmahapatra, D. Dupplaw, B. Hu, H. Lewis, P. Lewis., and N. Shadbolt Facilitating multi-disciplinary knowledge-based support for breast cancer screening. Special issue of the International Journal of Healthcare Technology and Management.
    [ PDF ] [ bib ]
24. Y. Zheng, C. Tanner, D.L.G. Hill, D.J. Hawkes, M.J. White, M. Khazen, and M.O. Leach. Alignment of dynamic contrast enhanced MR volumes of the breast for a multicenter trial: an exemplar grid application. In Medical Imaging 2004, San Diego, CA, USA. SPIE, February 2004.
    [ bib ]
25. Dnyanesh Rajpathak, Enrico Motta, Zdenek Zdrahal, and Rajkumar Roy. (2003). A Generic Library of Problem Solving Methods for Scheduling Applications. In Proceedings of the Second International Conference on Knowledge Capture (KCAP'2003). Florida, USA, Oct. 23.25, 2003, pp. 113-120.
26. V. Dimitrova, K. Bontcheva. The Use of Conceptual Graphs for Interactive Student Modelling and Adaptive Web Explanations. In Proceedings of The 7th International Conference on Knowledge-Based Intelligent Information & Engineering Systems (KES'2003), 03-05 September, Oxford, UK, 2003.
27. B. Hu, S. Dasmahapatra, and N. Shadbolt. From Lexicon To Mammographic Ontology: Experiences and Lessons. In D. Calvanese, G. De Giacomo, and E. Franconi, editors, Proceedings of the International Workshop on Description Logics (DL'2003), pages 229-233, 2003.
    [ bib ]
28. B. Hu and N. Shadbolt. Visualising a DL Knowledge Base with DeLogViz. In D. Calvanese, G. De Giacomo, and E. Franconi, editors, Proceedings of the International Workshop on Description Logics (DL'2003), pages 224-228, 2003.
    [ bib ]
29. B. Hu,, S. Dasmahapatra, P. Lewis, and N. Shadbolt Ontology-Based Medical Image Annotation with Description Logics. Proceedings The 15th IEEE International Conference on Tools with Artificial Intelligence, Sacramento, CA, USA. 2003
    [ PS ]
30. E. Motta, J. Domingue, L. Cabral, and M. Gaspari IRS-II: A Framework and Infrastructure for Semantic Web Services. 2nd International Semantic Web Conference (ISWC2003) 20-23 October 2003, Sundial Resort, Sanibel Island, Florida, USA.
    [ PDF ]
31. K. Bontcheva. Reuse and Problems in the Evaluation of NLG systems. In Proceedings of EACL'03 Workshop on Evaluation Initiatives, April 2003.
    [ PDF ] [ bib ]

• KMi ran the AKT-SWS04 workshop dedicated to semantic web services with MIAKT as exemplar, in December 2004.
• K. Bontcheva gave a tutorial on Named Entity Recognition together with Hamish Cunningham at the International Conference "Recent Advances in Natural Language Processing", 2003.
• F. Ciravegna:- Invited tutor at the First European Summer School on Ontological Engineering and the Semantic Web, 21st-26th July 2003 Cercedilla (Spain)
• Invited tutorial on Intorduction to Information extraction from Web documents at 14th European Conference on Machine Learning (ECML) and the 7th European Conference on Principles and Practice of Knowledge Discovery in Databases (PKDD),Monday 22 September 2003, Cavtat-Dubrovnik (Croatia) with Nick Kushmerick, University College Dublin, Ireland.
• Presentation on MIAKT by S. Dasmahapatra at e-Science all hands in Nottingham, 2-4th September.
• N. Shadbolt presented the MIAKT project in a keynote invited talk at the AAAI Spring Symposium on Web Services at Stanford University.
• N.Shadbolt presented the MIAKT work at the IRC e-Science All Hands metting held in Edinburgh.
• M.Poissonnier presented the MIAKT work at the Internation Workshop on Digital Mammography, June 2004.
• K. Bontcheva gave a tutorial on Human Language Technology for the Semantic Web together with Hamish Cunningham at the European Semantic Web Symposium (ESWS.04), Crete, Greece, 2004.
• John Domingue. Tutorial on the IRS-II Semantic Web Reasoning Framework in the First European Summer School on Ontological Engineering and the Semantic Web (SSSW-2003), July 2003.
• John Domingue and Liliana Cabral. UNICOM Tutorial in London, June, 2003.
• John Domingue. Tutorial on the IRS-II Semantic Web Reasoning Framework in the Eleventh International Conference on Artificial Intelligence: Methodology, Systems, Applications, Sept. 2004.
• John Domingue. Tutorial on the Semantic Web Services in the Second European Summer School on Ontological Engineering and the Semantic Web (SSSW-2004), July 2004.
• Tutorials were given on IRS-III and its interoperability with WSMO and OWL-S at AIMSA04 (September 2004, Varna, Bulgaria), NetObjectDays04 (September 2004, Erfurt, Germany), and ISWC04 (November 2004, Hiroshima, Japan).
• Demos were given of IRS-III at EKAW04 (October 2004, Northampton, UK), and ISWC04 (November 2004, Hiroshima, Japan).
• Nigel Shadbolt has presented the MIAKT system extensively as an illustration of the benefits of an integrated semantic web and grid approach in science. Keynotes include:
  • Keynote "AKTivating Knowledge Services" AAAI Spring Symposium March 2004 Semantic Web Services, Stanford USA
  • Keynote " Engineering Webs of Knowledge" DSTL Conference October 2003, Oxford
  • Keynote "Semantic Spaces" June 2004, European SW Summer School, Madrid
  • Keynote NATO Conference on Semantic Interoperability September 2004, The Hague
  • Keynote "Advanced Knowledge Technologies" KCAP Conference October 2004, Florida
• Epistemics Ltd. had a "Solutions Day" for their customer base in which MIAKT was a presented case study.

• Medical Guidelines
  • NHS documents for breast cancer screen NHS Sources or Local 1, 2.
  • BI-RADs Guideline from American College of Radiology ACR Sources
  
  
• Headline Stories
  • Genesis and Overview of the CDMRPs of the American Department of Defense
  • Grid computing to aid breast cancer research, CNN
  • Grid Computing in Cancer Fight
  
  
• e-Science project Links
  • e-Diamond
  
  
• Mammography resources
  • American National Digital Mammography Archive at University of Pennsylvania
  • On-line Mammography Database at University of South Florida
  • Breast Cancer in Women under Age 50 Medical College of Virginia of Virginia Commonwealth UnIversity
  • The Australia National Breast Cancer Centre: Computer aided detection/diagnosis (CAD)
  
  
• Histopathology resources
  • Health Science Center at University of Utah
  • HistoBank at National Institutes of Health, U.S. Department of Health and Human Services (registration is required)
  
  
• Breast Cancer related research projects
  • CAD of Breast Cancer at University of Calgary
  • Digital Mammography Research at Purdue University
  • Breast Imaging at DIRD, Department of Radiology, Duke University Medical Center
  • MammoNet at Medical College of Wisconsin and University of Wisconsin-Milwaukee
  • SMI at Stanford applied the BI-RADS lexicon in their recent research in Breast Cancer.
  • Automated reasoning in breast cancer
    • A Bayesian Network for Mammography, PDF
    • Automated Indexing of Mammography Reports Using Linear Least Squares Fit, PDF
    • Influence Diagram Model For Breast Cancer Screening, PDF
    • A neural network approach, PDF
  • CADVision
  
  
• Health Care
  • Imaginis