Improving medical report generation

Improving medical report generation

Problem being addressed

Automated medical report generation in spine radiology​,​ i.e.​,​ given spinal medical images and directly create radiologist-level diagnosis reports to support clinical decision making​,​ is a novel yet fundamental study in the domain of artificial intelligence in healthcare. However​,​ it is incredibly challenging because it is an extremely complicated task that involves visual perception and high-level reasoning processes.

Solution

The neural-symbolic learning (NSL) framework that performs human-like learning by unifying deep neural learning and symbolic logical reasoning for the spinal medical report generation. Generally speaking, the NSL framework firstly employs deep neural learning to imitate human visual perception for detecting abnormalities of target spinal structures. NSL conducts human-like symbolic logical reasoning that realizes unsupervised causal effect analysis of detected entities of abnormalities through meta-interpretive learning. NSL fills these discoveries of target diseases into a unified template, successfully achieving a comprehensive medical report generation.

Advantages of this solution

When employed in a real-world clinical dataset, a series of empirical studies demonstrate its capacity on spinal medical report generation as well as show that our algorithm remarkably exceeds existing methods in the detection of spinal structures. These indicate its potential as a clinical tool that contributes to computer-aided diagnosis.

Solution originally applied in these industries

healthcare

Healthcare Sector

Possible New Application of the Work

data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAGQAAABkCAYAAABw4pVUAAAPV3pUWHRSYXcgcHJvZmlsZSB0eXBlIGV4aWYAAHjarZpnViMxFkb/axWzBOWwHIWnc2YHs/y5T2WCwdCY7uZA4XJZ4YUviDbyv/9u8x/+pdiyianU3HK2/IstNt/5pdrr33V1Np6f51+Ot/fc/X3z+obnVuAabh+Q2/Od++ntA+X2vBv3902Zt3HqbaDbGy8DBp3Z88u6LfI2UPDXfXd7bZq/fun53XZu33v6prfSuN76+DoWgrES4wVvvAQX7Pnpr5nC9d35zudn8i93EtfOt/8cP/MaugcBfP3tQ/zsvN0Pb+G4BnrZVv4Qp9t9lx7H70Tp/Yqcf53Zv19R2i+hfBC/verecu2uR+qoxXzb1MtWzm88SEhjOB/LfBW+E7+X89X4qrbbyVSLrQ5jBy+a80Sc+d1y3W0n5zrdZInRiy9cvZ8+nHs1FN/8JPwuRP1y2xcTWlihkolJ5gK3/eta3Jm36XxMVpl5OZ70jsGc5u79l/l447dfdwPtrWXunK2vsWJdXquGZWjm9CdPkQK3bzFNJ77OXBf78Z8mNpDBdMJc2WC34xpiJPdWW+HkOdhkeDTaK8murNsAhIi5E4txgQzY7EJy2dnifXGOOFby01m5D9EPMuCSSX6xSh9DyCSnep2bzxR3nvXJX7eBFxKRaJpCalroJCvGFDP9VimhblJIMaWUU0k1tdRzyDGnnHPJilO9hBJLKrmUUksrvYYaa6q5llprq735FoCxZFpupdXWWu9M2mNnrM7znRvDjzDiSCOPMupoo0/KZ8aZZp5l1tlmX36FBQSYlVdZdbXVxQmlJFGSZClSpUnf1NoOO+608y677rb7a9ZuWb3P2sfMfZ81d8uaP4nS58pb1rhdyssQTuEkac7ImI+OjBfNAAXtNWe2uhi9Zk5zZpsPJoBbrDJpcpbTjJHBKM7T+q+5e8vcl3kzRPfZvPlHmTOaun+ROaOpe5e5z3l7kLXVD9yGkyDtQmIKQgbaT2LYQu2X2vml7B35HnvRx1s5rH94WxlEf16PAIPOjL77YBe8aLz5h8c/jfg6obnN+PVoP1ybeT/b36zNfJrxl2szj2d7fm3mmxmfWpv502w/XZv5Pqk/X5v5acH9aW3mpwX3p7WZ55tBR2t8b5k7zhGapx/FiFht7soDkptAQ91LrEirWQAjH9Fpucfq0azSl3ggoLQcWrct2TCLjxnxAGbHOiGhKkpSbaIUy2xJ3NyVeXzYjoc7AoGb0pKrK8gWxF8rU1qOLDCyimaYgc73e87g2nQ799V1CzUXZEkte9k4eILtczecbbrOzoAZjVXdYeaxEaMjCVArdVlRIEtL2kCp+DX9Gp1hZ5WJGOkD5BSJLAoxwqoA0zM48DxmMmiCoC/7+bl4n0nrAunSSrOAbGKlRLRTGqWyn0AgkyJeWMylUwGXMs3auQ6P8gY+e1daz2GgluCnuOfYxDgKlDPt921iflqKfUwCBAM4CCDkYlkPVLNSl7VHjAaSsX67LKRwzR5aIiYxl37yN8JbFL4KAvd5wFxPKHJvfeL2Plm7whSTjnc++zLaw2ed+fOML+MRbvf11fzpgc/XXGQU2LdR5mE5KcuXlM0ohCrVuUeZk+ofPgu1Qyn6Tr9MhHUNEDq0mBe9tYKWlp9CFQuECMPX7OIyM8pZuIczoUYmXtSDjD2QzTwfBzUwRvXQaaaId+ul2cgz6qvmcIIXbDaY7aBu24QsU3BQ7ZJUJVefaFc3GwZPVYE6IprxdGUJEa2bzlbxGdcVWZPL6rkyEQMM1ys9zor38HsgVPyQVbzsHCTT9WMkRisqWCWAEWHJiJ6uM7ajM/rIqIOaJgU2FgrEISt4qAeZo1VqjCLjJgusaChJyANQw+0YaLlC429TEUNMznh1eVd3zBslQLVqWQBHI8zVESfqPggjvZLt6A0dh2RaQpeh6WhIE5YfA11HtLsu8bdX8+UDfZeVHdtuq81Gk+3cbFrkvtW17QSsmiMV1EhLYRqVgJa+ZdsopRArBuu0blNEmyWjfgX1hZobERFpO0WFvsQs9ZCJK1hjixND+7aEsBoWZVYpmjxmQ4MRH9KH3FuNdBHYQrXaGbJWU5eon6birKe3EvLLrKUTqp2euyD7tMNWB8AapT7ofrI7neTMGsIO42S+8TDSL4yVyrZnxWYKahH/HvKAGHRT2a/lZ8fF0LgLUAyj8eFa1qxq5SM1oEKQOC7iOdoZy4wmvi9EItTjVgEaF7Z35D5Qx4kCEQxml1LQlixloOBRxM7zeslOCwe9dhpimpb05MMSm1B1ZCXuEGliwq2kCodVWgVLWDo9mXQRtQz4YwDn8ayBwGKOAyGdk1Yj6pRkoppbqItSIzmssx2eLGCqeHx6P/Xx6Wq+euPZ64OBaO/qDxi0vFiFv4GB13Xx6gIDChGkUjAILvmEXS85SUgr0O+ztF53DWzBy9TWhRSw/anhSEBuoA5aoC3pc+piJum2wMIVM224gO4eahuTXtzdwrQ5wG3OOYpMGwS82Xp0g/eAEyWB4dvbnXFaJHy5EPs2hBTctSuAO3QXLAgvQ39t7Dbmam1TuwiVPC3wSgJp95Tre0zjmqpBcbQN3rVdo/JxKV3SnhQUKAaOhdKjmr5GGjG0lJINfVhKaNyNZe4B8/fXTwOVeiivDN1jLZOlatuQzEPg6KHUt0LZoUqLZZrgxK6GtpTpLgaVSscB7Nz4wGXlDKeEtCmC0EVPYo6okRYpVqnGpUs6uKFxblb0/SxHY9C4tF+3P2FP8yTNfrpShMCioGqxuWi8DApVf6SBBbsGL6jPPQOb8RSd+HnEjk2qejrwqGplfAq20/3d7U7PRk94X/f3fZyMBuolbTmssSswR/2o1lu7ZkoIkOlj0R4IB6p29oLbtzV5SyeG3DYMv4wmUJeZ53elUvymIBxSGdWISe60XqB5kbcY+IFSh0W8XyrifZtjsjj2D9Jn4LnpZ4F+wLrX71AEV75NASdKTehWNuN1LzJSQninkhUcEbMbIkk0T7O+UZAgwwJ6WSO9dxT+EVrfJ/XnOTXfJ/XnOTV/Lv4zYoasNx0Y1wndqBWaCLwkHBkeXwbmiHlBYmF0eiLaWZu6EnwCuDhFuzUCXxrZUId6o+0SscT1ZN7ZuKfiYZGEkhvg8EpgbYLIwKapJN8cCGfp/lAg/OVRWimrRqDawCgWwzgCHOaQ3PImry6hYCTakFT0mGXVGdCNwZEZdWPIJbSHjQJDv0LjsSkEOaoU8KFnQwrg0drZsGuIkZGaMptvHfPT2iR6Piv510YxE6hAXgqjCiVK1TTkAsQJZesJPLqxZYQbcqGMvB2GJw/9ywBp7jUTeNuOm0uqQ8urlBpeEHisM0BHnawnX5QLVisUkegp0hISwExz1AX9tBN+O53qK4cSupQ7KralnXV/hkDFcgiESA0oCQbJrZNSu4agTsl1JyJIHOXMpOLJvmo7qhKqqk0LklDhYMdABG9RVzfSSKsNtFayaYqUFF21sbqVKhwzXqJyHxTz+6jcB8X8Pir3QTHPRuX++ta65jEea+P+hOG45guazBtGhTOcIEvgPJWBdPta14c6xbuh7ssaVha9sVcFMMaeXWdsy1e8zLIP0W+WpYJA3QragO5N5DY3jN6g+3RmUudVqdL9wDvtP62ecVqH06h7Ih9eYzFqWCh3jXepRMSjEVEZgUpZISI0hfFnNHPROIt3gVHfcSg7AV5IYLezo6lQK3hBOaocAX6QyiV0dI4FoMT6Cw5RliGXC7jcyw0hJluhmFd4jzWqtKkN/x6D61ZRl2GLFKAVqQMbsHw0GN3U44WTuSDtLE5lrqgRraCSujsMhMNvH8ayDr+A3s8kvufzKdihFoRWEIl7OLjiOouZykLYtKkp85hhKW6WOI9OU0muQyIgWbP+ZQKTElidAem40gWKgnGU2F3jQzQcrOEJPGyqJgP8YlNW/1iIeT0rOS5qJtToas5QUARnk1qQlrjgZrTSCaKamrV5lRoAKqGXY9vzPvEZoQry0uuJGEa3GdWvyGjcBTSOQFQrVY+bJtOXi7pRE6ANuDpkJaIWWO9ecDvYob5WbkY5Cw3sFCng6WQZD4uR9QhAkOXQqcpOVW1+d5xv8ztc0KONO8/RGTbRqHSlcnG59C3iXrJqa6T94tF6jBriGBDA0hxuLuGM7SElPXtaREnsXiZqfW7SnRAasalXg5wCZi3PXvWcBmPZm7RVN3ujOP3DdjafFCtVCzIR/k5DDPYA9J3WddI2mQIGG8IAg0wxbaVdXg3SL4siEXWyRNfpoRUNStMMlDwW1+q5iECDlC82M2KZSU3ECIz8PjNGUxNW/whZihcHLbh1wwsQSxHjFS7GHeyYx7jz/DmC+YyeYcfjeGRb+HXbrH/eWUduATKY8jT1AIUaFeoTU4ddlmhw3jdM/sYkqs2hEbEypFZQRNQZI+sWyAd6hhbBxGpsnZ8NQKLAg8V5lYSpaFfhfBZ0jzSV+SCqfm0ozN8ZiJ8OpHs4OzhHSWcP1h5leL8FNmC+E5jPeBtTaUHSl0faFpkNGutxHbzW+CXghBEWAAK8gKr0+RzZNby6gE6jpbhTxqG7ZbI6DzpCxPWYqmpUBAnUDz7qn5bx+P0cwmOMg1S1AWHTfkh1tmaZflNX0NFABiIZO2hBRdEO9DKdPmMHCnDlANdkvcUrAqAVJ2IG8MihIxJGBEbQikgAg6ThZXQsHqsSHawBm9B+NqX5Vy3yrmsfs/xd156epTibeacW9GTt111r/vbY8G2gp5HnMfCYJ6aGjUlpWcX1DL2i5fSMmayqsjMJKSEwG2KiBuRs1uIreogNgiILFhp4s4Y4WcWgavRPwXGjZqAMVUkJEEdBGeAYKQzkgFoxFzVEwSszYpPBNowKqoPmQRnvgsRqiHrGh5PnCsgZi7wdMXeDUgbD9VBQKKxzNulyawiMhoXk2dggpCl7oC2h/SWZ+NCbdAvWROXZmd6o0q3/AEl+4iB/BHbmX4CaXp8f6AuwM3dopzpe/yMJ9gB9CHPUlfSE1J9jW6g7QNcXHSVSvpoe2/qJHpy0SGkhrVu8y5zXSdVCyQarPkAzv1GoPmuLjqieIZaCX0UAuNHd9XcdUxtrqqJ+n/l+P5RBW/6ToYwu618MZa4d/v1Q5iVYfzuUeYv73w1l3qfwb4Yy99Xw+6HMx8L67VDmc43+bijzqNx/M5R53DnPD2W+asJnhzJf9/NzQ5nvoOGZocz3KPNuKDB6NeDi/0GkifZdvb4EAAABhWlDQ1BJQ0MgcHJvZmlsZQAAeJx9kT1Iw0AcxV9Ta0UqDu0g4pChioMFUVFHrUIRKoRaoVUHk0s/hCYNSYuLo+BacPBjserg4qyrg6sgCH6AODk6KbpIif9LCi1iPDjux7t7j7t3gFAvMc3qGAU0vWKmEnExk10Rg6/oRABhDGNKZpYxK0lJeI6ve/j4ehfjWd7n/hw9as5igE8knmGGWSFeJ57crBic94kjrCirxOfEIyZdkPiR64rLb5wLDgs8M2KmU3PEEWKx0MZKG7OiqRFPEEdVTad8IeOyynmLs1aqsuY9+QtDOX15ies0B5DAAhYhQYSCKjZQQgUxWnVSLKRoP+7h73f8ErkUcm2AkWMeZWiQHT/4H/zu1sqPj7lJoTgQeLHtj0EguAs0arb9fWzbjRPA/wxc6S1/uQ5Mf5Jea2nRI6B3G7i4bmnKHnC5A/Q9GbIpO5KfppDPA+9n9E1ZIHwLdK+6vTX3cfoApKmr5A1wcAgMFSh7zePdXe29/Xum2d8PohJyuulrZdUAAAAGYktHRAD/AP8A/6C9p5MAAAAJcEhZcwAALiMAAC4jAXilP3YAAAAHdElNRQfkBgUTNBaoAa0pAAAFaklEQVR42u2dbYhUVRyHnzOrbpujKepkoZiFuom2ULSCJVRGq7mSkRUWaBRlWxSKhUhIERlLQVSEbdCbUJZbSJD0QhqtGfghdc2MzTcqPwhqVGQUlvvrwz22o427c8Y51xn5P7Ass3vnnLn3Oed/Xu45d8AwjFPjurq67CqcRH19PZKywLXARGA48AuwD+hwzh2Idd2cJDNwIucCy4GHgIEF/t8NvA8sc87tK/f1MyEnMgr4DKgv4tgjwDzn3LpyXkMT0kMW2AKMD3jPUaAJ+KJcH6KfeQDnHJKWBcoAGAC8BTzvQ91+YL1zbn+pBd1qSE/BPAycV4a0uoG1wAPAIRNSGg1AZ5nT3A9cDfwU8qaMuQBgSIQ0RwPtzjlMSDi/R0p3iqTZJiScb303NgazQ2qJCUl6WUeB1yIlf6+kDuASa9TDGA58A1wQKf2DwJV9NfJWQ3o4DMwCfo6Ufg54xUJWWOjaBlwOfF7E4b+WkMUMYKSFrBLcAFOBu3yYGeb/fgjYBLzqa9QaP9YIYXpvwk1I7zUGAEkZ/7rbv84XNx24g2RC0vlBZl0vyV4G7DAhKYjzsu72NahQX3e7D4nd1oZERNJ/P86514FmkptZ+ewA5vYmw2pIXGqAyST3WA6QzJUds3FIlWEhy4QYvWF3DE+zdyXpbeDCEpPY6pxbkt9smJDTZwpFThwW4JiFLGtDDBNiQgwTYkIME2JCDBNimBATYpgQE2KYEBNimBATYlSWkNAdP6XgnIueTxp5pCJEUgvQGPNkJI32u15rY+UjabCkFUC2msQUClkNwGZJ7cCoSCdTCzwNdEmaS+Fll+U4tyXAXkkLSRauVW0b4oBbgd2SnolYyi4C3gM2kqx5jUEOaAO2AddVe6N+DvCoL2UtkUoyJEv6vwZWUfqSmr6YDGwAPgTGVXsvKwesJNnyNTNSbXHAfGAX8IQvDDFoBnYCLwBDq73bOwn4SNLHwORIYgYCj3sx8yPl0R94GNjtf9dUq5DjzAA6Ja0EcpEu2mhglaTNwFWR8hjma8pOYFYl9MYyp/neFt++LPU9pxhMATZJWg2MiXTRJgDrJH0SseanNlLPAq2++t8e8bPOA76X9KTPMwZNvua/BIw4E2IyZQ4x7wKbgakRxy/Lgb3AAuJM/WSAB4F9khaTPIKpKoXkh5gvJa2JGGJywJvAVmBapDyywHNAF3BTWrUlEzHd24BdklqBwZFOqAHokLQWuDhSHmOBDyRtBBpii4k92zsAWArskXQfcbY/OOBm4DtJzwKDIl20acAWSW8A58cSk9b0+wiSx0psB26INOKvBR4h7txVDcnDBHZLekxSv2oVcpyJwKfAO5HltwFfEW9D0iDgKT94zZUz4TO1g+qKFPKYkEIeY6u9hhgmxIQYJsSEGCbEhBhngFLGIf8ACpQeMmqWzyP0PEJG/8fo47lVBehfqUJuAToCjl9AcleuWH4kWZAQInE1cGPA8StIZnKLZQjwQ6UK+QP4LeD4PwPT73bOHQl8jtffgXn8FXgOqYV2a0OsUTdMyFney1pEssy0WC4NTH+4pJcDe00NgXnMAcYEHF9byUKaI3+mwcD9kfNo9D8WsgwTYkIME2JCDBNi45BT0EqyfL9YrgHuCTj+ILA4sLAsImwlSzvJTqpiGUiytKgihawn2RpWLHWBQo4451YHTi7ODRTSSfIdtsUyNC0hFrKsDTFMyFneqDcStollUmD6dZKaAgtL6Pra8cDMgOOzaQkp9A07bcBCK6upsME5d32+AwtZ1oYYJsSEGCbkLOr2zjmpWzfOLktqjJR0J3nrB5ykPZT+pVaGhSwTYqTchrxIBT7IyzAM4//8C2U7d5B72HWZAAAAAElFTkSuQmCC

Manufacturing Sector

The suggested solution is a human-like learning framework with visual perception ability and high-level logical reasoning strength. This combination can boost the generalization and interpretability of neural learning, also give a robust solution naturally. It can be an effective and scalable solution to relieve laborious workloads.

Author of original research described in this blitzcard:

question-mark-icon

Name of the author who conducted the original research that this blitzcard is based on.

Source URL: #############check-icon


search-iconBrowse all blitzcards