High-Throughput AI Inference for Medical Image Classification and Segmentation using Intelligent Streaming

05/24/2023
by   Pranav Kulkarni, et al.
0

As the adoption of AI systems within the clinical setup grows, limitations in bandwidth could create communication bottlenecks when streaming imaging data, leading to delays in patient diagnosis and treatment. As such, healthcare providers and AI vendors will require greater computational infrastructure, therefore dramatically increasing costs. To that end, we developed intelligent streaming, a state-of-the-art framework to enable accelerated, cost-effective, bandwidth-optimized, and computationally efficient AI inference for clinical decision making at scale. For classification, intelligent streaming reduced the data transmission by 99.01 throughput by 27.43x. For segmentation, our framework reduced data transmission by 90.32 work demonstrates that intelligent streaming results in faster turnaround times, and reduced overall cost of data and transmission, without negatively impacting clinical decision making using AI systems.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset