Skip to content

#SK hynix

Today 0 items
Oct 2Fri
  1. SK hynix Memory Technology37

    [AI Ecosystem] Redesigning infrastructure: Why architecture determines performance

    As AI workloads shift toward inference and agentic AI, system bottlenecks are moving from compute to data movement. The article notes that under processor-centric architectures, fetching data once from DRAM can consume 150 to 2,000 times the energy of a simple arithmetic operation, and over 90% of system energy in large machine learning models may be spent on memory access and data movement. It leads into SK hynix's vision of building a next-generation AI memory ecosystem, arguing that GPUs/NPUs/TPUs, memory, storage and networking should be co-designed as a single system.

Sep 3Thu
  1. SK hynix Memory Technology37

    [AI Ecosystem] The real bottleneck: Data, not compute

    In its AI Ecosystem series, SK hynix notes that as AI shifts from pretraining to inference and agentic AI, the system bottleneck is moving from GPU compute to where data resides and how it flows. The memory wall proposed by Wulf and McKee in 1994 is becoming reality: AI accelerators now reach petaflops of compute, but memory read speeds cannot keep up, leaving many compute units idle waiting for data. The response is to increase memory bandwidth or move memory closer to the processor.