NEC Technology Enables Significantly Faster Design Of Big Data Processing Hardware
NEC has developed technology that enables the quick design of hardware for the high-speed real-time analytical processing of big data.
Analytical processing of big data provides added value by analysing large quantities of time-series data on a real-time basis. This type of processing has been launched in areas that include the automated trading (algorithmic trading) of securities companies stock and the analyses of traffic by network providers. The utilisation of this processing is also being considered in fields such as healthcare and public security.
The use of dedicated hardware is expected to accelerate the processing of big data by 10 to 50 times compared with processing using software. However, the development and implementation of new hardware has historically taken a significant amount of time, often requiring several months.
"NECs newly developed technologies permit the easy design of hardware dedicated to high-speed processing. In order to carry out data analysis, users simply input the required analytical processing content using SQL, a programming language used as an open interface," said Naoki Nishi, General Manager, Green Platform Research Laboratories, NEC Corporation. "This reduces the time for developing hardware from as much as several months to approximately 1/50 the time, or several hours. The technology also reduces the time required for rewriting the processing content to approximately 1/1,000,000 of the previous time, or from milliseconds to nanoseconds, allowing the dynamic operation of the system without shutting it down."
NEC has developed design technology that permits the use of CyberWorkBench, a circuit synthesis technology for the Field Programmable Gate Array (FPGA) owned by NEC, to automatically convert software designed using SQL, which is widely used for the analytical processing of big data, to dedicated hardware on FPGA. This permits users in charge of data analysis to design FPGA directly using SQL, a familiar programming language. This means that circuit design work by engineers is no longer necessary, and the time required for developing hardware, which conventionally takes several months, is reduced to approximately 1/50 of the time, or several hours.
NEC has also developed a hardware processing mechanism that switches between data processing content instantaneously, while operating the circuit for the old processing and a circuit for the new processing in parallel. Previously, processing had to be halted for several milliseconds when changing processing content since the circuit for the old processing had to be reconfigured for the new processing. The newly developed mechanism reduces the shutdown time to nanoseconds, or approximately 1/1,000,000 of the previous time. This enables dynamic corrections and processing changes without shutting down the system.
NEC said it would continue to carry out research and development with the aim of providing the technology as a real-time big data processing solution using hardware by the close of the fiscal year ending March 2015.
The use of dedicated hardware is expected to accelerate the processing of big data by 10 to 50 times compared with processing using software. However, the development and implementation of new hardware has historically taken a significant amount of time, often requiring several months.
"NECs newly developed technologies permit the easy design of hardware dedicated to high-speed processing. In order to carry out data analysis, users simply input the required analytical processing content using SQL, a programming language used as an open interface," said Naoki Nishi, General Manager, Green Platform Research Laboratories, NEC Corporation. "This reduces the time for developing hardware from as much as several months to approximately 1/50 the time, or several hours. The technology also reduces the time required for rewriting the processing content to approximately 1/1,000,000 of the previous time, or from milliseconds to nanoseconds, allowing the dynamic operation of the system without shutting it down."
NEC has developed design technology that permits the use of CyberWorkBench, a circuit synthesis technology for the Field Programmable Gate Array (FPGA) owned by NEC, to automatically convert software designed using SQL, which is widely used for the analytical processing of big data, to dedicated hardware on FPGA. This permits users in charge of data analysis to design FPGA directly using SQL, a familiar programming language. This means that circuit design work by engineers is no longer necessary, and the time required for developing hardware, which conventionally takes several months, is reduced to approximately 1/50 of the time, or several hours.
NEC has also developed a hardware processing mechanism that switches between data processing content instantaneously, while operating the circuit for the old processing and a circuit for the new processing in parallel. Previously, processing had to be halted for several milliseconds when changing processing content since the circuit for the old processing had to be reconfigured for the new processing. The newly developed mechanism reduces the shutdown time to nanoseconds, or approximately 1/1,000,000 of the previous time. This enables dynamic corrections and processing changes without shutting down the system.
NEC said it would continue to carry out research and development with the aim of providing the technology as a real-time big data processing solution using hardware by the close of the fiscal year ending March 2015.
