\documentstyle{article}
\begin{document}
{\large \bf Recommendations}

\noindent
prepared by Thomas Sterling


Having determined the availability of important candidate applications for
PetaFLOPS computing and validated the feasibility of implementing a petaFLOPS
architecture in the twenty-year timeframe, many questions remain concerning
efficiency, programmability, cost, nearer-term opportunities, generality, and
other issues related to the practical exploitation of petaflops. Some
recommendations central to advancing the state of petaFLOPS computing as it is
currently conceived are provided in this section. 


\begin{enumerate}
\item
Further applications studies need to be performed to
\begin{itemize}
\item
	expand the range of known petaflops applications,
and
\item
	identify and characterize requirements and limiting factors.
\end{itemize}

\item
Support research into specific advanced architecture techniques:
\begin{itemize}
\item

	latency hiding for ``just-in-time" operand delivery such as
	  multithreading, gather-scatter pre-post fetching, streams, and futures

\item
	memory hierarchy to reduce penalty barriers and establish memory
          continuum for seamless out-of-core computation

\end{itemize}
\item
Sponsor development exploration in advanced technologies:

\begin{itemize}
\item
	superconductor logic and storage such as RFSQ

	optoelectronic communications between subassemblies and between
	  integrated circuits

\item
	optical storage
\item
	advanced lithography and semiconductor fabrication

\end{itemize}
\item
Conduct ``point design" studies of petaflops architectures using teams
     comprising expertise in both architecture and applications for distinct
     system types such as

\begin{itemize}
\item
	natural evolution path through commercial vendors

\item
	PIM structures combining processors and memory on the single chip to
	  exploit high available memory bandwidth
\item
	Petabyte mass storage management-oriented systems
\item
	 hybrid technology with multithreading for high clock rate through
	  superconductivity, high bandwidths through optical guided and free
	  space communications, and large memory through semiconductor and
	  optical storage
\item
	``rapid-path" structures automating out-of-core and switched systolic
	  arrays for low memory content and high bandwidth streaming,
	  including response time critical computation

\item
	very large SIMD array structures
\item
	cellular structures
\end{itemize}

Studies should include basic parameterized analysis, simulation, and
breadboarding in certain cases.
\item

Develop performance models of applications and architectures to determine
     suitability and predict performance across the array of architectures in
     support of identified petaFLOPS applications.

\item
Sponsor additional workshops in architecture, algorithms, and system
     software related to petafLOPS computing to extend the basis of
     consideration and expand the research community. Issues to be addressed
     should include
\begin{itemize}
\item

	molecular computing
	quantum computing
	nanotechnology
	distributed interactive simulation
	nonlinear electronic simulation
	structural mechanics
\end{itemize}
\item
Advanced system software research should be funded in runtime systems
     and innovative compiler-driven resource management heuristics.

\item
Establish a standing petaflops oversight committee to monitor ongoing
     research, assess progress, and recommend new initiatives.





\end{enumerate}
\end{document}
