"
A HISTORY OF
"THE
ARPANET:
,*,i , C.%"
SWPt'ov
April 1981
1'o PLtLiT o
^ELECTE
DTIC
dltT.~
and Newman, Inc.)
S82
Li
06 10
044
JuStifiee
DTIC TAB
ii
April 1981
DCst.Ibu
tJ
speci
Report No.
4799
I-I II-1 11-2 11-2 11-5 11-7 II-7 II-10 II-10 11-12 11-19 11-21 11-21 11-23
II.'N 'HE
1.&,'rogram Objective and Technical Need. 1.1 1.2 1.3 1.4 Defense Program Addressed State of the Art at Program Inception Specific Technological Problems Addressed Expected Payoff/Time-Frame/Costs
2.(30rogram Description and Evolution2.1 2.2 2.3 Program Structure Major Technical Problems and Approaches Major Changes in Objectives and Approaches
3, ,3 Scientific and Technical Results and Accomplishments. 3.1 3.2 Results of the Effort in Relation to the Program Objectives Technical Aspects of the Effort Which Were Successful and Aspects of the Effort Which Did Not Materialize as Originally Planned Applications and Considerations for the Future,
4.
4.1 4.2
Conclusions of Technical Feasibility Recommendations on Additional R&D Requirements and Opportunities t54rogram Impact and Assessment of Technology beveloped Service Use of Technology Impact on Non-DoD Programs Applications of the Program Results Advance in the State-of-the-Art Bibliography of Reports
Li
Report No.
4799
II-12
1. 1.1
History Background The RAND Study of Distributed Communications Networks The Lincoln/SDC Experiment The NPL Data Network The Events of 1967 and 1968 Key Aspects of the RFQ Chronological Development, 1969 to 1975
III-11 111-14 111-18 III-24 111-25 111-26 111-29 111-32 111-35 111-36 111-39 111-45 111-48 111-53 III-58 111-61 111-64 111-68 111-72 111-72 III-76 111-91 111-94 111-104
1.4.1 -'The Groups and the Key People, 1.4.1.1 1.4.1.2 1.4.1.3 1.4.1.4 1.4.1.5 1.4.1.6 1.4.1.7 1.4.2 1.4.3 1.4.4 1.4.4.1 1.4.4.2 1.4.4.3 Management and Administration of the Network: DARPA/IPTO,, DSS-W, RML, and DECCO The Network Analysis Corporation The Telephone Companies Bolt Beranek and Newman Inc. The Network Information Center The etwork Measurement Center The Network Working Group and Host Involvement Initial Subnet Design Subnet Development Host Protocol Development Host-to-Host Protocol The Evolution of TELNET The Evolution of Other Host ?rotocols Growth -A Summary.
6 6
S"'
" ' " J i : '" :- " ' .. . i I "'|';"' " iii
111-106 2.
2.1
Observations
Social Issues
111-107
111-112 III-113 111-119 III-122
Technical Lessons Terminal Handling Reliability and Fault Isolation Maintenance Management Appendices
A.
B.
iii
Report No.
4799
CHAPTER 1:
EXECUTIVE SUMMARY
I-
Report No.
4799
Inc.
1.
EXECUTIVE SUMMARY
In fiscal year 1969 a DARPA program entitled "Resource
Sharing
Computer
Networks"
was initiated.
out under this program has since become internationally the ARPANET.
This DARPA program has created no less than a revolution computer technology and has been one The
in
the use of computers by the entire public and private the United States and around the worlu. the telegraph, and the printing Just as had
sectors, the
both in
telephone,
press
far-reaching
utilization of computer networks which has been catalyzed by ARPANET project represents a similarly far-reaching change in use of computers by mankind.
changes set in
many years.
In 1975 the ARPANET was successfully transferred to the it since that
I-2
Repor
No.4799Bolt
CHAPTER II:
Ii,
iI
[
5
1I-1
Report No.
4799
1. 1.1
PROGRAM OBJECTIVE AND TECHNICAL NEED Defense Program Addressed The DPRPA program and had the following objectives: experience on (1) To
develop computers
techniques in
obtain
interconnecting
such a way that a very broad class of interactions and (2) To improve and increase It computer research that by
are possible,
was envisioned
a network tying computer research centers together, In fact, for an the most efficient way to effective network was
be by involving the research talent at these centers Just hundreds as of time-shared individual computer users it was to systems share thought
permitted
hardware and software resources with one another, that networks connecting dozens of
for the type of network interconnection desired was that any user or program on any of the networked computers be able to utilize without
any program or subsystem available on any other computer having to modify the remote program.
11-2
Report No.
4799
This objective was an entirely new and different approach to an extremely serious problem which existed throughout botn the The many hundreds of
Defense Department and the many other the private and public sectors
forced to recreate all the software and data files that it to utilize. In of many cases this involves the
reprogramming
software
or reformatting of data files. extremely DARPA the costly and that costs
duplication and redundant effort is consuming. In fiscal more year than the 1969
estimated national
double
maintaining
software.
completely different attempts to address this attempts at language standards for and
computers, attempts
attempts at
languages.
Although of
the problems
share computer software resources or files was truly enormous. In addition to the general problem shared with the rest of the Defense DepartmeTrt also faces
community, problems
personnel trained to use one manufacturer's equipment must be trained again to use another's. Machines procured
11-3
Report No.
479'
user
training
accumulate
programs
must
be
stored,
created
and
maintained
systems
separately
at
each
in a
different
machine.
Military
interconnected
distributed intiractive network obviate such constraints. Another objective of th( of specialized It computers to program was to permit the linking
centers. in the
hardware
processing to
available
significantly
increase
the capability at
This program was addressed et no less then changing the of computers by the entire Defense Department. computer across network It
use
would
11-4
Report No.
4799
1.2
State of the Art at Program Inception By the date of the program plan in the late 1960s most of
the
specific
technologies
required
some form.
been many connections of phone lines to computers system, However, Air Line reservations systems, there
the SAGE
connect computers together for the purpose of experimenting the sharing of resources.
"o
In the early 1960s an attempt was made to link computers together at the Western Data Processing Center at UCLA
for the purpose of enabling similar computers to perform load sharing. A similar experiment was also performed
"o
A number of networks were constructed purpose inventory of message control handling, system The
for
the
primary
and
reservations
networks.
SITA network for air line concept in generally In any case, the not the
reservations was surprisingly advanced in mid-1960s, known in but details about SITA were
techniques
11-5
Report No.
4799
into
A direct progenitor of the ARPANET was an effort made in the mid-1960s to achieve computing computer. between Laboratory, modifying interactions. expertise and a coupling the between academic
operation of the SDC Q32 phone the line TX2 connection at Lincoln ease of
demonstrated sharing
the
relative to permit
systems
network
Aside computers
from with
the
technical
problems circuits,
of
interconnecting
number
Paul Baran and others at the Rand Distributed was work done Communications" by Donald in
Davies
in England in
the mid-1960's.
at the time of the initiation of the ARPANET program year 1969 many of the requisite ideas bits and had been pieces
considered and many of the requisite technical had been attempted in some form, them
together
11-6
Report No.
4799
1.3
Specific Technological Problems Addressed The technological problems of building the ARPANET can be
At the top level,
considered at many different levels of detail. there were really two problems: 1. To construct a "subnetwork"
consisting
of
telephone
circuits
and
switching capacity,
characteristics,
resource sharing among the computers on the network. 2. To understand, procedures design, and implement the the operating protocols of and each
within
systems
connected computer,
subnetwork by those computers in sharing resources. Within these two major technological problems, of course, a large number of sub-problems; there including were, the
line disciplines to work through phone line errors, problem, 1.4 and many others.
Expected Payoff/Time-Frame/Costs The goals for the ARPANET project were very broad and of computers
11-7
Report No.
4799
in
However, some
research program itself, and a resulting cost/performance benefit to the services from DARPA research. number of In fiscal year 1969, a
computer research centers throughout the country were Information of Processing an effective
installation
network tying these locations together would substantially reduce duplication and improve the transfer of well as develop scientific results, as
the network techniques needed by the military. inportant to all this output three be of
The research output of these projects was Services and it was expected that
could
substantially increased for the same dollar cost if the funds were utilized for the network. In addition,
a portion
technology transfer from the ARPANET project in three ways: o By dissemination of new scientific knowledge through
conferences and the appropriate literature. o By transfer of management of the carrier, and the resulting ARPANET to of of a common ARPANET Education and
availability Office
NSF-supported universities,
Report No.
4799
By
adoption
of
the
network
technology
by
specific
military System
groups Support
(such as the National Military Command Center and other military centers
affiliated
wth
it; e.g.,
CINCPAC,
CINCEUR,
and MACV).
11-9
Report No.
4799
2. 2.1
PROGRAM DESCRIPTION AND EVOLUTION Program Structure With the initiation of the ARPANET program plan in early
fiscal
year
1969,
network
system
the switching nodes and the efforts sharing within the DARPA and
initiate resource
experiments
specialized network support. DECCO was able to handle all the the contractual details with
but a small number of circuits were leased from other In addition, in DARPA arranged which system
greatly facilitated the interactions between the contractor, DARPA, and AT&T. The selection (and,
internode
connections was
circuit
terminations)
problem and represented a difficult theoretical own right. To help solve this particular
II-10
hal':'d
A'-
=,
" ,
.-
- - . -
-:o
I .
Report No.
4799
support,
NAC's advice
on
topology
was
sought through the various stages of ARPANET growth. A competitive procurement was planned for the selection of as general
the contractor to design the switching nodes and act systems contractor. Bolt Beranek and An RFP was prepared and issued in Newman Inc. (BBN)
July 1968.
subnetwork
transfer
DCA in
July of 1975,
served as the systems contractor for the design, operation and maintenance of the subnetwork; Defense
serving that role under the aegis of the Agency (DCA). The
Communications
research groups receiving DARPA IPTO support then began the and, design in turn, and implementation of protocols in and the
considering procedures
Several
tasked to develop and run a "Network Measurement Center" with the objective of determining the performance of the network; SRI was
specifically tasked to develop and operate a "Network Information Center" with the objective of collecting information about the
lI-11
Report No.
4799
network,
about
host
resources,
Beyond these two specific contracts, were pursued to reach the over the
agreement
various
contractors
about
interested
individuals
sites
After a time, this Network Working Group became and eventually a semi-official approval
authority
discussion of and issuance of host protocols to be implemented by the various research contractors. Progress in this area was
rather slow for a while, but with time, this mechanism eventually was successful in establishing effective host protocols. 2.2 Major Technical Problems and Approaches In a program of this duration and complexity, it is not
difficult to identify many dozens of important technical problems and approaches to those problems. We here list a few of the
problems which were most technically challenging in the early few years of the ARPANET program. A few additional major technical
problems will be listed in the next section on "Major Changes and Objectives".
11-12
Report No.
4799
this
type
with
even
and quite
formidable Assuming
problem that
of ways of arranging M
large; the links are usually available in (bandwidth); delay and the and component reliability
functions,
The design may be subject to many maximum or average time delay, and reliability
requirements. The usual goal of the optimization is to provide a network design that meets all constraints at the lowest cost. design an The approach to this problem was to the
elaborate It is
optimization. approach, a
exhaustive
and instead the approach used was to generate network" to the and then to in perform local
8starting
transformations
topology
order to reach a
locally optimum network. If this procedure is repeated with many starting networks and if the resulting locally optimum networks are evaluated, feasible it is possible to find a
11-13
Report No.
4799
necessity was to
for
provide
communication and one component of such reliability an ability to work through the
expected phone line The approach hardware each 50 taken at the kilobit
checksumming end of
transmitting circuit in
receiving
transmission checksum is
the at the receiving node, Then, be transmitted. checksum is recomputed in hardware and compared with Lhe transmitted checksum. If there is no error, back error, will an to no be 3 An important issue was the proper
acknowledgment (with its own checksum) the transmitting is node. sent If and there the
is sent is an
packet
host computers of many different types. to allow a logical match between the
switching
routines of the
switching
11-14
Report No.
4799
routines
of
without
placing
an
undue
processing
could
that
logically
each
small
host
specialized
hardware
machine a logical
and electrical convention was specified by the switching network in to all a manner intended to minimize overall trouble then each host was required to meet that
hosts,
central
goal
of
the
to provide resource sharing between remote such a way resource required that a local user could In be have
installations in employ a
i-emote this
reliable, great
have sufficiently
capacity
These objectives translated into a major technical for the switching node itself to provide low
problem
11-15
Report No.
4799
cost.
The
approach
optimize the capacity and the low delay of the data path in the switching node. minimizing the Great time attention of was paid to
operating
these programs. o REMOTE CONTROL - A special and new problem was posed by
the need to put dozens of small identical mini computers in the field, in an environment where the host
connections to those computers was somewhat experimental and where the programs in the mini computers were month. under themselves
software,
installation difficulties
associated
develop computer
management.
A Network Control
established
for the subnetwork and software was developed which made it possible to examine or change the operating software control
11-16
Flow_
Report No.
4799
center.
This
approach
made
it
possible each
to
issue in In to
node
network from a central place in an hour or twc. each node reports the state of its health
addition, the
decides how to route information to reach any particular destination. This is a difficult theoretical problem
including fixed
and various forms of distributed adaptive routing. approach taken was to use a distributed adaptive traffic routing algorithm which adjacent for estimates nodes each the on the
basis
of
globally in
proper
path
loads
line
of the output circuit corresponding to the minimum delay path to each other IMP,
the delay.
of
Periodically,
its
current an IMP
routing estimates to
neighbors;
receives
such
message
it
updates
its
internal
II-17
Report No.
4799
estimates. is
Thus,
regularly
propagated
whenever a packet of traffic must be placed on the queue for an output circuit, of the best path. the IMP uses its latest estimate
HOST PROTOCOL - In many ways a computer host users: computers as the telephone
network is
is
to
system
to human
after the caller has learned how dial, it is still the necessary person called
language as communication
to occur.
to design a host
communication that will occur and yet can be implemented in all of the various different host computer systems. approach taken involved the development of a a a "Network host would Control Program" such with that the The
The initial
this
Network
Program.
switch connections,
U1-18
Report No.
4799
Inc.
that
more
complex
procedures (such as File Transfer Procedures) on top of simpler procedures in Program. 2.3 Major Changes in Objectives and Approaches
were built
The ARPANET development was an extremely intense activity in which contributions were made by many of the best computer "major
scientists in technical
Thus,
problems"
continuing changed
attention and the detailed approach several However, times in during the early
those
problems
were introduced once the initial o THE TIP - The IMPs, were initial
intended to interconnect computers and high lines. At the outset all terminal
network was via terminal connections to After a time it cf users for became clear that which terminal
not conveniently able to access the network via computer. Thus, a new nodal switching unit, or TIP, was
a Terminal defined to
11-19
serve
the purpose of an IMP plus an additional function This shift resulted in the
design of a TIP which really was a tiny host embedded in a switching node itself and permitted the direct
asynchronous node.
switching
often even
11-20
1i
II
Report No.
4799
3. 3.1
SCIENTIFIC AND TECHNICAL RESULTS AND ACCOMPLISHMENTS Results of the Effort in Relation to the Program Objectives can be seen to reach its
or Armstrong stepping onto the moon. ARPANET, success, and was over "to
an equally important objective may be reached with equal but the event must be observed in a longer period of time. develop techniques in and a more complicated way ARPANET objective experience on
interconnecting
computers
such a way that a very broad class Not just techniques, but an
possible".
and an
enormous body of experience has been developed on interconnecting computers to allow a broad class of interactions. A second objective, which has also been attained, was to
improve computer research productivity through the development of computer resource sharing. Another objective was to permit the linking of specialized Several
specialized computers have been linked over the ARPANET to main general purpose computer centers in an extremely
successful fashion.
11-21
Report No.
4799
At
technological
level,
would facilitate resource sharing among the and to understand, such over 50 resource nodes design and implement sharing. Such a
the network;
permit of
Hawaii to Norway,
among
decisions were to a
made to take advantage of this success and to grow the net size that had never been anticipated at the outset;
more than 50 nodes over a geographic area from Hawaii was certainly not originally anticipated.
the first
but as decisions were made to expand the cost no longer followed the
the scale of
11-22
Report No.
4799
In
short, far
the
results than
of
the
effort met
were the
eminently objectives
more
adequately
stated.
3.2
Were
Successful
and
Aspects Envisaged
A representative list
Powerful
computer-based were
techniques
for
topological
optimization
developed
topology was made with the aid of these tools. o The carriers successfully provided high reliability
50K/sec circuits. o A subnetwork including nodal switching IMPs and TIPs was constructed whose performance, facilitate resource sharing. o The ARPANET provides adaptive routing in a convincing can demonstration be made that reliability, and cost did
algorithms
failures),
adapting
.1
11-23
Report No.
4799
changes flexibly
in
the
network
quickly a
and
(e.;., and
accommodating internode
circuit
bandwidths
build a large operational network in such a way that the effects of component failures are localized rather than otherwise
all
"crashing" or
portions or
making
non-operational
large
of the network.
will
be
prevented
theoretical packets to
result
that
which which
in
compared
the
computers (hosts)
demonstrated
that
network
can
be
lines, traffic,
and so on can
addition.
I1-24
Report No.
4799
is
possible
for
operate itself
for hours at a
time without explicit control from a control center. o The ARPANET has demonstrated and new techniques for
monitoring,
maintenance,
debugging.
The nodes in no
the ARPANET typically operate at sites where there is krowledgeable automatically itself) and person report available their locally. (via and The the
nodes network
status
typically carried out (again via the network) monitoring center. o Possibly the development most of the difficult ARPANET to make of a task was undertaken
in
the which
number
independent and
systems
varying
manufacture,
single
manufactured
characteristics. o A set of host protocols was host organizations hammered out between the
and resulted in
11-25
-'
*-wla~oL---
Report No.
4799
to the
Defense
there had
were been
areas some
utilization developed more slowly than had been anticipated. Problems of routing, the subnetwork flow control, out and congestion control in to be as difficult as be
turned
modified more than the implementors had anticipated. Luckily, the improvements in the algorithms managed to stay slightly and, ahead of the growth in network size and traffic with to the algorithms sharing on never the
therefore, an
difficulties impediment
represented
network. It
resource
the
specification
of
adequate However,
the eventual
design
sharing.
k
of a widely-useful on-line Network project.
tools
The
development
proved to be a
difficult
11-26
Report No.
4799
for
information
host
sites
tools
nearly
were
intractable. developed,
computer
elegant,
of the NIC wer-e substantially reduced and at the time of the ARPANET obtain transfer detailed to DCA, it was about generally necessary to the resources at a
inform3tion
Many
different
kinds
of
resource the
sharing
use
were Of
ARPANET
program.
remote use of one program by another was one of While some of this kind of resource such Use has grown more
taken place,
t1
11-27
4.
4.1
achieving
performance,
effective
communications turn,
sharing
computer
also proved the feasibility of achieving closely knit communities of technical interest over a widespread geographic possible that this social feasibility area; it is is as
demonstration
important as the many technical feasibility demonstrations. 4.2 Recommendations on Additional R&D Requirements and
Opportunities It is clear that packet switching and in control networks have a very and a significant
command exists
develop testbeds whereby packet switching technologies and related technologies can be experimentally
employed There
cooperation with one or more of the military services. a clear requirement for improved
11-28
At
deep
technical
level,
the
proper
design
of host to
operating systems for efficient and cost effective connection networks is still in the area of significant project,
In the
ARPANET
"add-ons"
and it of how
investigation
techniques for remote control of computers in the field probably more broadly
applicable to the management of computer resources in other areas of the Defense Department. These remote management techniques ARPANET
represent another opportunity which has grown out of the experience. It was earlier indicated that it
Network Information Center in the ARPANET to keep current on-line detailed descriptions of program resources available host and community. development This within the
opportunity
research computer
and development is required on how to properly describe programs such and how to create standards for such
descriptions
that it
will be easier to create compendia of despite the sharing great problem success still
resource
11-29
Report No.
4799
represents a fertile area for research and development. the networking technology itself is "given",
Now that at
attempts
description and documentation of host resources might more easily yield to a research and development effort.
IJ
11-30
Report No.
4799
5.
5.1
The
ARPANET technology is being succe.sfully transferred to Not only was it possitle to transfer the
Agency (Code
535),*
but the Defense Communications Agency has already embarked on the procurement of its primary backbone major communications system
AUTODIN II -based very specifically on the
of the future --
packet
switching
technology step
in
the
ARPANET. are
Even
services
actively
investigations
their specific needs. 5.2 Impact on Non-DoD Programs In just the very short ARPANET time since the inception of the
this technology has already resulted in the formation of a private sector development
networks. Two
a new industry:
packet
of
"value
added"
and
switching
corporations,
Telenet
Tymshare,
communications
to the general public as common carriers under the Communi'.,ations act of 1934. This program therefore has also had direct and sector. In addition,
11-31
Report No.
4799
all
over the worlc new communications systems are being designed packet switching technology
--
and built to take advantage of the demonstrated by the ARPANET project. Great Britain, France and Canada
this technology. 5.3 Applications of the Program Results The most specific result of course, been the ARPANET itself; the ARPANET and the Program has, of is
currently fully operational under the management of Communications Agency and is actively serving
Defense of
thousands
of communications and the state-of-the-art The greatest advance reliable, has been in the
significant
state-of-the-art
taken
optimization, resource
routing,
technology, network
sharing
between
mail systems,
11-32
Report No.
4799
6.
BIBLIOGRAPHY OF REPORTS There has been an enormous amount of literature sharing been about the
ARPANET
in
particular, general.
and
about
resource
computer formed in
networks in the
AFIPS Spring Joint Computer Conference in published in the Proceedings Vol 36, of that
Proceedings,
07645).
Another
1972
Conference in
papers
AFIPS Conference Proceedings, Vol. 40. papers represent a sensible introduction about and plans for the ARPANET.
A
sizeable bibliography and index to publications about the 1976 with DARPA support: "Selected Becker This about
Bibliography and Index to Publications About the ARPANET", and Hayes Inc., February 1976, 185 paias, AD-A026900. listing
complete is
availa.le
provide help in
11-33
would be suitable to look at in what order. on the literature of resource ARPANET) sharing has been
general (not just the Department of Commerce, Bibliography Networks", document what is NBS is of the Special also not
"Annotated
Publication
revised
Several volumes of reprints have been published with computer networks but which in general attempt to (rather collect than
specifically),
together
important
papers
themselves
Computer
Communications",
Dedham,
Wesley W. Chu,
Artech House,
1974; (2)
Inc.,
610
Washington St.,
Massachusetts
02026,
"Computer
E. 47th
Green,
Jr.
and
Robert
W.
Street,
New York,
New York P.
"Computer Networking",
edited by Robert
Cotton, 1916.
compendium
with
very
large list of references is "Infotech State of the Art Report 24, Network Systems and Software", Infotech International Ltd.,
11-34
Report No.
4799
Maidenhead,
Berkshire,
England,
1975.
This
the ARPANET, but it tries deals with far more than just other current work as of 1975. to put the ARPANET in context with There are three important been prepared for the reference documents which have by the
Defense
Communications
Agency
Menlo Research Institute, Network Tnformation Center at Stanford addressed to 94025 which are specifically California Park, (1) "ARPANET Resource Handbook", various aspects of the ARPANET: NIC Protocol Handbook", "ARPANET NIC 39335, December 1976; (2) (3)"ARPANET Directory", NIC 36437, 7104, Revision 1, April 1976; July 1976. A textbook on computer networks is John Davies Wiley, and Barber, 1973. A
Computers",
11-35
CHAPTER III:
~1
I<
I"
II
tt-
SA
Report No.
4799
1.
called,
consists of IMPs,
lines,
Figure 1. small,
Interface
Message
are
computers
connected
heterogeneous
IHO St]IHOST!
HOlST
PHONE
LINES
Figure 1
--
IMPs,
Lines,
and Hosts
used
for
variety
of
applications. through
The
IMPs
provide
subnetwork
111-2
Report No.
4799
subnetwork
In
of which the hosts are users. one IMP may have several When is data is
broken into discrete entities called "messages" which is of also called the "source host".
host,
consists
which host the data is host". its IMP, Successive where they
"destination
messages are
are passed from the source host to into smaller entities called
broken
each of which carries the same address as the message. are routed from IMP to IMP across the network until at the IMP to which the destination host is
packets arrive
where the original messages are reconstructed from the and passed to the destination host. ARPANET was conceived in the middle to late 1960s as a Techniques (DARPA) of the r
the Defense Advanced Research Projects Agency Department of Defense ir' 1969. By (DoD). Construction
began
111-3
Report No.
4799
In 1975, U.S.
control of the network was transferred from DARPA to the Communications Agency, an agency better suited to
Defense
the administration of a working facility. The ARPANET is a computer major development Our why it purpose in here the evolution of
communications.
it, ones)
deci3ions
its
evolutionary development,
maturity,
important.
111-4
Report No.
4799
1.1 1.1.1
Background The RAND Study of Distributed Communications Networks One of the most important early studies of computer networks
was
performed
by
Paul
Baran
and Many
his
concepts
later development of the ARPANET and other computer networks were first described in the series of reports published by RAND in
of these reports is given in the bibliography at the subsection). These ideas include the improved
reliability of a distributed network structure over a centralized or star network and over so-called decentralized networks made up of a collection of smaller star networks. undertaken, determine expected including how to be simulation a of Extensive studies were some grid networks, could to be
"survivable"
distributed
network
keeping
face of enemy attacks on the network# from the point of its suitability for Department of Defense applications. In specifying closely
practical
networks that
In the
Distributed
Adaptive
Message
111-5
Block
Network, of
"multiplexing differing
is
station"
connects
up to 1024 Automatic
the network links
terminals
widely
characteristics.
integrated into
user-to-user
cryptography
Both satellite
for providing the npt-.'ork with very high data rate circuits. The a packet of up to concept of a,"mesrav block" .s introduced: 1024 bito of header and data, which is the unit of data
aspects
Lhe network. is
that 1t concluded
was
not
only
feasible
but
also
highly
and proposed that many of the switching functions Baran was considering ways of making and so preferred simple solutions
networks,
and reliable hardware where possible. The following bibliography includes the entire set of eleven reports in the original RAND study as well as two published papers resulting from that set and trom two later reports. is included in An
"Adaptive (John M.
McQuillan,
11
Report No.
4799
Bibliography P. Baran, "On Distributed Communications: I. Introduction to Distributed Communications Networks," August 1964, 37p. RAND Corp. Memo RM-3420-PR,
S. Boehm and P. Baran, "On Distributed Communications: II. Digital Simulation of Hot-Potato Routing in a Broadband Distributed Communications Network," RAND Corp. Memo RM-3103-PR, August 1964,
4
9p.
J. W. Smith, "On Distributed Communications: III. Determination of Path-Lengths in a Distributed Network," RAND Corp. Memo RM-3578-PR, August 1964, 91p. P. Baran, Precedence, 1964, 63p. "On and IV. Priority, Distributed Communications: Overload," RAND Corp. Memo RM-3638-PR. August
P. Baran, "On Distributed Communications: V. History, Alternative Approaches, and Comparisons," RAND Corp, Memo RM-3097-PR August 1964, 51p.
P. Baran, Microwave,"
P. Baran,
"On Distributed Communications: VI. Mini-Cost RAND Corp. Memo RM-3762-PR, August 1964, 101p.
"On Distributed Communications: VII. Node," Tentative
Engineering
Specificatio,'
and
8 5p.
Preliminary
Design
RAND
for
Corp.
Memo RM-3763-PR,
August 1964,
P. Baran, "On Distributed Communications: VIII. The Multiplexing Station," RAND Corp. Memo RM-3764-PR, August 1964, 103 p. P. Baran, "On Distributed Communications: IX. Security, Secrecy,
and
Tamper-Free
Considerations,"
RAND
Corp.
Overview,"
P. Baran, "On Distributed Communication Networks," Transactions on Communications Systems Vol. CS-12, March
pp. 1-9.
IEEE 1964,
111-7
Report No.
4799
emo and R. L. Mobley, "Adaptive Corp.M Motn B. W. Boehm Communications SYstems" RAND
Distributed February 1966, 78p.
iqe
fo47-r,
Simulation of Adaptive L. Mobley, "A Computer R. RAND and Boehm W. B. Communications Systems," Distributed for Routing Techniques February 1966, 35p. Corp. Memo R14-4782-PR, for "Adaptive Routing Techniques on Mobley, L. R. and Transactions B. W. Boehm IEEE Systems," 3, June 1969, pp. Distributed Communications Vol. No. COM-17, Technology, Communication
340-349.
.1
.4
IH
1I1-8
Report No.
4799
1.1.2
The Lincoln/SDC Experiment The notion by of J.C.R. linking computers into a network was
envisioned reality.
Licklider long before the ARPANET become a director of DARPA IPTO. and his colleagues at Computer were
"In 1965
Corporation
America
Cambridge,
Massachusetts)
Lincoln Laboratory to study the concept of The primary technical contact at Lincoln the
network study; and the contract was, the Laboratory's DARPA contract. and a report of on the
Network
Thomas
Corporation
Thomas
Marill
appeared in
available communications techniques and recommended constructed. computers, that The a three-computer suggested
report
existing the
TX-2.
II I-9
Report No.
4799
Later
in
1966,
CCA
received another contract to carry out the The Q-32 and TX-2 were in Later a fact small
linking of the Q-32 and the TX-2. linked together, Digital network,
Equipment Corporation machine at DARPA was added to this by now known that The as "The Experimental Network". It is
noteworthy directly,
Ii
III-10
' ...
Report No.
4799
1.1.3
The NPL Data Network Another early of the major network was development undertaken England, system under design at which the the affected National leadership
development
ARPANET
Network,
as it
a resemblance to the network proposed by Paul Baran at RAND, to the ARPANET. The network NPL and Data was
was proposed that "local networks" be constructed "interface computers" which had responsibility for
multiplexing among a number of user systems and for communicating with a "high level nodes" network". connected The latter would be constructed together with megabit rate
with "switching
circuits.
Considerable
detail about the NPL Data Network may be found by two of the network's designers, Davies and 1973). A
Wiley
bibliography
published
iIi
... . mrlmm
Bibliography T. and P. Scantlebury, R. A. Bartlett, D. W. Davies, K. A. Wilkinson, "A Digital Communication Network for Computers Giving Rapid Response at Remote Terminals," ACM Symposium on Operating Systems Problems, October 1967, 17p. Bartlett, R. A. Scantlebury, and P. K. A. Real-Time for Network Communication International Conference on Communications, Wilkinson, "A Data IEEE Computers," U.S.A., June 1968. T.
Networks to Serve Rapid Response "Communication D. W. Davies, Vol. 2 1968, Computers," Proceedings of the IFIP Congress Hardware Applications, pp. 650-658. K. A. Bartlett, "Transmission Control in a Local Data Network," Vol. 2 - Hardware Proceedings of the IFIP Congress 1968, Applications, pp. 704-708. "The Principles of a Data Communications Network D. W. Davies, IFIP of the for Computers and Remote Peripherals," Proceedings Congress 1968, Vol. 2 - Hardware Applications, pp. 709-715. Wilkinson, and K. A. Bartlett, "The T. P. A. Scantlebury, R. Communication Design of a Message Switching Centre for a Digital 2 Vol. 1968, of the IFIP Congress Proceedings Network," Hardware Applications, pp. 723-733. in P. T. Wilkinson and R. A. Scantlebury, "The Control Functions 1968, Congress Proceedings of the IFIP a Local Data Network," Vol. 2 - Hardware Applications, pp. 734-738. Colloque D. W. Davies, "A Versatile Data Communication Network," Paris, March 1969, pp. sur la Teleinformatique, International
&461-467.
Scantlebury, A. R. and D. V. Blake, Barber, A. D. L. for Data Interface of the British Standard "Implementation Colloque Data," Digital of and Acceptors Exchange between Sources pp. March 1969, Paris, International sur la Teleinformatique, 807-816. Bartlett, R. A. Scantlebury, and P. T. Wilkinson, K. A. Transmission over Half-Duplex on Reliable Full-Duplex CACM, Vol. 12, No. 5, May 1969, p. 260. "A Note Lines,"
D. L. A. Barber, "Experience with the Use of the British Standard Interface in Computer Peripherals and Communication Systems," ACM Symposium on Data Communication, Pine Mountain, October 1969. III-12
Report No.
4799
for the Local Area of a Data "A Model R. A. Scantlebury, and Hardware Organization," Communication Network - Objectives Mountain, October 1969. ACM Symposium on Data Communication, Pine a Data "A Model for the Local Area of Wilkinson, T. P. on Symposium ACM Communication Network - Software Organization," 1969. Data Communication, Pine Mountain, October "The NPL Data Network," Barber and D. W. Davies, A. D. L. Automation, Laboratory On Conference Proceedings of the Novosibirsk, October 1970. Switching "The Control of Congestion in Packet D. W. Davies, on Symposium of the Second ACM/IEEE Proceedings Networks, Systems, Communication of Data the Optimization Problems in Vol. of IEEE, Transactions in also 46-49; pp. October 1971, COM-20, No. 3, June 1972. "The Design of a Switching R. A. Scantlebury and P. T. Wilkinson, Computer Services by Other Access to System to Allow Remote of the Second Proceedings Devices," Computers and Terminal the Optimization of Data in ACM/IEEE Symposium on Problems also in 160-167; Pp. October 1971, Systems, Communication 1972. 3, June Transactions of IEEE, Vol. COM-20, No.
W.
L.
?rice,
Physical and P. T. Wilkinson, "The National R. A. Scantlebury ICCC the of Proceedings Laboratory Vata Communication Network," 229-238. Conference, Stockholm, August 1974, pp.
D.
W.
Davies,
"Packet
W.
Isarithmically Controlled L. Price, "Simulation Studies of an Proceedings of the Network, Store and Forward Data Communication
IFIP Congress, Stockholm, August 1974, pp. 151-154.
111.l3
Report No.
4799
1.2
The Events of 1967 and 1968 The years 1967 and 1968 were spent promoting interest in the
ARPANET
project
both
within
the
government
and
the
with
IPTO
contractors, writing a
network, and
selecting a contractor,
In early 1967,
for
the proposed
network,
lines that
and the
inter-host
would
conventions
and retransmission,
Westervelt,
wrote a position
"Communication and
a meeting of the group scheduled. The plan considered throughout much of the Michigan was and to data connect sets meeting
all of the computers by dial-up telephone lines so as any to allow any computer to establish
communication
with
other it up
computer on the
technique (i.e.,
calling
program
in
each
computer
would
111-14
Report No.
4799
message
to
-another
computer,
the
transmission function, deciding how to actually reach computer and transmitting the message to it.
a small computer be inserted between each phone line. This concept was
Message Processor or IMP emerged. The IMP checking, the would perform the functions of dial-up, error
retransmission,
routing,
and verifications on behalf of we shall lines hereafter and data call sets
participants'
computers
(which
hosts). would
IMP would be a digital interface of a much simpler sort requiring no host consideration routing. It was IMP of error checking, retransmission, and of
another
IMPs
was
recognized
to
be
design
the
could
fact
be
that
unified,
straightforward
network
of
111-15
Report No.
4799
Further,
it
would be
much simpler to modify the network of IMPs than to modify all the host computers. communications It Finally, burdens the IMPs would relieve the hosts of the they were initially scheduled to carry. be located at
strategic
points
IMPs
would be useful in
By October 1967 the proposed network was becoming the ARPA Computer Network, discussion or ARPANET for short. at that time
known
as
including and
message queuing,
protocols, error It
routing
communication.
communications lines would be used because of the vastly improved response time which could be obtained with these lines as opposed to the previously proposed 2.4 Kb lines. be leased, The 50 Kb lines were to The nature of 50
affordable.
permanently lines,
111-16
Report No.
4799
message handling.
bits from its
computer
into 1,000-bit
packets.
routed
on one of the two or more inter-IMP lines. at an IMP, further it was to be stored, At its
error checked,
It.?.
destination, assembled
RFQ
for
prospective bidders.
(DSSW).
Four bidders were rated within the zone of contention to technical briefings
receive the IMP contract, and supplementary were requested from each of these bidders.
111-17
Report No.
4799
1.3
Key Aspects of the RFQ It was specified that responses to the RFQ would be
Availability of qualified, experienced personnel for assignment to software, hardware, and installation of the system. Estimated functional performance and choice of hardware. General quality, responsiveness, commitment to the network concept. RFQ had and corporate
3. 4.
The
that there would be no other opportunity for bidders technical issues with the government.
contract with the contractor supporting them three take months after installation. full system responsibility,
111-18
Report No.
4799
I.
Network Description A. Introduction B. Functional Description 1. The User Subnet 2. The Communication Subnet
C. Functional Description of the IMPS 1. Breaking of Messages into Packets 2. Management of Message Buffers 3. Routing of Messages 4. Generation. Analysis and Alteration of Formatted Messages 5. Coordination of Activities with Other IMPS 6. Coordination of Activities with its HOST(s) 7. Measurement of Network Parameters and Functions 8. Detection and Disposition of Faults 9. IMP Software Separation Protection The HOST-IMP Interfaces The IMP-CARRIER Interfaces Network Performance Characteristics 1. Message Delay 2. Reliability 3. Network Capacity 4. Network Model HOST-HOST Characteristics IMP-Operator Interface
D. E. F.
G. H. II. III.
Appendix A. ARPA Network Nodes B. ARPA Network Topology C. IMP Delivery Schedule D. Input and Output Facilities for the IMP Operator E. ARPA Network Data Rates Between Nodes in Kilobits/sec.
F.
G.
Figure 2:
111-19
Report No.
4799
The
IMP
specification
clearly
IMP contractor,
Each individual host site was responsible for designing for its own convenience the the hardware and and the The
implementing
network,
hardware and software to utilize other hosts on the network. telephone company
was to be responsible for providing necessary and line conditioning equipment utilized IMP contractor was to by
be responsible for
providing necessary hardware and software to connect IMPs to each other using the circuits supplied by the telephone company and to connect IMPs to hosts, as well as providing hardware and software
necessary to implement the procedures which allowed creation of a network of IMPs capable of forwarding messages from one another. The functional description of an IMP specified the use of would be broken into host to
size to make them manageable for the hosts. used to reduce the probability of attendant necessity for
transmission It
retransmission.
provision of message and packet buffer space would conversions delays, to take place,
and permit
retransmission
111-20
Report No.
4799
transmission.
take into account the connectivity of the network, busyness, and message priority, IMP and on a use path
updates
loading
information
with
other
IMPs
and
hosts
was
also
hypothesized.
the
host's
convenience.
The
network messages
parameters through
network.
initiation and termination by a host or another were to detect and recover from
various IMP,
and line
failures.
examine,
stop,
start,
it
Finally,
was
thought
that
at
each
code
IMP
to
special
was desirable to protect the rest of the that the host personnel could access and
the
program.
111-21
Report No.
4799
There were
host-to-IMP
two
particularly
1)
interesting
aspects
of
the
interface:
for
of
each
host;
2)
each
although
messages.
The interface between an iMP and its telephone lines was detect CRC, control a
sense check
microseconds
provide to be six.
information.
Further,
handling
The average message delay for a short message to go from a source IMP to a destination IMP was to be less than one-half second for
fully
loaded
network.
was to be
considered
defined to be the maximum bit rate that can node and still
have the meSsage delay remain less than one-half A network model
second;
was presented.
111-22
Host-to-host
traffic
flows be
were a
estimated
and
it
was of
would
trimodal
distribution
type (high rate and short length, and low rate and long length). the
option
of
multiple
hosts
the bidder was also asked to consider the to new facilitate software, simultaneous IMP
II-2
Report No.
4799
1.4
Chronological Development,
Within a year after the award of the IMP contract, IMPs were installed in the field.
was written, hosts began to communicate with each and gradually the ARPANET
other, more IMPs and hosts were added, became an operating entity.
operation the network was no longer best suited to management an agency with the charter to
development, Defense
Communications
I1I-24
Report No.
4799
1.4.1
The Groups and the Key People The ARPANET and development was a all joint effort to of many DARPA's further,
individuals dire.tion. it is
institutions,
responsive
development
best to list
11
!i'I
!
III-25
F77--
Report No.
4799
1.4.1.1
Management and Administration of the Network: DARPA IPTO, DSS-W, RML, and DECCO the development was as Robert well as
DARPA IPTO played a major role in The director of IPTO provided the at the
time
necessary
support
Lawrence
Roberts Roberts
program manager for the network program. network, made certain key architectural the IMP
decisions, and
led the evaluation team which selected selected other involved contractors. director of IPTO. While
contractor
who would join the network, day by day. the out network, much of
BBN provided day-by-day operation and maintenance of and BBN and the other contractors the day-by-day business of the involved carried network among
themselves without need for daily IPTO supervision. Initially IPTO itself filling out took care of ordering telephone lines,
forms which were sent to DECCO for procurement from telephone companies. of Also, the IPTO
technical
monitoring
various as the
contractors associated with the ARPANET; procurement agency for the contractors.
attempting
1II-26
Report No.
4799
to rid
itself
of
the
routine, and
tedious
aspects
of
ordering of
communications
lines
providing
technical
monitoring
routine dealings the DSS-W functions, shifted IPTO contractors, Range technical monitoring to the with DECCO, and some contractor Force Base in Florida; in Laboratory at Patrick Air Measurements RML also had a capability, procurement a having addition to technical support capabilitY. of the IPTO staff who have were several other members Roberts. of the ARPANET besides management the in prominent been There
These
have
included
A.
Blue,
B.
Wessler,
D.
Carlstrom,
S.
Crocker,
B. Dolan,
C. Fields,
S. Walker,
and D. Russell.
a strong technical IPTO often played number As mentioned above, of the IPTO staff wrote a role in the ARPANET, and members
of papers describing the ARPANET activity.
Several of these
111-27
Bibliography Network T. Marill and L. G. Roberts. "Toward a Cooperative Time-Shared Computers," Proceedings FJCC 1966, p.425-431. of
L. G. Roberts, "Multiple Computer Networks and Intercomputer Communication," ACM Symposium on Operating System Principles, October 1967, 7p. L. G. Roberts and B. D. Wessler, "Computer Network Development to Achieve Resource Sharing," Proceedings SJCC 1970, p.5 4 3-5 4 9. L. G. Roberts, L. G. Roberts, 1971, p. 4 - 8 . "A Forward Look," Signal, August 1971, p.77-81. Fall
EDUCOM
L. G. Roberts, "Network Rationale: A 5-Year Proceedings COMPCON 1973, February 1973, p.3- 6 .
Reevaluation,"
L. G. Roberts, "Dynamic Allocation of Satellite Capacity through Packet Reservation," Proceedings NCC&E 1973, p.711-716.
L.
G.
Roberts,
"The
ARPA
Net,"
in
Computer-Communication
Prentice-Hall, 1973.
Networks,
N. Abramson and F.
Kuo (Eds.),
S.D. Crocker, J.B. Postel, J.F. Heafner, R.M. Metcalfe, "Function-oriented Protocols for the ARPA Computer Network," AFIPS Conference Proceedings 40, May, 1972, pp. 271-279.
111-28
Report No.
4799
The Network Analysis Corporation by Dr. Howard Frank, Long Island, the Network Analysfs Corporation was put under contract by DARPA
the topological design of the ARPANET and to analyze and reliability characteristics. of the parameters of a or
performance,
such as cost,
reliability,
delay,
throughput,
through the
it
is necessary
proposed
to
simulate
Then,
the
flow
of
traffic
network.
is
for
specifying
the
routes
on
which
flow in the network, and the procedure must repeated so often in the
not be too complex since it must be iterative methods design process. for incremental
taking advantage of
111-29
I,
Report No.
4799
Bibliography NAC First Semiannual Technical Report for the Project, "Analysis and Optimization of Store-and-Forward Computer Networks," June 1970, 62p. NAC Second Semiannual Technical Report for the Project, "Analysis and Optimization of Store-and-Forward Computer Networks," January 1971, 96p.
NAC Third Semiannual Technical Report for the Project, "Analysis and Optimization of Store-and-Forward Computer Networks," June
1971, 109p. NAC Fourth Semiannual Technical Report for the Project, "Analysis and Optimization of Store-and-Forward Computer Networks," December 1971, 1 2 3p. NAC Fifth Semiannual Technical Report for the Project, "Analysis and Optimization of Store-and-Forward Computer Networks," June 1972, 92p. NAC Final Technical Report for Optimization of Store-and-Forward 1972, 120p. the Project, "Analysis and Computer Networks," October
H. Frank, I. T. Frisch, and W. Chou, "Topological Considerations in the Design of the ARPA Computer Network," Proceedings SJCC 1970, p.581-585. H. Frank, I. T. Frisch, R. Van Slyke, and W. S. Chou, Design of Centralized Computer Networks," Networks, Vol. 1, 1971, p.43-58. H. Frank and W. Chou, "Routing in Vol. 1, No. 2, 1971, p.99-112. H. Frank, "Computer Network Convention Record, March 1971, p. H. Frank Networks,"
2 20
Design," -221 .
Internation:'.
Networks,
England,
and W. Chou, "Throughput in Computer- Communications International State of the Art Report no. 6; Computer
Infotech
Information
Ltd.
Maidenhead,
Berkshire,
Part
1971,
p.493-512. Analysis:
R. Van Slyke and H. Frank, "Network Reliability I," Networks, Vol. 1, No. 3, 1971, p. 2 79- 2 90.
111-30
Report No.
4799
H. Frank and I. T. Frisch, "The Design of Large-Scale Proceedings of the IEEE, Vol. 60, No. 1, January 1972,
R. E. Kahn, and L. Kleinrock, "Computer Communication H. Frank, Practice," and Theory with Experience Network Design SJCC 1972, p.255-270; also in Networks, Vol. 2, No. Proceedings 2,1972, p135-166. W. Chou and H. Frank, "Routing Strategies for Computer Network Institute Research the Microwave of Proceedings Design," Networks and International Symposium on Computer-Communications Teletraffic, April 1972, p.301-309. A. Kershenbaum and R. Van Slyke, "Computing Minimum Spanning Conference, Trees Efficiently," Proceedings of the ACM Annual August 1972, p.51 8 -5 2 7. "Topological H. Frank and W. Chou, Networks," Proceedings of the IEEE, Vol. 1972, p.1385-1397. Optimization of Computer November 60, No. 11,
"Optimal Design of Computer Networks," in Computer H. Frank, Networks, R. Rustin (Ed.), Prentice-Hall, 1972, p.1 6 7-1 8 3. in Routing Policies "Deterministic and Adaptive M. Gerla, Packet-Switched Computer Networks," ACM Third Data Communications Symposium, Florida, November 1973, p.23-28. Slyke, "Simulation of Centralized R. 'Van H. Frank, W. Chou, Computer Communications Systems," ACM Third Data Communications Symposium, Florida, November 1973. p.121-130. W. Chou and A. Kershenbaum, "A Unified Algorithm for Designing Multidrop Teleprocessing Networks," ACM Third Data Communications Symposium, Florida, November 1973, p.148-156. H. Frank, "Providing ACM Third Components," November 1973, p.161-164. Unreliable Reliable Networks with Data Communications Symposium, Florida,
I. Gitman, R. M. Van Slyke, and H. Frank, "On Splitting Random Channels," Proceedings of the Accessed Broadcast Communication on System Sciences. Conference International Seventh Hawaii January 1974, 5p.
111-31
Report No.
4799
1.4.1.3
The Telephone Companies a nationwide communications network means doing further, if the
Building
to have overseas or foreign components, various international This task carriers was and
with
Telephone
Telegraphs.
handled by DECCO,
negotiated with the relevant telephone companies and obtained the specified service at the best price. from UCLA to RAND, for example, In the case of a circuit
procured from General Telephone, in the Los Angeles area. in the example just
given,
requested
circuit
fell
completely within the jurisdiction of a single telephone company. To handle all instances when the requested service spanned the
jurisdictions of more than one telephone company, utilized their Long Lines division; and in
Lines,
several years of the ARPANET development, to DARPA were, Ken Stanley. in A turn,
the Al
customer
111-32
Report No.
4799
representative's job is to make the customer aware of of service available Fortunately that
the
kinds
and to keep him happy with the service he for the ARPANET, the Bell System
receives. understood
the
requirements
rather
than
having
to
rely
on
the Thus
usual the
was already in contact with his counterparts in the many regional telephone companies, was permitted to use his network of contacts to provide informal coordination of the entire Bell System
service to, the ARPANET. For instance, installing a telephone circuit between two at both
ends
all
be
ready
simultaneously.
supplier and one of the telephone companies to strain to scheduled date. strain date if
the other telephone company cannot make that is useless for the date if telephone companies to
Similarly, it to make a
The Bell
System customer representattve took it upon himself to coordinate all such interdependent events.
willingness to
By virtue of the
Bell
System's
smooth and efficient relationship has been built up IMP suppliers, DARPA, and the member companies
of the Bell
111-33
I..
... . .. .
_,
' i i J/ i l
I I'
:I i
Report No.
4799
System.
For a network of the size and complexity of the ARPANET, trouble with the procurement
1.4.1.4 The
Bolt Beranek and Newman Inc. contract to construct and it Frank was the IMP Inc. for (BBN) the ARPANET was of Cambridge,
Newman
carried Once
Heart.
BBN continued to play a central role in the evolution operating it and maintaining it as well as doing
names of many of these individuals may be found as authors of the papers on the ARPANET which have come out of BBN. Robert Kahn, deserves particular However, one
individual, several
mention.
After
years
advance of packet-switching technology than any other individual. A bibliography of ARPANET-related reports and papers wri;.ten by members of the BBN staff is included as Appendix A. L
I,
-~-I
111-35
Report No.
4799
1.4.1.5
The accessibility of distributed resources carries the need for an information service (either
centralized or resources,
those
develop and operate a "Network Information Center" established for the ARPANET. 1969, With the
beginning
It
maintained a list
of
community.
to the NIC with instructions for duplication and distribution the membership or one or more of the ipecial structured system data base NLS) construction, interest groups. manipulation,
highly display
ARPANET protocol
specifications were maintained on-line at the NIC. The NIC has had a hand in the proauction or distribution of
hundreds and hundreds of documents related to the ARPANET. of these documents describe the activities of the NIC itself
A few or
111-36
Report No.
4799
are
otherwise
of
special
interest
within
the
ARPANET;
.1
II1-37
Report No.
4799
Bibliography D. C. Engelbart, "Network Information Augmented Team Interaction", Stanford Augmentation Research Center, January 30,
D. C. Engelbart, "On-line Team Environment", Stanford Research Institute, Augmentation Research Center, June 2, 1972, 272p. D. C. Engelbart, "Coordinated Information Service for a Discipline or Mission-oriented Community", Time-sharing: Past, Present, and Future. Second Annual Computer Communications Conference, 1973, pp. 2.1-2.4. Current Catalog of the NIC Collection, NIC No. 5145. 5150.
Current Directory of Network Participants, Network Resource Handbook, Current Network Protocols, NIC No. NIC No. 6740. 7104.
NIC No.
111-38
"Report No.
4799
1.4.1.6 One
The Network Measurement Center of the influential early studies of communications is reported in
networks was performed by Leonard Kleinrock and his 1962 Ph.D. thesis at MIT,
Stochastic New
(reprinted
Publications,
This study proved convincingly that message delays network can be made very low, and
thus
rest one of the early and persistent objections to Kleinrock considered several and aspects their of the
networking. operation of
communications
networks
underlying Kleinrock
algorithms in is
today a faculty member at UCLA. UCLA was selected to be allow used (NMC). to be the site of the first IMP
early connection of an SDS SIGMA 7 host to support The the tasks of a Network for
Measurement
Center
performance.
direct measurements based on statistics gathered by While Kleinrock himself was the guiding force
members who supervised the day-to-day measurement work, Gerald Cole, (each Vinton Cerf, Holger Opderbeck, and
William
obtained
a UCLA Ph.D.,
NMC work).
111-39
Report No.
4799
There has been a series of doctoral di-ssertations written by students at the UCLA School of Engineering work of the NMC. A list and related to the
of of these theses.
as well as other
relevant publications by the faculty and students associated with the NMC, is included in the following bibliography.
111-140
Report Nc.
4799
Bibliography L. Kleinrock, "Communication Nets: Stochastic Message Delay," Dover Publications, New York, 1964, 2 0 9p. Flow and
L. Kleinrock, "Models for Computer Networks," Proceedings of the International Communications Conference, June 1969, p.21.9-21.16. L. Kleinrock, Methods for Computer Network Modela,""Comparison Proceedings of of Solution the Computers and Communications Conference, October 1969. L. Kleinroek, "Analytic and Simulation 1970, p.5
6
Methods 9-579.
in
Computer
Network Design,"
Proceedings SJCC
L. Kleinrock and G. L. Fultz, "Adaptive Routing Techniques for Store-and-Forward Computer Communication Networks," International State of the Art Report No. 6; Computer Networks, Infotech Information Ltd. Maidenhead, Berkshire, Efigland, 1971, p.541-562; also in Proceedings of the International Conference on Communications, Montreal, Quebec, Canada, June 1971, p.39.1-39.8. G. Cole, "Performance Keaourements on the ARPA Computer Network," Proceedings of the Second ACM/IEEE Symposium on Problems in the Optimization of Data Communications Systems, October 1971, p.39-45; also in IEEE Trans. on Communications , Vol COM-21, No 3, June 1972, p630-636. V. G. Cerf and W. E. Naylor, "Storage Considerations in Store-and-Forward Message Switching," Paper presentec at WESCON Conference, September, 1972, 8 p. V. G. Cerf and W. E. Naylor, "Selected ARPA Network Measurement Experiments," Proceedings COKPCON 1972, September 1972. L. Kleinrock, "Computer Networks," in Computer Science. A. F. Cardenas et al. (Eds.), John Wiley and Sons, Inc. New York, 1972, p.241-284. L. Kleinrock, "Performance Models and Measurement of the ARPA Computer Network," Proceedings of the International Symposium on the Design and Application of Interactive Computer Systems. Brunel University, Uxbridge, England, May 1972, 30p. L. Kleinrock, "Survey of Analytical Methods Networks," in Computer Networks, R. Rustin (Ed.), 1972, p.1 8 3-205. in Queueing Prentice-Hall,
111-41
of
Messages
in
Computer Network Via Mathematical Programming," Proceedings COMPCON 72, September 1972, p.167-170. L. Fratta, M. Gerla, and L. Kleinrock, "The Flow Deviation
Method:
Design,"
An
Approach
Vol.
Networks,
. in Distributed
"Capacity
Allocation
Computer Networks," Proceedings of the Seventh Hawaii International Conference on System Sciences, January 1974, p. 115-117. G. Cole, "Computer Networks Measurements: Techniques and Experiments," PhD Thesis, UCLA-ENG-7165, Computer Science Department. School of Engineering and Applied Science. UCLA, October 1971, 350p. G. L. Fultz, "Adaptive Routing Techniques for Message Switching Computer-Communications Networks," PhD Thesis, UCLA-ENG-7252, Computer Science Department, School of Engineering and Applied Science, UCLA, July 1972, 4 18 p. M. Gerla, "The Design of Store-and-Forward (S/F) Networks for Computer Communications," PhD Thesis, UCLA-ENG-7319, Computer Science Department, School of Engineering and Applied Science, UCLA, January 1973, 30 0 p. Kleinrock, L. Queueing Systems, Interscience, New York, 1975. Volume I: Theory, II: in Wiley Computer Time-Shared
Kleinrock, L. Queueing Systems, Volume Applications, Wiley Interscience, New York, 1976. Kleinrock, L., "Scheduling, Queueing and Delays
Systems and Computer Networks," in Computer-Communication Networks, Abramson, N. and Kuo, F. (eds.), Prentice Hall, Englewood Cliffs, New Jersey, 1973, pp. 95-141. Kamoun, Science F., "Design Considerations for Large Computer
Communication
Networks," 407p.
PhD
Thesis,
UCLA-ENG-7642,
Computer
Department,
School
Ziegler, J. and L. Kleinrock, "Nodal Blocking in Large Networks," ICC Conference Record, Montreal, Canada, June 1971, pp. 39-9 to 39-15.
11-i
Report No.
14799
Kahn and L. Kleinrock, "Computer Communication R. H., Frank, Network Design--Experience with Theory and Practice," AFIPS Conference Proceedings, Vol. 40, SJCC, Atlantic City, New Jersey, May 1972, pp. 255-270. Also in Networks, Vol. 2, No. 2 1972, pp. 135-166. Kleinrock, L., "Analytical Techniques for Computer- Communication Networks," Computers and Communications, Proc. of the joint IBM-University of Newcastle upon Tyne Seminar, University of Newcastle upon Tyne, England, September 1973, pp. 63-90. Kleinrock, L. and W. Naylor, "On Measured Behavior of the ARPA Network," AFIPS Conference Proceedings, Vol. 43, NCC, Chicago, May 1974, pp. 767-780. Kleinrock, L. "Resource Allocation in Computer Systems and Computer Communication Networks," Proc. of the International Federation for Information Processing, Stockholm, Sweden, August 1974, pp. 11-18. Opderbeck, H. and L. Kleinrock, "The Influence of Control Procedures on the Performance of Packet-Switched Networks," National Telecommunications Conference Record, San Diego, California, December 1974, pp. 810-817. Naylor, W. E., "A Loop-Free Adaptive Routing Algorithm for Packet Switched Networks," Proc. of the 4th Data Communications Symposium, Quebec City, Canada, October 1975 pp. 7.9 to 7.14. Kleinrock, L., W. Naylor and H. Opderbeck, "A Study of Line Overhead in the ARPANET," Proc. of the IIASA Conf. on Computer Communication Networks, October 1974, pp. 87-109. Also in "Communications of the ACM, Vol. 19, January 1976, pp. 3-12. Kleinrock, L. and H. Opderbeck, "Throughput in the ARPANET-Protocols and Measurement," 4th Datd Communications Symposium, Quebec City, Canada, October 1975, pp. 6-1 to 6-11. also in IEEE Trans. on Communications, Vol. COM-25, January 1977, pp. 95-104. Kamoun, F. and L. Kleinrock, "Analysis of Shared Storage in a Computer Network Environment," Proc. of the 8th Hawaii International Conf. on System Science. Honolulu, January 1976, pp. 89-92. Kleinrock, June 1976, L. pp. "ARPANET Lessons," 20-1 to 20-6. Proc. of the ICC, Philadelphia,
111-43
Report No.
4799
"Data Communications Through Large Proc. of International Teletraffic November 1976, pp. 521-1 to 521-10.
W. and L. Kleinrock, "On the Effect of Periodic Routing Naylor, Dallas. Updates in Packet-Switched Networks," Proc. of the NTC, Texas, November 1976, pp. 16.2-1 to 16.2-7. Kleinrock, Computers, 1326-1335. IEEE Trans. L., "On Communications and Networks," 25th Anniversary Issue, Vol. C-25, December 197.6, on pp.
"On The Topological Design of Gerla, M. and L. Kleinrock, IEEE Trans. on Communications, Distributed Computer Networks," Vol. COM-25, January 1977, pp. 48-60. Kamoun, "Hierarchical Routing for Large Kleinrock, L. and F. Computer Performance Evaluation and Optimization." Networks, Networks, Vol. 1, No. 3, January 1977, pp. 155-174. Kleinrock, L., "Performance of Distributed Multi-Access ComputerCommunication Systems," Proc. of IFIP Congress, Toronto, Canada, August 1977, pp. 547-552. "Analysis of Buffer Allocation Kermani, P. and L. Kleinrock, 2, Vol. Schemes in a Multiplexing Node," ICC Conference Record, Chicago, Illinois, June 1977, pp. 30.4-269 to 30.4-275.
111-44
.... ,',,,,""+'",,,,"
Report No.
4799
1.4.1.7 The
The Network Working Group and Host Involvement initial design of the ARPANET as contained in certain formats for the RFQ
inter-IMP
for host sites to work out among themselves. provide the hosts with a little DARPA assigned impetus to work on the the S. problem Crocker, fall of to S. Elmer Carr, to
problems, SRI.
1968
continue discussion of host-to-host protocol issues. thinking was at a very high level, e.g.,
Their early
the feasibility of
creating a portable front-end package which could be written once and moved to all network hosts; a host desiring to send another host would first data to
host which instructed the front-end package at the receiving host hcw to interpret data coming from the sending host. On
1969,
meeting of host
representatives
representatives
NMC
and NAC, of
contractor, storm. In
the middle
April 1969,
a series of working notes called Request for which could be circulated to let
Comments (RFCs)
was established,
III-45
Report No.
4799
others know what they were doing and to obtain the reactions involvement of other interested parties.
and
the Network Working Group (NWG). The NWG eventually grew quite from almost every host large, with representatives and on
By the beginning of 1972 the NWG had of its work was done -over the network.
committee which
provide
guidance e.g.,
for
Crocker,
and
to
those
of
various
subcommittees,
protocol. working network.
Gradually the activities of the NWG began to diminish. of the host site personnel who had originally been active
Many moved
on
0se
to
other
tasks,
ri
1 -
111-46
k'
4~
Report No.
4799
specification.
As
Crocker's
time
for
the
NWG
increasingly limited, he appointed Alex McKenzie and to serve jointly in his place.
process
settled
for
the
most
part
inio
the
status
of
III-i7
Report No.
4799
1.4.2
Initial Subnet Design BBN's proposal for the IMP was for the most part compliant
with
the
requirements
of tne RFQ.
however,
processor between the host and the network to a logical it specified that the IMP be used only functions, and that there 1,;e maximum logical Thus, separation
for communications
the design did not provide for IMP repacking on behalf of a host or for doing character Further, IMP and the design precluded all host
messages
also
hosts,
specified
minimal
control
add additional su'ch control messages. The IMP design called for a hardened robust statistics in the face of physical IMP, which would be
While
eventually
111-48
Report No.
4799
The
to
the
"design.
importance. A tape,
proved
operational
decision
was
made
to
and each IMP was provided with a paper tape reader. would sooner and it was or
later
was.
probably
the beginning. was also specified to take place from a of simplicity, with tae A the
debugging in the
terminal, that
interests
knowledge
one IMP per month in months eight instead of all four at month
through eleven after contract start, nine, was assumed. In keeping w1th the strict IMP was to gather to statistics
the them
periodically
111-419
Report No.
4799
The
initial
IMP
design
was
particular way which was changed at BBN, host DARPA, per and host representatives. IMP and
The RFQ had called for one although it Almost also asked it
that more hosts per IMP be became connect clear to a the that many
immediately
had more than one host to the first three, IMP was
single
IMP.
before
delivered,
or four was
hosts on an IMP along with five, a simple change to implement. In the area of
or three lines.
This
Unfortunately,
the host-to-IMP protocol had significant detrimental performance of the other prutocols. the
Particularly unfortunate have been the acknowledgment system, retransmission system, and the message
identification system
initially suggested by the host-to-IMP protocol. It is crucial for the IMPs to limit the rate of flow of host
is being
traffic into the net to the rate at which that traffic taken first out, in order to prevent subnetwork congestion. which was insufficient, took the
attempt,
suggesting
end-to-end
111-50
Report No.
4799
previous
message
was
received.
part of host-to-host protocol upon which all the higher protocols are based. host-to-host ARPANET protocol time As a consequence, connection is using 50
severely lines,
response
Kbs
destination-to-source
acknowledgment
40 Kbs possible with a constant stream of messages. It was originally thought that the ARPANET would lose a hosts ever bothering resolving various
message so seldom that there was no point in with message retransmission. Unfortunately,
possible lockups has required the subnetwork to discard a message occasionally, and the topology of the network has evolved into the probability
long series of machines and lines that increase of involuntary message loss. However, did
realities
probability
inordinately
host-to-host protocol (and protopols based on it) particularly * * As robust although it of the has been reliable.
part
host-to-IMP the
protocol host-to-IMP
end-to-end protocol
111-51
&MW go.
'
i tt tm li I iili ili
Report No.
4799
specified
an
8-bit
in a
number;
conversation
fact, messages
carry
with
this
same
different
identification numbers were not guaranteed to be delivered in the order sent. uniquely Eight bits is probably insufficient to identify
(for
of the small 8-bit message identifier was one of the factors that prevented reliable high-bandwidth connections. The IMP/host protocol has been changed longer message necessary order to is cases wait now for the so that it is no
preserved requiring
considerations;
message host;
sending
message
111-52
Report No.
4799
1.4.3
Subnet Development The first four IMPs were developed and installed on schedule
by it
relatively
"distant"
by
IMP/host
line
developed.
heftier error it
these distant interfaces made clear that on the host/IMP interface. on such
needed
Previously, a local
hard
and some problems which looked more worrisome. a rudimentary version of the network control
center was established at BBN. As the year wore on, network, the IMP sites continued continued 230.4 Kb to to be be added to the NCC
improved, was
circuit
tested
and
design for a version of the IMP able to begun. The latter was
support direct terminal connection was called the Terminal IMP (TIP).
111-53
Report No.
4799
In 1970 major problems with the IMP flow control and storage allocation even after techniques were demonstrated. these problems were It is interesting that (and they were
demonstrated
serious enough to completely halt network operation under certain circumstances), for many, many the network while continued to give adequate service improvements were designed and
months
implemented. in
The hosts were simply asked to not use the network and the hosts did
as they were asked. About three-quarters T1Ps were delivered, of the way through 1971 the first two time soine
to users without their own hosts or access to terminals other organization's host. By the beginning of 1972 it 'as
distant version of the IMP/host interface was not sufficient, design for a circuits worth a was little IMP/host begun. interface for use over
communications is
additional
asynchronous,
IMP/host an
effort
simplify
the hosts.
111-54
i
'1
Report No.
4799
the
IMP
and
the
host.
The IMP and host did not have to worry and they did not It have also have to worry
constraints. would
having to worry about these issues operation. hodge-podge of distant first However, interface than this
interface each
variations, its
designed
more
operation
predecessors,
and none except the which need not fear it would clearly be
the now proven packet-switching technology, better e.g., to HDLC, use an industry
for every IMP/host connection. half of 1972 the TIP's capability was expanded
In the first
Also,
a massive change in
software
to correct the previously discovered flow control and In the second half of the year, was released in many the
the
IMP
program
small
The beginning of 1973 brought the first the network, from California a to Hawaii. of
link
in
traffic
rapidly
increasing,
number
SIII1-55
problems
developed
which
had
By mid-year, in Norway
pair of TIPs had been shipped to Europe. London. first These brought
and
time,
circuits
were
TIPs were on a long spur off the network rather than being doubly connected as IMPs typically are. be delivered, During 1973, nodes continued to switching of
but there began to be a low level of to optimize the use of various TY,' came on and went off the
network.
improvements were also made to correct problems with the algorithm. As 1973 ended the first
connected to the network over telephone lines. In 1974 there were major efforts to make operationally usable. the network more
Subnetwork reliability was improved as was reliability. and Methods for providing TIP pa:t~tioning Methods were of logical to
accounting
developed
selectively reload sections of IMP memory. In 1975 network development slowed up and the network took operational appearance. Major network
Pluribus IMP,
111-56
Report No.
4799
sixty-three IMPs in the network and attachment of the Satellite IMPs to the network.
first
two
was under DCA management. Looking back, I appears the subnet development between 1969 and 1975
relatively smooth,
trying
The network grew slowly enough, was flexible and which most
implementation
robust
enough,
that
many problems,
part corrected before they obstructed the work of too mauy users. The fact that the network was also part of an experiment no doubt also made users more tolerant.
III-57
tita tttll'i~ll
NNWllII11
Report No.
4799
1.4.4
Host Protocol Development Specifications, generally called the IMP-to-host protocol, message transfer between a
exist for the physical and logical host and its to IMP. specify
however, processes
running in
Rather,
processes must have some agreement as to the method of initiating communication, forth. the interpretation of it pair a the transmitted data, and so
Altnough
desirable in necessary
order for
network-wide
communication.
ideas
and to formulate
additional specifications
The NWG adopted a "layered" approach to the specification communicartions protocols, use the services of wherein the higher layers lower l3yers; the of
advantages
disadvantages of the layered approach are discussed elsewhere thiz report. As shown in Figure 3, the lowest layer is the of
(called methods
host-to-host establishing
figure)
111-58
Report No.
4799
iA
ad hoe
S~Host/Host
FTP
Host/IMP
Figure 3 --
communications paths between hosts, managing buffer space at each end of a communications path, Protocol or ICP etc. Next, the Initial Connection
process) to attract the attention of a network host, to using that host: The
pressing the attention button at a local terminal on a host. the next layer is the Telecommunications Network
or TELNET
protocol, hosts.
access to remote
TELNET is
and the protocol for communicating between this standard terminal and a host. The next logical protocol layer consists of function two of which, File Transfer Protocol (FTP)
oriented protocols,
111-59
and
Remote
Job
Entry
protocol (RJE),
are shown in it is
Finally,
at any point in
superimpose ad hoc protocols. In events in the following subsections we discuss in some detail the
the evolution of the host-to-host and TELNET protocols, the evolution of a number of other protocols in
111-60
Um .... ..... . *''cl,',l i-,' ...... "l .' m' t. ._._.o_ta _, --. .. .
Report No.
4J
4799
1.4.4.1
which supported communication between a terminal on one host a process on another the initial host. At a meeting in
protocol specification
Lawrence Roberts of DARPA who was unhappy with it plan would not support transmission of
electronic
right." spring of 1970 several successive versions of a and a relatively formal the
meeting of the NWG was held at UCLA before mid-year at which latest version of the protocol was described.
Reactions to the
described protocol were very negative. a series of meetings held at UCLA and from these two institutions tried
In August of 1970 some of the more general (and some thought more exotic) aspects of the host-to-host protocol being considered
were ordered dropped from the protocol by Barry Wessler of DARPA, thus administratively clearing away some of had prevented agreement. Tha those issues which
111-61
Report No.
4799
in
particular,
there
was
discussion between Crocker and Roberts regarding the formality to be sought for the protocol, and DARPA approvals required, Joint and so
forth.
Another NWG meeting was held at the Fall November 1970 in Houston, Texas. 1971
Computer
Conference in
appointed changes
host-to-host desirable or
protocol
see This
immediately
necessary.
subcommittee went directly from where it met for two days, Los
Illinois to Cambridge,
Massachusetts,
(known as the "host-to-host protocol glitch cleaning the design of the ARPANET host-to-host
coming close to being settled. At about this same time DARPA was beginning to pressure not only exert great
to get the host-to-host protocol settled but At a NWG meeting at the in a May 1971,
also to get it
task
not to
111-62
il
In M.I.T.,
October
1971
the
final a
big
NWG
programmers'
host-to-host
II1-63
~ t. ,
Report No.
4799
1.4.4.2
a major function of the network would be to provide remote use of interactive systems. his local host) To allow a user at a terminal (connected to a remote host, as
if
a special mechanism
are legion: for
physically
individual
terminal scanner rather than logically attached via a multiplexed connection to the network; a given host expects to communicate
only
with
terminals
with
certain
characteristics
(e.g.,
line-at-a-time,
physical echo,
while a remote user's terminal might have characteristics no character echo, (e.g.,
character-at-a-time, baud).
mechanism necessary to permit such communication. As early as 1969 a few hosts had been programmed on an Ad In 1971
an NWG subcommittee was formed to consider the general problem of supporting interactive use of arbitrary hosts by users in at the
111-64
committee
discussions,
character set, By
widespread had
TELNET
protocol
implementation
of
the
early
TELNET to
attempts
There were
several problems with the early version: 1. Despite the attempt to permit a minimal
well suited to
implementation
there if
the constraints of small hosts, implementation. not be desired provided use. For for in
Even a case
given some
implementation,
had to
inadequate.
example,
unless made, it
some
of
other
TELNET
to take
connection
commanding
one
end
as echoing
111-65
S"
"
""
"
Report No.
4799
behavior.
protocol for character communication between not serving terminals, a role for which which
otherwise have been well suited and for already protocol. 4. frequently used
hosts
to
By
early 1973 it
to the early TELNET protocol would not solve these that some fundamental changes were needed. guide
to the earlier principles of the Network Virtual Terminal and the remote interrupt (synch) mechanism, of the resulted in a revised TELNET earlier problems that had
precluded universal acceptakice of the protocol. There was such enthusiasm for the new version was that a laid
schedule for "rapid" (within the year) out. However, the implementation of
implementation
proceeded more slowly than expected. implementations been widely available. several reasons
111-66
. .. *z ,r'.,,- .t
i -i iii = -
-- -:
. . . . . .
. .
_ . . . _. . _ .
_ .._.. . . . .
Report No.
4799
time
the
r-vised
protocol
implementation
was
scheduled,
implementation;
the
network
was declining and the network was entering a period 3) despite initial belief that a clean
phasing over from the initial protocol to the revised existed, most none was found by most implementors and
consequently
implementation
the TIP, proved to be very difficult (because of the memory) and time-consuming,
limited
pressure on the server hosts to implement the The new TELNET protocol has been the
several years,
and it
III-67
Report No.
4799
1.4.4.3
The Evolution of the Other Host Protocols host protocols the evolution of
which should be briefly mentioned. The File Transfer Protocol started out as two protocols, a
Data
Transfer
Protocol
the Data
and
File
Transfer
Protocol.
To
over-simplify,
Transfer
Protocol
format of data being transferred and the File was to specify how it was transferred.
Transfer Protocol alone was defined with a control portion. After the final push
data to
portion
consisting only of
clean up fundamental aspects of the protocol, work reconciling the "reply codes" that
and a good
of
different hosts used to indicate FTP-related events. Before a Remote Job Entry protocol could be defined by the UCLA's IBM 360/91 host, a batch oriented host,
NWG as a whole,
needed some RJE-like protocol with which to serve a few users who wanted host. early Thus, access to the computing power of that particular a protocol called the Remote The NWG
Job Service or RJS protocol was defined and implemented. eventually got
around to working on the problem of a Remote Job undertook a relatively massive effort to
protocol.
However,
1-68
Report No.
4799
half a doz i or
so
hosts
had
already
interested
incentive for them to implement the new today the RJE protocol is carefully and
protocol. but
specified
to our knowledge is
the RJS protocol prevails. Moving upward in the subject of sophistication, another protocol that was
Several
versions of a graphics protocol were specified but until recently there was never as part widespread of the implementation ACCAT of any an of them.
Recently,
experiment,
operational
graphics protocol has been developed. In addition to the host-to-host protocol which specified after much iteration, were suggested by various was finally
members
an alternative protocol.
suggestion.
recently,
Robert Thomas,
111-69
Report No.
4799
protocol
known 3s MSG.
Another protocol,
known as TCP,
deserves
special mention.
Near the time of the formation of the International Working interest, Group, as network interconnection Network
began to be of great
discussions began on 3 -t;idard inter-network protocol, ;ore of the shortcomings zrret A-,. the AFIPS 1973 NCC in ideas for a of New new
York City a meeting was held at which certain host-to-host correspondence, Stanford, got protocol were discussed.
After Vinton
perhaps not satisfied that TCP represented continued also developing participated the still in another this later host-to-host
(Cerf
protocol was insufficient or where inter-networking was required. With DARPA support, protocol has come ARPANET. and its several TCP implementations were done and the into use relatively is still widespread use within the
spreading.
TCP is
scheduled to
replace the ARPANET host-to-host protocol throughout the net by I January 1983. of Meanwhile the host-to-host protocol that the and documented, submitted rest
PTTs and
carriers
111-70
iA
Report No.
4799
standard
to
CCITT;
so
the
INWG
I1
III-71
1.4.5
Network Growth
--
A Summary
In the following three subsections we consider tnree aspects of the growth of the network: the traffic growth, the growth of of
Traffic Growth
In internode
early
1973,
Roberts
traffic growth for the network* which showed the level at a rate of a
sent from a host on one node to a host on a different node; i.e., it does not include traffic sent between hosts on the same node.
following figure,
prediction the
internode traffic growth decreased sharply to roughly a factor of two every twenty months. It is interesting to speculate on the
L.G. Roberts, *Network Rationale: A 5-Year Proceedings COHPCON 1973, February 1973, pp. 3-6.
Reevaluation,"
111-72
I 106
JAN
72
JAN 73
JAN 74
JAN 75
JAN,
76
JAN 7Y
111-73
Report No.
4799
It new
can be hypothesized that the existing hosts (and the that were added)
few
hosts
were used remotely more and more and more, hosts) until began the to hosts run (at
out of attempt
network running
growth.
Therefore,
instead
network
already
stated,
Roberts'
the figure above includes only internode traffic. reasons for excluding intranode traffic. First.
intranode
traffic puts a burden on only one node rather than on the network as a whole. calculate Thus when Roberts, the effects of for instance, was attempting to he
intranode
available
traffic statistics
being looped from a host through its node and back host, and there is from It is
no convenient way to separate this looped test data traffic between two hosts on the same however, real that there is actually a
traffic node.
actual
believed, of
significant
amount
traffic
III-74
NE
Report No.
4799
node.
week-long
measurement,
average of twenty percent of the level of internode traffic, in some one-hour intervals
much as eighty percent of the internode traffic level. available long term statistics on intershows and intranode
that intranode traffic levels have averaged between twenty Thus the traffic
and forty percent of internode traffic levels. curve given in the figure above
factor if
all traffic is
the IMP is
installed in there is
a computer center to connect some host very soon pressure center to to connect other
computer
communicate with other computers in between the two it computers was not
happen even if
* L. Kleinrock and W. Naylor, "On Measured Behavior of the ARPA AFIPS Conference Proceedings, Volume 43, May 1974, pp. Network,"
767-780.
111-75
Report No.
4799
Third,
the
TIP (a host) has been chosen by several sites as the available terminal multiplexor and TIP-to-host Fourth, there to be
certain site and therefore often on the same that, while some cynics
guessed that every computer center manager is trying in fact the world of
running computer centers but do so because they need the Once the network became other sites that
site managed it
A further reason
scale possible when only one facility and staff is the operation of several computers. 1.4.5.2 The Topology first ARPANET
California at Los Angeles in late 1969 and the next were installed in California and Utah.
111-76
Report No.
4799
i
1
UA?
Figure 5:
The ARPANET in
December 1969
S"111-77
Il
Report No. 4799 Bolt Beranek and Newman Inc.
By
June 1970 three East Coast and two more West Coast nodes
were added,
SR
HARVA
Figure 6:
June 1970
111-78
Report No.
4799
IMPs continued to be delivered to the field rate of approximately one per month,
at
an
average
so that by late 1970 there The IMPs the were all 516
being
Honeywell
MIT~
Figure 7:
December 1970
III-79
two
additional
516
I
WCOLN
S41
ANDILLINOIS
CREI
iuN
Figure 8:
September 1971
111-80
Report No.
4799
The
TIPs
were
based a
on
Honeywell a
316
instead IMP
of
516 was By
component
316-based
which
completely compatible with the 516 IMP but half as expensive. early 1972 several
additional IMPs and TIPs had been installed the East and West
out.
JTAN
AFG K
......
AESILNOSEI UC8
S~Figure
9: March 1972
111-.81
Report No.
4799
By August 1972 a third cross-country line had been added and it was clear that in addition to the IMPs scattered throughout there were actually clusters Boston, Washington. of D.C., IMPs San
areas,
Francisco,
S
McCLELLAN UTNCASE
UTAI
,MIT
)89N AFGWCso
AMES
NOA
ILLINOIS
U
UNL
TIKE
IT:R.
A RPAT
Figure 10:
August 1972
111-82
Report No.
4799
'
v
There follow once-yearly maps for the with which the reader can
years
1973
to
1977
ARPANET topology.
SIMT
IE ,. ,I''
I
l Figure 11 : September 1973
III-83
Mo AM AMES STAN EX HAWAN UCSD RAN10 US0.1 Usc-ISI SRI UYAN GWC ARGONNE PURR !UR WPAFB SELVOIR SDAC SOAC MITRE APA GUNTER EGLIN RML 0 IMP s TIP SATELLITE CIRCUIT
Figure 13:
July 19T5
111-85
TAWM PU*SuS
* fWMEXTIIMaOESmT@wMFgVFIha
OTPO
vSCC)
ReportBolt
lnc.
flifuAkk'$
01FiSO Ors#t
SATCLT(
"Fi4r 15:
V111-8?e silts
Jul
1977
Report No.
4799
topology
through
the eleven maps shown above as the basis the Figure 16 chart. six entries exist at Columns
for the quantitative data shown in 6 and 7 are missing the first
NORSAR, earlier
The first
three entries in
columns 8 kept in
through 11 are missing because that information was not the early days of the network.
facts that should be noted from the chart. network this, nodes has stayed about
Despite Next,
note that intranode throughput actually is of total network throughput. length reached in path 1974-75, Also,
a significant fraction
as a direct response to network delay problems which occurred 1974-75. from Finally, note that in July 1975 and July 1977,
the path
HLWAII
to LONDON is
equaled by other paths in the network; was 15 hops from both UCSB in (Santa and
California)
California) is
1975,
California)
111-88
Report No.
4799
1 DEC69 JUN70
DEC70
---
, .....
III
1 91 2.221 2.311 41
.-.--.--!--I --
II
1-13.27% --14.00%1
742,7461 3,635,876
JUN74 1461 2.171 6.141131 5.9811211.19%1 3,125,9551 1,513,7771 4,639,732 I III III I JUL75 1571 2.281 6.791151 6.681151 .67%1 5,179,3611 1,018,5381 7,097,899 JUL76 1581 2.451 5.261111 5.131101 .5851 111 2.41111 'It 1 5.271111 1 1 .9451 JUL77 158, 5.371111 6,627,9681 1,961,7261 8,589,694 7,051,9221112,706,054; 9,757,976
where the columns contain the following information: Column Column Column Column Column Column Column Column Column Column Column 1: Date of Map 2: Number of Nodes 3: Average Connectivity 4: Average Path Length ;: Maximum Path Length 6: Average Path Length, Minus 3AWAII, NORSAR, 7: Maximum Path Length, Minus HAWAII, NORSAR, 8: Percentage of Node Unavailability 9: Internode Throughput 10: Intranode Throughput 11: Sum of Internode and Intranode Throughput
LONDON LONDON
Figure 16:
111-89
Report No.
4799
There
has
been
good
is presented in the paper entitled "On Measured Behavior ARPA Network" (L. Kleinrock Vol. and W.E. 767-780). Naylor,
AFIPS
Conference Proceedings,
43, pp. 9
Report No.
4799
1.4.5.3
Hosts
four hosts connected to the ARPANET were an SDS
The first
SIGMA-7
at UCLA,
an SDS-940 at SRI,
and a
operating
recent*
systems
schematic
There follows a
showing the
various hosts.
Notice that the hosts range from small PDP-lls to hosts systems to such from very
large IBM systems, with a scattering of very special as ILLIAC-IV, running a variety provided of by operating
relatively
standard
ones
manufacturers
special ones constructed by university researchers. Figure 18 provides a breakdown of the numbers and kinds of It is based on information compiled by the Some of these Also, each of hosts the
host
twenty-three TIPs
in
the
ARPANET
logically
provides
host
* A sampling of such schematic maps covering the of the ARPANET is provided in Appendix B.
entire
history
111-91
-Report
No. 4799
MOFFET
*FW
EA
CUTAH
ILINOS
WTREas
O-
T IMP
.1
P LL POORAT1O
FOPL-11~
A MCAC
UR C ET
M 10
SPOPUE BY HE
HFigure
Logical Nap--
une197
111-92PP-1
Mr
V r40-
4 C 0 f-in 04040-1a
r4A
IV
q 4
- Cqr4 04 #4 rq0 0 10
0O in'
iO in
N. N.1-1
00.000;D
I Cn MCa424
14
4. 0 il -4 1 0
-40 0 %
0
S
C
1
ooT no
tnoo00MC
A0 : r.4r~ 904 ti m4
r4Mr44
40r 4i C, . to%00 4
qMr 44 41 s:0: 03
CO (
~'7
44
0.t0
00
aO0
>
0 62 a 000 $4 02 W
00 M 0 4r 00000@ 44 A4 P40
0 E4 40
0
V0
000 0
0 A P
r4e
.E14Ca0~~H
0.i.
00
111-93
Report No.
4799
i11-9
11_!91
Report No.
4799
1.5
The Impact of the ARPANET The ARPANET a new has served well its original function as a technology. More
testbed for
computer
communications
recently the ARPAKET has also given good operational service to a number of users who have come to depend on it However, for their computer program it
network
techniques and experimental results through the and technical literature. (2) Through
by individuals with an academic or research leaning, naturally sets of been papers were
numerous papers written on the ARPANET. written a set relatively of early in the
development
111-95
Report No.
4799
five
presented
in
session
at
the
of five papers were specially bound together and a distributed number of widely. papers In 1975 We in have the IPTO
"already listed
these
and
other
this history.
California, ARPANET
561 relevant documents and includes a stlbject is available from NTIS under
document AD-A026900.
accession
working papers distributed among the various groups and Many of these The
individuals working on the ARPANET development. are also covered in the Becker
National Bureau of Standards has also constructed a on computer communications which includes
bibliography hundreds of
PRPANET-related publications. In mid possibility Spring Joint instead 1971, Robert Kahn, then at BBN, suggested the
of h public demonstration of the ARPANET at the 1972 Computer Conference. Lawrence Roberts arranged
111-96
"Report No.
4799
first This
(ICCC). ARPANET to
forced
participants
project
and test their network support and application gave international visibility to the packet
until then, had been viewed largely with communications community. and Robert personnel Kahn and
resources
of the ARPANET community planned and culminated lines in were the a successful leased from
phone
existing network sites to the conference site at Hilton room in Hotel, and an ARPANET TIP was set up in
Washington
a demonstration Dozens of
Manufacturers of
hours, each day of the conference, there were individuals available to demonstrate the use of programs on ARPANET hosts from the manufacturer-provided and many terminals. copies made A relatively thick available at the
by means of which visitors to the demonstration area yourself" directions to use programs on many
III-97
Report No.
4799
and
the
promise
of
computer
communications
was
Coming at a time when the long time, when only a and the
when many hosts had completed the fnitial implementation necessary host software but few had had it the ICCC demonstration provided
ARPANET community to pull together and get the operational shape. The demonstration itself
well,
remarked that the ARPANET technology "really is this impression back home with them.
Roberts promised the demonstration and the routine way he spoke of it while it the of
was happening no doubt enhanced the visitors, of and belied the crash
panic
community who were called upon to execute the demonstration. There technology. have Of been numerous many other of demonstrations of the
course,
these
but in
example,
community,
demonstrations was given for members of the NATO community over a two-week period.
111-98
Report No.
4799
success of
in
transferring
the
ARPANET The
parts
Communications
Agency
networks,
function,
with the ARPANET technology. the first of these was used in connection with the
Where direct copies of the ARPANET were not appropriate, ARPANET technology
the
has nonetheless affected the characteristics built. II, For instance, the new DoD is
AUTODIN
explicitly a second generation ARPANET. Outside the U.S. use the ARPANET military, the commercial world has begun to or variations on it. Several
technology
companies
offer communications services based more or less directly on packet-switching technology developed in ARPANET. which
are Telenet Communications Corporation (for the financing and Lawrence Roberts was
President,.
111-99
Report No.
4799
Graphnet,
IT&T,
and AT&T.
of the several
eighty
cities to
arrangements
connect
Tymshare
available
substantially
different
although
related Tymnet
technology; however,
techniques IT&T, closer
a new version of
to those
being
developed their
Graphnet, provide
have
announced
public packet-switching services. A number of U.S. companies have also procured many it or are of the
procuring techniques
private
corporate
networks
utilizing
constructed
An increasing number of commercial RFPs call for packet switching or for functions A which of can only be provided using packet
switching.
number
1II-100
Report No.
4799
Several
PTTs
(the
Telephone,
and
development
government research agency. RCP -built by the French PTT and operational as a teatbed. -under construction by the French PTT 1978. and
TRANSPAC
network in the
built early
by
the
phases
-------------------
may be found in "Planned New Public Data Networks", P.T. Kirstein, Computer Networks, Volume 1, Number 2, September 1976, pp. 79-94; Kirstein is himself a member of the ARPANET community and was instrumental in arranging the installation of the London node of the ARPANET.
III-101
S.
Report No.
4799
--
Japan. by
jointly and
U.K.,
strongly
initially to use the EIN technology. are other networks besides those mentioned With so many
above in the planning phase or under construction. networks coming into being, From
become important
representatives in and
issues.
computer networks met informally to discuss to consider possible standards. was formed.
Vinton Cerf of the ARPANET community was first chairman and DARPA offered the
selected to be
services of the the ARPANET NIC to coordinate and distribute INWG working notes. Later INWG became associated Processing, with DARPA the cut
back
its
its
NIC support,
From
than the
beginning, used in
those
ARPANET for a long time remained the one against which new ideas were compared. 111-102
network
Report No.
4799
The
international
communications standards organization at which all of the world's communications authorities are represented) speed has with remarkable
adopted standards for connecting hosts to packet-switching networks to each other. Known as
ARPANET
ARPANET was seen to be deficient. While today the operational primary of purpose traffic, of it the is ARPANET still in For is the
transmission
network
development.
underway to develop:
- more efficient and loop-free rcuting algorithms - multi-destination, capabilities improved mechanisms host attachment to more than one node networ!k flow control and congestion control broadcast, and group addressing
III-103
lel
l I:n
lu
11l i
~
I
lin
li
lm
il
II
Il
II
host
interface
enhancements
to
permit
internetwork
routing.
"11-lO0
1.6
Maturity and Handover to DCA A memorandum of agreement was worked out between DARPA and of
DCA for management of the ARPANET to be transferred to DCA as July 1, 1975, with a
with
ARPANET
The memorandum also called for a detailed transition plan written which was completed by June 1975. Along DCA,
the technical functions that had been being performed at RML functions were
were also transferred to DCA and the procurement transferred from RHL to DECCO, which is
There are several aspects of the memorandum of agreement and the transition plan network which are worthy of mention here. The
with sponsors being those users or collections of users NBS) who originally owned ARPANET equipment it was turned over to DCA. DCA before
DARPA, of
management
and maintenance of the network through use of the which would recover
111-105
to
contract
initially and if
BBN
and and
SRI NIC
to
perform
operations initially
network
maintenance topological
functions, was
consulting
needed; it was clearly implied that to the perform first these year. functions DCA was to
and thereafter if operate the network for a period of three years be provided on a necessary until equivalent service could
S111i10
= = =-
2.
contractors, centers
and in
research
the development of the ARPANET has been an exciting time their professional careers.
1969 the ARPANET project represented a high risk, research useful form effort. has not The existence provided but it of
only
communications represents a
formidable communications technology and experience base on which the Defense Department as well as the entire public and private depend diverse for advanced communications generated needs. The
experience
base
project has placed this country ahead of all others digital communications science and technology.
111-107
boo
Report No.
4799
2.1
Social Issues Somewhat expectedly, the network has facilitated a social It has
change in become
more
ability to collaboratively use powerful editing and document has chauged significantly the "feel" of
research
ARPANET may finally be the largest single impact of dcvelopment. A non-trivial. question of
country is would
certainly
the same formula could be applied to While timing, is possible accident, and luck
to identify several
possible contributing factors: o Despite the fact project and that the ARPANET was a government was run at least
further
despite it
111-108
Report No.
4799
research
and
development
from
constraints First,
activities.
contractors
"free
good"; this allowed people to the and Third, network without being
probably despite
Department
concern it
government the
facilities, without
build
ARPANET
complex Finally,
did not have to interconnect directly with was possible to nova, the
explore line protocols and interface standards dL in the best ways was that could be devised. free of
Thus,
incredibly
"artificial"
relatively
111-109
Report No.
4799
and
there
have
been
experiments
line interfaces) in the transmission of and research was etc., support done etc. of
on how to implement network login procedures, o A very convenient fact was the common DARPA
both the "network authority" and the initial early group of network users.
encourage engineering a at
project
cooperation was most critically necessary. In sum, the project with was an illustration of what can be
accomplished
strong
technically
sophisticated
central
management,
adequate
resources,
and
a clearheaded undeviating
the
little
There is
in
developed
drastically in
techniques private
intercommunication
hindsight, one can easily see the reasons for this success. primary prior existing communications techniques (the U.S.
service and the telephone)
The postal
III-110
The postal service has become more expensive and its in measured in days for delivery of letters.
performance
and reaching 10 distributed people within a is a essentially impossible. careful checks but it system back is is
period
time
works if individual
established
frequently,
a busy person able to accept a phone call at the time you make it is little for truly unusual, and some officials have desks covered with with requests
network mail where at any time of the day or night one can send a message to any number of other people and expect that message semi-instantaneously the recipients. part of all be available in to
their mailboxes when they are free and not at a meeting, performance of the communications represents
improvement over the postal service or the telephone. addition messages, of sophisticated
filing the
forwarding messages,
messages,
III-111
Report No.
4799
system takes on yet another step function of performance over the alternate possibilities. In the space of just a couple of years
this "computer center curiosity" became a smashing success on the ARPANET; there was a sufficiently large community of who wished to communicate, and they all individuals
and the system overnight became a way of life. of this kind of success are enormous.
but there is
ARPANET program provided a truly convincing demonstration of The change will upon the not be of overnight, terminals
availability
are already available and substantial DoD experiments are already under way.
111-112
"Report No.
4799
2.2
Technical Lessons Leaving the broad social plane, the ARPANET program provided
111-113
Report No.
4799
2.2.1
Terminal Handling Rather early in the ARPANET program, the many it became clear that
access
to
net via the main host computers was an classes of users required direct
approach; access
to the net in
The first
response to this pressure was the design of (TIP) Newman problem: only by Inc. the ARPANET
the Terminal Interface Message Processor prime contractor, to Bolt Beranek a and
designed
address
limited
character-oriented
asynchronous
terminals
and
integral part of the network authority and not available for user programming or special user hard-nosed TIP design, features. This limited goal and
attitude permitted the rather rapid completion of the the fielding of many TIPs, the and the rapid availability network. Thus, the TIP
of widespread terminal access to effort was extremely successful in Unfortunately, goal and absolute but perhaps
surprisingly, user of
restriction in
programming the
unhappiness
portions
potential other
"better"
had "leapfrogged"
I11-114
Report No.
4799
was concerned with batch processing and the line disciplines from such batch
use
of
processing
units. where
groups really wanted "a computer of their own" under the guise of obtaining terminal access to the ARPANET. Still other criticism the relative
would permit user programming and would handle a broader class of terminals. sophisticated Finally, users some who criticism were used was to provided the by highly support
terminal
like the limited services provided by the tiny mini-host resident in the TIP. In response to this pressure, DARPA for a time supported the
development of a device called the "ARPA Network Terminal System" (ANTS). to This was a system based on a PDP-11 which was intended
the handling of synchronous and a more powerful the goals put into the and
Unfortunately, were
configuration fielded
difficulty in delays in
debugging
111-115
of
requirements,
another
"ELF*. improve,
the hope was to permit user programming and the From the viewpoint of
use ELF were much more successful; and more attention However, was paid to
and maintenance.
been more useful as a base for individualized mini-hosts local specialized host functions than as a
distributed network access for large numbers of At the time the ARPANET was transferred to DCA.
primary terminal
either through the main network hosts or via the There are several morals to this
extremely
Second,
configuration
management,
111-116
Report No.
4799
fielded in
precludes
programming if
a device is
widely deployed. Another related aspect of the terminal handling problem to do with the management extent of the network authority. an unsophisticated user typed at has It a
a remote location and something went wrong (that is, the user typically "blamed
the network" despite the fact that any number of possible things: the terminal itself, at the local modem, the local line, the modem
the other end of the local line. TIP), the network itself,
similar it is
adequate
administrative
outcries of rage from the end terminal user. program, numerous "crisis" incidents
failure of equipment which was not in any way under of the network authority. (Perhaps
III-117
Report No.
4799
difficulties in the local on-base telephone system at Ames it took a massive effort
where
defense to participate and lead in the massive debugging activity even though the offending device, eventually found was clearly control.] The generalizable
network
authority's
this kind of history is that devices that attach to be extremely Either the clearly device in- somebgdy'.1 camp of
must
responsibility.
network authority and must have built-in techniques for debugging and failure location, host organization or or the device must clearly some other well for in belong to the who
identified
group and
maintenance cracks
trouble different it is
devices
between
simple,
frequently overlooked. A final point on the general terminal handling problem has for dealing with
can either be in the terminal itself, in network port (e.g., or, way. of course, the TIP),
intelligence
111-118
"R9
the reviewed to ensure that periodically be must matter of technological change. performance can take advantage
system
1-
III-119
Report No.
4799
2.2.2 At
Reliability and Fault Isolation the outset of the ARPANET design considerable toward For built-in example, techniques IMP-to-IMP of- fault circuits effort was and cross fail
expended recovery.
and mechanisms for reloading one IMP from a it was therefore somewhat of a
efforts down this path were not nearly there was a nearly improve existing
Over the life of the ARPANET program, effort for to add techniques and
fault isolation,
and containment
recovery
network's ability to cope with trouble: o For critical pieces the of code such as the routing
checksummed
before
were was
accessed.
discovered
classes
failures
rather
local difficulties.
111-120
It
was
discovered
that
dial-in
modems
for
remote
terminals
could break or "hang" and there %as no simple had a happened. centrally A technique was
located used an
line to periodically dial and test 311 dial-in ports all over the network (at least in the continental United
States). o It was discovered that when a difficulty occurred in IMP which caused an automatic program reload, an the
automatically attempted,
offending
copy and improved capability for debugging. o The ARPANET program need was for forced a to cope with hour
the
the a day
same
simultaneous
twenty-four
continuously operating reliable system and at time relatively constant levels of growth,
modification,
and
change.
technique was evolved whereby greater attention was paid to dividing a large change into small incremental
III-121
Report No.
4799
changes Then,
that when
were compatible with the previous system. trouble occurred, debugging could be
concentrated
taken to the previous release. o As network users began to depend upon a "service" hosts for a wide it variety became few of more particular services, important
maintain availability
In some cases,
perceived by its own local operators and yet in not be properly servicirnZ
some way A
whereby to then
software
"watch" in a
when necessary.
111-122
ki'
Report No.
4799
2.2.3
Maintenance Management In the early years of the ARPANET program, the IMPs and TIPs
of the network were maintained by subcontract to the manufacturer of the basic cost-effective mini computer (Honeywell). because However, simply of This represented had a
approach
Honeywell
maintenance
this rather standard form of inadequate for After the a high time, Bolt and the
reliability
requirements
the
ARPANET.
maintenance of' the network nodes was undertaken directly by Beranek and Newman Inc., the network prime contractor,
special new techniques were developed which greatly improved average nodal reliability. In particular,
and s3ftware experts at the central Network Control close concert with a small number of field
the IMP and TIP machines. itself it to could observe talk the
The central staff could use the network behavior of an offending node and
through the
Further,
the field became much more dedicated and responsive to as compared to time-shared Honeywell
difficulties
territory.
111-123
Report No.
4799
systems,
especially in
as
those and
systems thereby
will
increasingly
be
interconnected maintenance.
networks
accessible to central
III-124
4. ----
'~'
Report No.
4799
A. A.1
BBN ARPANET Bibliography Technical Reports BBN Report No. 1763, Message Processors January 1969. "lnitial for the Design for Interface ARPA Computer Network",
AD682905
*ADAO19160 BBN
Sinterconnection
Report
No.
of
January 1976. AD730725 BBN Report No. 2161, "A Study of the ARPA Network Design and Performance", Kahn and Crowther, August 1971.
*ADA014398 BBN Report No. 2183, "Terminal Interface Message Processor User's Guide," updated version of August 1975. *ADA002481 *AD776995 BBN Report No. 2184, of November 1974. "TIP Hardware Manual," revision
BBN Report No. 2277, "Specifications for the Interconnection of Terminals and the Terminal IMP," Rettberg, revision of June 1973. BBN Report No. 2491, "Throughput in the ARPA Network S-Analysis and Measurement," McQuillan. January 1973 (text also contained in QTR No. 16, January 1973).
ADA025358
BBN Technical Information Report (TIR) Interface Message Processor Program," of June 1976 (Version 3231).
"
BBN TIR No. 90, "The Network Control Center Program," updated versiQn of November 1976 (Version 131). ADA031617 BBN TIR No. 91, "The Terminal Interface Message ~Processor Program," updated version of August 19T6 (Version 400). AD781467 BBN Report No. 2831, "Adaptive Routing Algorithms for Distributed Computer Networks," McQuillan, May 1974.
ADA033351
!
A-1 Srl
!!i
llll
l! I
!11
lll~iAr
Report No.
4799
BBN TIR No. 93, "The Remote Job Entry Mini-Host," August 1974 (text also contained in QTR No. 6, July 1974). BBN Report No. 2891, "A Proposed Experiment in Packet Broadcast Satellite Communications," Rettberg and Walden, September 1974. BBN Report No. 2918, "Network Design Issues," November 1974 (text also contained in QTR No. 7, October 1974). ADA022040 BBN Report No. May 1975. 2999, "Pluribus Document 1: Document Overview," 2: System 3: Basic Advanced Functional 7"
BBN Report No. 2930, "Pluribus Handbook," January 1975. BBN Report Configurator,"
Document 4:
BBN Report No. 3001, "Pluribus Software," December 1975. BBN Report No. 2931, Software," April 1975.
Document
"Pluribus Document 5:
BBN Report No. 3002, "Pluribus Document 6: Specifications," February 1976. BBN Report Maintenance," No. 3004, "Pluribus September 1976.
Document
ADA018341
BBN Report No. 3056, "The Atlantic Satellite Packet Broadcast and Gateway Experiments," R. Binder, R. Rettberg, and D. Walden. April 1975. BBN Report No. 3126. "A Multiprocessor Design," W. Barker, September 1975.
A-2
Report No.
4799
A.2
Published Papers*
W. Teitleman and RE. Kahn, "A Network Simulation and Display Program," Proceedings of the Third Annual Princeton Conference on Information Sciences and Systems, March 1969. F.E. Heart, R.E. Kahn, S.M. Ornstein, W.R. Crowther, and D.C. Walden, "The Interface Message Processor for the ARPA Computer Network," AFIPS Conference Proceedings 36, June 1970, pp. 551-567; also in Advances in Computer Communications, W.W. Chu (ed.), Artech House Inc., 1974, pp. 300-316; also in Computer Communications, P.E. Green and R.W. Lucky (eds.), IEEE Press, 1975, pp. 375-391; also in Computer Networking, R.P. Blanc and I.W. Cotton (eds.), IEEE Press, 1976, pp. 60-76. F.E. Heart and S.M. Ornstein, "Software and Logic Design Interaction in Computer Networks," International Computer State of the Art Report No. 6: Computer NetworkS, Infotech Information Ltd., Maidenhead, Berkshire, England, pp. B23-462. R.E. Kahn, "Terminal Access to the ARPA Computer Network," in Courant Computer Science Symposium 3 -Computer Networks, R. Rustin (ed.), Prentice-Hall, Englewood Cliffs, N.J., 1972, pp. 147-166. R.E. Kahn and W.R. Crowther, "Flow Control in a Resource-Sharing Computer Network," Proceedings of the Second ACM/IEEE Symposium on Problems in the Optimization of Data Communications Systems, Palo Alto, California. October 1971, pp. 108-116; also in IEEE Transactions on Communications, Vol. COM-20, No. 3, Part II, June 1972, pp. 539-546; also in Advances in Computer Communications, Chu (ed.), Artech House Inc., 1974, pp. 230-237; also in W.W. Computer Networking, R.P. Blanc and I.W. Cotton (eds.), IEEE Press, 1976, pp. 117-125. D.C. Walden, "A System for Interprocess Communication in a Resource-Sharing Computer Network," Communications of the- ACM, Vol. 15, No. 4, April 1972, pp. 221-230; also in Advances in Computer Communications, W.W. Chu (ed.), Artech House Inc., 1974, pp. 340-349.
A-3
Report No.
4799
R.H. Thomas and D.A. Henderson, "McROSS -A Multi-Computer Programming System," AFIPS Conference Proceedings, Vol. 40, June 1972, pp. 281-293; also in Computer Networking, R.P. Blanc and I.W. Cotton (eds.), IEEE Press, 1976, pp. 246-258. S.. Ornstein, F.E. Heart, W.R. Crowther, S.B. Russell, H.K. Rising, and A. Michel, "The Terminal IMP for the ARPA Computer Network," AFIPS Conference Proceedings 40, June 1972, pp. 243-254; also in Advances in Computer Communications, W.W. Chu (ed.), Artech House Inc., 1974, pp. 317-328; also in Computer Communications, P.E. Green and R.W. Lucky (eds.), IEEE Press, 1975, pp. 354-365. H. Frank*, R.E. Kahn, and L. Kleinrock"*, "Computer Communications Network Design -Experience with Theory and Practice," AFIPS Conference Proceedings, Vol. 40, June 1972, pp. 255-270; also in Networks, Vol. 2, No. 2, 1972, pp. 135-166; also in Advances in Computer Communications, W.W. Chu (ed.), Artech House Inc., 1974, pp. 254-269. A.A. McKenzie, B.P. Cosell, J.M. McQuillan, and H.J. Thrope, "The Network Control Center. for the ARPA Network," Proceedings of the First International Conference on Computer Communication, Washington, D.C., October 1972, pp. 185-191; also in Computer Networking, R.P. Blanc and I.W. Cotton (eds.), IEEE Press, 1976, pp. 319-325. R.E. Kahn, "Resource-Sharing Computer Communications Networks," Proceedings of the IEEE, Vol. 60, No. 11, November 1972, pp. 1397-1407; also in Advances in Computer Communications, W.W. Chu (ed.), Artech House Inc., 1974, pp. 208-218; also in Computer Communications, P.E. Green and R.W. Lucky (eds.), IEEE Press, 1975, pp. 537-547. J.M. McQuillan, W.R. Crowther, B.P. Cosell, D.C. Walden, and F.E. Heart, "Improvements in the Design and Performance of the ARPA Network," AFIPS Conference Proceedings 41, December 1972, pp. 741-754.
A-4
Report No.
4799
W.R.
Crowther,
R.D.
Rettberg,
D.C.
Walden,
S.M.
Ornstein,
and
F.E.
Heart.
"A
System
Reservation-ALOHA,"
for
Broadcast pp.
Communication:
January 1973,
371-374.
D.C. Walden, "Host-to-Host Protocols," International ComputerState of the Art Report No. 24: Network Systems and Software, Infotech, Maidenhead, England, pp. 287-316. N.W. Mimno, B.P. Cosell, D.C. Walden, S.C. Butterfield, and J.B. Levin, "Terminal Access to the ARPA Network -Experience and Improvements," Proceedings of the Seventh Annual IEEE Computer Society International Conference, San Francisco, California, February 1973, pp. 39-43; also in Computer Networking, R.P. Blanc and I.W. Cotton (eds.), IEEE Press, 1976, pp. 287-291.
E.W.
Wolf,
"An
Advanced
F.E. Heart,
Crowther,
and W.B.
Barker,
Minicomputer/Multiprocessor for the ARPA Network," AFIPS Conference Proceedirgs 42, June 1973, pp. 529-537; also in Advances in Computer Communications, W.W. Chu (ed.), Artech House Inc., 1974, pp. 329-337; also in Computer Communication Networks, R.L. Grimsdale and F.F. Kuo (eds.), Proceedings of the NATO Advanced Study Institute of September 1973, Sussex, England, published by Noordhoff International Publishing, Leyden, The Netherlands, 1975, pp. 159-180; also in Computer Communications, P.E. Green and R.W. Lucky (eds), IEEE Press, 1975, pp. 366-374. R.H. Thomas, "A Resource Sharing Executive for the ARPANET," AFIPS Conference Proceedings 42, June 1973, pp. 155-163; also in Advances in Computer Communications, W.W. Chu (ed.), Artech House
"A New
Inc.,
1974,
pp. 359-367.
F.E. Heart, "The ARPA Network," in Computer Communication Networks, R.L. Grimadale and F.F. Kuo (eds.), Proceedings of the NATO Advanced Study Institute of September 1973, Sussex, England,
published by Noordhoff International Netherlands, 1975, pp. 19-33. Publishing, Leyden, The
W.R. Crowther, J.M. McQuillan, and D.C. Walden, "Reliability Issues in the ARPA Network," Proceedings of the ACM/IEEE Third Data Communications Symposium, November 1973, pp. 159-160; also in Computer Networking, R.P. Blanc and I.W. Cotton (eds.), IEEE Press, 1976, pp. 142-143.
A-5
Report No.
4799
and I.W.
J.M. McQuillan, "Design Considerations for Routing Algorithms in Computer Networks," Proceedings of the Seventh Annual Hawaii International Conference on System Sciences. Honolulu, Hawaii, January 1974, pp. 22-24; also in Computer Networking, R.P. Blanc
Cotton (eds.), IEEE Press, 1976, pp. 108-110.
S.M. Ornstein, W.B. Barker, R.D. Bressler, W.R. Crowther, F.E. Heart, M.F. Kraley, A. Michel, and M.J. Thrope, "The BBN Multiprocessor," Proceedings of the Seventh Annual Hawaii International Conference on System Sciences, Honolulu, Hawaii, January 1974, Computer Nets Supplement, pp. 92-95. A.A. McKenzie, "Some Computer Nptwork Interconnection Issues." AFIPS Conference Proceedings 43, May 1974, pp. 857-859. E.A. Akkoyunlu', A.J. Bernstein*, and R.E. Schantz, "Interprocess Communication Facilities for Network Operating Systems," IEEE Compute, Vol. 7, No. 6, June 1974, pp. 46-55. F.E. Heart, "Implications of the Computer-Communication Partnership," in Preprints of Papers, MEDINFO 74: The First World Conference on Medical Informatics, Stockholm, Sweden, August 1974, pp. 21-27; proceedings to be published by North-Holland, The Netherlands. F.E. Heart. "Networks and the Life Sciences: the ARPA Network and Telenet," Federation Proceedings, Federation of American Societies for Experimental Biology (FASEB), Vol. 33, No. 12, December 1974, pp. 2399-2402; also in Computers in Life Science Research, W. Siler and D.A.B. Lindberg (eds), FASEB and Plenum Press, 1975, pp. 209-215. J.M. McQuillan, "The Evolution of Message Processing Techniques in the ARPA Network," International Computer State of the Art
Report No. 24: Network Systems
Maidenhead,
and
Software,
England,
pp.
Infotech,
541-578.
R.H. Thomas, "JSYS Traps - A TENEX Mechanism for Encapsulation of User Processes," AFIPS Conference Proceedings 44, May 1975, pp. 351-360.
A-6
Report No.
4799
A. R.D. Bressler, M.F. Kraley, S.M. Ornstein, W.R. Crowther, Michel, and F.E. Heart, "Pluribus -- A Reliable Multiprocessor," AFIPS Conference Proceedings 44, May 1975, pp. 551-559. F.E. Heart, S.M. Ornstein, W.R. Crowther, W.B. Barker, M.F. "The Pluribus A. Michel, Bressler, and Kraley, R.D. Multiprocessor System." in Multiprocessor Systems: Infotech State of the Art Report, Infotech International Ltd., Maidenhead, Berkshire, England, 1976, pp. 307-330. W.R. Crowther, F.E. Heart, A.A. McKenzie, J.M. MeQuillan. and D.C. Walden, "Issues in Packet-Switching Network Design," AFIPS Conference Proceedings 44, May 1975, pp. 161-175; also in Cotton (eds.), IEEE Computer Networking, R.P. Blanc and I.W. Press, 1976, pp. 182-196. R.S. Tomlinson, "Selecting Sequence Numbers," ACM SIGCOMM-SIGOPS Interface Workshop Communications, March 1975, pp. 11-23. Proceedings of the on Interprocess
J.M. McQuillan and D.C. Walden, "Some Considerations for a High Performance Message-Based Interprocess Communication System," Proceedings of the ACM SIGCOMM-SIGOPS Interface Workshop on Interprocess Communications, March 1975, pp. 77-86. High "The Evolution of a Walden, S.M. Ornstein and D.C. Performance Modular Packet-Switch," Conference Record of the 1975 International Conference on Communications, June 1975, Vol. I, pp. 6-17 to 6-21.
R.D. Bressler, M.F. Kraley, and A. Michel, "Pluribus: a Multiprocessor for Communications Networks," Fourteenth Annual an the mid-70's: Computing in ACM/NBS Technical Symposium --
Assessment.
June 1975,
pp.
13-19.
D.C. Walden, "Experiences in Building, Operating, and Using the USA-Japan Computer Proceedings of the 2nd ARPA Network," Conference, Tokyo, Japan, August 1975, pp. 453-458. R.D. Rettberg and D.C. Walden, "Gateway Design for Computer
Networks: Communications in: Interconnection," Network on Conference Computing European the of Proceedings Communications Networks, London. England, September 1975, published by Online Conferences Limited, Uxbridge, England, 'p.
113-128.
A-7
Report No.
4799
M.F. Kraley, "The Pluribus Multiprocessor," Digest of the 1975 International Symposium on Fault-Tolerant Computing, Paris, France, June 18-20. 1975, p. 251 (abstract only). B.P. Cosell, J.M. McQuillan, and D.C. Walden, "Techniques for
Detecting and Preventing Multiprogramming Bugs," in: Minicomputer Software, J.R. Bell and C.G. Bell (eds.), North-Holland Publishing Co., 1976. pp. 301-308.
A.A. the McKenzie, "The ARPA Network Control Center," Fourth ACM Data Communications Symposium, Proceedings of Quebec City,
Canada,
October 1975,
B.P. Cosell, P.R. Johnson, J.H. Malman, R.E. Schantz, J. Sussman. R.H. Thomas, and D.C. Walden, "An Operational System for Computer Resource Sharing," Proceedings of the Fifth Symposium on Operating System Principles, Austin, Texas, November 1975, pp. 75-81.
R.D.
Bressler
and
R.H.
Thomas,
Computing," in Distributed Systems: Infotech State of the Art Report, Infotech International Ltd., Maidenhead, Berkshire, England, 1976, pp. 215-222. V. Cerft, A. McKenzie, R. Scantlebury"*, and H. Zimmermann***, "Proposal for an International End to End Protocol," ACM Computer Communication Review, Vol. 6, No. 1, January 1976, pp. 63-89. W.F. Mann, S.M. Ornstein, and M.F. Kraley, "A Network-Oriented Multiprocessor Front-End Handling Many Hosts and Hundreds of Terminals", AFIPS Conference Proceedings 45, June 1976, pp.
533-540. Distributed
Technical 143-148. P.J. Santos, "Software Instrumentation for Maintainability of
Computer
Networks,"
and
Fifteenth
Annual
ACM/NBS
pp.
Symposium--Directions
Challenges,
June 1976,
J.M.
Computer Society/International Federation for Information Processing Joint International Symposium on Data Communications Technology and Practice, August 1976, pp. 13.1-13.7.
McQuillan,
"A Status
Report
on
the
ARPANET,"
Australian
(France)
A-8
Report No.
4799
J.M. McQuillan, "Strategies for Implementation of Multi-Host Computer Networks," ACS/IFIP Joint International Symposium on Data Communications Technology and Practice, August 1976, pp. 26.1-26.6; also in Computer Communication Review, Vol. 6, No. 4, October 1976, pp. 19-24. F.E. Heart and D.C. Walden, "Communications Applications of the Pluribus Computer," Conference Record of the 1976 IEEE National Telecommunications Conference, Dallas, Texas, 29 November-1 December 1976, pp. 7.1-1 to 7.1-5. R. Levin*, J.M. McQuillan, and R. Schantz, "Distributed Systems," a section of "New Directions for Operating Systems: Report," J.C. Browne, Operating Systems Review, Vol. A11, Workshop No. 1, January 1977, pp. 14-19. J.M. McQuillan and D.C. Walden, "Issues in Packet Switching Network Design and the ARPANET Design Decisions," submitted to Computer Networks. J. Davidson, W. Hathaway*, N. Mimno, J. Postel'*, R. Thomas, and D. Walden, "The ARPANET TELNET Protocol: Its Purpose, Principles, Implementation. and Impact on Host Operating System Design," submitted for presentation at the ACM/IEEE Fifth Data Communications Symposium, Snowbird, Utah, September 27-29, 1977.
I
";C negi e-Mllon University
A-9
Report No.
4799
B.
Selection of ARPANET Logical Maps The following logical maps of the ARPANET are included:
January 1977
March 1977
B-i
ej
'a .
I.
0 h-0..
0.00
to'
II
400
to-
a.a
'5-
0 0
IL
1-1
0
0
I I I Iw 0.
O I
~)to
CiL
I.
(L
*
I /8
IIL
JIA
WE
IoL
IL~
4L4
CL,
Q3
Rt
inio
-- v
W I
q7
;7I-
CL
a. CL
wr
Z~~
Nlo
s.0
c.:
XLz 0.0
A.0
~o
9_0
0~ I.
-0_
L0
zI
Oc
I- W
47j
: (a cc0
0.03
f--I,
w
0.
ICI
aWc
C0
--
I.-l
0.g
CI L CL
C.
a 4 M.
1.w IL-
aacal a
IL
0a~aCl
MrI
0 .z
U))
jf I% a.
U 5
ff~
100
CL)
I4
LC
CL 0
0.
9L AL)
awL
(D
4L
~
40
-0
9LL)
0
t; CL
0
a = CL
00
cL 0 &
IL
UO UV) a: 0 qr z
CL
cL 0
a a-.
ob I
CLAL
to of w 0
0 a fn z
0 one
000 0000
in 0 N W,
7o13
in u v
w a 0.
CL
cc u w cc 4
CL
0- a. IL 0 w v
t c 0 o 0 o
w La w 0 - 0 w w -4 1 CL.
Q
CL
us a.
.9 w z
CL 0 CL
CL CL
CL
1A
CL ca
-3 0 It
w cr< 0
a. U$ 0 il z
a7
31:
0 u
IL 43
LL U
in
W Z 0 0 z U, 0 Z
C03
x w 10-
W 00 X.C u x 04 x 0 z
8
Mc a 0. co 0. x 0 z
F.
3 [. AM
x
w V
in 2
-K w WS I-U; U) 0 z Lu i; u z Z X'd 3: CL 4L o 2
a MA
CC
X
I-
39
z
M u vi
qj
P10 % 0 0 Fm
CL CL M w
0 00to W.,
IL
00
'u
w ki IL
44
CL IL 0 IL ICL & sn a
0 x GM U, ir W 44 0 OX
-ildraiffmifl-