Data storage

“ Software and Data Carpentry instructors are scientists from diverse backgrounds who have encountered a variety of data storage challenges and are active in teaching other scientists best practices for scientific computing and data management. ”

“ The expense of storing data is a very significant part of computer system cost. This consists of direct charges for storage media as well as the costs of transferring data to and from local and remote storage devices. Data compaction and compression produce cost savings by reducing storage and transmission requirements. In addition, these data reduction methods enable more efficient information retrieval and more economical transmission of large quantities of data over computer networks. ”

“ Science often needs the highest capacity computer, the highest bandwidth networks, and the largest data storage capabilities available, so they are often harbingers for what will be in general use in the future. ”

“ When the storage context allows, it is better to simply incorporate permanent output of all underlying data when a main result is generated, using a systematic naming convention to allow the full data underlying a given summarized value to be easily found. ”

“ The law defines the concept of personal data for the purposes of data storage as well as the conditions for establishing data banks and data basis by public or private entities and the conditions of utilization and access. (5) Citizens may not be issued all-purpose national identification numbers. (6) The law defines the provisions applicable to transborder data flows establishing adequate norms of protection of personal data and of any other data in which the national interest is justified. ”

“ While the importance of this aspect of data reduction will grow over time, the majority of data reduction is associated with the world model in the process of eliminating the storage of redundant data. ”

“ In the search and seizure of data, the mass storage of information in data banks and its transmission through carriers may necessitate additional safeguards, with regard to the criteria for limiting acceptable purpose of search and seizure and for determining relevance in the selection of the data. ”

“ Using the tidy format makes this distinction clearer. One axiom about the structure of data and code holds that one should “write code for humans, write data for computers” [ [23] ] . When data can be easily imported and manipulated using familiar software (whether via a scripting language, a spreadsheet, or any other computer program that can import these common files) , data becomes easier to re-use. Furthermore, having the source code for the software doing the analysis available provides provenance for how the data is processed and analyzed. ”

“ These figures range from the first 5 megabyte hard drives used in our very first mainframe, through the first 5M Apple drive, to the same drive running on an IBM, to our current 1.2G drive that cost less than ANY of our previous drives and has storage for twice as much data. ”

“ Introduction Data is the central currency of science, but the nature of scientific data has changed dramatically with the rapid pace of technology. This change has led to the development of a wide variety of data formats, dataset sizes, data complexity, data use cases, and data sharing practices. ”

“ Any computer job can have up to 8,388,608 bytes of memory at once. Memory is divided into pages of 4096 bytes each. Pages are stored either in the real memory or on a paging device. The real memory is almost always too small to hold all the pages. There is only one real memory (two million bytes of storage) and two principal paging devices (IBM 2301 drum storage units) . All the jobs share them. Each byte has an address. What you do to bytes is to reference (i.e., store data in or fetch data from) them. Jobs take turns referencing. Jobs can reference only their own bytes, not anybody else's. ”

“ The key element in handling, processing, and storing data in the proposed satellite system is the use of a world model to abstract useful information from images and thus accomplish a large reduction in required data transmission and storage. ”

“ Serial Operation—Digital computer operation in which all digits are handled serially.
Storage—Use of drums, tapes, cards, and so on to store data outside the computer proper.
The Computer’s Parts Looking at computers from a distance, we are vaguely aware that they are given problems in the form of coded instructions and that through some electronic metamorphosis this problem turns into an answer that is produced at the readout end of the machine. There is an engineering technique called the “black box” concept, in which we are concerned only with input to this box and its output. ”

“ Since the mid-1990s, libraries were studying how to store an enormous amount of data, and make it available on the internet through a reliable search engine. Library 2000 was a project run between 1995 and 1998 by the MIT Laboratory for Computer Science (MIT: Massachusetts Institute of Technology) to explore the implications of large scale online storage, using the digital library of the future as an example. It developed a prototype using the technology and system configurations expected to be economically feasible in 2000. ”

“ Your storage devices—tape cassettes, floppy disks, or hard disks—that store computer programs and data, are sometimes called external memory.
The computer system also needs input devices and output devices. Your keyboard is an input device; disk drives and tape drives are also input devices. ”

“ The target of request is not the carrier itself but the intangible specific data. If seizure remains applicable only to physical objects, the carrier is still at issue. The technical storage capacity of such data banks and carriers often far exceeds the volume of content requested by the investigating State. Explicit rules should be elaborated in relation to the surplus of information a data bank or carrier might contain, which would allow the execution of letters rogatorys upon only the targeted data. ”

“ Even as identifier standards may change over time, datasets can evolve over time as well. In order to distinguish between different versions of the same data, each dataset should have a distinct name, which includes a version identifier. ”

“ The respective time period is indicated for each network, information system or database. Where exchanges of information between customs authorities would be required for the implementation of procedures in accordance with Article 49 once electronic data-processing is no longer possible in accordance with this Annex, alternative means for the exchange and storage of information shall be used. ”

“ Some agricultural programs use 48K or 64K of memory. User friendly programs, which require little training to use and which guide you through the program, may be easier; but they may require more memory for the program itself, leaving you less storage space or memory for the data. ”

“ TheThe “B” drive is my data disk, devoted entirely to storage of my writing. I can easily squeeze the equivalent of about fifty pages of double-spaced typing with WordStar, which is one reason I bought a Kaypro instead of an Osborne. Brand O’s earlier versions could store only half that amount of material. Before buying a computer, you should always analyze your paper records in terms of “K.” Each K stands for 1,024 characters ”

“ The supervisor will maintain for each user an input-output assignment table in which the logical-physical unit number interconnection will be kept. When a user gives a logout command at his console at the end of his session, all assigned units will be disconnected.
Magnetic Tape UsageMagnetic Tape Usage Although for a large number of cases the disk memory, because of its quasi-random access, is more appropriate for program data and temporary storage requirements, there are still many problems such as payrolls, bubble chamber scanner output, etc., where magnetic tapes are more appropriate. ”

“ This is as of early 1996; note that the threshold for `real computer' rises with time. See {bitty box} and {toy}.
:GFR: /G-F-R/ /vt./ [ITS: from `Grim File Reaper', an ITS and LISP Machine utility] To remove a file or files according to some program-automated or semi-automatic manual procedure, especially one designed to reclaim mass storage space or reduce name-space clutter (the original GFR actually moved files to tape) . Often generalized to pieces of data below file level. "I used to have his phone number, but I guess I {GFR}ed it." ”

“ Reuse of data on your hard disk ———————————————- Over time your personal archives will grow in size. You begin to experience the benefits of having all this information on your hard disk. Yesterday's news is today's history, and may be used in many interesting ways. One business executive regularly monitors key technologies, customers, competitors, and suppliers. He does it by tapping sources like KOMPASS, Associated Press, and Reuters. Interesting bits of information are regularly stored on his disk. ”

“ Each computer unto itself is a necessary repository to facilitate business transactions. However, when someone begins to investigate me, crossing the boundaries of multiple data bases, without question, they are invading my privacy. ”

“ Recorded programming would be stored on servers designed by Arroyo Video Solutions, Inc. (each, an “Arroyo server”) containing multiple hard disk drives. (Mitchko Decl. ¶ 14) . Each customer would be allotted a specified amount of storage capacity on one of those hard drives; his or her recorded programming would be stored in that hard drive space and available only to that customer. (Id.) . Cablevision determines the amount of memory allotted to each customer; initially, Cablevision contemplated allocating 80 megabytes of memory to each customer, but later decided on 160 megabytes. ”

“ The tremendous volume of information already amassed and the expected increases in future rates of collection due to improved sensor technology make the philosophy of unorganized data acquisition obsolete. ”

“ Use internal to the carrier's facility of companding techniques, bandwidth compression techniques, circuit switching, message or packet switching, error control techniques, etc. that facilitate economical, reliable movement of information does not alter the nature of the basic service. In the provision of a basic transmission service, memory or storage within the network is used only to facilitate the transmission of the information from the origination to its destination, and the carrier's basic transmission network is not used as an information storage system. ”

“ Since this is a transitional medium, why even bother to create software to run on a CD-ROM? Since everybody knows people will be networking information, why go to the trouble—which is far greater with CD-ROM than with the production of magnetic data? Finally, how does one make the data available? Can many of the hurdles to using electronic information that some publishers have imposed upon databases be eliminated?
The PLD project was based on the principle that computer-searching of texts is most effective when it is done with a large database. ”

“ Desiderate for storage systems. A storage system should have a high monetory economy, i.e. we wish to be able to store a large number of digits per pound sterling of outlay: it should also have a high spacial economy. ”

“ Cablevision determines how much memory to allot to each customer and reserves storage capacity for each on a hard drive at its facility, and customers may very well be offered the option of acquiring additional capacity—for a fee. ”

“ We must be mindful of the special needs of electronic records, just as for paper and special media, which require both access and protection, the preservation and conservation routines which care for the physical object to extend its life, usually through providing an appropriate storage environment. ”

“ In addition to a physical database memory onboard and on the ground, the world model requires extensive artificial intelligence software including expert systems which use the database in controlling sensing, image location and rectification, data processing, labeling, anomaly search, and decisionmaking on board the satellite and on the ground. ”

“ Here are some ways in which dBASE II might organize your records if you’re an executive like Bowie:
1. The CREATE command lets you begin a file.
2. A file in a data base is the electronic version of a file drawer or cabinet. It’s just the space on the disks holding records—say, the house-budget summaries for your homes.
3. A field is a category of fact like the amount of money spent on each air-conditioning system for each house.
4. Structure is simply the way a record is set up. ”

“ To substitute for the microfilming equipment, insure maximum security of documents which may become evidence, implement a more realistic and positive means of duplicating all records (as well as to ensure physical separation) in order to overcome present delays and backlogs, to obtain necessary statistical data, and to locate and properly file misplaced documents would result in a savings of cost and man years, would be a means of purifying the Record and of implementing procedures to guarantee the continued integrity of the Record. ”

“ Therefore, once it superimposes a three dimensional matrix over holographic information it wishes to interpret and reduces that information mathmatically to two dimensional form, it can completely process it using its fundamental binary system just as any computer made by the hand of man can process volumes of data and make various comparisons between the data and information stored in its digital memory. ”