Proprietary Standards and Technologies

Many great technologies have failed simply because they were proprietary in nature. This is particularly noticeable when a proprietary technology faces competition from a whole bunch of interrelated technologies; from multiple manufacturers/vendors, that are based around an open standard.

Part of the reason is due to the very competitive nature of economies founded upon open market products and services and part is due to the restrictive nature of monopolistic proprietary technologies.

Compatibility and Interoperability

It is the area of commonality between various technologies that standards provide which ensures that the products and services from one manufacturer/vendor are compatible and interoperable with those of other manufacturers/vendors.

To illustrate the importance of the role provided by standards consider for a moment that you wish to manufacture a network interface card (NIC). Let us assume that you have the option of selecting from only two different specifications for your NIC. One of which is a proprietary and the other is an open standard.

Proprietary Standard - If you wish to rely upon a set of proprietary technologies you will need to enter into negotiations with the owner of that proprietary technology before you can use it or even begin to develop something similar yourself. The owner of the proprietary standard also has the prerogative to deny you out of hand any access to or use of their standard.

Open Standard - On the other hand; if you were to base your product around an open standard, then all you need do is approach the relevant standards authority for that technology and obtain the appropriate documentation regarding the specifications that your product must comply with. While this can sometimes be a little Draconian more often than not it is a boon.

One element of considerable weight here is that if your product is fully compliant with the prescribed standard; you can with considerable confidence, state that it will work (interoperate) with other products or services that are also based upon the same open standard specifications. All you need do is a little testing to verify the fact. This is something that proprietary technologies cannot deliver with any degree of certainty.

Open Systems Interconnect (OSI) Reference Model

A classic example of an interoperable open standard is the OSI Reference Model. Here we have a seven layered network protocol processing stack. All of the functions and requirements for each layer of the protocol processing stack are clearly stated and precisely defined.

As a manufacturer/developer all you need do is to ensure that the implementation you produce complies (abides) with the guidelines and specifications as stated in the OSI Reference model. If so; you will be able to rest assured that your processing stack implementation will be compatible with and interoperable with those produced by other; potentially unknown to you, manufacturers/developers.

The beauty here is that you do not need to know the nitty-gritty of the other manufacturer's processing stacks for both systems (yours and theirs) to reliably function interactively. In the case of the OSI Reference model this would mean that a successful conversation can be conducted between geographically separated end-systems. If this sounds familiar; it should, because this is indeed the way in which the Internet works.

Standards Definition, Documentation and Evangelism

Using the Internet as an example again we note that it (the Internet) is in fact a bunch of open standards-based technologies that the Internet Architecture Board (IAB), the Internet Engineering Task Force (IETF) and the World Wide Web Consortium (W3C) among others define and thoroughly document; each in their own areas of specialization.

In addition to the definition of the various standards and the production of the relevant accompanying documentation these organizations also actively pursue an evangelistic policy of ensuring that said documentation is widely known of and readily available and accessible to one and all.

The goal here is to ensure that all past, present, future and would-be hardware and software developers have a pertinent set of basic reference specifications to act as the core foundation upon which to build their products, applications and services.

Standards and Rapid Application Development (RAD)

Developing products compliant with the prevailing established prescribed standards means that new products can be brought to market considerably quicker than would otherwise be the case. Much of the development of today's information technology evolution and initiatives are squarely aligned with a Rapid Application Development (RAD) ethos.

Underpinning the RAD ethos are the principles of modularity, compartmentalization and reusability. The later point of reusability is of particular importance in software engineering as it facilitates a much faster delivery to market of new/improved technologies, products and services.

Metaphorically speaking the RAD ethos can be summed up as follows: if there is no truly good reason to reinvent the wheel; why bother?

IEEE 1394 (FireWire) v Universal Serial Bus (USB)

Let us have a quick look at an open standard and a proprietary standard to see what effects their open or closed inclinations have culminated in to date. The two I have elected to use to demonstrate this are the IEEE 1394 (FireWire) standard and the USB (Universal Serial Bus) standard. Both are directed toward providing a one interface does all for peripheral device connectivity and I/O operations.

With both technologies targeting the same market (peripheral device connectivity and I/O) they were fated to be in direct head-to-head competition with each other.

FireWire - In marked contrast to the open USB standard, the superior performing (in comparison to USB) IEEE 1394 (FireWire) started its life as a proprietary protocol. This meant that royalties had to be paid or some form of cooperation/peering needed to be negotiated in order for a manufacturer could use the technology.

Because FireWire is a bus this fact impacted motherboard and I/O adapter card manufacturers directly. The end result manifested as fewer numbers of more expensive devices being manufactured.

USB - To compound this even further; once the open USB protocol and standards were released, uptake of IEEE 1394 enabled devices dropped dramatically as a diverse array of substantially cheaper USB counterparts began to appear on the market.

Global Considerations and Influences

As with all things involving massively large-scale factors on the global stage, standards can become very loose and modified to reflect local objectives (political and otherwise) by a multiplicity of organizations in numerous countries.

Hence, it becomes necessary to formally develop and implement formal control, development, ratification and wide-spread implementation processes for standards development, documentation and implementation applicable from both generic and singularly specific perspectives.

International Organization for Standardization (ISO)

It was for these reasons along with many others (too many for me to list here) that the International Organization for Standardization (ISO) was formed. Globally speaking ISO is the premier general purpose standards organization today.

Think of ISO as being standards architects. Their mission was; and still is, to define the framework upon which standards applicable to both current and future technologies, protocols, products and services will be built.

Other Standards Organizations

Besides ISO there are a considerable number of other standards bodies and/or organizations throughout the world. As with ISO, some of these organizations have considerable presence and influence on the global scale while others don't.

However; unlike ISO they tend to be more specific, focusing their attentions and coverage to a numerically smaller more specialized range of interrelated (family) technologies. Some of the alternative Information Technology (IT) standards organizations with a global presence include:

• The Institute for Electrical and Electronics Engineers (IEEE)
• The International Standards Organization (ISO)
• The Internet Society (ISOC)
• The Internet Architecture Board (IAB)
• The Internet Engineering Task Force (IETF)
• The World Wide Web Consortium (W3C)
• The Electronic Industries Association (EIA)
• The International Telecommunications Union (ITU)
• The Motion Pictures Experts Group (MPEG)
• The Joint Photographic Experts Group (JPEG)
• The National Institute of Science and Technology (NIST)
• The American National Standards Institute (ANSI)
• The Telecommunications Association (TIA)
• Request For Comment - rfc-editor.org.
• The Project Management Institute (PMI)
• Payment Card Industry (PCI)

The Need for Collaboration and Partnerships

Note that many of the above organizations cover a considerable range and diversity of topics and technologies and that there can be a considerable degree of overlap of interest and authority between these organizations in a number of areas. The reasons for this state of affairs are historical, geographical, demographical, technological, fiscal and as a regulatory consequence or convenience.

Importantly; the majority of the larger authoritative organizations were originally founded some time ago in different geographical regions. Originally; each organization bore greater responsibility for its individual primary sphere of influence.

However; over time and with the advent of and continued exponential expansion of publically accessible mass air transport the world became a smaller place. These factors when combined with the arrival of a host of new technologies in the information revolution resulted not only in the formation of new authoritative bodies but existing ones expanded their influence into other areas both within and beyond their original sphere of local influence.

We have since experienced considerable clouding of technological realms to the extent that many of the original standards organizations saw fit to work on various technological standards collaboratively. For example; a transoceanic submarine communications cable required that both ends adopt and implement compatible technologies as well as entering into a mutually agreeable infrastructure costs sharing arrangement.

The settling upon this cooperative collaborative approach was also heavily influenced by the limited jurisdiction and regulatory enforceable control that each partner held or could exert in the others domicile country, state or city.

Goals, Objectives and Ideals

Most of the organizations listed above have as their driving goal the ideals of assisting engineers, manufacturers and business in solving basic production and distribution issues through the development of appropriate technical standards and specifications. Here are a few of the benefits that regulated standards and standardization deliver:

• Development of safer, cleaner, more efficient manufacturing, distribution, and supply of products and services thereby promoting easier and fairer trade practices beneficial to one and all
• To assist governments with a technical basis for health, safety and environmental legislation
• The dissemination and interchange of technology
• Safeguarding the rights and expectations of consumers and end users of existing and emerging technologies, products and services including the delivery of said technologies, products and services with a specific set minimal baseline Quality of Service and Expectancy

Payment Cards Industry (PCI)

In the case of the Payment Cards Industry (PCI), failure to comply with these standards generally results in the merchant/business having their trading rights revoked. This is a serious matter and as a result, merchant/business compliance is in excess of 99%.

The adoption on a global scale of the PCI standards is so universally high primarily because compliance is mandatory and the penalty for non-compliance is so high (removal of merchant privileges). We have also seen a wide adoption of the ISO 9000:2000 family of standards in the areas of quality control, quality management and quality assurance.

International Standards

Here are the highlights delivered through adoption of international standards:

Business Benefits - Local and international trade and business benefit from the "level playing field" that International Standards deliver to all competitors at both the regional and global market levels.

Consumer Benefits - Consumers in general benefit greatly from the adoption of international standards delivered by worldwide technology compliance and/or compatibility. This translates into ensuring the delivery of a greater all-round variety and diversity of products and services. These benefits to the consumer are further compounded by way of greater manufacturer/vendor competition delivering a superior competitive pricing of the products and/or services which they the consumer consumes.

Government Benefits - Governments implementing a consumption-based taxation structure (GST, VAT etc) reap great fiscal benefits as consumers and end-users consumer or use more products and services and business profits increase.

Government policy making is also more streamlined as standards based legislation can be enacted in whole, in part or with amendments by numerous countries. This also helps to create greater legislative uniformity on a global front with a commonality of illegality. What is illegal in one country is also illegal in most other countries. The same standards are being applied to the citizenry globally. This in turn promotes understanding and empathy which helps to increase tolerance and reduce conflict.

An example of consistency in cross-national boundaries legislation can be found in the European Union's privacy laws. It is important to understand that if any country external to the EU does not comply with the EU's requirements in this regard then great difficulty will be experienced by those attempting to conduct business with every EU member nation.

What is a Standard?

A Standard is a published document which sets out the specifications and procedures that are designed to ensure that a material, product, method or service is fit for its purpose and consistently performs in the way it was intended. A standard can be:

An Open Standard - Meaning that the standard is readily available and accessible to all and sundry. The primary obligation is on the part of those wishing to adopt or employ an open standard to adhere to and comply with the specifications contained within.

There is also a general proviso that any further developments of an open standard remain open; usually as an amendment or extension of the original, and that any such work must be clearly stated as being supplemental with full detail of said changes being accompanied with complete and open documentation.

A Proprietary Standard - "In-House" or "owned" by some entity or group of entities to the exclusion of all other parties unless otherwise formally agreed upon as shared (cooperative) or limited usage rights between all entities undertaking to the agreement and all stipulations contained within. There is generally no guarantee of interoperability with proprietary standards from different factions.

A classic example being the two video standards that were backed by different factions: Beta Max and VHS. Each technology had its merits and its proponents. But all in all both standards were totally incompatible with each other. As time went by VHS won and Beta Max disappeared off into the sunset.

Another long standing case of note was; up until recently, the incompatibility of Apple® computers and their Mac® operating system and Intel® x86 architecture CPUs. Because the difference here was so fundamental and the methodology that the CPU employed when addressing data was so crucial the very manner in which bit ordering was approached was so diametrically different between the two systems there would never be a meeting of minds here. That is until Apple® decided to go with their own customised version of the now reliable Linux operating system which had been built up over the years to run on Intel® x86 and compatible CPUs now manufactured only by Intel® themselves and AMD® did we see the change. We also saw the Apple® adds promoting Macs as “With Intel® Inside”.

De Facto Standards - Generally de facto standards are followed as a matter of convenience. There are no truly binding regulations between parties that adopt such a standard. One common interpretation that has and still is used by organisations concerns their right of and to substitution.

For example a manufacturer may for whatever reason be unable to deliver goods as promised then at the manufacturer's discretion they are entitled to substitute the goods or services contracted with goods or services of not less than equal to but usually greater value than those originally contracted for. This is a situation that depends very heavily upon the manufacturer, vendor or supplier; of the said goods or services, desire to maintain good-will (their good reputation) in generally exceptional circumstances.

The overall benefit that a small number of customers get in the short term is off-set by the continued loyalty that those customers and many other customers will place with the manufacturer, vendor or service provider.

Well they did go out of their way when they didn't have to. This is a sentiment that promotes much direct and indirect goodwill between current customers and forms the “track-record” by which many future potential customers will make buying decisions. In the marketing industry this is known as “a lost leader”

De Jure Standards - Only because we have to. Here we have a class of standards which are used purely because of more or less legally binding legislation, contracts or other documents.

More often than not some form of legislation has been enacted that has resulted in a statutory body (the legislature or legislative body (usually appointed by government) that issues these types of “official” standards or decrees with ensuing obligation by all parties to adhere to. Thus they can be viewed as prerequisite for conducting business and/or any other affairs between different entities.

Opt-In Standards - The De Jure standard plus the extra mile. The individual or organisation is required to adhere to some form of De Jure standard but has decided for whatever reasons to adopt as a standard policy stipulations that exceed the De Jure standard.

One area in Australia where this is a common occurrence is in the area of Privacy and Privacy Law which is at the moment very inconsistent across the nation.

With regards to Privacy legislation many industries have adopted the approach to present a common front on the national scale although much of their membership may only be bound by law to do so to varying degrees as prescribed by those elements of the Federal law that are applicable and those of their individual State laws that may also be relevant.

This has created a degree of confusion throughout some industries with the result that their appointed council has recommend that they as an industry adopt a common front and propose an opt-in policy to the Office of the Privacy Commissioner which when ratified will be taken as the status quo for all members of that industry to adopt if they so desire.

Because the benefits of compliance are more economical than failing to do so these opt-in standards have a very high adherence rate within each industry (in most cases over 95% participation and compliance).

One reason; that has been given, for this high acceptance level is that in most instances it is believed that in due course; as each State produces its own more complicating legislation, the battle-field of compliance will become ever muddier. With this in mind; by adopting a higher than currently expected level of standard, the industry has every reason to presume; that over time, legislators will take the easy road and simply legislate that which is already current common practice.

There will be very little in the way of power lobby groups to voice difference and so the duly elected will be able to publically pat themselves on the back, lap up the kudos and that will be that.

Opt-Out Standards - Any excuse not to live up to expectations will do. Buyer beware is the rule here.

If an industry has an opt-In standard that it recommends that its members adopt and the vast majority do (usually over 95% compliance with industry formulated Opt-In standards that have been developed with due consultation and open debate from membership is the norm) be vary wary of those individuals or organisations that are unwilling to heed the wishes of their peers.

There is usually a good reason; so ask. You may find that there are legitimate reasons for the opt-out but more often than not you will find; that especially in the case of individuals, if the reason given for the individual's decision to opt-out presents you with an uneasy frame of mind then follow the old adage “if in doubt leave out”. Don't do business with them. It's far better to be safe than sorry (ripped-off).

What is in a Standard?

Never forget that a standard is a written document of considerable depth and detail and is freely available from the organisation or body charged with its formulation, maintenance and upkeep as well as its evolution. Standards will detail such elements and specifications about that which they are defining the standard for and so can be expected to describe to considerable detail such characteristics as:

• Style, form, format, content, presentation, medium etc. in very much the same way as content for publication or transmission via publically accessible media has standards by which TV and radio stations have regulatory conditions to which they must adhere
• Materials physical characteristics, electrical and electronic specifications and characteristics, composition, performance parameters, colour-coding etc
• Internationally agreed standards
• Prescribed, recognized and abided by terms and conditions
• Standards relating to products and services may detail enforceable terms, conditions, parameters, specifications, properties, styles, form factors, formatting, presentation and manner etc
• Other standards will cover such things as intellectual property and intellectual property rights
• Patents are a type of standard that has been around for a considerable time now. Yes there are problems associated with the patents system and many changes have been made over the years in response to issues that have arisen.
• Legally binding standards are also another area of great contention today
• Advertising standards and advertising practices standards according to many lobbyists just simply don't go far enough

These and many other attributes of just exactly what makes a standard will be the subject for part three of this series about Standards, Standardisation and Policies. So stay tuned and I'll see you soon.