Year: 2020

Management Notes

Time Series Analysis, Concepts, Meaning, Utility, Components, Models, Importance and Limitations

indiafreenotesby indiafreenotes0

Time series consists of observations of a variable arranged in chronological order, such as yearly sales, monthly production, or daily stock prices. Each observation depends on the passage of time. Unlike cross-sectional data, time series data emphasizes changes over time. The analysis focuses on identifying underlying movements and separating short-term fluctuations from long-term patterns. Understanding these movements helps managers make informed decisions related to planning and control.

Meaning of Time Series Analysis

Time Series Analysis is a statistical technique used to study data collected over a period of time at regular intervals. Such data is called time series data. The main purpose of time series analysis is to identify patterns, trends, and variations in data so that future values can be predicted. In business, time series analysis is widely used for forecasting sales, demand, production, prices, and economic indicators.

Utility of Time Series

Time series analysis is highly useful in business and economics as it helps in understanding past behavior of data and predicting future trends. By studying data collected over time, managers can identify patterns, evaluate performance, and make informed decisions. The utility of time series lies in its wide applicability across various functional areas of business.

1. Sales Forecasting

Time series analysis helps businesses forecast future sales by analyzing past sales data. By identifying trends and seasonal patterns, firms can estimate future demand accurately. Sales forecasting assists in production planning, budgeting, and resource allocation. Reliable forecasts reduce uncertainty and help businesses meet customer demand effectively without overproduction or stock shortages.

2. Demand Estimation

Time series data is used to estimate demand for products and services over time. By studying historical demand patterns, businesses can understand consumer behavior and anticipate changes in demand. This information helps in planning production levels, inventory management, and pricing strategies. Accurate demand estimation improves operational efficiency and customer satisfaction.

3. Production Planning

Time series analysis supports production planning by identifying long-term trends and seasonal variations in demand. Businesses can schedule production activities in advance to match expected demand levels. This helps avoid idle capacity during low-demand periods and shortages during peak seasons. Efficient production planning leads to cost reduction and better utilization of resources.

4. Inventory Control

Time series analysis helps firms manage inventory effectively by forecasting future demand and identifying seasonal fluctuations. Proper inventory control reduces holding costs, minimizes the risk of stockouts, and ensures timely availability of goods. Businesses can maintain optimal stock levels based on predicted demand patterns, leading to improved cash flow and customer satisfaction.

5. Budgeting and Financial Planning

Time series analysis is useful in budgeting and financial planning by forecasting revenues, expenses, and profits. Past financial data helps managers estimate future financial requirements and allocate funds efficiently. Accurate budgeting ensures financial stability and supports long-term strategic planning. It also helps in monitoring performance and controlling costs.

6. Price Trend Analysis

Businesses use time series analysis to study price movements over time. Understanding price trends helps firms make informed pricing decisions and adjust strategies in response to market conditions. It is particularly useful in industries where prices fluctuate due to seasonal or economic factors. Price trend analysis supports better revenue management and competitive positioning.

7. Economic and Market Analysis

Time series analysis is widely used to study economic indicators such as inflation, interest rates, and national income. Businesses analyze these indicators to understand economic conditions and their impact on operations. This helps in investment decisions, expansion planning, and risk assessment. Time series provides valuable insights into overall market behavior.

8. Performance Evaluation

Time series data allows businesses to evaluate performance over time by comparing current results with past performance. It helps identify growth patterns, declines, or fluctuations in business activities. Performance evaluation supports corrective actions, policy adjustments, and continuous improvement. It also helps in setting realistic targets and measuring progress effectively.

Components of Time Series

Time series data shows variations over time due to several underlying forces. These forces are known as the components of a time series. Identifying and studying these components helps in understanding past behavior and predicting future values. Generally, a time series is composed of four main components: Trend, Seasonal, Cyclical, and Irregular variations.

1. Trend (T)

Trend represents the long-term movement of a time series over an extended period. It shows the general tendency of data to increase, decrease, or remain constant. Trend is influenced by factors such as population growth, technological progress, economic development, and changes in consumer preferences. For example, a steady rise in mobile phone sales over several years indicates an upward trend. Trend analysis is important for long-term planning, forecasting, and policy formulation in business.

2. Seasonal Variations (S)

Seasonal variations are regular and recurring fluctuations that occur within a year. These variations repeat at fixed intervals, such as monthly or quarterly. They arise due to seasonal factors like climate conditions, festivals, customs, and consumer habits. For instance, demand for umbrellas increases during the rainy season, while sales of woolen clothes rise in winter. Understanding seasonal variations helps businesses plan production, inventory, and marketing activities efficiently.

3. Cyclical Variations (C)

Cyclical variations refer to long-term oscillations in a time series caused by business cycles. These cycles include periods of expansion, peak, recession, and recovery. Unlike seasonal variations, cyclical movements do not occur at regular intervals and may extend over several years. Factors such as economic policies, investment patterns, and overall economic conditions influence cyclical variations. Analysis of cyclical movements helps businesses anticipate economic changes and adjust strategies accordingly.

4. Irregular or Random Variations (I)

Irregular variations are unpredictable and random fluctuations caused by unexpected events such as wars, natural disasters, strikes, pandemics, or sudden policy changes. These variations do not follow any pattern and are usually short-term in nature. Although irregular variations cannot be forecasted, identifying them helps isolate their effect from other components of a time series. This ensures more accurate trend and seasonal analysis.

Models of Time Series

Time series models explain how different components of a time series—Trend (T), Seasonal (S), Cyclical (C), and Irregular (I)—combine to form the actual observed data. These models help in analyzing past data and forecasting future values. The two most commonly used models are the Additive Model and the Multiplicative Model.

1. Additive Model of Time Series

In the additive model, the various components of a time series are added together to obtain the observed value. The model is expressed as:

Y=T+S+C+IY = T + S + C + I

This model assumes that the effect of each component is independent of the others and remains relatively constant over time.

Features of Additive Model

  • Seasonal variations remain constant in absolute terms.

  • Suitable when fluctuations do not increase with the level of the series.

  • Easy to understand and apply.

  • Commonly used when data shows stable seasonal effects.

Examples of Additive Model

If a company’s average monthly sales increase steadily, and seasonal increases remain almost the same every year, the additive model is appropriate. For example, sales may increase by 50 units during festive seasons each year, regardless of overall growth.

Uses of Additive Model

The additive model is useful in analyzing time series data with small or stable variations. It is widely used in social sciences, demographic studies, and business data where seasonal and cyclical effects remain fairly constant. It helps in short-term forecasting and trend analysis.

2. Multiplicative Model of Time Series

In the multiplicative model, the components of a time series are multiplied together to obtain the observed value. The model is expressed as:

Y=T×S×C×IY = T \times S \times C \times I

This model assumes that the impact of components changes proportionally with the level of the time series.

Features of Multiplicative Model

  • Seasonal variations change in proportion to the level of the series.

  • Suitable when fluctuations increase as the trend increases.

  • More realistic for economic and business data.

  • Widely used in forecasting and index number construction.

Examples of Multiplicative Model

If sales grow over time and seasonal fluctuations also increase in magnitude, the multiplicative model is more appropriate. For example, if festive-season sales rise by 10% every year rather than by a fixed number, the multiplicative model fits better.

Uses of Multiplicative Model

The multiplicative model is commonly used in business, economics, and finance. It is ideal for analyzing sales, production, prices, and demand where seasonal and cyclical effects grow with the trend. This model provides more accurate forecasts in dynamic and expanding markets.

Importance of Time Series Models

  • Helps in Understanding Data Behavior

Time series models help in breaking down complex data into its basic components such as trend, seasonal, cyclical, and irregular variations. By separating these components, managers can clearly understand the underlying behavior of data over time. This understanding enables businesses to identify long-term growth patterns and short-term fluctuations, making data interpretation more meaningful and systematic.

  • Facilitates Accurate Forecasting

One of the most important uses of time series models is forecasting future values. By analyzing past patterns and component behavior, businesses can predict sales, demand, production, and prices. The additive and multiplicative models provide a scientific basis for forecasting, reducing guesswork and uncertainty. Accurate forecasts help organizations plan resources efficiently and prepare for future market conditions.

  • Supports Business Planning and Control

Time series models assist management in planning and controlling business operations. Trend analysis helps in long-term strategic planning, while seasonal analysis supports short-term operational planning. Managers can plan inventory levels, workforce requirements, and production schedules more effectively. This leads to better coordination among departments and improved overall business performance.

  • Aids in Seasonal Adjustment

Seasonal variations often distort actual performance measurement. Time series models help in isolating and removing seasonal effects, enabling businesses to measure real growth or decline. Seasonal adjustment is especially important for comparing data across different periods. It ensures fair performance evaluation and helps management take corrective actions based on accurate information.

  • Useful in Economic and Financial Analysis

Time series models are widely used in economic and financial studies. They help analyze price movements, inflation trends, stock market behavior, and economic cycles. Governments and financial institutions rely on these models to formulate policies, assess economic stability, and predict future economic conditions. The multiplicative model is especially useful in analyzing proportional changes in economic variables.

  • Improves Decision-Making Quality

By providing a structured and quantitative approach, time series models improve the quality of managerial decisions. Decisions related to pricing, marketing strategies, investment, and expansion are based on data-driven insights rather than intuition. This reduces risk and enhances confidence in decision-making, especially in uncertain and competitive business environments.

  • Helps in Performance Evaluation

Time series models enable businesses to compare actual performance with expected or forecasted performance. Deviations can be analyzed to identify causes such as irregular or cyclical factors. This helps management evaluate efficiency, detect problems early, and take timely corrective measures. Performance evaluation becomes more objective and systematic.

  • Assists in Risk Reduction and Uncertainty Management

Time series models help businesses reduce risk by providing a systematic analysis of past data patterns. By studying trends, seasonal effects, and cyclical movements, managers can anticipate possible future changes and prepare contingency plans. This reduces uncertainty in decision-making related to investments, production expansion, pricing, and inventory management. When decisions are supported by time series analysis, the chances of unexpected losses decrease, and businesses can respond more confidently to market fluctuations and economic changes.’

Limitations of Time Series Models

  • Dependence on Past Data

Time series models are entirely based on historical data and assume that past patterns will continue in the future. However, sudden changes in economic conditions, government policies, or consumer behavior may make past data irrelevant. As a result, forecasts based on time series models may become inaccurate when structural changes occur in the business environment.

  • Inability to Predict Unexpected Events

Time series models cannot effectively account for irregular or random variations caused by unforeseen events such as natural disasters, wars, strikes, pandemics, or sudden technological changes. Since these events do not follow any pattern, they reduce the reliability of forecasts generated through time series models.

  • Assumption of Stable Patterns

These models assume that trend, seasonal, and cyclical patterns remain stable over time. In reality, seasonal behavior and consumer preferences may change due to lifestyle changes, innovation, or market competition. When such patterns change, the model fails to reflect actual conditions accurately.

  • Limited Explanatory Power

Time series models focus mainly on identifying patterns rather than explaining the causes behind changes. They do not consider external factors such as price changes, income levels, competition, or marketing strategies. Hence, the analysis may lack depth and fail to provide a complete explanation of business performance.

  • Difficulty in Isolating Components Accurately

Separating trend, seasonal, cyclical, and irregular components is often complex and subjective. Errors in measuring one component may affect the accuracy of others. This makes the overall results sensitive to the method used for decomposition.

  • Unsuitable for Long-Term Forecasting

Time series models are generally more reliable for short-term forecasts. Long-term forecasting becomes difficult due to changing economic conditions and technological advancements. Over longer periods, the assumptions of continuity and stability are less likely to hold true.

  • Requires Large and Reliable Data

Accurate time series analysis requires a sufficiently large and reliable dataset. Incomplete, inconsistent, or inaccurate data can lead to misleading conclusions. Small datasets may not capture true patterns, reducing the effectiveness of the model.

  • Ignores Cause-and-Effect Relationships

Time series models analyze data based only on time-based patterns and do not establish cause-and-effect relationships between variables. They explain what has happened over time but not why it happened. Important factors such as changes in pricing, advertising, competition, income levels, or government policies are ignored. As a result, decisions based solely on time series models may lack strategic insight and may not be effective in dynamic and competitive business environments.

Management Notes

Components of Time Series

indiafreenotesby indiafreenotes0

When quantitative data are arranged in the order of their occurrence, the resulting statistical series is called a time series. The quantitative values are usually recorded over equal time interval daily, weekly, monthly, quarterly, half yearly, yearly, or any other time measure. Monthly statistics of Industrial Production in India, Annual birth-rate figures for the entire world, yield on ordinary shares, weekly wholesale price of rice, daily records of tea sales or census data are some of the examples of time series. Each has a common characteristic of recording magnitudes that vary with passage of time.

Time series are influenced by a variety of forces. Some are continuously effective other make themselves felt at recurring time intervals, and still others are non-recurring or random in nature. Therefore, the first task is to break down the data and study each of these influences in isolation. This is known as decomposition of the time series. It enables us to understand fully the nature of the forces at work. We can then analyse their combined interactions. Such a study is known as time-series analysis.

Components of time series

A time series consists of the following four components or elements:

  1. Basic or Secular or Long-time trend;
  2. Seasonal variations;
  3. Business cycles or cyclical movement; and
  4. Erratic or Irregular fluctuations.

These components provide a basis for the explanation of the past behaviour. They help us to predict the future behaviour. The major tendency of each component or constituent is largely due to casual factors. Therefore a brief description of the components and the causal factors associated with each component should be given before proceeding further.

  1. Basic or secular or long-time trend: Basic trend underlines the tendency to grow or decline over a period of years. It is the movement that the series would have taken, had there been no seasonal, cyclical or erratic factors. It is the effect of such factors which are more or less constant for a long time or which change very gradually and slowly. Such factors are gradual growth in population, tastes and habits or the effect on industrial output due to improved methods. Increase in production of automobiles and a gradual decrease in production of foodgrains are examples of increasing and decreasing secular trend.

All basic trends are not of the same nature. Sometimes the predominating tendency will be a constant amount of growth. This type of trend movement takes the form of a straight line when the trend values are plotted on a graph paper. Sometimes the trend will be constant percentage increase or decrease. This type takes the form of a straight line when the trend values are plotted on a semi-logarithmic chart. Other types of trend encountered are “logistic”, “S-curyes”, etc.
Properly recognising and accurately measuring basic trends is one of the most important problems in time series analysis. Trend values are used as the base from which other three movements are measured.
Therefore, any inaccuracy in its measurement may vitiate the entire work. Fortunately, the causal elements controlling trend growth are relatively stable. Trends do not commonly change their nature quickly and without warning. It is therefore reasonable to assume that a representative trend, which has characterized the data for a past period, is prevailing at present, and that it may be projected into the future for a year or so.

  1. Seasonal Variations: The two principal factors liable for seasonal changes are the climate or weather and customs. Since, the growth of all vegetation depends upon temperature and moisture, agricultural activity is confined largely to warm weather in the temperate zones and to the rainy or post-rainy season in the torried zone (tropical countries or sub-tropical countries like India). Winter and dry season make farming a highly seasonal business. This high irregularity of month to month agricultural production determines largely all harvesting, marketing, canning, preserving, storing, financing, and pricing of farm products. Manufacturers, bankers and merchants who deal with farmers find their business taking on the same seasonal pattern which characterise the agriculture of their area.
    The second cause of seasonal variation is custom, education or tradition. Such traditional days as Dewali, Christmas. Id etc., product marked variations in business activity, travel, sales, gifts, finance, accident, and vacationing.

The successful operation of any business requires that its seasonal variations be known, measured and exploited fully. Frequently, the purchase of seasonal item is made from six months to a year in advance. Departments with opposite seasonal changes are frequently combined in the same firm to avoid dull seasons and to keep sales or production up during the entire year. Seasonal variations are measured as a percentage of the trend rather than in absolute quantities. The seasonal index for any month (week, quarter etc.) may be defined as the ratio of the normally expected value (excluding the business cycle and erratic movements) to the corresponding trend value. When cyclical movement and erratic fluctuations are absent in a lime series, such a series is called normal. Normal values thus are consisting of trend and seasonal components. Thus when normal values are divided by the corresponding trend values, we obtain seasonal component of time series.
3. Business Cycle: Because of the persistent tendency for business to prosper, decline, stagnate recover; and prosper again, the third characteristic movement in economic time series is called the business cycle. The business cycle does not recur regularly like seasonal movement, but moves in response to causes which develop intermittently out of complex combinations of economic and other considerations. When the business of a country or a community is above or below normal, the excess deficiency is usually attributed to the business cycle. Its measurement becomes a process of contrast occurrences with a normal estimate arrived at by combining the calculated trend and seasonal movements. The measurement of the variations from normal may be made in terms of actual quantities or it may be made in such terms as percentage deviations, which is generally more satisfactory method as it places the measure of cyclical
tendencies on comparable base throughout the entire period under analysis.
4. Erratic or Irregular Component: These movements are exceedingly difficult to dissociate quantitatively from the business cycle. Their causes are such irregular and unpredictable happenings such as wars, droughts, floods, fires, pestilence, fads and fashions which operate as spurs or deterrents upon the progress of the cycle. Examples such movements are : high activity in middle forties due to erratic effects of 2nd world war, depression of thirties throughout the world, export boom associated with Korean War in 1950.
The common denominator of every random factor it that does not come about as a result of the ordinary operation of the business system and does not recur in any meaningful manner.
Mathematical Statement of the Composition of Time Series
A time series may not be affected by all type of variations. Some of these type of variations may affect a few time series, while the other series may be effected by all of them. Hence, in analysing time series, these effects are isolated. In classical time series analysis it is assumed that any given observation is made up of trend, seasonal, cyclical and irregular movements and these four components have multiplicative relationship.
Symbolically :

O = T × S × C × I
where O refers to original data,
T refers to trend.
S refers to seasonal variations,
C refers to cyclical variations and
I refers lo irregular variations.
This is the most commonly used model in the decomposition of time series.
There is another model called Additive model in which a particular observation in a time series is the sum of these four components.
O = T + S + C + I

Management Notes

Classical and empirical probability

indiafreenotesby indiafreenotes0

Classical Probability: There are ‘n’ number of events and you can find the probability of the happening of an event by applying basic probability formulae. For example – the probability of getting a head in a single toss of a coin is 1/2. This is Classical Probability.

Empirical Probability: This type of probability is based on experiments. Say, we want to know that how many times a head will turn up if we toss a coin 1000 times. According to the Traditional approach, the answer should be 500. But according to Empirical approach, we’ll first conduct an experiment in which we’ll toss a coin 1000 times and then we can draw our answer based on the observations of our experiment.

Management Notes

Conditional Probability

indiafreenotesby indiafreenotes0

Conditional probability refers to the probability of an event occurring, given that another event has already occurred. It quantifies the likelihood of one event under the condition that the related event is known.

The probability of the occurrence of an event A given that an event B has already occurred is called the conditional probability of A given B:

The same is explained in Figure 2.15 using the sample spaces related to the events A and B, assuming that there are few sample points common to these two events. Part 1 of the figure shows the total sample space related to the experiment as in the form of rectangle and the sample space related to the event A as a circle. Similarly part 2 of the figure shows the total sample space and the sample space related to event B. As explained earlier in conditional probability the total sample space is restrained to the sample space that is related to event B (which has already occurred). The same is shown in part 3 of Figure 2.15. Now the sample space for event A (B is the total sample space available) is nothing but the sample points related to event A and falling in the sample space. This is nothing but the intersection of the events A and B and is shown in part 3 of the figure as the hatched area.  

Figure 2.15: Representation of conditional probability using the Venn diagrams

For example, there are 100 trips per day between two places X and Y. Out of these 100 trips 50 are made by car, 25 are made by bus and the other 25 are by local train. Probabilities associated to these modes are 0.5, 0.25, and 0.25, respectively. In transportation engineering both the bus and the local train are considered as public transport so the event space associated to this is the summation of the event spaces associated to bus and local train. Probability of choosing public transportation is 0.5. Now if one is interested in finding the probability of choosing bus given public transportation is chosen the conditional probability is useful in finding that.

Management Notes

Addition and Multiplication Theorems

indiafreenotesby indiafreenotes0

Addition Theorem on probability:

If A and B are any two events then the probability of happening of at least one of the events is defined as P(AUB) = P(A) + P(B)- P(A∩B).

Since events are nothing but sets,

From set theory, we have

n(AUB) = n(A) + n(B)- n(A∩B).

Dividing the above equation by n(S), (where S is the sample space)

n(AUB)/ n(S) = n(A)/ n(S) + n(B)/ n(S)- n(A∩B)/ n(S)

Then by the definition of probability,

P(AUB) = P(A) + P(B)- P(A∩B).

Example:

If the probability of solving a problem by two students George and James are 1/2 and 1/3 respectively then what is the probability of the problem to be solved.

Solution:

Let A and B be the probabilities of solving the problem by George and James respectively.

Then P(A)=1/2 and P(B)=1/3.

The problem will be solved if it is solved at least by one of them also.

So, we need to find P(AUB).

By addition theorem on probability, we have

P(AUB) = P(A) + P(B)- P(A∩B).

P(AUB) = 1/2 +.1/3 – 1/2 * 1/3 = 1/2 +1/3-1/6 = (3+2-1)/6 = 4/6 = 2/3

Note:

If A and B are any two mutually exclusive events then P(A∩B)=0.

Then P(AUB) = P(A)+P(B).

Multiplication theorem on probability:

If A and B are any two events  of a sample space such that P(A) ≠0 and P(B)≠0, then

P(A∩B) = P(A) * P(B|A) = P(B) *P(A|B).

Example:  If P(A) =  1/5  P(B|A) =  1/3  then what is P(A∩B)?

Solution: P(A∩B) = P(A) * P(B|A) = 1/5 * 1/3 = 1/15

INDEPENDENT EVENTS:

Two events A and B are said to be independent if there is no change in the happening of an event with the happening of the other event.

i.e. Two events A and B are said to be independent if

P(A|B) = P(A) where P(B)≠0.

P(B|A) = P(B) where P(A)≠0.

i.e. Two events A and B are said to be independent if

P(A∩B) = P(A) * P(B).

Example:

While laying the pack of cards, let A be the event of drawing a diamond and B be the event of drawing an ace.

Then P(A) =  13/52 = 1/4 and P(B) =  4/52=1/13

Now, A∩B = drawing a king card from hearts.

Then P(A∩B) =  1/52

Now, P(A/B) = P(A∩B)/P(B) = (1/52)/(1/13) = 1/4 = P(A).

So, A and B are independent.

[Here, P(A∩B) = =    = P(A) * P(B)]

Note:

(1)    If 3 events A,B and C are independent the

P(A∩B∩C) = P(A)*P(B)*P(C).

(2)    If A and B are any two events, then P(AUB) = 1-P(A’)P(B’).

Management Notes

Probability Meaning and Approaches of Probability Theory

indiafreenotesby indiafreenotes0

In our day to day life the “probability” or “chance” is very commonly used term. Sometimes, we use to say “Probably it may rain tomorrow”, “Probably Mr. X may come for taking his class today”, “Probably you are right”. All these terms, possibility and probability convey the same meaning. But in statistics probability has certain special connotation unlike in Layman’s view.

The theory of probability has been developed in 17th century. It has got its origin from games, tossing coins, throwing a dice, drawing a card from a pack. In 1954 Antoine Gornband had taken an initiation and an interest for this area.

After him many authors in statistics had tried to remodel the idea given by the former. The “probability” has become one of the basic tools of statistics. Sometimes statistical analysis becomes paralyzed without the theorem of probability. “Probability of a given event is defined as the expected frequency of occurrence of the event among events of a like sort.” (Garrett)

The probability theory provides a means of getting an idea of the likelihood of occurrence of different events resulting from a random experiment in terms of quantitative measures ranging between zero and one. The probability is zero for an impossible event and one for an event which is certain to occur.

Approaches of Probability Theory

  1. Classical Probability:

The classical approach to probability is one of the oldest and simplest school of thought. It has been originated in 18th century which explains probability concerning games of chances such as throwing coin, dice, drawing cards etc.

The definition of probability has been given by a French mathematician named “Laplace”. According to him probability is the ratio of the number of favourable cases among the number of equally likely cases.

Or in other words, the ratio suggested by classical approach is:

Pr. = Number of favourable cases/Number of equally likely cases

For example, if a coin is tossed, and if it is asked what is the probability of the occurrence of the head, then the number of the favourable case = 1, the number of the equally likely cases = 2.

Pr. of head = 1/2

Symbolically it can be expressed as:

P = Pr. (A) = a/n, q = Pr. (B) or (not A) = b/n

1 – a/n = b/n = (or) a + b = 1 and also p + q = 1

p = 1 – q, and q = 1 – p and if a + b = 1 then so also a/n + b/n = 1

In this approach the probability varies from 0 to 1. When probability is zero it denotes that it is impossible to occur.

If probability is 1 then there is certainty for occurrence, i.e. the event is bound to occur.

Example:

From a bag containing 20 black and 25 white balls, a ball is drawn randomly. What is the probability that it is black.

Pr. of a black ball = 20/45 = 4/9 = p, 25 Pr. of a white ball = 25/45 = 5/9 = q

p = 4/9 and q = 5/9 (p + q= 4/9 + 5/9= 1)

  1. Relative Frequency Theory of Probability:

This approach to probability is a protest against the classical approach. It indicates the fact that if n is increased upto the ∞, we can find out the probability of p or q.

Example:

If n is ∞, then Pr. of A= a/n = .5, Pr. of B = b/n = 5

If an event occurs a times out of n its relative frequency is a/n. When n becomes ∞, is called the limit of relative frequency.

Pr. (A) = limit a/n

where n → ∞

Pr. (B) = limit bl.t. here → ∞.

Axiomatic approach

An axiomatic approach is taken to define probability as a set function where the elements of the domain are the sets and the elements of range are real numbers. If event A is an element in the domain of this function, P(A) is the customary notation used to designate the corresponding element in the range.

Probability Function

A probability function p(A) is a function mapping the event space A of a random experiment into the interval [0,1] according to the following axioms;

Axiom 1. For any event A, 0 ≤ P(A) ≤ 1

Axiom 2. P(Ω) = 1

Axiom 3. If A and B are any two mutually exclusive events then,

                              P(A ∪ B)) = P(A) + P(B)

As given in the third axiom the addition property of the probability can be extended to any number of events as long as the events are mutually exclusive. If the events are not mutually exclusive then;

P(A ∪ B) = P(A) + P(B) – P(A∩B)

P(A∩B) is Φ if both the events are mutually exclusive.

If there are two types of objects among the objects of similar or other natures then the probability of one object i.e. Pr. of A = .5, then Pr. of B = .5

Management Notes

Lines of Regression; Co-efficient of regression

indiafreenotesby indiafreenotes0

Regression Line is the line that best fits the data, such that the overall distance from the line to the points (variable values) plotted on a graph is the smallest. In other words, a line used to minimize the squared deviations of predictions is called as the regression line.

There are as many numbers of regression lines as variables. Suppose we take two variables, say X and Y, then there will be two regression lines:

  • Regression line of Y on X: This gives the most probable values of Y from the given values of X.
  • Regression line of X on Y: This gives the most probable values of X from the given values of Y.

The algebraic expression of these regression lines is called as Regression Equations. There will be two regression equations for the two regression lines.

The correlation between the variables depend on the distance between these two regression lines, such as the nearer the regression lines to each other the higher is the degree of correlation, and the farther the regression lines to each other the lesser is the degree of correlation.

The correlation is said to be either perfect positive or perfect negative when the two regression lines coincide, i.e. only one line exists. In case, the variables are independent; then the correlation will be zero, and the lines of regression will be at right angles, i.e. parallel to the X axis and Y axis.

The regression lines cut each other at the point of average of X and Y. This means, from the point where the lines intersect each other the perpendicular is drawn on the X axis we will get the mean value of X. Similarly, if the horizontal line is drawn on the Y axis we will get the mean value of Y.

Co-efficient of Regression

The Regression Coefficient is the constant ‘b’ in the regression equation that tells about the change in the value of dependent variable corresponding to the unit change in the independent variable.

If there are two regression equations, then there will be two regression coefficients:

  • Regression Coefficient of X on Y:

The regression coefficient of X on Y is represented by the symbol bxy that measures the change in X for the unit change in Y. Symbolically, it can be represented as:

The bxy can be obtained by using the following formula when the deviations are taken from the actual means of X and Y:When the deviations are obtained from the assumed mean, the following formula is used:

  • Regression Coefficient of Y on X:

The symbol byx is used that measures the change in Y corresponding to the unit change in X. Symbolically, it can be represented as:


In case, the deviations are taken from the actual means; the following formula is used:
The byx can be  calculated by using the following formula when the deviations are taken from the assumed means:

The Regression Coefficient is also called as a slope coefficient because it determines the slope of the line i.e. the change in the independent variable for the unit change in the independent variable

Management Notes

Difference between Correlation and Regression

indiafreenotesby indiafreenotes0

Correlation and Regression

Correlation and regression are two important statistical tools used to study the relationship between variables. Both help managers analyze data and make informed business decisions. While correlation measures the degree and direction of relationship between variables, regression explains the cause-and-effect relationship and helps in prediction. Though closely related, their objectives and applications are different.

Correlation

The term correlation is a combination of two words ‘Co’ (together) and relation (connection) between two quantities. Correlation is when, at the time of study of two variables, it is observed that a unit change in one variable is retaliated by an equivalent change in another variable, i.e. direct or indirect. Or else the variables are said to be uncorrelated when the movement in one variable does not amount to any movement in another variable in a specific direction. It is a statistical technique that represents the strength of the connection between pairs of variables.

Correlation refers to a statistical measure that indicates the extent and direction of relationship between two variables. It shows whether variables move together or in opposite directions. Correlation is expressed numerically through the correlation coefficient (r), whose value lies between –1 and +1. A positive value indicates direct relationship, a negative value indicates inverse relationship, and zero indicates no relationship. Correlation does not indicate causation; it only measures association.

On the contrary, when the two variables move in different directions, in such a way that an increase in one variable will result in a decrease in another variable and vice versa, This situation is known as negative correlation. For instance: Price and demand of a product.

The measures of correlation are given as under:

  • Karl Pearson’s Product-moment correlation coefficient
  • Spearman’s rank correlation coefficient
  • Scatter diagram
  • Coefficient of concurrent deviations

Regression

Regression analysis is a statistical technique that establishes a functional or causal relationship between a dependent variable and one or more independent variables. It helps estimate or predict the value of one variable based on the known value of another. Regression provides a mathematical equation that explains how much change in the dependent variable is caused by changes in independent variables. It is widely used in forecasting and planning.

Differences Between Correlation and Regression

1. Meaning and Concept

Correlation and regression differ fundamentally in their basic meaning and conceptual approach. Correlation is a statistical measure that shows the degree and direction of relationship between two variables. It simply answers the question of whether variables are related and how strongly they move together. It does not explain why the relationship exists.

Regression, on the other hand, is a statistical technique that establishes a functional or causal relationship between variables. It explains how one variable (dependent) is affected by changes in another variable (independent). Regression goes beyond association and attempts to quantify the impact of one variable on another. Thus, while correlation is concerned with measuring association, regression focuses on explanation and prediction, making it more powerful for business decision-making.

2. Objective of Study

The objective of correlation is to determine whether a relationship exists between variables and to measure its strength and direction. It helps analysts understand patterns and tendencies in data. Correlation answers questions like: Are sales and advertising related? or Do income and consumption move together?

The objective of regression is to predict or estimate the value of one variable based on another. It is used when a business wants to forecast outcomes, such as predicting sales based on price or estimating costs based on output. Regression analysis provides a mathematical equation that can be used for planning, control, and forecasting. Hence, correlation is mainly descriptive in nature, while regression is both descriptive and predictive, making regression more suitable for managerial decision-making

3. Nature of Relationship

Correlation measures the degree of linear relationship between variables but does not indicate any cause-and-effect connection. Even if two variables are highly correlated, one may not necessarily cause changes in the other. For example, ice cream sales and electricity consumption may show correlation due to seasonal effects, not causation.

Regression, in contrast, assumes a cause-and-effect relationship between variables. It explains how changes in the independent variable bring about changes in the dependent variable. For instance, regression can estimate how much sales will increase due to a specific increase in advertising expenditure. Thus, correlation reflects association only, whereas regression attempts to establish dependence, which is crucial for business forecasting and strategic planning.

4. Treatment of Variables

In correlation, variables are treated symmetrically. There is no distinction between dependent and independent variables. The correlation between X and Y is the same as the correlation between Y and X. Both variables are given equal importance, and the analysis does not require identifying which variable influences the other.

In regression, variables are treated asymmetrically. One variable is clearly identified as the dependent variable, and the other(s) as independent variables. The entire analysis is based on explaining or predicting the dependent variable. For example, sales may depend on price and advertising. This clear distinction is essential for regression analysis, making it more suitable for practical business applications where cause-and-effect relationships are required.

5. Numerical Measure and Output

Correlation is expressed using a single numerical value, called the correlation coefficient (r). This value ranges from –1 to +1 and indicates only the strength and direction of relationship. A single figure summarizes the entire relationship, which makes correlation easy to compute and interpret but limited in analytical depth.

Regression produces regression equations, such as Y = a + bX, where coefficients show the magnitude of change in the dependent variable due to a unit change in the independent variable. These equations provide detailed quantitative insights and allow prediction. Therefore, while correlation provides a summary measure, regression offers a complete analytical model useful for forecasting and decision-making.

6. Symmetry and Direction

Correlation is symmetric in nature, meaning that correlation between X and Y is exactly the same as correlation between Y and X. There is no concept of direction of dependence in correlation analysis. This symmetry limits its usefulness in predictive analysis.

Regression is not symmetric. Regression of Y on X is different from regression of X on Y. Each regression equation serves a specific purpose depending on which variable is treated as dependent. This directional nature makes regression a powerful analytical tool. It helps managers decide which variable should be predicted and which variables should be used as predictors, making regression more practical for real-world business problems.

7. Use in Prediction and Forecasting

Correlation is not suitable for prediction. Although it indicates the existence of a relationship, it does not provide a mechanism to estimate future values. A high correlation does not necessarily mean accurate forecasting is possible.

Regression is specifically designed for prediction and forecasting. Using regression equations, businesses can estimate future sales, costs, profits, or demand based on known values of independent variables. This makes regression extremely valuable for planning, budgeting, and policy formulation. Thus, correlation is primarily exploratory, while regression is predictive and decision-oriented.

8. Practical Application in Business

Correlation is mainly used for preliminary analysis. It helps identify whether variables are related and whether further analysis is worthwhile. For example, before performing regression, managers often check correlation to see if a relationship exists.

Regression has direct practical applications in business, including sales forecasting, demand estimation, cost control, pricing decisions, and investment analysis. It provides a scientific basis for managerial decisions. Hence, correlation serves as a starting point in analysis, while regression forms the foundation of advanced quantitative decision-making in business.

Key Differences Between Correlation and Regression

Aspect Correlation Regression
Meaning Correlation measures the degree and direction of relationship between two variables. Regression measures the functional and causal relationship between variables.
Nature It shows association only. It shows cause-and-effect relationship.
Objective To determine whether variables are related and how strongly. To predict or estimate the value of one variable from another.
Type of Relationship Indicates linear association only. Explains dependence of one variable on another.
Variables Does not distinguish between dependent and independent variables. Clearly distinguishes dependent and independent variables.
Direction of Influence No direction of influence is implied. Direction of influence is clearly defined.
Numerical Measure Expressed through a single value called correlation coefficient (r). Expressed through regression equations.
Range of Values Lies between –1 and +1. No fixed range for regression coefficients.
Symmetry Symmetric in nature (X with Y = Y with X). Asymmetric (Regression of Y on X ≠ X on Y).
Use in Prediction Not suitable for prediction. Specifically used for forecasting and prediction.
Number of Equations Only one coefficient is calculated. Two regression equations can be formed.
Dependency Assumption No assumption of dependency. Assumes dependency of one variable on another.
Effect of Change in Units Correlation coefficient is unit-free. Regression coefficients depend on measurement units.
Business Application Used mainly for preliminary analysis. Widely used for decision-making and planning.
Analytical Depth Provides limited analytical insight. Provides detailed quantitative analysis.
Management Notes

Rank correlation; coefficient of determination

indiafreenotesby indiafreenotes0

Rank Correlation

Sometimes there doesn’t exist a marked linear relationship between two random variables but a monotonic relation (if one increases, the other also increases or instead, decreases) is clearly noticed. A Pearson’s Correlation Coefficient evaluation, in this case, would give us the strength and direction of the linear association only between the variables of interest. Herein comes the advantage of the Spearman Rank Correlation methods, which will instead, give us the strength and direction of the monotonic relation between the connected variables. This can be a good starting point for further evaluation.

The Spearman Rank Order Correlation Coefficient

The Spearman’s Correlation Coefficient, represented by ρ or by rR, is a nonparametric measure of the strength and direction of the association that exists between two ranked variables. It determines the degree to which a relationship is monotonic, i.e., whether there is a monotonic component of the association between two continuous or ordered variables.

Monotonicity is “less restrictive” than that of a linear relationship. Although monotonicity is not actually a requirement of Spearman’s correlation, it will not be meaningful to pursue Spearman’s correlation to determine the strength and direction of a monotonic relationship if we already know the relationship between the two variables is not monotonic.

On the other hand if, for example, the relationship appears linear (assessed via scatterplot) one would run a Pearson’s correlation because this will measure the strength and direction of any linear relationship.

Spearman Ranking of the Data

We must rank the data under consideration before proceeding with the Spearman’s Rank Correlation evaluation. This is necessary because we need to compare whether on increasing one variable, the other follows a monotonic relation (increases or decreases regularly) with respect to it or not.

Thus, at every level, we need to compare the values of the two variables. The method of ranking assigns such ‘levels’ to each value in the dataset so that we can easily compare it.

  • Assign number 1 to n (the number of data points) corresponding to the variable values in the order highest to lowest.
  • In the case of two or more values being identical, assign to them the arithmetic mean of the ranks that they would have otherwise occupied.

The Formula for Spearman Rank Correlation

where n is the number of data points of the two variables and di is the difference in the ranks of the ith element of each random variable considered. The Spearman correlation coefficient, ρ, can take values from +1 to -1.

  • A ρ of +1 indicates a perfect association of ranks
  • A ρ of zero indicates no association between ranks and
  • ρ of -1 indicates a perfect negative association of ranks.
    The closer ρ is to zero, the weaker the association between the ranks.

Coefficient of Determination

The Coefficient of determination is the square of the coefficient of correlation r2 which is calculated to interpret the value of the correlation. It is useful because it explains the level of variance in the dependent variable caused or explained by its relationship with the independent variable.

The coefficient of determination explains the proportion of the explained variation or the relative reduction in variance corresponding to the regression equation rather than about the mean of the dependent variable. For example, if the value of r = 0.8, then r2 will be 0.64, which means that 64% of the variation in the dependent variable is explained by the independent variable while 36% remains unexplained.

Thus, the coefficient of determination is the ratio of explained variance to the total variance that tells about the strength of linear association between the variables, say X and Y. The value of r2 lies between 0 and 1 and observes the following relationship with ‘r’.

  • With the decrease in the value of ‘r’ from its maximum value of 1, the ‘r2’ also decreases much more rapidly.
  • The value of ‘r’ will always be greater than ‘r2’ unless the r2=0 or 1.

The coefficient of determination also explains that how well the regression line fits the statistical data. The closer the regression line to the points plotted on a scatter diagram, the more likely it explains all the variation and the farther the line from the points the lesser is the ability to explain the variance.

Management Notes

Properties of Correlation co-efficient

indiafreenotesby indiafreenotes0

The following are the main properties of correlation.

  1. Coefficient of Correlation lies between -1 and +1:

The coefficient of correlation cannot take value less than -1 or more than one +1. Symbolically,

-1<=r<= + 1 or | r | <1.

  1. Coefficients of Correlation are independent of Change of Origin:

This property reveals that if we subtract any constant from all the values of X and Y, it will not affect the coefficient of correlation.

  1. Coefficients of Correlation possess the property of symmetry:

The degree of relationship between two variables is symmetric as shown below:

  1. Coefficient of Correlation is independent of Change of Scale:

This property reveals that if we divide or multiply all the values of X and Y, it will not affect the coefficient of correlation.

  1. Co-efficient of correlation measures only linear correlation between X and Y.
  2. If two variables X and Y are independent, coefficient of correlation between them will be zero.

Karl Pearson’s Coefficient of Correlation is widely used mathematical method wherein the numerical expression is used to calculate the degree and direction of the relationship between linear related variables.

Pearson’s method, popularly known as a Pearsonian Coefficient of Correlation, is the most extensively used quantitative methods in practice. The coefficient of correlation is denoted by “r”.

If the relationship between two variables X and Y is to be ascertained, then the following formula is used:

Properties of Coefficient of Correlation

  • The value of the coefficient of correlation (r) always lies between±1. Such as:
    r=+1, perfect positive correlation
    r=-1, perfect negative correlation
    r=0, no correlation
  • The coefficient of correlation is independent of the origin and scale.By origin, it means subtracting any non-zero constant from the given value of X and Y the vale of “r” remains unchanged. By scale it means, there is no effect on the value of “r” if the value of X and Y is divided or multiplied by any constant.
  • The coefficient of correlation is a geometric mean of two regression coefficient.Symbolically it is represented as:
  • The coefficient of correlation is “zero”when the variables X and Y are independent. But, however, the converse is not true.

Assumptions of Karl Pearson’s Coefficient of Correlation

  1. The relationship between the variables is “Linear”,which means when the two variables are plotted, a straight line is formed by the points plotted.
  2. There are a large number of independent causes that affect the variables under study so as to form a Normal Distribution. Such as, variables like price, demand, supply, etc. are affected by such factors that the normal distribution is formed.
  3. The variables are independent of each other.

Note: The coefficient of correlation measures not only the magnitude of correlation but also tells the direction. Such as, r = -0.67, which shows correlation is negative because the sign is “-“and the magnitude is 0.67.

error: Content is protected !!