{"id":502,"date":"2024-10-18T02:10:58","date_gmt":"2024-10-18T02:10:58","guid":{"rendered":"https:\/\/pressbooks.ccconline.org\/mat1260\/?post_type=chapter&#038;p=502"},"modified":"2024-12-12T20:58:51","modified_gmt":"2024-12-12T20:58:51","slug":"4-2-probability-rules","status":"publish","type":"chapter","link":"https:\/\/pressbooks.ccconline.org\/mat1260\/chapter\/4-2-probability-rules\/","title":{"raw":"4.2: Probability Rules","rendered":"4.2: Probability Rules"},"content":{"raw":"<div class=\"\">\r\n<h2 class=\"textbox__header\">Basic Probability Rules<\/h2>\r\n<\/div>\r\n<div class=\"section\">\r\n<div class=\"sectionContain\">\r\n<div class=\"textbox textbox--learning-objectives\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Learning Objectives<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<ul>\r\n \t<li>Apply probability rules in order to find the likelihood of an event.<\/li>\r\n \t<li>When appropriate, use tools such as Venn diagrams or probability tables as aids for finding probabilities.<\/li>\r\n<\/ul>\r\n<\/div>\r\n<\/div>\r\nIn the previous section we considered situations in which all the possible outcomes of a random experiment are equally likely, and learned a simple way to find the probability of any event in this special case. We are now moving on to learn how to find the probability of events in the general case (when the possible outcomes are not necessarily equally likely), using five basic probability rules. Fortunately, these basic rules of probability are very intuitive, and as long as they are applied systematically, they will let us solve more complicated problems; in particular, those problems for which our intuition might be inadequate.\r\n\r\n<\/div>\r\n<\/div>\r\n<table id=\"N10B05_bx\" class=\"theorem labeled\">\r\n<thead>\r\n<tr>\r\n<th>\r\n<h5>Rule 1<\/h5>\r\n<\/th>\r\n<\/tr>\r\n<\/thead>\r\n<tbody>\r\n<tr>\r\n<td>\r\n<div class=\"theorem\">\r\n<div class=\"statement\">\r\n\r\n<em>For any event A, 0 \u2264 P(A) \u2264 1.<\/em>\r\n\r\n<\/div>\r\n<\/div><\/td>\r\n<\/tr>\r\n<\/tbody>\r\n<\/table>\r\nThis first rule simply reminds us of the basic property of probability that we\u2019ve already learned. The probability of an event, which informs us of the likelihood of it occurring, can range anywhere from 0 (indicating that the event will never occur) to 1 (indicating that the event is certain). One practical use of this rule is that is can be used to identify any probability calculation that comes out to be more than 1 as wrong.\r\n\r\nBefore moving on to the other rules, let\u2019s first look at an example that will provide a context for illustrating the next several rules.\r\n<div class=\"examplewrap\">\r\n<div class=\"example clearfix\">\r\n<div class=\"textbox textbox--examples\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Example<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<div class=\"examplewrap\">\r\n<div class=\"example clearfix\">\r\n\r\nAs previously discussed, all human blood can be typed as O, A, B or AB. In addition, the frequency of the occurrence of these blood types varies by ethnic and racial groups. According to Stanford University\u2019s Blood Center (<a href=\"http:\/\/bloodcenter.stanford.edu\/\" target=\"_blank\" rel=\"noopener\">bloodcenter.stanford.edu<\/a>), these are the probabilities of human blood types in the United States (the probability for type A has been omitted on purpose):\r\n\r\n<span class=\"imagewrap\"><span class=\"image\"><img class=\"img-responsive popimg aligncenter\" title=\"Data given in &quot;Blood Type: Probability&quot; Format: O: 0.44; A: ?; B: 0.10; AB: 0.04;\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image010.gif\" alt=\"Data given in &quot;Blood Type: Probability&quot; Format: O: 0.44; A: ?; B: 0.10; AB: 0.04;\" \/><\/span><\/span>\r\n\r\n<em>Motivating question for rule 2:<\/em>\u00a0A person in the United States is chosen at random. What is the probability of the person having blood type A?\r\n\r\n<em>Answer:<\/em>\u00a0Our intuition tells us that since the four blood types O, A, B, and AB exhaust all the possibilities, their probabilities together must sum to 1, which is the probability of a \u201ccertain\u201d event (a person has one of these 4 blood types for certain). Since the probabilities of O, B, and AB together sum to .44 + .1 + .04 = .58, the probability of type A must be the remaining .42 (1 \u2013 .58 = .42):\r\n\r\n<span class=\"imagewrap\"><span class=\"image\"><img class=\"img-responsive popimg aligncenter\" title=\"Data given in &quot;Blood Type: Probability&quot; Format: O: 0.44; A: 0.42; B: 0.10; AB: 0.04;\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image011.gif\" alt=\"Data given in &quot;Blood Type: Probability&quot; Format: O: 0.44; A: 0.42; B: 0.10; AB: 0.04;\" \/><\/span><\/span>\r\n\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\nThis example illustrates our second rule, which tells us that the probability of all outcomes in the sample space together must be 1.\r\n<table id=\"N10B42_bx\" class=\"theorem labeled\">\r\n<thead>\r\n<tr>\r\n<th>\r\n<h5>Rule 2<\/h5>\r\n<\/th>\r\n<\/tr>\r\n<\/thead>\r\n<tbody>\r\n<tr>\r\n<td>\r\n<div class=\"theorem\">\r\n<div class=\"statement\">\r\n<p id=\"N10B49\"><em>P(S) = 1; that is, the sum of the probabilities of all possible outcomes is 1.<\/em><\/p>\r\n\r\n<\/div>\r\n<\/div><\/td>\r\n<\/tr>\r\n<\/tbody>\r\n<\/table>\r\n<h2>Comment<\/h2>\r\n<\/div>\r\n<\/div>\r\n<div id=\"N10B4F\" class=\"section\">\r\n<div class=\"sectionContain\">\r\n\r\nThis is a good place to compare and contrast what we\u2019re doing here with what we learned in the Exploratory Data Analysis (EDA) section. Notice that in this problem we are essentially focusing on a single categorical variable: blood type. We summarized this variable above, as we summarized single categorical variables in the EDA section, by listing what values the variable takes and how often it takes them. In EDA we used percentages, and here we\u2019re using probabilities, but the two convey the same information. In the EDA section, we learned that a pie chart provides an appropriate display when a single categorical variable is involved, and similarly we can use it here (using percentages instead of probabilities):\r\n\r\n<span class=\"imagewrap\"><span class=\"image\"><img class=\"img-responsive popimg aligncenter\" title=\"A pie chart, titled &quot;Blood Types.&quot; Type O takes up 44% of the pie chart, A uses 42%, AB represents 4%, and B represents the rest, 10%.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image012.gif\" alt=\"A pie chart, titled &quot;Blood Types.&quot; Type O takes up 44% of the pie chart, A uses 42%, AB represents 4%, and B represents the rest, 10%.\" \/><\/span><\/span>\r\n<p id=\"N10B5F\">Even though what we\u2019re doing here is indeed similar to what we\u2019ve done in the EDA section, there is a subtle but important difference between the underlying situations in this section and the ones in the Exploratory Data Analysis section. In EDA, we summarized data that were obtained from a\u00a0<em>sample<\/em>\u00a0of individuals for whom values of the variable of interest were recorded. Here, when we present the frequency, or probability, of each blood type, we have in mind the entire\u00a0<em>population<\/em>\u00a0of people in the United States, for which we are presuming to know the overall frequency of values taken by the variable of interest.<\/p>\r\n\r\n<div class=\"textbox textbox--exercises\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<p id=\"N1006E\"  >Marital status can be categorized into: never married, married, widowedor divorced.<\/p>\r\n<p id=\"N10070\"  >According to Infoplease.com, the following are the probabilities of those marital status categories for adults in the United States (data from 2000):<\/p>\r\n\r\n<div class=\"image shouldbeleft\"><img id=\"N10072\" class=\"img-responsive popimg aligncenter\" title=\"\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/dig012.gif\" alt=\"\" \/><\/div>\r\n<div><\/div>\r\n<div>[h5p id=\"63\"]<\/div>\r\n<\/div>\r\n<\/div>\r\nLet\u2019s move on to rule 3. In probability and in its applications, we are frequently interested in finding out the probability that a certain event will\u00a0<em>not<\/em>\u00a0occur. An important point to understand here is that \u201cevent A does not occur\u201d is\u00a0<em>a separate event<\/em>\u00a0that consists of all the outcomes in the sample space S that are not in A. It is for this reason that the event \u201cevent A does not occur\u201d is called\u00a0<em class=\"bold\">\u201cthe complement event of A,\u201d<\/em>\u00a0since it compares event A to the whole sample space. Notation: we will write\u00a0<em>\u201cnot A\u201d<\/em>\u00a0to denote the event that A does\u00a0<em>not<\/em>\u00a0occur. Here is a visual representation of how event A and its complement event \u201cnot A\u201d together represent the whole sample space.\r\n\r\n<span class=\"imagewrap\"><span class=\"image\"><img class=\"img-responsive popimg aligncenter\" title=\"The entire sample space S is represented with a gray box. Inside of this box is a blue circle, representing all outcomes in A. Everything else in the gray box but outside of the blue circle is &quot;not A&quot;.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image013.gif\" alt=\"The entire sample space S is represented with a gray box. Inside of this box is a blue circle, representing all outcomes in A. Everything else in the gray box but outside of the blue circle is &quot;not A&quot;.\" \/><\/span><\/span>\r\n<div class=\"section\">\r\n<div class=\"sectionContain\">\r\n<h2><span title=\"Quick scroll up\">Comment<\/span><\/h2>\r\nSuch a visual display is called a \u201cVenn diagram.\u201d A Venn diagram is a simple way to visualize events and the relationships between them using rectangles and circles. We will use Venn diagrams throughout this module.\r\n\r\n<\/div>\r\n<\/div>\r\nRule 3 deals with the relationship between the probability of an event and the probability of its complement event. Given that event A and event \u201cnot A\u201d together make up the whole sample space S, and since rule 2 tells us that P(S) = 1, the following rule should be quite intuitive:\r\n<table id=\"N10B31_bx\" class=\"theorem labeled\">\r\n<thead>\r\n<tr>\r\n<th>\r\n<h5>Rule 3: The Complement Rule<\/h5>\r\n<\/th>\r\n<\/tr>\r\n<\/thead>\r\n<tbody>\r\n<tr>\r\n<td>\r\n<div class=\"theorem\">\r\n<div class=\"statement\">\r\n<p id=\"N10B39\"><em>P(not A) = 1 \u2013 P(A); that is, the probability that an event does not occur is 1 minus the probability that it does occur.<\/em><\/p>\r\n\r\n<\/div>\r\n<\/div><\/td>\r\n<\/tr>\r\n<\/tbody>\r\n<\/table>\r\n<div class=\"examplewrap\">\r\n<div class=\"example clearfix\">\r\n<div class=\"textbox textbox--examples\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Example<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<p id=\"N10B43\">Back to the blood type example:<\/p>\r\n<span class=\"imagewrap\"><span class=\"image\"><img class=\"img-responsive popimg aligncenter\" title=\"Data given in &quot;Blood Type: Probability&quot; Format: O: 0.44; A: 0.42; B: 0.10; AB: 0.04;\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image011.gif\" alt=\"Data given in &quot;Blood Type: Probability&quot; Format: O: 0.44; A: 0.42; B: 0.10; AB: 0.04;\" \/><\/span><\/span>\r\n\r\nHere is some additional information:\r\n<ul>\r\n \t<li>A person with type\u00a0<em>A<\/em>\u00a0can donate blood to a person with type\u00a0<em>A<\/em>\u00a0or\u00a0<em>AB<\/em>.<\/li>\r\n \t<li>A person with type\u00a0<em>B<\/em>\u00a0can donate blood to a person with type\u00a0<em>B<\/em>\u00a0or\u00a0<em>AB<\/em>.<\/li>\r\n \t<li>A person with type\u00a0<em>AB<\/em>\u00a0can donate blood to a person with type\u00a0<em>AB<\/em>\u00a0only.<\/li>\r\n \t<li>A person with type\u00a0<em>O<\/em>\u00a0blood can donate to anyone.<\/li>\r\n<\/ul>\r\nWhat is the probability that a randomly chosen person cannot donate blood to everyone? In other words, what is the probability that a randomly chosen person does not have blood type O? We need to find P(not O). Using the Complement Rule, P(not O) = 1 \u2013 P(O) = 1 \u2013 .44 = .56. In other words, 56% of the U.S. population does not have blood type O:\r\n\r\n<span class=\"imagewrap\"><span class=\"image\"><img class=\"img-responsive popimg aligncenter\" title=\"A pie chart, titled &quot;Blood Types.&quot; Type O takes up 44% of the pie chart, A uses 42%, AB represents 4%, and B represents the rest, 10%. Note that the types of blood which are &quot;not O&quot; take up 56% of the pie chart.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image014.gif\" alt=\"A pie chart, titled &quot;Blood Types.&quot; Type O takes up 44% of the pie chart, A uses 42%, AB represents 4%, and B represents the rest, 10%. Note that the types of blood which are &quot;not O&quot; take up 56% of the pie chart.\" \/><\/span><\/span>\r\n\r\n<\/div>\r\n<\/div>\r\n<h2>Comment<\/h2>\r\n<\/div>\r\n<\/div>\r\n<div id=\"N10B83\" class=\"section\">\r\n<div class=\"sectionContain\">\r\n<p id=\"N10B8A\">Note that the Complement Rule,\u00a0<em>P(not A) = 1 \u2013 P(A)\u00a0<\/em>can be re-formulated as\u00a0<em>P(A) = 1 \u2013 P(not A).\u00a0<\/em>This seemingly trivial algebraic manipulation has an important application, and actually captures the strength of the complement rule. In some cases, when finding P(A) directly is very complicated, it might be much easier to find P(not A) and then just subtract it from 1 to get the desired P(A). We will come back to this comment and see examples later in this module.<\/p>\r\n\r\n<div class=\"textbox textbox--exercises\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<p id=\"N10B9F\"  >On the \"Information for the Patient\" label of a certain antidepressant it is claimed that based on some clinical trials, when taking this medication<\/p>\r\n<p id=\"N10BA2\"  >- there is a 14% chance of experiencing sleeping problems, or insomnia (denote this event by I)<\/p>\r\n<p id=\"N10BA5\"  >- there is a 26% chance of experiencing headaches (denote this event by H), and<\/p>\r\n<p id=\"N10BA8\"  >- there is a 35% chance of experiencing at least one of these two side effects (denote this event by L)<\/p>\r\n<p  >[h5p id=\"64\"]<\/p>\r\n\r\n<\/div>\r\n<\/div>\r\n\r\n<hr \/>\r\n\r\nWe are now moving to rule 4, which deals with another situation of frequent interest, finding P(A\u00a0<em>or<\/em>\u00a0B), the probability of one event\u00a0<em>or<\/em>\u00a0another occurring. Before we get to the actual rule, however, we need some clarifications and definitions.\r\n\r\nWhen a parent says to his or her child in a toy store \u201cDo you want toy A or toy B?\u201d, this means that the child is going to get only one toy and he or she has to choose between them. Getting both toys is usually not an option.\r\n\r\nIn contrast,\r\n\r\n<em>In probability, \u201cOR\u201d means either one or the other or both.<\/em>\r\n<p id=\"N10B1E\">and so,<\/p>\r\n<p id=\"N10B21\"><em>P(A or B) = P(event A occurs or event B occurs or both occur)<\/em><\/p>\r\nHaving said that, it should be noted that there are some cases where it is simply impossible for the two events to both occur at the same time, in which case we don\u2019t have to worry about the possibility that both occur when we try to find P(A or B). The distinction between events that can happen together and those that cannot is an important one.\r\n<p id=\"N10B2A\">Here are two examples:<\/p>\r\n\r\n<div class=\"examplewrap\">\r\n<div class=\"example clearfix\">\r\n<div class=\"textbox textbox--examples\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Example<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n\r\nConsider the following two events:\r\n\r\nA\u2014a randomly chosen person has blood type A, and\r\n\r\nB\u2014a randomly chosen person has blood type B.\r\n\r\nIn rare cases, it is possible for a person to have more than one type of blood flowing through his or her veins, but for our purposes, we are going to assume that each person can have only one blood type. Therefore, it is impossible for the events A and B to occur together.\r\n\r\n<\/div>\r\n<\/div>\r\nOn the other hand \u2026\r\n\r\n<\/div>\r\n<\/div>\r\n<div class=\"examplewrap\">\r\n<div class=\"example clearfix\">\r\n<div class=\"textbox textbox--examples\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Example<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<div class=\"examplewrap\">\r\n<div class=\"example clearfix\">\r\n<div>\r\n\r\nConsider the following two events:\r\n\r\nA\u2014a randomly chosen person has blood type A\r\n\r\nB\u2014a randomly chosen person is a woman.\r\n\r\nIn this case, it\u00a0<em>is possible<\/em>\u00a0for events A and B to occur together.\r\n<p id=\"N10B50\"><em>Definition:<\/em>\u00a0Two events that cannot occur at the same time are called\u00a0<em>disjoint<\/em>\u00a0or\u00a0<em>mutually exclusive.<\/em>\u00a0(We will use disjoint.)<\/p>\r\nWe can therefore say that in the first example events A and B are disjoint, and in the second example they are not disjoint. Using Venn diagrams, we can visualize two events that are disjoint and compare them to two events that are not:\r\n\r\n<span class=\"imagewrap\"><span class=\"image\"><img class=\"img-responsive popimg aligncenter\" title=\"A Venn diagram titled &quot;A and B are Disjoint.&quot; The entire sample space is represented as a rectangle. Inside the rectangle are two separate circles. One circle represents the events in A and the other represents the events in B.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image015.gif\" alt=\"A Venn diagram titled &quot;A and B are Disjoint.&quot; The entire sample space is represented as a rectangle. Inside the rectangle are two separate circles. One circle represents the events in A and the other represents the events in B.\" \/><\/span><\/span><span class=\"imagewrap\"><span class=\"image\"><img class=\"img-responsive popimg aligncenter\" title=\"A Venn diagram titled &quot;A and B are NOT Disjoint.&quot; The entire sample space is represented as a rectangle. Inside the rectangle are two circles. One circle represents the occurrences in A and the other represents the occurrences in B. These two are not disjoint, so the two circles partially overlap each other. (Being NOT disjoint, two circles could overlap each other completely, but in this example they do not.)\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image016.gif\" alt=\"A Venn diagram titled &quot;A and B are NOT Disjoint.&quot; The entire sample space is represented as a rectangle. Inside the rectangle are two circles. One circle represents the occurrences in A and the other represents the occurrences in B. These two are not disjoint, so the two circles partially overlap each other. (Being NOT disjoint, two circles could overlap each other completely, but in this example they do not.)\" \/><\/span><\/span>\r\n\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<p id=\"N10B6C\">The Venn diagrams suggest that another way to think about disjoint versus not disjoint events is that disjoint events\u00a0<em>do not overlap<\/em>. They do not share any of the possible outcomes, and therefore cannot happen together. On the other hand, events that are not disjoint are overlapping in the sense that they share some of the possible outcomes and therefore can occur at the same time.<\/p>\r\n\r\n<\/div>\r\n<\/div>\r\n<div class=\"textbox textbox--exercises\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<p id=\"N10B7F\"  >Recall the couple that is planning to have 3 children, where the sample space S of all possible outcomes is:<\/p>\r\n<p id=\"N10B82\"  >S={BBB, BBG, BGB, GBB, GGB, GBG, BGG, GGG}<\/p>\r\n<p  ><span style=\"text-align: initial; font-size: 1em; word-spacing: normal;\">Consider the following two events:<\/span><\/p>\r\n<p id=\"N10072\"  >A\u2014the middle child is a girl<\/p>\r\n<p id=\"N1007A\"  >C\u2014the three children are of the same gender<\/p>\r\n<p  ><img class=\"aligncenter\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/webcontent\/flash\/images\/lbd002.gif\" \/><\/p>\r\n\r\n<div class=\"asx \">\r\n<div id=\"du3_m1_rules3_tutor1\" class=\"activitywrap sectionNest flash\">\r\n<div class=\"activityhead\">\r\n<div class=\"activityinfo\"><\/div>\r\n<\/div>\r\n<div class=\"actContain\">\r\n<div class=\"activity flash\">\r\n<div id=\"u3_m1_rules3_tutor1\" class=\"flash_obj asx testFlash mark_flash\">\r\n<div id=\"ou3_m1_rules3_tutor1\" class=\"page 2963789\">\r\n<div id=\"2963789\" class=\"question\">\r\n<div>\r\n<p  >[h5p id=\"65\"]<\/p>\r\n\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<div class=\"textbox textbox--exercises\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<div>\r\n<p id=\"N1006F\">A couple decides to have children until they have one boy and one girl, but they will not have more than three children. The sample space of possible outcomes is S = {GB, BG, BBG, GGB, BBB, GGG}.<\/p>\r\n<p id=\"N10072\">Consider the following events:<\/p>\r\n<p id=\"N10075\">A\u2013the couple has one boy<\/p>\r\nC\u2013the couple has three children\r\n<p id=\"N1007B\">D\u2013all of the children are the same gender<\/p>\r\n<p id=\"N1007E\">Determine if the following pairs of events are disjoint.<\/p>\r\n\r\n<\/div>\r\n<div id=\"2963832\" class=\"question ddfb\">\r\n<div><\/div>\r\n<\/div>\r\n<div id=\"2963834\" class=\"question ddfb\">\r\n<div>\r\n<p id=\"N1009F\">[h5p id=\"66\"]<\/p>\r\n\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\nNow that we understand the idea of disjoint events, we can finally get to rule 4. Rule 4 actually has two versions, one for finding P(A or B) in the special case when events A and B are disjoint, and a more general version for when the events are not necessarily disjoint. We will first present the version of rule 4 that is restricted to disjoint events, and later in the module (after rule 5) we will revisit rule 4 and present the more general version.\r\n<table id=\"N10B19_bx\" class=\"theorem labeled\">\r\n<thead>\r\n<tr>\r\n<th>\r\n<h5>Rule 4: The Addition Rule for Disjoint Events<\/h5>\r\n<\/th>\r\n<\/tr>\r\n<\/thead>\r\n<tbody>\r\n<tr>\r\n<td>\r\n<div class=\"theorem\">\r\n<div class=\"statement\">\r\n\r\n<em>The Addition Rule for Disjoint Events: If A and B are disjoint events, then P(A or B) = P(A) + P(B).<\/em>\r\n\r\n<\/div>\r\n<\/div><\/td>\r\n<\/tr>\r\n<\/tbody>\r\n<\/table>\r\n<div class=\"section\">\r\n<div class=\"sectionContain\">\r\n<h2><span title=\"Quick scroll up\">Comment<\/span><\/h2>\r\nWhen dealing with probabilities, the word \u201cor\u201d will always be associated with the operation of addition; hence the name of this rule, \u201cThe Addition Rule.\u201d\r\n\r\n<\/div>\r\n<\/div>\r\n<div class=\"examplewrap\">\r\n<div class=\"example clearfix\">\r\n<div class=\"textbox textbox--examples\"><header class=\"textbox__header\">\r\n<h1 class=\"textbox__title\">Example<\/h1>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n\r\nRecall the blood type example:\r\n\r\n<span class=\"imagewrap\"><span class=\"image\"><img class=\"img-responsive popimg aligncenter\" title=\"Data given in &quot;Blood Type: Probability&quot; Format: O: 0.44; A: 0.42; B: 0.10; AB: 0.04;\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image011.gif\" alt=\"Data given in &quot;Blood Type: Probability&quot; Format: O: 0.44; A: 0.42; B: 0.10; AB: 0.04;\" \/><\/span><\/span>\r\n<p id=\"N10B40\">Here is some additional information:<\/p>\r\n* A person with type\u00a0<em>A<\/em>\u00a0can donate blood to a person with type\u00a0<em>A<\/em>\u00a0or\u00a0<em>AB.<\/em>\r\n\r\n* A person with type\u00a0<em>B<\/em>\u00a0can donate blood to a person with type\u00a0<em>B<\/em>\u00a0or\u00a0<em>AB.<\/em>\r\n\r\n* A person with type\u00a0<em>AB<\/em>\u00a0can donate blood to a person with type\u00a0<em>AB<\/em>\u00a0only.\r\n<p id=\"N10B64\">* A person with type\u00a0<em>O<\/em>\u00a0blood can donate to anyone.<\/p>\r\n<p id=\"N10B6A\">What is the probability that a randomly chosen person is a potential donor for a person with blood type A?<\/p>\r\nFrom the information given, we know that being a potential donor for a person with blood type A means having blood type A or O. We therefore need to find P(A or O). Since the events A and O are disjoint, we can use the addition rule for disjoint events to get: P(A or O) = P(A) + P(O) = .42 + .44 = .86. It is easy to see why adding the probability actually makes sense. If 42% of the population has blood type A and 44% of the population has blood type O, then 42% + 44% = 86% of the population has either blood type A or O, and thus are potential donors to a person with blood type A. This reasoning about why the addition rule makes sense can be visualized using the pie chart below:\r\n\r\n<span class=\"imagewrap\"><span class=\"image\"><img class=\"img-responsive popimg aligncenter\" title=\"A pie chart titled &quot;Blood Types.&quot; Type A takes up 42% of the pie chart, and type O takes up 44%. Together, as A or O, they take up 86% of the pie chart.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image017a.gif\" alt=\"A pie chart titled &quot;Blood Types.&quot; Type A takes up 42% of the pie chart, and type O takes up 44%. Together, as A or O, they take up 86% of the pie chart.\" \/><\/span><\/span>\r\n\r\n<\/div>\r\n<\/div>\r\n<div class=\"textbox textbox--exercises\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<p id=\"N1006E\"  >The probabilities in this table were calculated from data describing the highest level of educational attainment in 2005 for U.S. adults 25 years old or older. (Source: U.S. Census Bureau,\u00a0<em class=\"italic\"  >Current Population Survey<\/em>, March 2005)<\/p>\r\n\r\n<div class=\"image shouldbeleft\"><img id=\"N10074\" class=\"img-responsive popimg aligncenter\" title=\"table of probability of highest level of education attained\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/u3_m1_rules4_tutor5.png\" alt=\"table of probability of highest level of education attained\" \/><\/div>\r\n<div><\/div>\r\n<div>[h5p id=\"67\"]<\/div>\r\n<\/div>\r\n<\/div>\r\n<div class=\"textbox textbox--exercises\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Practice Activity<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<p id=\"N10BA0\"  >So far we have introduced the addition rule for the special case in which the events being considered are disjoint. The purpose of this activity is to make you aware of the danger in wrongly using the addition rule for disjoint events in cases where the events are actually not disjoint. Consider the blood type example again.<\/p>\r\n<p id=\"N10BA3\"  >Recall the blood type example:<\/p>\r\n\r\n<div class=\"image shouldbeleft\"><img id=\"_i_2\" class=\"img-responsive popimg aligncenter\" title=\"Data given in &quot;Blood Type: Probability&quot; Format: O: 0.44; A: 0.42; B: 0.10; AB: 0.04;\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/lbd004.gif\" alt=\"Data given in &quot;Blood Type: Probability&quot; Format: O: 0.44; A: 0.42; B: 0.10; AB: 0.04;\" \/><\/div>\r\n<p id=\"N10BAB\"  >with the following additional information:<\/p>\r\n<p id=\"N10BAE\"  >A person with type\u00a0<em  >A<\/em>\u00a0can donate blood to a person with type\u00a0<em  >A<\/em>\u00a0or\u00a0<em  >AB<\/em>.<\/p>\r\n<p id=\"N10BBA\"  >A person with type\u00a0<em  >B<\/em>\u00a0can donate blood to a person with type\u00a0<em  >B<\/em>\u00a0or\u00a0<em  >AB<\/em>.<\/p>\r\n<p id=\"N10BC6\"  >A person with type\u00a0<em  >AB<\/em>\u00a0can donate blood to a person with type\u00a0<em  >AB<\/em>\u00a0only.<\/p>\r\n<p id=\"N10BCF\"  >A person with type\u00a0<em  >O<\/em>\u00a0blood can donate to anyone.<\/p>\r\n<p id=\"N10BD5\"  >Suppose that there are two patients who are each in need of a blood donation. Patient 1 has blood type A and patient 2 has blood type B. Consider the following events:<\/p>\r\n<p id=\"N10BD8\"  >D1\u2014a randomly chosen person can be a donor for patient 1.<\/p>\r\n<p id=\"N10BDB\"  >D2\u2014a randomly chosen person can be a donor for patient 2.<\/p>\r\n<p id=\"N10BDE\"  >We are interested in finding the probability that a randomly chosen person can be a donor for patient 1 or patient 2. In other words, we are interested in finding P(D1 or D2).<\/p>\r\n<p  >[h5p id=\"68\"]<\/p>\r\n\r\n<\/div>\r\n<\/div>\r\nAs we mentioned earlier, later on in this module we will establish a more general Addition Rule that applies even when two events are not disjoint.\r\n\r\n<\/div>\r\n<\/div>\r\n<div class=\"asx\">\r\n<div id=\"du3_m1_rules4_tutor5\" class=\"activitywrap purpose didigetthis flash\">\r\n<div class=\"activityhead\">\r\n<div class=\"purposeType purposedidigetthis\" title=\"\">\r\n<div id=\"N10C43\" class=\"section\">\r\n<div class=\"sectionContain\">\r\n<h2><span title=\"Quick scroll up\">Comment<\/span><\/h2>\r\n<p id=\"N10C4A\">The Addition Rule for Disjoint Events can naturally be extended to more than two disjoint events. Let\u2019s take three, for example. If A, B, and C are three disjoint events,<\/p>\r\n<span class=\"imagewrap\"><span class=\"image\"><img class=\"img-responsive popimg aligncenter\" title=\"A Venn Diagram showing 3 disjoint events. As usual there is a gray box showing the entire sample space. Inside this gray box are three completely separate circles. The first circle is for the occurrences in A, the second for occurrences in B, and the third for occurrences in C.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image018.gif\" alt=\"A Venn Diagram showing 3 disjoint events. As usual there is a gray box showing the entire sample space. Inside this gray box are three completely separate circles. The first circle is for the occurrences in A, the second for occurrences in B, and the third for occurrences in C.\" \/><\/span><\/span>\r\n<p id=\"N10C53\">then P(A or B or C) = P(A) + P(B) + P(C). The rule is the same for any number of disjoint events.<\/p>\r\n\r\n<div class=\"textbox textbox--exercises\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<p id=\"N1006F\"  >The probabilities in this table were calculated from data describing North America\u2019s favorite car colors in 2003. (Source: DuPont Automotive as cited in money.cnn.com)<\/p>\r\n\r\n<div class=\"image shouldbeleft\"><img id=\"N10074\" class=\"img-responsive popimg aligncenter\" title=\"table showing car colors and their popularity\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/dig011.gif\" alt=\"table showing car colors and their popularity\" \/><\/div>\r\n<div><\/div>\r\n<div><\/div>\r\n<div>[h5p id=\"69\"]<\/div>\r\n<\/div>\r\n<\/div>\r\nWe are now done with the first version of the Addition Rule (the version restricted to disjoint events) and we are ready to move on to rule 5. As mentioned before, the general version of the Addition Rule will be presented after rule 5.\r\n\r\nRule 4, the addition rule, deals with finding P(A\u00a0<em>or<\/em>\u00a0B). We are now moving on to rule 5, which deals with yet another situation of frequent interest, finding P(A\u00a0<em>and<\/em>\u00a0B), the probability that both events A and B occur. In other words,\r\n\r\n<em>P(A and B) = P(event A occurs and event B occurs)<\/em>\r\n\r\nFor example, we might be interested in the probability that if two people are chosen at random, both the first has blood type O\u00a0<em>and<\/em>\u00a0the second has blood type O. Since a person with blood type O can donate blood to anyone, this probability might be of particular interest in this context.\r\n<p id=\"N10B26\">Using a Venn diagram, we can visualize \u201cA and B,\u201d which is represented by the overlap between events A and B:<\/p>\r\n<span class=\"imagewrap\"><span class=\"image\"><img class=\"img-responsive popimg aligncenter\" title=\"A rectangle represents the entire sample space. Inside this rectangle are two circles, one for the occurrences in A and one for the occurrences in B. These two circles partially overlap. The area in the overlap contains the ocurrences for A and B.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image019.gif\" alt=\"A rectangle represents the entire sample space. Inside this rectangle are two circles, one for the occurrences in A and one for the occurrences in B. These two circles partially overlap. The area in the overlap contains the ocurrences for A and B.\" \/><\/span><\/span>\r\n<div class=\"section\">\r\n<div class=\"sectionContain\">\r\n<h2><span title=\"Quick scroll up\">Comment<\/span><\/h2>\r\nThere is one special case for which we know what P(A and B) equals without applying any rule.\r\n<div class=\"textbox textbox--exercises\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n\r\n[h5p id=\"70\"]\r\n\r\n<\/div>\r\n<\/div>\r\nSo, if events\u00a0<strong><em class=\"bold\">A and B are disjoint<\/em><\/strong>, then (by definition)<strong>\u00a0<\/strong><em class=\"bold\"><strong>P(A and B)= 0<\/strong>.<\/em>\u00a0But what if the events are not disjoint?\r\n\r\nRecall that rule 4, the Addition Rule, has two versions. One is restricted to disjoint events, which we\u2019ve already covered, and we\u2019ll deal with the more general version later in this module. The same is true of rule 5. Rule 5 has two versions. The version we\u2019ll present here is restricted to a special case that we\u2019ll now discuss, and there is a more general version that we\u2019ll present in the next module.\r\n\r\nThe version of rule 5 that will be presented here applies to the special case in which the two events are\u00a0<em>independent<\/em>\u00a0of each other.\r\n<dl>\r\n \t<dd><strong>independent<\/strong><\/dd>\r\n \t<dd>\r\n<div class=\"meaning\">Two events A and B are said to be\u00a0<em>independent<\/em>\u00a0if the fact that one event has occurred\u00a0<em>does not affect<\/em>\u00a0the probability that the other event will occur. If whether or not one event occurs\u00a0<em>does affect<\/em>\u00a0the probability that the other event will occur, then the two events are said to be\u00a0<em>dependent.<\/em><\/div><\/dd>\r\n<\/dl>\r\n<p id=\"N10B8F\">Here are a few examples:<\/p>\r\n\r\n<div class=\"examplewrap\">\r\n<div class=\"example clearfix\">\r\n<div class=\"textbox textbox--examples\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Example<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n\r\nA woman\u2019s pocket contains two quarters and two nickels. She randomly extracts one of the coins and, after looking at it, replaces it before picking a second coin.\r\n<p id=\"N10B97\">Let Q1 be the event that the first coin is a quarter and Q2 be the event that the second coin is a quarter.<\/p>\r\n<p id=\"N10B9A\">Are Q1 and Q2 independent events?\u00a0<em>Yes.<\/em>\u00a0Why?<\/p>\r\n<p id=\"N10BA0\">Since the first coin that was selected is\u00a0<em>replaced<\/em>, whether or not Q1 occurred (i.e., whether the first coin was a quarter) has no effect on the probability that the second coin will be a quarter, P(Q2). In either case (whether Q1 occurred or not), when she is selecting the second coin, she has in her pocket:<\/p>\r\n<span class=\"imagewrap\"><span class=\"image\"><img class=\"img-responsive popimg aligncenter\" title=\"The coins in the woman's pocket. There are 2 Quarters and 2 Nickels.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image020.gif\" alt=\"The coins in the woman's pocket. There are 2 Quarters and 2 Nickels.\" \/><\/span><\/span>\r\n<p id=\"N10BAC\">and therefore the P(Q2) = 2\/4 = 1\/2 regardless of whether Q1 occurred.<\/p>\r\n\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<div class=\"examplewrap\">\r\n<div class=\"example clearfix\">\r\n<div class=\"textbox textbox--examples\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Example<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<p id=\"N10BB2\">A woman\u2019s pocket contains two quarters and two nickels. She randomly extracts one of the coins, and\u00a0<em>without placing<\/em>\u00a0it back into her pocket, she picks a second coin. As before, let Q1 be the event that the first coin is a quarter, and Q2 be the event that the second coin is a quarter.<\/p>\r\nAre Q1 and Q2 independent events?\u00a0<em>No.<\/em>\u00a0Q1 and Q2 are\u00a0<em>not independent<\/em>. They are\u00a0<em>dependent.<\/em>\u00a0Why?\r\n<p id=\"N10BC4\">Since the first coin that was selected is\u00a0<em>not replaced,<\/em>\u00a0whether Q1 occurred (i.e., whether the first coin was a quarter)\u00a0<em>does affect<\/em>\u00a0the probability that the second coin is a quarter, P(Q2).<\/p>\r\n<p id=\"N10BCD\">If Q1 occurred (i.e., the first coin was a quarter), then when the woman is selecting the second coin, she has in her pocket:<\/p>\r\n<span class=\"imagewrap\"><span class=\"image\"><img class=\"img-responsive popimg aligncenter\" title=\"One Quarter and Two Nickels\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image021.gif\" alt=\"One Quarter and Two Nickels\" \/><\/span><\/span>\r\n<p id=\"N10BD6\">In this case, P(Q2) = 1\/3. However, if Q1 has not occurred (i.e., the first coin was not a quarter, but a nickel), then when the woman is selecting the second coin, she has in her pocket:<\/p>\r\n<span class=\"imagewrap\"><span class=\"image\"><img class=\"img-responsive popimg aligncenter\" title=\"Two Quarters and One Nickel.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image022.gif\" alt=\"Two Quarters and One Nickel.\" \/><\/span><\/span>\r\n<p id=\"N10BDF\">In this case, P(Q2) = 2\/3.<\/p>\r\n\r\n<\/div>\r\n<\/div>\r\n<p id=\"N10BE2\">In these last two examples, we could actually have done some calculation in order to check whether or not the two events are independent or not. Sometimes we can just use common sense to guide us as to whether two events are independent. Here is an example.<\/p>\r\n\r\n<\/div>\r\n<\/div>\r\n<div class=\"examplewrap\">\r\n<div class=\"exHead\">\r\n<div class=\"textbox textbox--examples\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Example<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<div class=\"exHead\">A family has 4 children, two of whom are selected at random. Let B1 be the event that one child has blue eyes, and B2 be the event that the other chosen child has blue eyes. In this case, B1 and B2 are not independent, since we know that eye color is hereditary, so whether or not one child is blue-eyed will increase or decrease the chances that the other child has blue eyes, respectively.<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<div class=\"examplewrap\">\r\n<div class=\"example clearfix\">\r\n<div class=\"textbox textbox--examples\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Example<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">Two people are selected at random from all people in the United States. Let B1 be the event that one of the people has blue eyes and B2 be the event that the other person has blue eyes. In this case, since they were chosen at random, whether one of them has blue eyes has no effect on the likelihood that the other one has blue eyes, and therefore B1 and B2 are independent. On the other hand \u2026<\/div>\r\n<\/div>\r\n<h4><em class=\"bold\">Note:<\/em><\/h4>\r\n<\/div>\r\n<\/div>\r\n<p id=\"N10BF7\">We can generalize what we learned in the last example and say that when two individuals are selected at random from a large population (like in the example, the entire U.S.) any event associated with one individual is independent of any event associated with the other individual. The fact that the two are chosen from a large population is key to the independence.<\/p>\r\n<p id=\"N10BFA\">If we were to change the example to: There are 10 people in a room, 4 of which have blue eyes. Two people are chosen at random. Let B1 be the event that the first person has blue eyes and let B2 be the event that the second person has blue eyes. In this case, since the two are chosen from a group of only 10 (rather than a large population) the events B1 and B2 are not independent. Clearly, whether or not the first person has blue eyes (i.e., whether or not B1 occurs) does have an effect on whether B2 occurs. You will get more practice on this point in the activities below the next comment.<\/p>\r\n\r\n<div id=\"N10BFD\" class=\"section\">\r\n<div class=\"sectionContain\">\r\n<h2><span title=\"Quick scroll up\">Comment<\/span><\/h2>\r\n<p id=\"N10C04\">It is quite common for students to initially get confused about the distinction between the idea of\u00a0<em>disjoint events<\/em>\u00a0and the idea of\u00a0<em>independent events<\/em>. The purpose of this comment (and the activity that follows it) is to help students develop more understanding about these very different ideas.<\/p>\r\n<p id=\"N10C0D\">The idea of\u00a0<em>disjoint events<\/em>\u00a0is about whether or not it is possible for the events to occur at the same time (see the examples on page 3 of the Probability Rules section).<\/p>\r\n<p id=\"N10C13\">The idea of\u00a0<em>independent events<\/em>\u00a0is about whether or not the events affect each other in the sense that the occurrence of one event affects the probability of the occurrence of the other (see the examples above).<\/p>\r\n<p id=\"N10C19\">The following activity deals with the distinction between these concepts.<\/p>\r\n\r\n<\/div>\r\n<\/div>\r\n<p id=\"N10C20\">The purpose of this activity is to help you strengthen your understanding about the concepts of disjoint events and independent events, and the distinction between them.<\/p>\r\n\r\n<div class=\"textbox textbox--exercises\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Activity<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<p id=\"N10C2A\">In the following questions, you are presented with a random experiment and two events related to it. You are asked to decide whether the events are disjoint or not, and whether the events are independent or not.<\/p>\r\n\r\n<div class=\"asx\">\r\n<div id=\"du3_m1_rules5_tutor2\" class=\"activitywrap sectionNest flash\">\r\n<div class=\"activityhead\">\r\n<div class=\"activityinfo\"><\/div>\r\n<\/div>\r\n<div class=\"actContain\">\r\n<div class=\"activity flash\">\r\n<div id=\"u3_m1_rules5_tutor2\" class=\"flash_obj asx testFlash mark_flash\">\r\n<div id=\"ou3_m1_rules5_tutor2\" class=\"page 2963496\">\r\n<div id=\"2963496\" class=\"question ddfb\">\r\n<div>\r\n\r\nTwo people are selected simultaneously and at random from a very large population, and their blood type is checked.\r\n\r\n<span class=\"B\"><span class=\"component\">[h5p id=\"71\"]<\/span><\/span>\r\n\r\n<\/div>\r\n<\/div>\r\n<span style=\"color: #ff0000;\">THERE ARE TWO QUESTIONS MISSING THAT RELATE TO EXAMPLES 2 and 3<\/span>\r\n\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<p id=\"N10C56\">Let\u2019s summarize the three parts of the activity:<\/p>\r\n\r\n<ul>\r\n \t<li>In Example 1: A and B are\u00a0<em class=\"bold\">not disjoint<\/em>\u00a0and\u00a0<em class=\"bold\">independent<\/em><\/li>\r\n \t<li>In Example 2: A and B are\u00a0<em class=\"bold\">not disjoint<\/em>\u00a0and\u00a0<em class=\"bold\">not independent<\/em><\/li>\r\n \t<li>In Example 3: A and B are\u00a0<em class=\"bold\">disjoint<\/em>\u00a0and\u00a0<em class=\"bold\">not independent<\/em>.<\/li>\r\n<\/ul>\r\n<p id=\"N10C7B\">Why did we leave out the case when the events are disjoint and independent? The reason is that this case DOES NOT EXIST!<\/p>\r\n\r\n<table class=\"wbtable\">\r\n<tbody>\r\n<tr class=\"e\">\r\n<td><\/td>\r\n<td><em class=\"bold\">A and B Independent<\/em><\/td>\r\n<td><em class=\"bold\">A and B Not Independent<\/em><\/td>\r\n<\/tr>\r\n<tr>\r\n<td><em class=\"bold\">A and B Disjoint<\/em><\/td>\r\n<td><span style=\"background-color: #ffff00;\"><em class=\"highlight\">DOES NOT EXIST<\/em><\/span><\/td>\r\n<td>Example 3<\/td>\r\n<\/tr>\r\n<tr class=\"e\">\r\n<td><em class=\"bold\">A and B Not Disjoint<\/em><\/td>\r\n<td>Example 1<\/td>\r\n<td>Example 2<\/td>\r\n<\/tr>\r\n<\/tbody>\r\n<\/table>\r\n<p id=\"N10CAA\">If events are\u00a0<em class=\"bold\">disjoint<\/em>\u00a0then they\u00a0<em class=\"bold\">must be not independent (dependent)<\/em><\/p>\r\n<p id=\"N10CB4\">Why is that?<\/p>\r\n<p id=\"N10CB7\">Recall: A and B disjoint means that they cannot happen together. In other words, A and B disjoint implies that if event A occurs then B does not and vice versa. Well\u2026 if that\u2019s the case, knowing that event A has occurred dramatically changes the likelihood that event B occurs \u2013 that likelihood is\u00a0<span id=\"MathJax-Element-1-Frame\" class=\"mjx-chtml MathJax_CHTML\"><span id=\"MJXc-Node-1\" class=\"mjx-math\"><span id=\"MJXc-Node-2\" class=\"mjx-mrow\"><span id=\"MJXc-Node-3\" class=\"mjx-mrow\"><span id=\"MJXc-Node-4\" class=\"mjx-mn\"><span class=\"mjx-char MJXc-TeX-main-R\">0<\/span><\/span><\/span><\/span><\/span><\/span>. This implies that A and B are not independent.<\/p>\r\n\r\n<div class=\"textbox textbox--exercises\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<div class=\"asx\">\r\n<div id=\"du3_m1_rules5_tutor4\" class=\"activitywrap sectionNest flash\">\r\n<div class=\"actContain\">\r\n<div class=\"activity flash\">\r\n<div id=\"u3_m1_rules5_tutor4\" class=\"flash_obj asx testFlash mark_flash\">\r\n<div id=\"ou3_m1_rules5_tutor4\" class=\"page 2963337 2963338\">\r\n<div id=\"2963337\" class=\"question ddfb\">\r\n<div>\r\n\r\nRoughly 7% of American males in U.S. have some sort of color blindness.\r\n\r\nSuppose that a medical researcher selects one American male at random.\r\n\r\n<em class=\"bold\">Let A represent the event \u2019the selected male is color blind\u2019.<\/em>\r\n<p id=\"N10076\"><em class=\"bold\">Let B represent the event \u2019the selected male is not color blind\u2019.<\/em><\/p>\r\n<p id=\"N1007A\">Determine whether A and B are disjoint or independent.<\/p>\r\n\r\n<\/div>\r\n<\/div>\r\n<div id=\"2963338\" class=\"question ddfb\">\r\n<div>\r\n<p id=\"N10088\">[h5p id=\"72\"]<\/p>\r\n\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<div id=\"pagecontrols-5618fe3d0a0001dc5ef000e03fb742b6\" class=\"pageControls clearfix\"><\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<div class=\"asx\">\r\n<div id=\"du3_m1_rules5_tutor5\" class=\"activitywrap sectionNest flash\">\r\n<div class=\"actContain\">\r\n<div class=\"activity flash\">\r\n<div id=\"u3_m1_rules5_tutor5\" class=\"flash_obj asx testFlash mark_flash\">\r\n<div id=\"ou3_m1_rules5_tutor5\" class=\"page 2963361 2963362\">\r\n<div id=\"2963361\" class=\"question ddfb\">\r\n<div>\r\n\r\nNow, suppose the medical researcher selects two American males at random.\r\n\r\n<em class=\"bold\">Let A represent the event \u201cthe first male is color blind.\u201d<\/em>\r\n\r\n<em class=\"bold\">Let B represent the event \u201cthe second male is not colorblind.\u201d<\/em>\r\n\r\nDetermine whether A and B are disjoint or independent.\r\n\r\n<\/div>\r\n<\/div>\r\n<div id=\"2963362\" class=\"question ddfb\">\r\n<div>\r\n<p id=\"N10086\">[h5p id=\"73\"]<\/p>\r\n\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\nNow that we understand the idea of independent events, we can finally get to rule 5. As mentioned before, Rule 5 actually has two versions, one for finding P(A and B) in the special case in which the events A and B are independent, and a more general version for use when the events are not necessarily independent. We will first present the version of rule 5 that is restricted to independent events, and in the next section we will revisit Rule 5 and present the more general version.\r\n<table class=\"theorem labeled\">\r\n<thead>\r\n<tr>\r\n<th>\r\n<h5>Rule 5: The Multiplication Rule for Independent Events<\/h5>\r\n<\/th>\r\n<\/tr>\r\n<\/thead>\r\n<tbody>\r\n<tr>\r\n<td>\r\n<div class=\"theorem\">\r\n<div class=\"statement\">\r\n\r\n<em>If A and B are two independent events, then P(A and B) = P(A) * P(B).<\/em>\r\n\r\n<\/div>\r\n<\/div><\/td>\r\n<\/tr>\r\n<\/tbody>\r\n<\/table>\r\n<div class=\"section\">\r\n<div class=\"sectionContain\">\r\n<h2><span title=\"Quick scroll up\">Comment<\/span><\/h2>\r\nWhen dealing with probabilities, the word\u00a0<em>\u201cand\u201d<\/em>\u00a0will always be associated with the operation of\u00a0<em>multiplication<\/em>; hence the name of this rule, \u201cThe Multiplication Rule.\u201d\r\n\r\n<\/div>\r\n<\/div>\r\n<div class=\"examplewrap\">\r\n<div class=\"example clearfix\">\r\n<div class=\"textbox textbox--examples\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Example<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<p id=\"N10B3D\">Recall the blood type example:<\/p>\r\n<span class=\"imagewrap\"><span class=\"image\"><img class=\"img-responsive popimg aligncenter\" title=\"Data given in &quot;Blood Type: Probability&quot; Format: O: 0.44; A: 0.42; B: 0.10; AB: 0.04;\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image011.gif\" alt=\"Data given in &quot;Blood Type: Probability&quot; Format: O: 0.44; A: 0.42; B: 0.10; AB: 0.04;\" \/><\/span><\/span>\r\n<p id=\"N10B46\">Two people are selected simultaneously and at random from all people in the United States. What is the probability that both have blood type O?<\/p>\r\nLet O1= \u201cperson 1 has blood type O\u201d and\r\n\r\nO2= \u201cperson 2 has blood type O\u201d\r\n\r\nWe need to find P(O1 and O2)\r\n\r\nSince they were chosen simultaneously and at random, the blood type of one has no effect on the blood type of the other. Therefore, O1 and O2 are independent, and we may apply Rule 5:\r\n\r\nP(O1 and O2) = P(O1) * P(O2) = .44 * .44 = .1936.\r\n\r\n<\/div>\r\n<\/div>\r\n<div class=\"textbox textbox--exercises\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n\r\nA 2011 poll by the Pew Research Center for People and the Press estimated that 62% of U.S. adults favor the death penalty for persons convicted of murder, 31% oppose it, with the remaining 7% undecided.\r\n\r\n[h5p id=\"74\"]\r\n<div class=\"ourAnswer\">OUR ANSWER<\/div>\r\n<p id=\"N1006E\"  >Let A be the event that the first person supports the death penalty. Let B be the event that the second person supports the death penalty.<\/p>\r\n<p id=\"N10071\"  >We want to find P(A and B). Since the two people are chosen at random from a large population, A and B are independent and we can use the Multiplication Rule for Independent Events.<\/p>\r\n<p id=\"N10074\"  >P(A and B) = P(A) * P(B) = 0.62 * 0.62 = 0.3844<\/p>\r\n\r\n<\/div>\r\n<\/div>\r\n<div class=\"textbox textbox--exercises\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Learn by Doing<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n\r\n[h5p id=\"75\"]\r\n\r\n&nbsp;\r\n<div class=\"ourAnswer\">OUR ANSWER<\/div>\r\nLet A be the event that the person voted for Bush in 2000. Let B be the event that the person voted for Bush in 2004. The question asks us to determine P(A and B). We might be tempted to use the Multiplication Rule for Independent Events and write P(A and B) = P(A)*P(B) = 0.48*0.51 = 0.2448, but this would be incorrect because these events are not independent. If an individual voted for Bush in 2000, it is likely that the individual voted for him in 2004. So we are unable to answer the question with the information given.\r\n\r\n<\/div>\r\n<\/div>\r\n<div class=\"textbox textbox--exercises\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<p id=\"N1006E\"  >Recall the estimate by the Pew Research Center that 62% of U.S. adults favor the death penalty for murder. The same report gave a much lower estimate for the percentage of U.S. college graduates supporting the death penalty in cases of murder. According to census data from 2000, roughly 28% of U.S. adults have a college degree.<\/p>\r\n<p id=\"N10071\"  ><em class=\"bold\"  >What is the probability that a randomly selected U.S. adult has a college degree and favors the death penalty?<\/em><\/p>\r\n<p id=\"N10076\"  >Let A be the event that a U.S. adult has a college degree. Let B be the event that this person supports the death penalty. We want to find P(A and B).<\/p>\r\n<p  >[h5p id=\"76\"]<\/p>\r\n\r\n<\/div>\r\n<\/div>\r\nSo far we have looked at examples where we have to consider and apply only one of the rules. The following example is a case where both the Addition Rule for Disjoint Events and the Multiplication Rule for Independent Events need to be applied in order to find the desired probability.\r\n<div class=\"examplewrap\">\r\n<div class=\"example clearfix\">\r\n<div class=\"textbox textbox--examples\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Example<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<p id=\"N10BBD\">Recall the blood types example:<\/p>\r\n<span class=\"imagewrap\"><span class=\"image\"><img class=\"img-responsive popimg aligncenter\" title=\"Data given in &quot;Blood Type: Probability&quot; Format: O: 0.44; A: 0.42; B: 0.10; AB: 0.04;\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image011.gif\" alt=\"Data given in &quot;Blood Type: Probability&quot; Format: O: 0.44; A: 0.42; B: 0.10; AB: 0.04;\" \/><\/span><\/span>\r\n<p id=\"N10BC6\">Two people are chosen simultaneously and at random. What is the probability that both have the same blood type? For both to have the same blood type there are four possibilities. Both have blood type O\u00a0<em>or<\/em>\u00a0both have blood type A\u00a0<em>or<\/em>\u00a0both have blood type B\u00a0<em>or<\/em>\u00a0both have blood type AB.<\/p>\r\n<span class=\"imagewrap\"><span class=\"image\"><img class=\"img-responsive popimg aligncenter\" title=\"A diagram showing the four possibilities.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image023.gif\" alt=\"A diagram showing the four possibilities.\" \/><\/span><\/span>\r\n<p id=\"N10BD8\">In other words, and using our regular notations,<\/p>\r\n<p id=\"N10BDB\">P(same blood type) = P([O1 and O2] or [A1 and A2] or [B1 and B2] or [AB1 and AB2])<\/p>\r\n<p id=\"N10BDE\">Since our four possibilities of both people having the same blood type are\u00a0<em>disjoint<\/em>, using our\u00a0<em>Addition Rule<\/em>\u00a0we can add their probabilities (i.e., replace every \u201cor\u201d with +). Also, within each of the four possibilities, we can use the\u00a0<em>Multiplication Rule<\/em>\u00a0and replace \u201cand\u201d with * (using the same\u00a0<em>independence<\/em>\u00a0argument as the first example on this page). Our answer is therefore,<\/p>\r\n<span class=\"imagewrap\"><span class=\"image\"><img class=\"img-responsive popimg aligncenter\" title=\"P(O and O) = .44 * .44 P(B and B) = .42 * .42 P(B and B) = .10 * .10 P(AB and AB) = .04 * .04 P(Both having the same blood type) = P(O and O) + P(A and A) + P(B and B) + P(AB and AB) = 0.3816\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image024.gif\" alt=\"P(O and O) = .44 * .44 P(B and B) = .42 * .42 P(B and B) = .10 * .10 P(AB and AB) = .04 * .04 P(Both having the same blood type) = P(O and O) + P(A and A) + P(B and B) + P(AB and AB) = 0.3816\" \/><\/span><\/span>\r\n<p id=\"N10BF3\">About 38% of the time, two randomly chosen U.S. people would have the same blood type. Note that in this example we used the Addition Rule and the Multiplication Rule one after the other, justifying along the way why it is appropriate to do so.<\/p>\r\n\r\n<\/div>\r\n<\/div>\r\n<div class=\"textbox textbox--exercises\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n\r\n[h5p id=\"77\"]\r\n\r\n<\/div>\r\n<\/div>\r\n<h2><span title=\"Quick scroll up\">Comment<\/span><\/h2>\r\n<p id=\"N10C1F\">The purpose of this comment is to point out the magnitude of P(A or B) and of P(A and B) relative to either one of the individual probabilities. Since probabilities are never negative, the probability of one event\u00a0<em>or<\/em>\u00a0another is always at least as large as either of the individual probabilities. Since probabilities are never more than 1, the probability of one event\u00a0<em>and<\/em>\u00a0another generally involves multiplying numbers that are less than 1, therefore can never be more than either of the individual probabilities.<\/p>\r\n<p id=\"N10C28\">Here is an example:<\/p>\r\n\r\n<div class=\"examplewrap\">\r\n<div class=\"example clearfix\">\r\n<div class=\"textbox textbox--examples\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Example<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<div class=\"examplewrap\">\r\n<div class=\"example clearfix\">\r\n<div>\r\n<p id=\"N10C2D\">Consider the event A that a randomly chosen person has blood type A. Modify it to a more general event\u2014that a randomly chosen person has blood type A or B\u2014and the probability increases. Modify it to a more specific (or restrictive) event\u2014that not just one randomly chosen person has blood type A, but that out of two simultaneously randomly chosen people, person 1 will have type A and person 2 will have type B\u2014and the probability decreases.<\/p>\r\n\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\nIt is important to mention this in order to root out a common misconception. The word \u201cand\u201d is associated in our minds with \u201cadding more stuff.\u201d Therefore, some students\u00a0<em>incorrectly<\/em>\u00a0think that P(A and B) should be larger than either one of the individual probabilities, while it is actually smaller, since it is a more specific (restrictive) event. Also, the word \u201cor\u201d is associated in our minds with \u201chaving to choose between\u201d or \u201closing something,\u201d and therefore some students incorrectly think that P(A or B) should be smaller than either one of the individual probabilities, while it is actually larger, since it is a more general event.\r\n\r\n<\/div>\r\n<\/div>\r\n<p id=\"N10C37\">Practically, you can use this comment to check yourself when solving problems. For example, if you solve a problem that involves \u201cor,\u201d and the resulting probability is smaller than either one of the individual probabilities, then you know you have made a mistake somewhere.<\/p>\r\n\r\n<div class=\"textbox textbox--exercises\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n\r\nPick a student at random. Let B denote the event that the student ate breakfast this morning; let M denote the event that the student is male.\r\n\r\n[h5p id=\"78\"]\r\n\r\n<\/div>\r\n<\/div>\r\n\r\n<hr \/>\r\n\r\nAs you\u2019ve seen, the last three rules that we\u2019ve introduced (the Complement Rule, the Addition Rule for Disjoint Events, and the Multiplication Rule for Independent Events) are frequently used in solving problems. Before we move on to our next rule, here are two comments that will help you use these rules in broader types of problems and more effectively.\r\n<div class=\"section\">\r\n<div class=\"sectionContain\">\r\n<h2><span title=\"Quick scroll up\">Comment<\/span><\/h2>\r\nAs we mentioned before, the Addition Rule can be extended to more than two disjoint events. Likewise, the Multiplication Rule can be extended to more than two independent events. So if A, B and C are three independent events, for example, then P(A and B and C) = P(A) * P(B) * P(C). These extensions are quite straightforward, as long as you remember that \u201cor\u201d requires us to add, while \u201cand\u201d requires us to multiply.\r\n\r\nAn example of a situation where more than two independent events naturally occur is when a random sample of more than two individuals is chosen from a large population.\r\n\r\nHere is an example:\r\n<div class=\"examplewrap\">\r\n<div class=\"example clearfix\">\r\n<div class=\"textbox textbox--examples\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Example<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n\r\nThree people are chosen at random from a large population. What is the probability that all three have blood type B? We\u2019ll use the usual notation of B1, B2 and B3 for the events that persons 1, 2 and 3 have blood type B, respectively. We need to find P(B1 and B2 and B3). Let\u2019s solve this one together:\r\n\r\n[h5p id=\"79\"]\r\n\r\n<\/div>\r\n<\/div>\r\nHere is another example that might be quite surprising.\r\n\r\n<\/div>\r\n<\/div>\r\n<div class=\"examplewrap\">\r\n<div class=\"example clearfix\">\r\n<div class=\"textbox textbox--examples\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Example<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<p id=\"N10B48\">A fair coin is tossed 10 times. Which of the following two outcomes is more likely?<\/p>\r\n<p id=\"N10B4B\">(a) HHHHHHHHHH<\/p>\r\n(b) HTTHHTHTTH\r\n\r\n[h5p id=\"80\"]\r\n\r\n&nbsp;\r\n<p id=\"N10B72\">In fact, they are equally likely. The 10 tosses are independent, so we\u2019ll use the Multiplication Rule for Independent Events:<\/p>\r\n<p id=\"N10B75\">P(HHHHHHHHHH) = P(H) * P(H) * \u2026 *P(H) = 1\/2 * 1\/2 *\u2026 * 1\/2 = (1\/2)<sup>10<\/sup><\/p>\r\n<p id=\"N10B7B\">P(HTTHHTHTTH) = P(H) * P(T) * \u2026 * P(H) = 1\/2 * 1\/2 *\u2026 * 1\/2 = (1\/2)<sup>10<\/sup><\/p>\r\n<p id=\"N10B81\">Here is the idea:<\/p>\r\n<p id=\"N10B84\">My random experiment here is tossing a coin 10 times. You can imagine how huge the sample space is.<\/p>\r\n<p id=\"N10B87\">There are actually 1,024 possible outcomes to this experiment, all of which are equally likely. Therefore, while it is true that it is more likely to get an outcome that has 5 heads and 5 tails than an outcome that has only heads (since there is only one possible outcome of the latter kind, and many possible outcomes of the former), if I am comparing 2\u00a0<em>specific outcomes<\/em>\u00a0as I do here, they are equally likely.<\/p>\r\n\r\n<\/div>\r\n<\/div>\r\n<div class=\"textbox textbox--exercises\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<p id=\"N1006F\"  >Recall:<\/p>\r\n\r\n<div class=\"image shouldbeleft\"><img id=\"N10072\" class=\"img-responsive popimg aligncenter\" title=\"probability of people having different blood types\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/dig001.gif\" alt=\"probability of people having different blood types\" \/><\/div>\r\n<p id=\"N10076\"  >Three people are chosen at random. (Assume the choices are independent events). What is the probability that they all have the same blood type?<\/p>\r\n<p  >[h5p id=\"81\"]<\/p>\r\n\r\n<\/div>\r\n<\/div>\r\n<div class=\"section\">\r\n<div class=\"sectionContain\">\r\n<h2><span title=\"Quick scroll up\">Comment: Finding the Probability of \u201cAt least one of \u2026\u201d<\/span><\/h2>\r\nRecall that when we talked about the Complement Rule, we mentioned that we would come back to it later and illustrate its strength. Well, the time has come to do that.\r\n\r\nRule 3: The Complement Rule, P(A) = 1 \u2013 P(not A), together with the Multiplication Rule, is\u00a0<em>extremely<\/em>\u00a0useful for finding the probability of events like \u201cat least one of \u2026\u201d in several repetitions of a random experiment.\r\n\r\nFor example,\r\n<ul>\r\n \t<li>10 people were randomly chosen. Find P(at least one of the 10 has blood type O).<\/li>\r\n \t<li>A student uses a random guess to answer 10 true\/false questions on a test. Find P(the student gets at least one question right).<\/li>\r\n<\/ul>\r\nThe key here is to use the fact that the complement event is much easier to deal with than the actual event of interest. Going back to our example:\r\n\r\nThe complement to\u00a0<em>\u201cat least one of<\/em>\u00a0the 10 has blood type O\u201d is\u00a0<em>\u201cnone<\/em>\u00a0of the 10 has blood type O.\u201d\r\n\r\nThe complement to \u201cgetting\u00a0<em>at least one<\/em>\u00a0question right\u201d is \u201cgetting\u00a0<em>none<\/em>\u00a0of the questions right.\u201d\r\n\r\n(Note how \u201cat least one of\u201d changes to \u201cnone\u201d in the complement.)\r\n\r\nIf you feel unsure about this, go back and redo the \u201cDid I Get This\u201d activity\u00a0on page 2 of the Probability Rules section.\r\n\r\nWe\u2019ll start with a very simple example in which it is still manageable to find P(at least one of \u2026) directly, without using the complement rule. Then we\u2019ll alter the example slightly and see how trying to find P(at least one of \u2026) directly can get\u00a0<em>VERY COMPLICATED<\/em>, and how the complement rule comes to the rescue. Finally, you\u2019ll check your understanding by attempting to solve a similar problem yourself.\r\n\r\n<\/div>\r\n<\/div>\r\n<div class=\"examplewrap\">\r\n<div class=\"example clearfix\">\r\n<div class=\"textbox textbox--examples\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Example<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n\r\nTwo people are selected at random. What is the probability that at least one of them has blood type O?\r\n<p id=\"N10B63\">Here is our sample space S = { (O,O) (O, not O) (not O, O) (not O, not O) }<\/p>\r\n<p id=\"N10B66\">The event \u201cat least one person chosen has blood type O\u201d consists of the first three possible outcomes, and therefore:<\/p>\r\n<p id=\"N10B69\">P(at least one person chosen has blood type O) = P((O and O) or (O and not O) or (not O and O)) = (.44 * .44) + (.44 * .56) + (.56 * .44) = .6864.<\/p>\r\n\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\nNow we\u2019ll just alter the example slightly by randomly choosing 10 people instead of 2:\r\n<div class=\"examplewrap\">\r\n<div class=\"example clearfix\">\r\n<div class=\"textbox textbox--examples\"><header class=\"textbox__header\">\r\n<h4 class=\"textbox__title\">Example<\/h4>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n\r\nA patient with blood type O desperately needs a blood transfusion. Since a person with blood type O can receive blood only from another person who has blood type O, the blood bank decides to choose 10 donors at random and hope that at least one of them has blood type O. Find P(at least one of the 10 donors has blood type O). To make things simpler, let\u2019s denote the event \u201cat least one has blood type O\u201d by L (for at\u00a0<em>L<\/em>east).\r\n<p id=\"N10B78\">Solving this using the brute force method would require a prohibitive amount of work. As before, we would need to list all the possible outcomes of blood types of 10 people (using either \u201cO\u201d or \u201cnot O\u201d), but this time there are 1,024 of them! We would then need to identify those outcomes that L consists of (i.e., the outcomes in which at least one of the 10 people has blood type O). Next, we would need to find the probability of each of those outcomes and add those probabilities up.\u00a0<em>What a pain!\u00a0<\/em>There must be a better way.<\/p>\r\n<p id=\"N10B7E\">Instead of doing all the work listed above, we can use the Complement Rule, which says P(L) = 1 \u2013 P(not L). As we explained before, in this case \u201cnot L\u201d is the event \u201cnone of the 10 have blood type O,\u201d or in other words that all 10 have a blood type other than O. So we can simply solve (using our regular notation from this module):<\/p>\r\nP(L) = 1 \u2013 P(not L) = 1 \u2013 P(not O1\u00a0<em>and<\/em>\u00a0not O2\u00a0<em>and<\/em>\u00a0not O3\u00a0<em>and<\/em>\u00a0not O4\u00a0<em>and<\/em>\u00a0not O5\u00a0<em>and<\/em>\u00a0not O6\u00a0<em>and<\/em>\u00a0not O7\u00a0<em>and<\/em>\u00a0not O8\u00a0<em>and<\/em>\u00a0not O9\u00a0<em>and\u00a0<\/em>not O10). Now, using the multiplication rule, = 1 \u2013 (.56 * .56 * .56 * .56 * .56 * .56 * .56 * .56 * .56 * .56) = 1 \u2013 .003 = .997.\r\n<p id=\"N10B9F\">Therefore, it is almost certain that if we choose 10 people at random, we\u2019ll find that at least one of them has blood type O. This result makes sense, since 44% have blood type O, and so out of 10 people it is almost certain that at least one will have blood type O.<\/p>\r\n\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n&nbsp;\r\n<div class=\"examplewrap\">\r\n<div class=\"example clearfix\">\r\n<div class=\"textbox textbox--exercises\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n\r\n[h5p id=\"83\"]\r\n\r\n<\/div>\r\n<\/div>\r\nWe are now getting to the last rule in this module in which we\u2019ll go back to P(A or B).\r\n\r\nSo far, we\u2019ve introduced the Addition Rule for finding P(A or B) in the special case when A and B are\u00a0<em class=\"bold\">disjoint\u00a0<\/em>events \u2013 that is when the events cannot happen together \u2192 P(A and B)=\u00a0<span class=\"mjx-chtml MathJax_CHTML\"><span class=\"mjx-math\"><span class=\"mjx-mrow\"><span class=\"mjx-mn\"><span class=\"mjx-char MJXc-TeX-main-R\">0<\/span><\/span><\/span><\/span><\/span>.\r\n<div class=\"image shouldbeleft\"><img class=\"img-responsive popimg aligncenter\" title=\"A Venn Diagram titled &quot;A and B are Disjoint. The entire sample space S is represented as a gray rectangle. Inside are two, separate, non-overlapping blue circles. One circle is for the occurrences in A and the other for occurrences in B.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/prob_9_of_11\/image1.png\" alt=\"A Venn Diagram titled &quot;A and B are Disjoint. The entire sample space S is represented as a gray rectangle. Inside are two, separate, non-overlapping blue circles. One circle is for the occurrences in A and the other for occurrences in B.\" \/><\/div>\r\nIn this special case P(A or B) refers to the probability of either event A occurring or event B occurring and we said that P(A or B)=P(A) + P(B). Visually, in the Venn diagram above we can clearly see that P(A or B), represented by the total blue area, can be found by adding the areas of the two circles, one representing P(A) and the other P(B).\r\n<p id=\"N10B3A\">As we mentioned above the case when A and B are disjoint is a special case and in many situations the events are\u00a0<em class=\"bold\">not disjoint \u2013<\/em>they can occur at the same time.<\/p>\r\n\r\n<div class=\"image shouldbeleft\"><img class=\"img-responsive popimg aligncenter\" title=\"A venn diagram titled &quot;A and B are NOT Disjoint.&quot; A gray box represents the sample space, and inside are two blue circles which have an overlapping area. One circle is labeled A and the other is labeled B. The area where the two circles overlap represents that Events A and B can occur at the same time, so P(A and B) \u2260 0.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/prob_9_of_11\/image2.png\" alt=\"A venn diagram titled &quot;A and B are NOT Disjoint.&quot; A gray box represents the sample space, and inside are two blue circles which have an overlapping area. One circle is labeled A and the other is labeled B. The area where the two circles overlap represents that Events A and B can occur at the same time, so P(A and B) \u2260 0.\" \/><\/div>\r\nWe are now ready to learn how to find P(A or B) in this more general case \u2013 when A and B are not necessarily disjoint. We\u2019ll call this rule the \u201cGeneral Addition Rule\u201d.\r\n\r\nBefore we introduce this rule through an example, it is important to understand what P(A or B) represents in the case when A and B are not disjoint. Let\u2019s look at the Venn diagram above.\r\n\r\nAgain, P(A or B) is represented by the total blue area which in this case looks different. In this case this area includes an overlap between the two circles which corresponds to the probability that both events A and B occur. This difference has an important implication to the meaning of P(A or B) when A and B are not disjoint.\r\n\r\nWhen A and B are not disjoint P(A or B) means P(A occurs or B occurs or both events occur).\r\n<div class=\"examplewrap\">\r\n<div class=\"example clearfix\">\r\n<div class=\"textbox textbox--examples\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Example<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n\r\nIt is vital that a certain document reach its destination within one day. To maximize the chances of on-time delivery, two copies of the document are sent using two services, service A and service B. It is known that the probabilities of on-time delivery are:\r\n<p id=\"N10B57\">0.90 for service A (<em class=\"bold\">P(A) = 0.90<\/em>)<\/p>\r\n<p id=\"N10B5E\">0.80 for service B (<em class=\"bold\">P(B) = 0.80<\/em>)<\/p>\r\n0.75 for both services being on time (<em class=\"bold\">P(A and B) = 0.75<\/em>)\r\n\r\n(Note that A and B are n<em class=\"bold\">ot disjoint<\/em>. They can happen together with probability 0.75.)\r\n\r\nThe Venn diagrams below illustrate the probabilities P(A), P(B), and P(A and B)\r\n\r\n[not drawn to scale]:\r\n<div class=\"image shouldbeleft\"><img class=\"img-responsive popimg aligncenter\" title=\"Three Venn Diagrams. In all of them there is a large rectangle representing all of the sample space S. Inside this rectangle are two circles which overlap partially. One circle is labeled A and the other is labeled B. In the first Venn Diagram the circle for A is colored blue, and we see that P(A) = 0.90 . In some sense P(A) is the area of the A circle. In the second Venn Diagram the circle for B is colored blue, and it is marked that P(B) = 0.80 . Just like in the first Venn diagram it can be thought that the circle for B has an area of 0.80 . In the third Venn Diagram the area which is the overlap of circles A and B is colored blue. P(A and B) = 0.75 . The area of the overlap can be thought of as having an area of 0.75 .\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/prob_9_of_11\/image3.png\" alt=\"Three Venn Diagrams. In all of them there is a large rectangle representing all of the sample space S. Inside this rectangle are two circles which overlap partially. One circle is labeled A and the other is labeled B. In the first Venn Diagram the circle for A is colored blue, and we see that P(A) = 0.90 . In some sense P(A) is the area of the A circle. In the second Venn Diagram the circle for B is colored blue, and it is marked that P(B) = 0.80 . Just like in the first Venn diagram it can be thought that the circle for B has an area of 0.80 . In the third Venn Diagram the area which is the overlap of circles A and B is colored blue. P(A and B) = 0.75 . The area of the overlap can be thought of as having an area of 0.75 .\" \/><\/div>\r\nIn the context of this problem, the obvious question of interest is:\r\n\r\n<em class=\"italic\">What is the probability of on-time delivery of the document using this strategy (of sending it via both services)?<\/em>\r\n<p id=\"N10B88\">The document will reach its destination on time as long as it is delivered on time by service A or by service B or by both services. In other words, when event A occurs or event B occurs or both occur. so\u2026.<\/p>\r\nP(on time delivery using this strategy)=\u00a0<em class=\"bold\">P(A or B)<\/em>, which is represented the by the shaded region in the diagram below:\r\n<div class=\"image shouldbeleft\"><img class=\"img-responsive popimg aligncenter\" title=\"The same Venn Diagram except the area of the two circles has been colored blue (shaded). This means the area in the overlap is also colored blue. Note that the overlap area has only been colored once, so even though it is in both circles we will count it once.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/prob_9_of_11\/image6.png\" alt=\"The same Venn Diagram except the area of the two circles has been colored blue (shaded). This means the area in the overlap is also colored blue. Note that the overlap area has only been colored once, so even though it is in both circles we will count it once.\" \/><\/div>\r\nWe can now use the three Venn diagrams representing P(A), P(B) and P(A and B) to see that we can find P(A or B) by:\r\n\r\nadding P(A) (represented by the left circle) and P(B) (represented by the right circle), then subtracting P(A and B) (represented by the overlap), since we included it twice, once as part of P(A) and once as part of P(B).\r\n<p id=\"N10B9D\">This is shown in the following image:<\/p>\r\n\r\n<div class=\"image shouldbeleft\"><img class=\"img-responsive popimg aligncenter\" title=\"The area of both circles in the Venn diagram (counting the overlap area once) is calculated as: the area of A's circle (which includes the overlap) + the area of B's circle (which also includes the overlap) - the area of the overlap. We therefore get: P(A or B) = P(A) + P(B) - P(A and B).\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/prob_9_of_11\/image7.png\" alt=\"The area of both circles in the Venn diagram (counting the overlap area once) is calculated as: the area of A's circle (which includes the overlap) + the area of B's circle (which also includes the overlap) - the area of the overlap. We therefore get: P(A or B) = P(A) + P(B) - P(A and B).\" \/><\/div>\r\n<p id=\"N10BA7\">If we apply this to our example, we find that:<\/p>\r\n<p id=\"N10BAA\">P(A or B)= P(on-time delivery using this strategy)= 0.90 + 0.80 \u2013 0.75 = 0.95.<\/p>\r\n<p id=\"N10BAD\">So our strategy of using two delivery services increases our probability of on-time delivery to 0.95.<\/p>\r\n\r\n<\/div>\r\n<\/div>\r\nAfter this example, the following General Addition Rule for the probability of finding P(A or B), should not be surprising:\r\n\r\n<\/div>\r\n<\/div>\r\n<table id=\"N10BB4_bx\" class=\"theorem labeled\">\r\n<thead>\r\n<tr>\r\n<th>\r\n<h5>Rule 6: The General Addition Rule<\/h5>\r\n<\/th>\r\n<\/tr>\r\n<\/thead>\r\n<tbody>\r\n<tr>\r\n<td>\r\n<div class=\"theorem\">\r\n<div class=\"statement\">\r\n<p id=\"N10BBC\"><em>For any 2 events A and B, P(A or B) = P(A) + P(B) \u2013 P(A and B).<\/em><\/p>\r\n\r\n<\/div>\r\n<\/div><\/td>\r\n<\/tr>\r\n<\/tbody>\r\n<\/table>\r\n<em class=\"bold\">Comment:<\/em>\r\n<p id=\"N10BCA\">As we mentioned above P(A or B)= P(A occurs or B occurs or both occur).<\/p>\r\nAnother way to interpret P(A or B) is therefore P(At least one of the two events occur).\r\n<div class=\"textbox textbox--exercises\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n\r\n[h5p id=\"84\"]\r\n\r\n<\/div>\r\n<\/div>\r\n<div class=\"textbox textbox--exercises\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<p id=\"N10BF9\"  >Suppose that Jim is applying to two colleges: College A, an \u201cIvy League\u201d school, and College B, a state university. Based on his credentials and the requirements of the two colleges, Jim estimates his chances with the following probabilities:<\/p>\r\n\r\n<ul  >\r\n \t<li  >Probability that he will be admitted to college A is 0.10.<\/li>\r\n \t<li  >Probability that he will be admitted to college B is 0.75.<\/li>\r\n \t<li  >Probability that he will be admitted to both colleges is 0.05.<\/li>\r\n<\/ul>\r\n[h5p id=\"85\"]\r\n\r\n<\/div>\r\n<\/div>\r\n<h2><span title=\"Quick scroll up\">Comments:<\/span><\/h2>\r\n<ol>\r\n \t<li id=\"N10C30\">Note that although the motivation for this rule was to find P(A or B) when A and B are not disjoint, this rule is general in the sense that if A and B happen to be disjoint (no overlap), then P(A and B) is zero, and we\u2019re back to the original version of Rule 4, the Addition Rule for Disjoint Events.<\/li>\r\n \t<li id=\"N10C33\">Note that in order to find P(A or B) using the General Addition Rule, you need to know P(A and B), the probability that both events occur. In all three examples above (document delivery, traffic lights and college admittance) P(A and B) was simply given to us. Sometimes instead of giving us P(A and B) directly, we are given a different piece of information which would allow us to find P(A and B). An example of that draws on our previous work with Rule 5. If A and B are independent, then we can multiply the individual probabilities to compute P(A and B)<\/li>\r\n<\/ol>\r\n<div>\r\n<div class=\"textbox textbox--exercises\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<p id=\"N1006E\"  >What is the probability that at least one of the next two strangers you meet shares your birth month? For this problem assume birth months are equally likely, so the probability of being born in a given month is 1\/12 (about 0.083).<\/p>\r\n<p id=\"N10070\"  ><em class=\"bold\"  >Let A = first stranger shares your birth month<\/em><\/p>\r\n<p id=\"N10074\"  ><em class=\"bold\"  >Let B = second stranger shares your birth month<\/em><\/p>\r\n<p id=\"N10078\"  >Assume that meeting two strangers is like randomly selecting two people from a large population.<\/p>\r\n<p  >[h5p id=\"87\"]<\/p>\r\n\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<h2><span title=\"Quick scroll up\">Comment:<\/span><\/h2>\r\n<p id=\"N10CC8\">The words \u201cat least one of\u201d might remind you of the Complement Rule strategy we used on the previous page for finding the probability that \u201cat least one of many independent events occurred.\u201d Note that P(A or B) can also be interpreted as the probability that \u201cat least one of the two events A, B occur.\u201d When the events are independent, the Complement Rule strategy and the General Addition Rule give the same results, as shown below for the birth month problem.<\/p>\r\n<p id=\"N10CCB\">* General Addition Rule when events are independent:<\/p>\r\n<p id=\"N10CCE\">P(at least one of the two shares your birth month)=<\/p>\r\n<p id=\"N10CD1\">P(A or B)=P(A)+P(B)\u2013P(A and B)=<\/p>\r\n<p id=\"N10CD4\">1\/12 +1\/12 -(1\/12)(1\/12)=0.16.<\/p>\r\n<p id=\"N10CD7\">* We could also have used the Complement Rule strategy:<\/p>\r\n<p id=\"N10CDA\">P(at least one of the two share your birth month)=<\/p>\r\n<p id=\"N10CDD\">1\u2013P(neither shares your birth month)=<\/p>\r\n<p id=\"N10CE0\">1- (11\/12)(11\/12)=0.16.<\/p>\r\n\r\n\r\n<hr \/>\r\n<p id=\"N10B2D\">In our delivery example, there are two categorical variables of interest in the background:<\/p>\r\n\r\n<ul>\r\n \t<li>On-time delivery by service A (yes\/no)<\/li>\r\n \t<li>On-time delivery by service B (yes\/no)<\/li>\r\n<\/ul>\r\nSince each of the two has two possible values (yes\/no), there are four possible combinations altogether, which correspond to the four possible outcomes of using the two services.\r\n<p id=\"N10B3C\">While the Venn diagrams were great to visualize the General Addition Rule, in cases like these it is much easier to display the information in and work with a two-way table of probabilities, much as we examined the relationship between two categorical variables in the Exploratory Data Analysis section.<\/p>\r\nHow do we build a two-way table of probabilities? Let\u2019s use our delivery example to illustrate this simple process:\r\n<div id=\"uwrap__i_0\" class=\"youtube\">\r\n\r\n[embed]https:\/\/www.youtube.com\/embed\/aN0eulm19MM[\/embed]\r\n\r\n<\/div>\r\nNow that we\u2019ve completed the table, it is important to understand what each of the table\u2019s entries mean in context.\r\n<div class=\"image shouldbeleft\"><img class=\"img-responsive popimg aligncenter\" title=\"The table has columns &quot;B,&quot; &quot;not B,&quot; and &quot;Total.&quot; The rows are &quot;A,&quot; &quot;not A,&quot; and &quot;Total.&quot; Here are is some information about the table, organized by cell: At the cell A,B, the value there (0.75) is P(A and B) = P(on-time delivery by both services). At the cell A,not B, the value there (0.15) is P(A and Not B) = P(on-time delivery ONLY by service A). At cell Not A and B, the value (0.05) is P(not A and B) = P(on-time delivery ONLY by service B). At cell Not A and Not B, the value (0.05) is P(not A and not B) = P(Neither service A nor B delivered on time).\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/prob_table_explained.png\" alt=\"The table has columns &quot;B,&quot; &quot;not B,&quot; and &quot;Total.&quot; The rows are &quot;A,&quot; &quot;not A,&quot; and &quot;Total.&quot; Here are is some information about the table, organized by cell: At the cell A,B, the value there (0.75) is P(A and B) = P(on-time delivery by both services). At the cell A,not B, the value there (0.15) is P(A and Not B) = P(on-time delivery ONLY by service A). At cell Not A and B, the value (0.05) is P(not A and B) = P(on-time delivery ONLY by service B). At cell Not A and Not B, the value (0.05) is P(not A and not B) = P(Neither service A nor B delivered on time).\" \/><\/div>\r\n<div class=\"section\">\r\n<div class=\"sectionContain\">\r\n<h2><span title=\"Quick scroll up\">Comment<\/span><\/h2>\r\nA common mistake is to confuse between: P(A) = P(event A occurs) and P(A and Not B) = P(ONLY event A occurs)[and similarly, between P(B) = P(event B occurs) and P(Not A and B) = P(only event B occurs)].\r\n\r\nLooking at the probability table is a great way to clear-up this confusion:\r\n<div class=\"image shouldbeleft\"><img class=\"img-responsive popimg aligncenter\" title=\"The table's first row has been highlighted. Here is the highlighted data in &quot;Row, Column&quot; format: A, B: P(A and B) = 0.75; A, not B: P(A and not B) = 0.15; A, Total: P(A) = 0.90 = P(A and B) + P(A and not B)\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/prob_table.png\" alt=\"The table's first row has been highlighted. Here is the highlighted data in &quot;Row, Column&quot; format: A, B: P(A and B) = 0.75; A, not B: P(A and not B) = 0.15; A, Total: P(A) = 0.90 = P(A and B) + P(A and not B)\" \/><\/div>\r\nP(A) = 0.90 means that in 90% of the cases when service A is used, it delivers the document on time.\r\n\r\nThese cases of on-time delivery by service A can be decomposed into two sub-cases:\r\n<ul>\r\n \t<li>P(A and B) = 0.75 \u2192 75% of the time the document is delivered on time also by service B (i.e., the document is delivered on time by both services)<\/li>\r\n \t<li>P(A and Not B) = 0.15 \u2192 15% of the time the document is not delivered on time by service B (i.e., delivered on time only by service A).<\/li>\r\n<\/ul>\r\nSimilarly,\r\n<div class=\"image shouldbeleft\"><img class=\"img-responsive popimg aligncenter\" title=\"The table's first column has been highlighted. Here is the highlighted data in &quot;Row, Column&quot; format: A,B: P(A and B) = 0.75; not A, B: P(not A and B) = 0.05; B,Total: P(B) = 0.80 = P(A and B) + P(not A and B)\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/prob_table2.png\" alt=\"The table's first column has been highlighted. Here is the highlighted data in &quot;Row, Column&quot; format: A,B: P(A and B) = 0.75; not A, B: P(not A and B) = 0.05; B,Total: P(B) = 0.80 = P(A and B) + P(not A and B)\" \/><\/div>\r\n<p id=\"N10B7A\">P(B) = 0.80 means that in 80% of the cases when service B is used, it delivers the document on time.<\/p>\r\n<p id=\"N10B7D\">These cases of on-time delivery by service B can be decomposed into two sub-cases:<\/p>\r\n\r\n<ul>\r\n \t<li>P(A and B) = 0.75 \u2192 75% of the time the document is delivered on time also by service A (i.e., the document is delivered on time by both services)<\/li>\r\n \t<li>P(Not A and B) = 0.05 \u2192 5% of the time the document is not delivered on time by service A (i.e., delivered on time\u00a0<em class=\"bold\">only by service B<\/em>).<\/li>\r\n<\/ul>\r\n<\/div>\r\n<\/div>\r\n<div class=\"examplewrap\">\r\n<div class=\"example clearfix\">\r\n<div class=\"textbox textbox--examples\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Example<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<p id=\"N10B91\">Recall the smoke detector example from the last activity. Here is a quick recap:<\/p>\r\nD\u2014the dining room alarm is set off by smoke in the kitchen\r\n\r\nB\u2014the bedroom alarm is set off by smoke in the kitchen\r\n\r\nP(D) = 0.95\r\n\r\nP(B) = 0.40\r\n\r\nD and B are independent \u2192 P(D and B) = 0.38\r\n<p id=\"N10BA3\">Complete the table below. Start with the information that is given and go from there.<\/p>\r\nComplete the following table: What is the probability that goes in each cell?\r\n<table class=\"wbtable plain\">\r\n<tbody>\r\n<tr class=\"e\">\r\n<td><\/td>\r\n<td align=\"center\">B<\/td>\r\n<td align=\"center\">not B<\/td>\r\n<td align=\"center\">Total<\/td>\r\n<\/tr>\r\n<tr>\r\n<td align=\"center\">D<\/td>\r\n<td><span class=\"A\"><span class=\"component\">\r\n\u2014\r\n0.02\r\n0.03\r\n0.05\r\n0.38\r\n0.40\r\n0.57\r\n0.60\r\n0.95\r\n1.00\r\n<\/span><\/span><\/td>\r\n<td><span class=\"B\"><span class=\"component\">\r\n\u2014\r\n0.02\r\n0.03\r\n0.05\r\n0.38\r\n0.40\r\n0.57\r\n0.60\r\n0.95\r\n1.00\r\n<\/span><\/span><\/td>\r\n<td><span class=\"C\"><span class=\"component\">\r\n\u2014\r\n0.02\r\n0.03\r\n0.05\r\n0.38\r\n0.40\r\n0.57\r\n0.60\r\n0.95\r\n1.00\r\n<\/span><\/span><\/td>\r\n<\/tr>\r\n<tr class=\"e\">\r\n<td align=\"center\">not D<\/td>\r\n<td><span class=\"D\"><span class=\"component\">\r\n\u2014\r\n0.02\r\n0.03\r\n0.05\r\n0.38\r\n0.40\r\n0.57\r\n0.60\r\n0.95\r\n1.00\r\n<\/span><\/span><\/td>\r\n<td><span class=\"E\"><span class=\"component\">\r\n\u2014\r\n0.02\r\n0.03\r\n0.05\r\n0.38\r\n0.40\r\n0.57\r\n0.60\r\n0.95\r\n1.00\r\n<\/span><\/span><\/td>\r\n<td><span class=\"F\"><span class=\"component\">\r\n\u2014\r\n0.02\r\n0.03\r\n0.05\r\n0.38\r\n0.40\r\n0.57\r\n0.60\r\n0.95\r\n1.00\r\n<\/span><\/span><\/td>\r\n<\/tr>\r\n<tr>\r\n<td align=\"center\">Total<\/td>\r\n<td><span class=\"G\"><span class=\"component\">\r\n\u2014\r\n0.02\r\n0.03\r\n0.05\r\n0.38\r\n0.40\r\n0.57\r\n0.60\r\n0.95\r\n1.00\r\n<\/span><\/span><\/td>\r\n<td><span class=\"H\"><span class=\"component\">\r\n\u2014\r\n0.02\r\n0.03\r\n0.05\r\n0.38\r\n0.40\r\n0.57\r\n0.60\r\n0.95\r\n1.00\r\n<\/span><\/span><\/td>\r\n<td><span class=\"I\"><span class=\"component\">\r\n\u2014\r\n0.02\r\n0.03\r\n0.05\r\n0.38\r\n0.40\r\n0.57\r\n0.60\r\n0.95\r\n1.00\r\n<\/span><\/span><\/td>\r\n<\/tr>\r\n<\/tbody>\r\n<\/table>\r\n<\/div>\r\n<\/div>\r\n<div class=\"textbox textbox--exercises\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n\r\n[h5p id=\"88\"]\r\n\r\n<\/div>\r\n<\/div>\r\n<div class=\"textbox textbox--exercises\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<p id=\"N1006E\"  >Recall the example concerning the delivery of an important document. To maximize the chances of on-time delivery, two copies of the document are sent using two services, service A and service B. It is known that the probabilities of on-time delivery are:<\/p>\r\n<p id=\"N10070\"  >0.90 for service A: P(A) = 0.90<\/p>\r\n<p id=\"N10072\"  >0.80 for service B: P(B) = 0.80<\/p>\r\n<p id=\"N10074\"  >0.75 for both services being on time: P(A and B) = 0.75<\/p>\r\n<p  >[h5p id=\"89\"]<\/p>\r\n\r\n<\/div>\r\n<\/div>\r\n<h2><span title=\"Quick scroll up\">Comment<\/span><\/h2>\r\n<p id=\"N10C35\">In both the delivery problem and the smoke detector problem, we knew P(A), P(B) and P(A and B). (In the smoke detector problem, we actually needed to work a bit to get P(A and B), but it wasn\u2019t too bad.) Visually, we had the probability for the three shaded cells below, which was enough information to complete the table.<\/p>\r\n<span class=\"imagewrap\"><span class=\"image\"><img class=\"img-responsive popimg aligncenter\" title=\"The table has columns &quot;B,&quot; &quot;not B,&quot; and &quot;Total.&quot; The rows are &quot;A,&quot; &quot;not A,&quot; and &quot;Total.&quot; We will be naming cells by &quot;{Row, Column}&quot; notation. Cells {A,B}, {A, Total}, and {Total, B} have been shaded.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image031.gif\" alt=\"The table has columns &quot;B,&quot; &quot;not B,&quot; and &quot;Total.&quot; The rows are &quot;A,&quot; &quot;not A,&quot; and &quot;Total.&quot; We will be naming cells by &quot;{Row, Column}&quot; notation. Cells {A,B}, {A, Total}, and {Total, B} have been shaded.\" \/><\/span><\/span>\r\n<p id=\"N10C3E\">This, however, is not the only combination of three cells that would provide sufficient information to complete the table. Essentially, as long as we are given (or can calculate) one cell in each of the margins (the total row and column), and one of the four cells in the body of the table, we\u2019ll be able to complete the entire table. Visually, we need:<\/p>\r\n<span class=\"imagewrap\"><span class=\"image\"><img class=\"img-responsive popimg aligncenter\" title=\"The same table. We need information about one of the cells in the body of the table. These cells are {A,B}, {A, not B}, {not A, B}, and {not A, not B}. In addition, we need information from one of the cells on the right margin. These cells are {A, Total} and {not A, Total}. The last group of cells we need information from is the bottom margin. These cells are {Total, B} and {Total, not B}. With one cell from each of these three groups we can fill in the entire table.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image032.gif\" alt=\"The same table. We need information about one of the cells in the body of the table. These cells are {A,B}, {A, not B}, {not A, B}, and {not A, not B}. In addition, we need information from one of the cells on the right margin. These cells are {A, Total} and {not A, Total}. The last group of cells we need information from is the bottom margin. These cells are {Total, B} and {Total, not B}. With one cell from each of these three groups we can fill in the entire table.\" \/><\/span><\/span>\r\n<div class=\"textbox textbox--exercises\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<p id=\"N10C4E\"  >Researchers studied thousands of court cases. For each case, they recorded the jury\u2019s decision. In addition, they asked the judge in each case how he or she would have decided the same case if there were no jury. In 67% of the cases the jury voted to convict, in 83% of the cases the judge would have convicted, and in 19% of the cases only the judge would have convicted.<\/p>\r\n<p id=\"N10C51\"  >Let A be the event \u201cjury convicts\u201d.<\/p>\r\n<p id=\"N10C54\"  >Let B be the event \u201cjudge convicts\u201d.<\/p>\r\n<p  >[h5p id=\"90\"]<\/p>\r\n\r\n<\/div>\r\n<\/div>\r\n<div class=\"textbox textbox--exercises\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<p id=\"N10C84\"  >According to www.jointogether.com, in 2000, 87% of all suicides were committed by males, 56% of all suicides were committed using a gun, and 10% of all suicides were committed by women not using a gun.<\/p>\r\n<p id=\"N10C87\"  >(We'll use M for suicide committed by a male, F [= not M] for suicide committed by female, and G for a suicide committed using a gun.)<\/p>\r\n\r\n<div class=\"asx \">\r\n<div id=\"du3_m1_rules10_tutor2\" class=\"activitywrap sectionNest flash\">\r\n<div class=\"activityhead\">\r\n<div class=\"activityinfo\"><\/div>\r\n<\/div>\r\n<div class=\"actContain\">\r\n<div class=\"activity flash\">\r\n<div id=\"u3_m1_rules10_tutor2\" class=\"flash_obj asx testFlash mark_flash\">\r\n<div id=\"ou3_m1_rules10_tutor2\" class=\"page 2962880\">\r\n<div id=\"2962880\" class=\"question\">\r\n<div><img id=\"N10070\" class=\"img-responsive popimg aligncenter\" title=\"four datatables\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/webcontent\/flash\/_u4_m1_digtutor11a_image1.gif\" alt=\"four datatables\" \/><\/div>\r\n<div>[h5p id=\"91\"]<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<h2><span title=\"Quick scroll up\">Comment<\/span><\/h2>\r\nWhen we used two-way tables in the Exploratory Data Analysis (EDA) section, it was to record values of two categorical variables for a concrete\u00a0<em>sample<\/em>\u00a0of individuals. In contrast, the information in a probability two-way table is for an entire\u00a0<em>population<\/em>, and the values are rather abstract. If we had treated something like the delivery example in the EDA section, we would have recorded the actual numbers of on-time (and not-on-time) deliveries for samples of documents mailed with service A or B. In this section, the long-term probabilities are presented as being known. Presumably, those probabilities were based on relative frequencies recorded over many repetitions.\r\n\r\n<hr \/>\r\n<p id=\"N10AFD\">Now that we know how to build a two-way probability table, let\u2019s see how we can use information from it to solve problems.<\/p>\r\n\r\n<div class=\"examplewrap\">\r\n<div class=\"example clearfix\">\r\n<div class=\"textbox textbox--examples\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Example<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<p id=\"N10B02\">Let\u2019s go back to our delivery example and see how we can \u201clift\u201d probabilities from the two-way probability table in order to answer the question posed in that example and related questions. Here is the table again:<\/p>\r\n<span class=\"imagewrap\"><span class=\"image\"><img class=\"img-responsive popimg aligncenter\" title=\"The table has 3 columns and 3 rows. The columns are: &quot;B,&quot; &quot;not B,&quot; and &quot;Total.&quot; The rows are &quot;A,&quot; &quot;not A,&quot; and &quot;Total.&quot; Here is the cell data in &quot;Row, Column: Value&quot; format. A,B: 0.75; A,not B: .15; A,Total: .90; not A, B: .05; not A, not B: .05; not A, Total: .10; Total, B: .80; Total, not B: .20; Total, Total: 1.00\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image033.gif\" alt=\"The table has 3 columns and 3 rows. The columns are: &quot;B,&quot; &quot;not B,&quot; and &quot;Total.&quot; The rows are &quot;A,&quot; &quot;not A,&quot; and &quot;Total.&quot; Here is the cell data in &quot;Row, Column: Value&quot; format. A,B: 0.75; A,not B: .15; A,Total: .90; not A, B: .05; not A, not B: .05; not A, Total: .10; Total, B: .80; Total, not B: .20; Total, Total: 1.00\" \/><\/span><\/span>\r\n<p id=\"N10B0B\">What is the probability of on-time delivery of the document using the two services strategy?<\/p>\r\nIn other words, what is P(A or B)?\r\n\r\nWe can use the table in two ways:\r\n\r\n(i) We can simply lift P(A), P(B) and P(A and B) from the table as shown in the table below and use the General Addition Rule to get 0.95. as we did before: P(A or B) = P(A) + P(B) \u2212 P(A and B) = 0.90 + 0.80 \u2212 0.75 = 0.95.\r\n\r\n<span class=\"imagewrap\"><span class=\"image\"><img class=\"img-responsive popimg aligncenter\" title=\"Cells are given in &quot;{Row,Column: Value}&quot; format. The same table as the previous, except that the cells {A,B: 0.75}, {A, Total: 0.90}, and {Total, B: 0.80} have been highlighted.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image034.gif\" alt=\"Cells are given in &quot;{Row,Column: Value}&quot; format. The same table as the previous, except that the cells {A,B: 0.75}, {A, Total: 0.90}, and {Total, B: 0.80} have been highlighted.\" \/><\/span><\/span>\r\n\r\n(ii) Another way to use the table is to use the fact that in probability, \u201cA or B\u201d actually means \u201cA or B or both.\u201d The corresponding cells for these three options are shaded below and are 0.15 (only A), 0.05 (only B), and 0.75 (both). We can add these up to get P(A or B) = 0.95.\r\n\r\n<span class=\"imagewrap\"><span class=\"image\"><img class=\"img-responsive popimg aligncenter\" title=\"Cells are given in &quot;{Row,Column}&quot; format. The same table as the previous, except that the cells {A,B: 0.75}, {A, not B: 0.15}, and {not A, B: 0.05} have been highlighted.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image035.gif\" alt=\"Cells are given in &quot;{Row,Column}&quot; format. The same table as the previous, except that the cells {A,B: 0.75}, {A, not B: 0.15}, and {not A, B: 0.05} have been highlighted.\" \/><\/span><\/span>\r\n\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<div class=\"examplewrap\">\r\n<div class=\"example clearfix\">\r\n<div class=\"textbox textbox--examples\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Example<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n\r\nWhat is the probability of on-time delivery by exactly one service?\r\n\r\nOn-time delivery by exactly one service occurs if the document arrives on-time by service A and not B, or by service B and not A. The probabilities of these two possibilities are represented by the shaded cells in the table below, and are 0.15 and 0.05 respectively. Therefore, P(on-time delivery by exactly one service) = 0.15 + 0.05 = 0.20\r\n\r\n<span class=\"imagewrap\"><span class=\"image\"><img class=\"img-responsive popimg aligncenter\" title=\"Cells are given in &quot;{Row,Column}&quot; format. The same table as the previous, except that the cells {A, not B: 0.15} and {not A, B: 0.05} have been highlighted.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image036.gif\" alt=\"Cells are given in &quot;{Row,Column}&quot; format. The same table as the previous, except that the cells {A, not B: 0.15} and {not A, B: 0.05} have been highlighted.\" \/><\/span><\/span>\r\n\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<div class=\"examplewrap\">\r\n<div class=\"example clearfix\">\r\n<div class=\"textbox textbox--examples\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Example<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n\r\nWhat is the probability that the document will\u00a0<em>not<\/em>\u00a0get to its destination on time? This would be the occurrence of the event \u201cnot A and not B,\u201d whose probability is 0.05, as shown in the table:\r\n\r\n<span class=\"imagewrap\"><span class=\"image\"><img class=\"img-responsive popimg aligncenter\" title=\"Cells are given in &quot;{Row,Column}&quot; format. The same table as the previous, except that the cell {not A, not B: 0.05} has been highlighted.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image037.gif\" alt=\"Cells are given in &quot;{Row,Column}&quot; format. The same table as the previous, except that the cell {not A, not B: 0.05} has been highlighted.\" \/><\/span><\/span>\r\n\r\n<\/div>\r\n<\/div>\r\n<div class=\"textbox textbox--exercises\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<p id=\"N1006E\"  >Candace is applying to two colleges, Ross College and the more prestigious Cirus College. The probability table below represents her belief about whether she will be accepted. We use the following notation:<\/p>\r\n<p id=\"N10070\"  >R\u2014the event of being accepted to Ross College<\/p>\r\n<p id=\"N10072\"  >C\u2014the event of being accepted to Cirus College<\/p>\r\n\r\n<div class=\"image shouldbeleft\"><img id=\"N10074\" class=\"img-responsive popimg aligncenter\" title=\"table of probabilities of acceptance to two different colleges\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/dig010.gif\" alt=\"table of probabilities of acceptance to two different colleges\" \/><\/div>\r\n<div>[h5p id=\"92\"]<\/div>\r\n<\/div>\r\n<\/div>\r\nWe are now done with this section, which introduced various probability rules. Let\u2019s summarize what we\u2019ve learned.\r\n\r\n1. The Complement Rule states that\r\n\r\n<em>P(not A) = 1 \u2212 P(A)<\/em>\r\n\r\nor when rearranged\r\n\r\n<em>P(A) = 1 \u2212 P(not A).<\/em>\r\n\r\nThe Complement Rule is very useful when we need to find probabilities of the sort: P(At least one of several events occur) which is hard to calculate. In this case, we apply the Complement Rule:\r\n<p id=\"N10B80\"><em>P(At least one of several events occur) = 1 \u2212 P(None of the events occur)<\/em>, since P(None of the events occur) is usually much easier to find.<\/p>\r\n2. The General Addition Rule states that for any two events,\r\n\r\n<em>P(A or B) = P(A) + P(B) \u2212 P(A and B),<\/em>\r\n<p id=\"N10B8E\">where, by P(A or B) we mean P(A occurs or B occurs or both).<\/p>\r\nIn the special case when A and B are\u00a0<em class=\"italic\">disjoint<\/em>\u00a0events (which means that P(A and B) = 0), the general addition rule becomes P(A or B) = P(A) + P(B), which we call the Addition Rule for Disjoint Events.\r\n<p id=\"N10B98\">Beware of wrongly using the Addition Rule for Disjoint events when the events are not disjoint.<\/p>\r\n<p id=\"N10B9B\">3. When we want to find P(A and B), we can use the Multiplication Rule, but so far we\u2019ve only learned the restricted version of this rule\u2014the Multiplication Rule for Independent Events. Events are independent if the occurrence of one of the events has no effect on the probability of the other occurring, in which case:<\/p>\r\n<p id=\"N10B9E\"><em>P(A and B) = P(A) * P(B).<\/em><\/p>\r\n<p id=\"N10BA4\">4. The Additional Rule for Disjoint Events can be naturally extended to more than two events. In other words, if events A, B, and C are disjoint, then<\/p>\r\nP(A or B or C)=P(A)+P(B)+P(C).\r\n\r\nSimilarly, the Multiplication Rule for Independent Events can be naturally extended to more than two independent events. In other words, if events A, B, and C are independent, then P(A and B and C) = P(A) * P(B) * P(C). The same is true for 4, 5, \u2026, disjoint\/independent events.\r\n\r\n5. When there are two categorical variables in the background, each with two possible values, a\u00a0<em class=\"italic\">two-way probability table<\/em>\u00a0is a quick and easy way to display the probabilities associated with the 4 possible combinations.\r\n<h2>Conditional Probability and Independence<\/h2>\r\n<div class=\"textbox textbox--learning-objectives\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Learning Objectives<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<ul>\r\n \t<li id=\"explain_conditional_probability\">Explain the reasoning behind conditional probability, and how this reasoning is expressed by the definition of conditional probability.<\/li>\r\n \t<li id=\"find_conditional_probabilities\">Find conditional probabilities and interpret them.<\/li>\r\n \t<li id=\"determine_whether_two_events_are_independent\">Determine whether two events are independent or not.<\/li>\r\n \t<li id=\"use_general_multiplication_rule\">Use the General Multiplication Rule to find the probability that two events occur (P(A and B)).<\/li>\r\n \t<li id=\"use_probability_trees\">Use probability trees as a tool for finding probabilities.<\/li>\r\n<\/ul>\r\n<\/div>\r\n<\/div>\r\n<h2><span title=\"Quick scroll up\">Introduction<\/span><\/h2>\r\n<p id=\"N10AE3\">In the last section, we established the five basic rules of probability, which include the two restricted versions of the Addition Rule and Multiplication Rule: The Addition Rule for <em>Disjoint<\/em>\u00a0Events and the Multiplication Rule for\u00a0<em>Independent<\/em>\u00a0Events. We have also established a General Addition Rule for which the events need not be disjoint. In order to complete our set of rules, we still require a General Multiplication Rule for which the events need not be independent. In order to establish such a rule, however, we first need to understand the important concept of\u00a0<em>conditional probability.<\/em><\/p>\r\n<p id=\"N10AEF\">This section will be organized as follows: We\u2019ll first introduce the idea of conditional probability, and use it to formalize our definition of independent events, which in the first module was presented only in an intuitive way. We will then develop the General Multiplication Rule, a rule that will tell us how to find P(A <em>and<\/em>\u00a0B) in cases when the events A and B are not necessarily independent. We\u2019ll conclude with a discussion of probability trees, a method of displaying conditional probability visually that is very helpful in solving problems.<\/p>\r\n\r\n<div class=\"multi\">\r\n<div class=\"textbox textbox--learning-objectives\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Learning Objectives<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<ul>\r\n \t<li>Explain the reasoning behind conditional probability, and how this reasoning is expressed by the definition of conditional probability.<\/li>\r\n \t<li>Find conditional probabilities and interpret them.<\/li>\r\n<\/ul>\r\n<\/div>\r\n<\/div>\r\nIn the first part of this chapter, we\u2019ll introduce the concept of conditional probability. The idea here is that the probabilities of certain events may be affected by whether or not other events have occurred. Let\u2019s illustrate this idea with a simple example:\r\n\r\n<\/div>\r\n<div class=\"examplewrap\">\r\n<div class=\"example clearfix\">\r\n<div class=\"textbox textbox--examples\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Example<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<p id=\"N10AFA\">All the students in a certain high school were surveyed, then classified according to gender and whether they had either of their ears pierced:<\/p>\r\n<span class=\"imagewrap\"><span class=\"image\"><img class=\"img-responsive popimg aligncenter\" title=\"A table of the data. The column headings are &quot;Pierced,&quot; &quot;Not Pierced,&quot; and &quot;Total.&quot; The Rows are &quot;Male,&quot; &quot;Female,&quot; and &quot;Total.&quot; The data in the cells is given in &quot;Row, Column: Value&quot; format: Male, Pierced: 36; Male, Not Pierced: 144; Male, Total: 180; Female, Pierced: 288; Female, Not Pierced: 32; Female, Total: 320; Total, Pierced: 324; Total, Not Pierced: 176; Total, Total: 500;\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m2_conditional_probability\/webcontent\/image001.gif\" alt=\"A table of the data. The column headings are &quot;Pierced,&quot; &quot;Not Pierced,&quot; and &quot;Total.&quot; The Rows are &quot;Male,&quot; &quot;Female,&quot; and &quot;Total.&quot; The data in the cells is given in &quot;Row, Column: Value&quot; format: Male, Pierced: 36; Male, Not Pierced: 144; Male, Total: 180; Female, Pierced: 288; Female, Not Pierced: 32; Female, Total: 320; Total, Pierced: 324; Total, Not Pierced: 176; Total, Total: 500;\" \/><\/span><\/span>\r\n\r\n(Note that this is a two-way table of counts that was first introduced when we talked about the relationship between two categorical variables. It is not surprising that we are using it again in this example, since we indeed have two categorical variables here:\u00a0<em>Gender:<\/em>\u00a0M or F (in our notation, \u201cnot M\u201d), and\u00a0<em>Pierced:<\/em>\u00a0Yes or No)\r\n\r\nSuppose a student is selected at random from the school. Let\u00a0<em>M<\/em>\u00a0and\u00a0<em>not M<\/em>\u00a0denote the events of being male and female, respectively, and\u00a0<em>E<\/em>\u00a0and\u00a0<em>not E<\/em>\u00a0denote the events of having ears pierced or not, respectively. We\u2019ll start by asking what will seem like simple questions, and we\u2019ll build our way to conditional probability:\r\n<ol class=\"lower-alpha\">\r\n \t<li>What is the probability that the student has one or both ears pierced?Since a student is chosen at random from the group of 500 students, out of which 324 are pierced,P(E) = 324\/500 = .648<\/li>\r\n \t<li>What is the probability that the student is male?Since a student is chosen at random from the group of 500 students, out of which 180 are male,P(M) = 180\/500 = .36<\/li>\r\n \t<li>What is the probability that the student is male and has ear(s) pierced?Since a student is chosen at random from the group of 500 students out of which 36 are male and have their ear(s) pierced, P(M and E) = 36\/500 = .072Now something new:<\/li>\r\n \t<li><em>Given<\/em>\u00a0that the student that was chosen is male, what is the probability that he has one or both ears pierced?At this point, new notation is required, to express the probability of a certain event given that another event holds. We will write \u201cthe probability of having one or both ears pierced (E) , given that a student is male (M)\u201d as\u00a0<em>P(E | M).<\/em><\/li>\r\n<\/ol>\r\nA word about this new notation: The event whose probability we seek (in this case E) is written first, the vertical line stands for the word \u201cgiven\u201d or \u201cconditioned on,\u201d and the event that is given (in this case M) is written after the \u201c|\u201d sign.\r\n\r\nWe call this probability the\u00a0<em>conditional probability<\/em>\u00a0of having one or both ears pierced, given that a student is male: it assesses the probability of having pierced ears under the condition of being male. Now to solve for the probability, we observe that choosing from only the males in the school essentially alters the sample space S from all students in the school to all male students in the school. The total number of possible outcomes is no longer 500, but has changed to 180. Out of those 180 males, 36 have ear(s) pierced, and thus:\r\n<p id=\"N10B53\">P(E | M) = 36\/180 = .20.<\/p>\r\n\r\n<\/div>\r\n<\/div>\r\nA good visual illustration of this conditional probability is provided by the two-way table:\r\n\r\n<span class=\"imagewrap\"><span class=\"image\"><img class=\"img-responsive popimg aligncenter\" title=\"The same table of the data for piercings. The column headings are &quot;Pierced,&quot; &quot;Not Pierced,&quot; and &quot;Total.&quot; The Rows are &quot;Male,&quot; &quot;Female,&quot; and &quot;Total.&quot; The data in the cells is given in &quot;Row, Column: Value&quot; format: Male, Pierced: 36; Male, Not Pierced: 144; Male, Total: 180; Female, Pierced: 288; Female, Not Pierced: 32; Female, Total: 320; Total, Pierced: 324; Total, Not Pierced: 176; Total, Total: 500; In this table, the first row (Male) has been highlighted. The {Male, Pierced: 36} cell is in dark green, and the rest is in light green, showing that we can use this row to calculate the conditional probability.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m2_conditional_probability\/webcontent\/image002.gif\" alt=\"The same table of the data for piercings. The column headings are &quot;Pierced,&quot; &quot;Not Pierced,&quot; and &quot;Total.&quot; The Rows are &quot;Male,&quot; &quot;Female,&quot; and &quot;Total.&quot; The data in the cells is given in &quot;Row, Column: Value&quot; format: Male, Pierced: 36; Male, Not Pierced: 144; Male, Total: 180; Female, Pierced: 288; Female, Not Pierced: 32; Female, Total: 320; Total, Pierced: 324; Total, Not Pierced: 176; Total, Total: 500; In this table, the first row (Male) has been highlighted. The {Male, Pierced: 36} cell is in dark green, and the rest is in light green, showing that we can use this row to calculate the conditional probability.\" \/><\/span><\/span>\r\n\r\nwhich shows us that conditional probability is not very different from (and actually quite the same as) the conditional percents we calculated in the example above.\r\n<div class=\"textbox textbox--exercises\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<p id=\"N10B33\"  >Consider the piercing example, where the following two-way table is given,<\/p>\r\n\r\n<div class=\"image shouldbeleft\"><img id=\"_i_1\" class=\"img-responsive popimg aligncenter\" title=\"The same table of the data for piercings. The column headings are &quot;Pierced,&quot; &quot;Not Pierced,&quot; and &quot;Total.&quot; The Rows are &quot;Male,&quot; &quot;Female,&quot; and &quot;Total.&quot; The data in the cells is given in &quot;Row, Column: Value&quot; format: Male, Pierced: 36; Male, Not Pierced: 144; Male, Total: 180; Female, Pierced: 288; Female, Not Pierced: 32; Female, Total: 320; Total, Pierced: 324; Total, Not Pierced: 176; Total, Total: 500;\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m2_conditional_probability\/webcontent\/dig001.gif\" alt=\"The same table of the data for piercings. The column headings are &quot;Pierced,&quot; &quot;Not Pierced,&quot; and &quot;Total.&quot; The Rows are &quot;Male,&quot; &quot;Female,&quot; and &quot;Total.&quot; The data in the cells is given in &quot;Row, Column: Value&quot; format: Male, Pierced: 36; Male, Not Pierced: 144; Male, Total: 180; Female, Pierced: 288; Female, Not Pierced: 32; Female, Total: 320; Total, Pierced: 324; Total, Not Pierced: 176; Total, Total: 500;\" \/><\/div>\r\n<p id=\"N10B3B\"  >Recall also that M represents the event of being a male (\"not M\" represents being a female), and E represents the event of having one or both ears pierced.<\/p>\r\n<p  >[h5p id=\"93\"]<\/p>\r\n\r\n<\/div>\r\n<\/div>\r\nAnother way to visualize conditional probability is using a Venn diagram:\r\n\r\n<span class=\"imagewrap\"><span class=\"image\"><img class=\"img-responsive popimg aligncenter\" title=\"A Venn Diagram, in which a large rectangle represents all of the sample space. There are two circles in the rectangle, labeled M (for Male) and E (for Ear Pierced). Circle M and circle E overlap (but not totally). P(M) = 180\/500 = .36, so this is somewhat like the area of circle M. The overlap is the event M and E. P(M and E) = 36\/500 = .072, which is also like the area of the overlap area.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m2_conditional_probability\/webcontent\/image003.gif\" alt=\"A Venn Diagram, in which a large rectangle represents all of the sample space. There are two circles in the rectangle, labeled M (for Male) and E (for Ear Pierced). Circle M and circle E overlap (but not totally). P(M) = 180\/500 = .36, so this is somewhat like the area of circle M. The overlap is the event M and E. P(M and E) = 36\/500 = .072, which is also like the area of the overlap area.\" \/><\/span><\/span>\r\n<p id=\"N10B68\">In both the two-way table and the Venn diagram, the reduced sample space (comprised of only males) is shaded light green, and within this sample space, the event of interest (having ears pierced) is shaded darker green. The two-way table illustrates the idea via counts, while the Venn diagram converts the counts to probabilities, which are presented as regions rather than cells.<\/p>\r\n<p id=\"N10B6B\">We may work with counts, as presented in the two-way table, to write<\/p>\r\n<p id=\"N10B6E\">P(E | M) = 36\/180.<\/p>\r\n<p id=\"N10B71\">Or we can work with probabilities, as presented in the Venn diagram, by writing<\/p>\r\n<p id=\"N10B74\">P(E | M) = (36\/500) \/ (180\/500).<\/p>\r\n<p id=\"N10B77\">We will want, however, to write our formal expression for conditional probabilities in terms of other, ordinary, probabilities and therefore the definition of conditional probability will grow out of the Venn diagram.<\/p>\r\nNotice that\r\n\r\nP(E | M) = (36\/500) \/ (180\/500) = P(M and E) \/ P(M). Generalized, we have a formal definition of conditional probability:\r\n<dl>\r\n \t<dt>conditional probability<\/dt>\r\n \t<dd>\r\n<div class=\"meaning\">The\u00a0<em>conditional probability of event B, given event A,<\/em>\u00a0is\u00a0<em>P(B | A) = P(A and B) \/ P(A)<\/em><\/div><\/dd>\r\n<\/dl>\r\n<div class=\"section\">\r\n<div class=\"sectionContain\">\r\n<h2><span title=\"Quick scroll up\">Comments<\/span><\/h2>\r\n<ol>\r\n \t<li>Note that when we evaluate the conditional probability, we always divide by the probability of the given event. The probability of both goes in the numerator.<\/li>\r\n \t<li id=\"N10BA1\">The above formula holds as long as P(A) &gt; 0, since we cannot divide by 0. In other words, we should not seek the probability of an event given that an impossible event has occurred.<\/li>\r\n<\/ol>\r\nLet\u2019s see how we can use this formula in practice:\r\n\r\n<\/div>\r\n<\/div>\r\n<div class=\"examplewrap\">\r\n<div class=\"exHead\">\r\n<div class=\"textbox textbox--examples\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Example<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<div class=\"exHead\">On the \u201cInformation for the Patient\u201d label of a certain antidepressant, it is claimed that based on some clinical trials, there is a 14% chance of experiencing sleeping problems known as insomnia (denote this event by I), there is a 26% chance of experiencing headache (denote this event by\u00a0<em>H<\/em>), and there is a 5% chance of experiencing both side effects (<em>I and H<\/em>).<\/div>\r\n<div class=\"example clearfix\">\r\n<p id=\"N10BB4\">(a) Suppose that the patient experiences insomnia; what is the probability that the patient will also experience headache?<\/p>\r\n<p id=\"N10BB7\">Since we know (or it is given) that the patient experienced insomnia, we are looking for P(H | I). According to the definition of conditional probability:<\/p>\r\n<p id=\"N10BBA\">P(H | I) = P(H and I) \/ P(I) = .05\/.14 = .357.<\/p>\r\n(b) Suppose the drug induces headache in a patient; what is the probability that it also induces insomnia?\r\n<p id=\"N10BC0\">Here, we are given that the patient experienced headache, so we are looking for P(I | H).<\/p>\r\n<p id=\"N10BC3\">Using the definition P(I | H) = P(I and H) \/ P(H) = .05\/.26 = .1923.<\/p>\r\n\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<h2>Comment<\/h2>\r\n<\/div>\r\n<\/div>\r\n<div id=\"N10BC7\" class=\"section\">\r\n<div class=\"sectionContain\">\r\n<p id=\"N10BCE\">Note that the answers to (a) and (b) above are different. In general, P(A | B) does not equal P(B | A). We\u2019ll come back and illustrate this point later in this module.<\/p>\r\n\r\n<\/div>\r\n<\/div>\r\n<p id=\"N10BD5\">The purpose of the following activity is to give you guided practice in using the definition of conditional probability, and teach you how the Complement Rule works with conditional probability.<\/p>\r\n\r\n<div class=\"textbox textbox--exercises\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<p id=\"N10BE0\"  >Recall the delivery services example:<\/p>\r\n<p id=\"N10BE3\"  >It is vital that a certain document reach its destination within one day. To maximize the chances of on-time delivery, two copies of the document are sent using two services, service A and service B, and the following probability table summarizes the chances of on-time delivery:<\/p>\r\n\r\n<div class=\"image shouldbeleft\"><img id=\"_i_3\" class=\"img-responsive popimg aligncenter\" title=\"A table. The column headings are &quot;B,&quot; &quot;not B,&quot; and &quot;Total.&quot; The rows are &quot;A,&quot; &quot;not A,&quot; and &quot;Total.&quot; Here is the cell data in &quot;Row, Column: Value&quot; format: A,B : .75; A, not B: .15; A, Total: .90; not A, B: .05; not A, not B: .05; not A, Total: .10; Total, B: .80; Total, not B: .20; Total, Total: 1.00;\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m2_conditional_probability\/webcontent\/lbd001.gif\" alt=\"A table. The column headings are &quot;B,&quot; &quot;not B,&quot; and &quot;Total.&quot; The rows are &quot;A,&quot; &quot;not A,&quot; and &quot;Total.&quot; Here is the cell data in &quot;Row, Column: Value&quot; format: A,B : .75; A, not B: .15; A, Total: .90; not A, B: .05; not A, not B: .05; not A, Total: .10; Total, B: .80; Total, not B: .20; Total, Total: 1.00;\" \/><\/div>\r\n<div><\/div>\r\n<div>[h5p id=\"94\"]<\/div>\r\n<\/div>\r\n<\/div>\r\n<div class=\"textbox textbox--exercises\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<p id=\"N10C54\"  >Recall the smoke alarms example from the previous module. A homeowner has smoke alarms installed in the dining room (adjacent to the kitchen) and an upstairs bedroom (above the kitchen). The two-way table below shows probabilities of smoke in the kitchen triggering the alarm in the dining room (D) or not, and in the bedroom (B) or not. Use this two-way table to answer the following:<\/p>\r\n\r\n<div class=\"image shouldbeleft\"><img id=\"_i_4\" class=\"img-responsive popimg aligncenter\" title=\"A table, in which the column headings are &quot;B,&quot; &quot;not B,&quot; and &quot;Total.&quot; The rows are &quot;D,&quot; &quot;not D,&quot; and &quot;Total.&quot; Here is the data in &quot;Row,Column: Value&quot; format: D, B: .38; D, not B: .57; D, Total: .95; not D, B: .02; not D, not B: .03; not D, Total: .05; Total, B: .40; Total, not B: .60; Total, Total: 1.00;\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m2_conditional_probability\/webcontent\/dig002.gif\" alt=\"A table, in which the column headings are &quot;B,&quot; &quot;not B,&quot; and &quot;Total.&quot; The rows are &quot;D,&quot; &quot;not D,&quot; and &quot;Total.&quot; Here is the data in &quot;Row,Column: Value&quot; format: D, B: .38; D, not B: .57; D, Total: .95; not D, B: .02; not D, not B: .03; not D, Total: .05; Total, B: .40; Total, not B: .60; Total, Total: 1.00;\" \/><\/div>\r\n<div>[h5p id=\"95\"]<\/div>\r\n<\/div>\r\n<\/div>\r\n<div class=\"\">\r\n<div class=\"textbox textbox--learning-objectives\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Learning Objectives<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<ul>\r\n \t<li>Determine whether two events are independent or not.<\/li>\r\n<\/ul>\r\n<\/div>\r\n<\/div>\r\nAs we saw in the Exploratory Data Analysis section, whenever a situation involves more than one variable, it is generally of interest to determine whether or not the variables are related. In probability, we talk about independent events, and in the first module we said that two events A and B are\u00a0<em>independent<\/em>\u00a0if event A occurring\u00a0<em>does not affect<\/em> the probability that event B will occur. Now that we\u2019ve introduced conditional probability, we can formalize the definition of independence of events and develop four simple ways to check whether two events are independent or not. We will introduce these \u201cindependence checks\u201d using examples, and then summarize.\r\n<div class=\"textbox__content\">\r\n<div class=\"textbox textbox--examples\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Example<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<div class=\"\">\r\n<div class=\"textbox__content\">\r\n\r\nConsider again the two-way table for all 500 students in a particular high school, classified according to gender and whether or not they have one or both ears pierced.\r\n\r\n<span class=\"imagewrap\"><span class=\"image\"><img class=\"img-responsive popimg aligncenter\" title=\"The same table of the data for piercings. The column headings are &quot;Pierced,&quot; &quot;Not Pierced,&quot; and &quot;Total.&quot; The Rows are &quot;Male,&quot; &quot;Female,&quot; and &quot;Total.&quot; The data in the cells is given in &quot;Row, Column: Value&quot; format: Male, Pierced: 36; Male, Not Pierced: 144; Male, Total: 180; Female, Pierced: 288; Female, Not Pierced: 32; Female, Total: 320; Total, Pierced: 324; Total, Not Pierced: 176; Total, Total: 500;\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m2_conditional_probability\/webcontent\/image001.gif\" alt=\"The same table of the data for piercings. The column headings are &quot;Pierced,&quot; &quot;Not Pierced,&quot; and &quot;Total.&quot; The Rows are &quot;Male,&quot; &quot;Female,&quot; and &quot;Total.&quot; The data in the cells is given in &quot;Row, Column: Value&quot; format: Male, Pierced: 36; Male, Not Pierced: 144; Male, Total: 180; Female, Pierced: 288; Female, Not Pierced: 32; Female, Total: 320; Total, Pierced: 324; Total, Not Pierced: 176; Total, Total: 500;\" \/><\/span><\/span>\r\n\r\n<\/div>\r\n<div class=\"textbox__content\" style=\"text-align: left;\"><span class=\"imagewrap\"><span class=\"image\">Would you expect those two variables to be related? That is, would you expect having pierced ears to depend on whether the student is male or female? Or, to put it yet another way, would knowing a student\u2019s gender affect the probability that the student\u2019s ears are pierced? To answer this, we may compare the overall probability of having pierced ears to the conditional probability of having pierced ears, given that a student is male. Our intuition would tell us that the latter should be lower: male students tend not to have their ears pierced, whereas female students do. Indeed, for students in general, the probability of having pierced ears (event E) is P(E) = 324\/500 = .648. But the probability of having pierced ears given that a student is male is only P(E | M) = 36\/180 = .20.<\/span><\/span><\/div>\r\n<div class=\"textbox__content\" style=\"text-align: left;\">As we anticipated, P(E | M) is lower than P(E). The probability of a student having pierced ears changes (in this case, gets lower) when we know that the student is male, and therefore the events E and M are dependent. (If E and M were independent, knowing or not knowing that the student is male would not have made a difference \u2026 but it did.)<\/div>\r\n<div class=\"textbox__content\" style=\"text-align: left;\">This example illustrates that one method for determining whether two events are independent is to compare\u00a0<em>P(B | A)<\/em>\u00a0and\u00a0<em>P(B)<\/em>.<\/div>\r\n<\/div>\r\n<div class=\"examplewrap\">\r\n<div class=\"example clearfix\">\r\n\r\nIf the two are\u00a0<em>equal<\/em>\u00a0(i.e., knowing or not knowing whether A has occurred has no effect on the probability of B occurring) then the two events are\u00a0<em>independent<\/em>. Otherwise, if the\u00a0<em>probability changes<\/em>\u00a0depending on whether we know that A has occurred or not, then the two events are\u00a0<em>not independent<\/em>. Similarly, using the same reasoning, we can compare\u00a0<em>P(A | B)<\/em>\u00a0and\u00a0<em>P(A)<\/em>.\r\n\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<div class=\"textbox textbox--examples\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Example<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n\r\nRecall the side effects example. On the \u201cInformation for the Patient\u201d label of a certain antidepressant it is claimed that based on some clinical trials, there is a 14% chance of experiencing sleeping problems known as insomnia (denote this event by\u00a0<em>I<\/em>), there is a 26% chance of experiencing headache (denote this event by\u00a0<em>H<\/em>), and there is a 5% chance of experiencing both side effects (<em>I and H<\/em>).\r\n\r\nAre the two side effects independent of each other?\r\n\r\nTo check whether the two side effects are independent, let\u2019s compare P(H | I) and P(H).\r\n\r\nIn the previous part of this module, we found that\u00a0<em>P(H | I)<\/em>\u00a0= P(H and I) \/ P(I) = .05\/.14 =\u00a0<em>.357<\/em>, while\u00a0<em>P(H) = .26.\u00a0<\/em>Knowing that a patient experienced insomnia increases the likelihood that he\/she will also experience headache from .26 to .357. The conclusion, therefore is that the two side effects are not independent, they are dependent.\r\n\r\nAlternatively, we could have compared P(I | H) to P(I).\u00a0<em>P(I) = .14<\/em>, and previously we found that\u00a0<em>P(I | H)<\/em>\u00a0= P(I and H) \/ P(H) = .05\/.26 =\u00a0<em>.1923<\/em>, and again, since the two are not equal, we can conclude that the two side effects I and H are dependent.\r\n\r\n<\/div>\r\n<\/div>\r\n<div class=\"textbox textbox--exercises\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<p id=\"N10B69\"  >Recall again the smoke alarms example.<\/p>\r\n<p id=\"N10B6C\"  >A homeowner has smoke alarms installed in the dining room (adjacent to the kitchen) and an upstairs bedroom (above the kitchen). The two-way table below shows probabilities of smoke in the kitchen triggering the alarm in the dining room (D) or not, and in the bedroom (B) or not.<\/p>\r\n\r\n<div class=\"image shouldbeleft\"><img id=\"_i_1\" class=\"img-responsive popimg aligncenter\" title=\"A table, in which the column headings are &quot;B,&quot; &quot;not B,&quot; and &quot;Total.&quot; The rows are &quot;D,&quot; &quot;not D,&quot; and &quot;Total.&quot; Here is the data in &quot;Row,Column: Value&quot; format: D, B: .38; D, not B: .57; D, Total: .95; not D, B: .02; not D, not B: .03; not D, Total: .05; Total, B: .40; Total, not B: .60; Total, Total: 1.00;\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m2_conditional_probability\/webcontent\/dig002.gif\" alt=\"A table, in which the column headings are &quot;B,&quot; &quot;not B,&quot; and &quot;Total.&quot; The rows are &quot;D,&quot; &quot;not D,&quot; and &quot;Total.&quot; Here is the data in &quot;Row,Column: Value&quot; format: D, B: .38; D, not B: .57; D, Total: .95; not D, B: .02; not D, not B: .03; not D, Total: .05; Total, B: .40; Total, not B: .60; Total, Total: 1.00;\" \/><\/div>\r\n<div>[h5p id=\"96\"]<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<div class=\"examplewrap\">\r\n<div class=\"example clearfix\">\r\n<h2><span title=\"Quick scroll up\">Comment<\/span><\/h2>\r\n<p id=\"N10B08\">Recall the pierced ears example. We checked the independence of the events M (being a male) and E (having pierced ears) by comparing P(E) to P(E | M).<\/p>\r\nAn alternative method of checking for dependence would be to compare P(E | M) with P(E | not M) [same as P(E | F)]. In our case, P(E | M) = 36\/180 = .2, while P(E | not M) = 288\/320 = .9, and since the two are very different, we can say that the events E and M are not independent.\r\n\r\nIn general, another method for checking the independence of events A and B is to compare\u00a0<em>P(B | A) and P(B | not A)<\/em>. In other words, two events are independent if the probability of one event does not change whether we know that the other event has occurred or we know that the other event has not occurred. It can be shown that\u00a0<em>P(B | A) and P(B | not A)<\/em>. would differ whenever P(B) and P(B | A) differ, so this is another perfectly legitimate way to establish dependence or independence.\r\n<div class=\"textbox textbox--exercises\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<p id=\"N10B23\"  >Recall again the smoke alarms example.<\/p>\r\n<p id=\"N10B26\"  >A homeowner has smoke alarms installed in the dining room (adjacent to the kitchen) and an upstairs bedroom (above the kitchen). The two-way table below shows probabilities of smoke in the kitchen triggering the alarm in the dining room (D) or not, and in the bedroom (B) or not.<\/p>\r\n\r\n<div class=\"image shouldbeleft\"><img id=\"_i_0\" class=\"img-responsive popimg aligncenter\" title=\"\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m2_conditional_probability\/webcontent\/dig002.gif\" alt=\"\" \/><\/div>\r\n<div>[h5p id=\"97\"]<\/div>\r\n<\/div>\r\n<\/div>\r\nBefore we establish a general rule for independence, let\u2019s consider an example that will illustrate another method that we can use to check whether two events are independent:\r\n<div class=\"examplewrap\">\r\n<div class=\"exHead\"><\/div>\r\n<div class=\"example clearfix\">\r\n<div class=\"textbox textbox--examples\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Example<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<div class=\"examplewrap\">\r\n<div class=\"example clearfix\">\r\n<div>\r\n\r\nA group of 100 college students were surveyed about their gender and whether they had decided on a major.\r\n\r\n<span class=\"imagewrap\"><span class=\"image\"><img class=\"img-responsive popimg aligncenter\" title=\"\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m2_conditional_probability\/webcontent\/image004.gif\" alt=\"\" \/><\/span><\/span>\r\n\r\nOffhand, we wouldn\u2019t necessarily have any compelling reason to expect that deciding on a major would depend on a student\u2019s gender. We can check for independence by comparing the overall probability of being decided to the probability of being decided given that a student is female:\r\n\r\nP(D) = 45\/100 = .45 and P(D | F) = 27\/60 = .45.\r\n\r\nThe fact that the two are equal tells us that, as we might expect, deciding on a major is independent of gender. Note from the comment that these must also equal P(D | M), which is 18\/40 = .45.\r\n\r\nNow let\u2019s approach the issue of independence in a different way: first, we may note that the overall probability of being decided is 45\/100 = .45.\r\n\r\n<span class=\"imagewrap\"><span class=\"image\"><img class=\"img-responsive popimg aligncenter\" title=\"\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m2_conditional_probability\/webcontent\/image005.gif\" alt=\"\" \/><\/span><\/span>\r\n\r\nAnd the overall probability of being female is 60\/100 = .60.\r\n\r\n<span class=\"imagewrap\"><span class=\"image\"><img class=\"img-responsive popimg aligncenter\" title=\"\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m2_conditional_probability\/webcontent\/image006.gif\" alt=\"\" \/><\/span><\/span>\r\n\r\nIf being decided is independent of gender, then 45% of the 60% of the class who are female should have a decided major; in other words, the probability of being female and decided should equal the probability of being female multiplied by the probability of being decided. If the events F and D are independent, we should have P(F and D) = P(F) * P(D).\r\n\r\nIn fact, P(F and D) = 27\/100 = .27 = P(F) * P(D) = .45 * .60. This confirms our alternate verification of independence.\r\n\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<p id=\"N10B8D\"><\/p>\r\n\r\n<\/div>\r\n<\/div>\r\nIn general, another method for checking the independence of events A and B is to compare P(A and B) to P(A) * P(B). If the two are equal, then A and B are independent, otherwise the two are not independent.\r\n\r\nLet\u2019s summarize all the possible methods we\u2019ve seen for checking the independence of events in one rule:\r\n\r\nTwo events A and B are independent if any one of the following hold:\r\n\r\nP(B | A) = P(B)\r\n\r\nP(A | B) = P(A)\r\n\r\nP(B | A) = P(B | not A)\r\n\r\nP(A and B) = P(A) * P(B)\r\n\r\n<\/div>\r\n<\/div>\r\n<div id=\"N10B90\" class=\"section\">\r\n<div class=\"sectionContain\">\r\n<h2><span title=\"Quick scroll up\">Comment<\/span><\/h2>\r\nThese various equalities turn out to be equivalent, so that if one equality holds, all are equal, and if one equality does not hold, all are not equal. (This is the case for the same reason that knowing one of the values P(A and B), P(A and not B), P(not A and B), or P(not A and not B), along with P(A) and P(B), allows you to determine the remaining cells of a two-way probability table.)\r\n\r\nTherefore, in order to check whether events A and B are independent or not, it is sufficient to check only whether one of the four equalities holds\u2014whichever is easiest for you.\r\n\r\n<\/div>\r\n<\/div>\r\nThe purpose of the next activity is to practice checking the independence of two events using the four different possible methods that we\u2019ve provided, and see that all of them will lead us to the same conclusion, regardless of which of the four methods we use.\r\n<div class=\"textbox textbox--exercises\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<p id=\"N1006F\"  >Recall the delivery services example:<\/p>\r\n<p id=\"N10072\"  >It is vital that a certain document reach its destination within one day. To maximize the chances of on-time delivery, two copies of the document are sent using two services, service A and service B, and the following probability table summarizes the chances of on-time delivery:<\/p>\r\n\r\n<div class=\"image shouldbeleft\"><img id=\"N10075\" class=\" img-responsive popimg\" title=\"probability tables of two different delivey services\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m2_conditional_probability\/webcontent\/lbd001.gif\" alt=\"probability tables of two different delivey services\" \/><\/div>\r\n<div><\/div>\r\n<p id=\"N10079\"  >Are the delivery times of the two services independent? In other words, are the events A and B independent? Common sense would say that there will be some degree of dependence between A and B, since the reasons that would cause one service to be delayed (like bad weather, airport delays, etc), would most likely also affect the other service, and cause it to be delayed too. Let's review the four possible methods that we can use to check whether events A and B are independent:<\/p>\r\n<p id=\"N1007C\"  >Two events A and B are independent if any one of the following hold:<\/p>\r\n<p id=\"N1007F\"  >P(B | A) = P(B)<\/p>\r\n<p id=\"N10082\"  >P(A | B) = P(A)<\/p>\r\n<p id=\"N10085\"  >P(B | A) = P(B | not A)<\/p>\r\n<p id=\"N10088\"  >P(A and B) = P(A) * P(B)<\/p>\r\n<p id=\"N1008B\"  >Use the four different methods to check whether events A and B are independent, and see that indeed all four are leading you to the same conclusion.<\/p>\r\n<p  >[h5p id=\"98\"]<\/p>\r\n\r\n<\/div>\r\n<\/div>\r\n<div class=\"\">\r\n<div class=\"textbox textbox--learning-objectives\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Learning Objectives<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n<ul>\r\n \t<li>Use the General Multiplication Rule to find the probability that two events occur (P(A and B)).<\/li>\r\n<\/ul>\r\n<\/div>\r\n<\/div>\r\nNow that we have an understanding of conditional probabilities and can express them with concise notation, and have a more formal understanding of what it means for two events to be independent, we can finally establish the General Multiplication Rule, a formal rule for finding P(A and B) that applies to any two events, whether they are independent or dependent.\r\n\r\n<\/div>\r\n<p id=\"N10AF4\">We begin with an example that contrasts P(A and B) for independent and dependent cases.<\/p>\r\n\r\n<div class=\"examplewrap\">\r\n<div class=\"example clearfix\">\r\n<div class=\"textbox textbox--examples\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Example<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n\r\nSuppose you pick two cards at random from four cards consisting of one of each suit: club, diamond, heart, and spade, where the first card is replaced before the second card is picked. What is the probability of picking a club and then a diamond? Because the sampling is done with replacement, whether or not a diamond is picked on the second selection is independent of whether or not a club has been picked on the first selection. Rule 5, the multiplication rule for independent events, tells us that:\r\n<p id=\"N10AFC\">P(C1 and D2) = P(C1) * P(D2) = 1\/4 * 1\/4 = 1\/16.<\/p>\r\n[Here we denote the event \u201cclub picked on first selection\u201d as C1 and the event \u201cdiamond picked on second selection\u201d as D2.] The display below shows that 1\/4 of the time we\u2019ll pick a club first, and of these times, 1\/4 will result in a diamond on the second pick: 1\/4 * 1\/4 = 1\/16 of the selections will have a club first and then a diamond.\r\n\r\n<span class=\"imagewrap\"><span class=\"image\"><img class=\"img-responsive popimg aligncenter\" title=\"All of the suit possibilities of picking one card, then replacing it and picking a second card. These possibilities are: SC, SD, SH, SS, HC, HD, HH, HS, DC, DD, DH, DS, CC, CD, CH, CS. Note that 1\/4 of these have C picked first (the last 4, out of 16 total). Out of these, only one is CD, which is 1\/4 of all of the possibilities with C picked first.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m2_conditional_probability\/webcontent\/image007.gif\" alt=\"All of the suit possibilities of picking one card, then replacing it and picking a second card. These possibilities are: SC, SD, SH, SS, HC, HD, HH, HS, DC, DD, DH, DS, CC, CD, CH, CS. Note that 1\/4 of these have C picked first (the last 4, out of 16 total). Out of these, only one is CD, which is 1\/4 of all of the possibilities with C picked first.\" \/><\/span><\/span>\r\n\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<div class=\"examplewrap\">\r\n<div class=\"example clearfix\">\r\n<div class=\"textbox textbox--examples\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Example<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n\r\nSuppose you pick two cards at random from four cards consisting of one of each suit: club, diamond, heart, and spade, without replacing the first card before the second card is picked. What is the probability of picking a club and then a diamond? The probability in this case is not 1\/4 * 1\/4 = 1\/16; because the sampling is done without replacement, so whether or not a diamond is picked on the second selection\u00a0<em>does<\/em>\u00a0depend on what was picked on the first selection. (For instance, if a diamond was picked on the first selection, the probability of another diamond is zero!) As in the example above, 1\/4 of the time we\u2019ll pick a club first. But since the club has been removed, 1\/3 of these selections with a club first will have a diamond second. The probability of a club and then a diamond is 1\/4*1\/3=1\/12; this is the probability of getting a club first, multiplied by the probability of getting a diamond second, given that a club was picked first. Using the notation of conditional probabilities, we can write\r\n\r\nP(C1 and D2) = P(C1) * P(D2 | C1) = 1\/4 * 1\/3 = 1\/12.\r\n\r\n<span class=\"imagewrap\"><span class=\"image\"><img class=\"img-responsive popimg aligncenter\" title=\"All of the suit possibilities of picking one card then a second card, without replacing any cards. These possibilities are: SC, SD, SH, HC, HD, HS, DC, DH, DS, CD, CH, CS. Note that 1\/4 of these have C picked first (the last 3, out of 12 total). Out of these, only one is CD. CD is 1\/3 of all of the possibilities with C picked first.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m2_conditional_probability\/webcontent\/image008.gif\" alt=\"All of the suit possibilities of picking one card then a second card, without replacing any cards. These possibilities are: SC, SD, SH, HC, HD, HS, DC, DH, DS, CD, CH, CS. Note that 1\/4 of these have C picked first (the last 3, out of 12 total). Out of these, only one is CD. CD is 1\/3 of all of the possibilities with C picked first.\" \/><\/span><\/span>\r\n\r\n<\/div>\r\n<\/div>\r\nFor independent events A and B, we had the rule P(A and B) = P(A) * P(B). Due to independence, to find the probability of both, we could multiply the probability of A by the simple probability of B, because the occurrence of A would have no effect on the probability of B occurring. Now, for events A and B that may be dependent, to find the probability of both, we multiply the probability of A by the conditional probability of B, taking into account that A has occurred. Thus, our general multiplication rule is stated as follows:\r\n\r\n<\/div>\r\n<\/div>\r\n<table id=\"N10B1E_bx\" class=\"theorem labeled\">\r\n<thead>\r\n<tr>\r\n<th><\/th>\r\n<\/tr>\r\n<\/thead>\r\n<tbody>\r\n<tr>\r\n<td>\r\n<div class=\"theorem\">\r\n<div class=\"statement\">\r\n\r\n<em>The General Multiplication Rule:\u00a0<\/em>For any two events A and B,\u00a0<em>P(A and B) = P(A) * P(B | A)<\/em>\r\n\r\n<\/div>\r\n<\/div><\/td>\r\n<\/tr>\r\n<\/tbody>\r\n<\/table>\r\n\r\n<hr \/>\r\n\r\nHere, again, is the General Multiplication Rule:\r\n\r\n<em>For any two events A and B, P(A and B) = P(A) * P(B | A)<\/em>\r\n<div class=\"section\">\r\n<div class=\"sectionContain\">\r\n<h2><span title=\"Quick scroll up\">Comments<\/span><\/h2>\r\n<ol>\r\n \t<li>Note that although the motivation for this rule was to find P(A and B) when A and B are not independent, this rule is general in the sense that if A and B happen to be\u00a0<em>independent<\/em>, then P(B | A) = P(B) is true, and we\u2019re back to Rule 5\u2014the Multiplication Rule for Independent Events: P(A and B) = P(A) * P(B).<\/li>\r\n \t<li>The General Multiplication Rule is just the definition of conditional probability in disguise. Recall the definition of conditional probability:\u00a0<em>P(B | A) = P(A and B) \/ P(A)<\/em>\u00a0Let\u2019s isolate P(A and B) by multiplying both sides of the equation by P(A), and we get:\u00a0<em>P(A and B) = P(A) * P(B | A)<\/em>. That\u2019s it \u2026 this is the General Multiplication Rule.<\/li>\r\n \t<li>The General Multiplication Rule is useful when two events, A and B, occur in stages, first A and then B (like the selection of the two cards in the previous example). Thinking about it this way makes the General Multiplication Rule very intuitive. For both A and B to occur you first need A to occur (which happens with probability P(A)),\u00a0<em>and<\/em>\u00a0then you need B to occur, knowing that A has already occurred (which happens with probability P(B | A)).<\/li>\r\n<\/ol>\r\n<div class=\"textbox textbox--exercises\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n\r\nA woman's pocket contains 2 quarters and 2 nickels; she randomly extracts one of the coins, and without replacing it picks a second coin.\r\n\r\n[h5p id=\"99\"]\r\n\r\n<\/div>\r\n<\/div>\r\nLet\u2019s look at another, more realistic example:\r\n<div class=\"examplewrap\">\r\n<div class=\"example clearfix\">\r\n<div class=\"textbox textbox--examples\"><header class=\"textbox__header\">\r\n<h3 class=\"textbox__title\">Example<\/h3>\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n\r\nIn a certain region, one in every thousand people (0.001) of all individuals are infected by the HIV virus that causes AIDS. Tests for presence of the virus are fairly accurate but not perfect. If someone actually has HIV, the probability of testing positive is .95. Let\u00a0<em>H<\/em>\u00a0denote the event of having HIV, and\u00a0<em>T<\/em>\u00a0the event of testing positive.\r\n<p id=\"N10B6F\">(a) Express the information that is given in the problem in terms of the events H and T.<\/p>\r\n\u201cone in every thousand people (0.001) of all individuals are infected with HIV\u201d \u2192\u00a0<em>P(H) = .001<\/em>\r\n\r\n\u201cIf someone actually has HIV, the probability of testing positive is .95\u201d \u2192\u00a0<em>P(T | H) = .95<\/em>\r\n\r\n(b) Use the General Multiplication Rule to find the probability that someone chosen at random from the population has HIV and tests positive.\r\n\r\n<em>P(H and T)<\/em>\u00a0= P(H) * P(T | H) = .001*.95 = .00095.\r\n\r\n(c) If someone has HIV, what is the probability of testing negative? Here we need to find P(not T | H).\r\n\r\nRecall from an activity earlier in this module that the Complement Rule works with conditional probabilities as long as we condition on the same event, therefore:\u00a0<em>P(not T | H)<\/em> = 1 \u2013 P(T | H) = 1 \u2013 .95 = .05.\r\n\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>","rendered":"<div class=\"\">\n<h2 class=\"textbox__header\">Basic Probability Rules<\/h2>\n<\/div>\n<div class=\"section\">\n<div class=\"sectionContain\">\n<div class=\"textbox textbox--learning-objectives\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Learning Objectives<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<ul>\n<li>Apply probability rules in order to find the likelihood of an event.<\/li>\n<li>When appropriate, use tools such as Venn diagrams or probability tables as aids for finding probabilities.<\/li>\n<\/ul>\n<\/div>\n<\/div>\n<p>In the previous section we considered situations in which all the possible outcomes of a random experiment are equally likely, and learned a simple way to find the probability of any event in this special case. We are now moving on to learn how to find the probability of events in the general case (when the possible outcomes are not necessarily equally likely), using five basic probability rules. Fortunately, these basic rules of probability are very intuitive, and as long as they are applied systematically, they will let us solve more complicated problems; in particular, those problems for which our intuition might be inadequate.<\/p>\n<\/div>\n<\/div>\n<table id=\"N10B05_bx\" class=\"theorem labeled\">\n<thead>\n<tr>\n<th>\n<h5>Rule 1<\/h5>\n<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>\n<div class=\"theorem\">\n<div class=\"statement\">\n<p><em>For any event A, 0 \u2264 P(A) \u2264 1.<\/em><\/p>\n<\/div>\n<\/div>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>This first rule simply reminds us of the basic property of probability that we\u2019ve already learned. The probability of an event, which informs us of the likelihood of it occurring, can range anywhere from 0 (indicating that the event will never occur) to 1 (indicating that the event is certain). One practical use of this rule is that is can be used to identify any probability calculation that comes out to be more than 1 as wrong.<\/p>\n<p>Before moving on to the other rules, let\u2019s first look at an example that will provide a context for illustrating the next several rules.<\/p>\n<div class=\"examplewrap\">\n<div class=\"example clearfix\">\n<div class=\"textbox textbox--examples\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Example<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<div class=\"examplewrap\">\n<div class=\"example clearfix\">\n<p>As previously discussed, all human blood can be typed as O, A, B or AB. In addition, the frequency of the occurrence of these blood types varies by ethnic and racial groups. According to Stanford University\u2019s Blood Center (<a href=\"http:\/\/bloodcenter.stanford.edu\/\" target=\"_blank\" rel=\"noopener\">bloodcenter.stanford.edu<\/a>), these are the probabilities of human blood types in the United States (the probability for type A has been omitted on purpose):<\/p>\n<p><span class=\"imagewrap\"><span class=\"image\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"Data given in &quot;Blood Type: Probability&quot; Format: O: 0.44; A: ?; B: 0.10; AB: 0.04;\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image010.gif\" alt=\"Data given in &quot;Blood Type: Probability&quot; Format: O: 0.44; A: ?; B: 0.10; AB: 0.04;\" \/><\/span><\/span><\/p>\n<p><em>Motivating question for rule 2:<\/em>\u00a0A person in the United States is chosen at random. What is the probability of the person having blood type A?<\/p>\n<p><em>Answer:<\/em>\u00a0Our intuition tells us that since the four blood types O, A, B, and AB exhaust all the possibilities, their probabilities together must sum to 1, which is the probability of a \u201ccertain\u201d event (a person has one of these 4 blood types for certain). Since the probabilities of O, B, and AB together sum to .44 + .1 + .04 = .58, the probability of type A must be the remaining .42 (1 \u2013 .58 = .42):<\/p>\n<p><span class=\"imagewrap\"><span class=\"image\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"Data given in &quot;Blood Type: Probability&quot; Format: O: 0.44; A: 0.42; B: 0.10; AB: 0.04;\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image011.gif\" alt=\"Data given in &quot;Blood Type: Probability&quot; Format: O: 0.44; A: 0.42; B: 0.10; AB: 0.04;\" \/><\/span><\/span><\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<p>This example illustrates our second rule, which tells us that the probability of all outcomes in the sample space together must be 1.<\/p>\n<table id=\"N10B42_bx\" class=\"theorem labeled\">\n<thead>\n<tr>\n<th>\n<h5>Rule 2<\/h5>\n<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>\n<div class=\"theorem\">\n<div class=\"statement\">\n<p id=\"N10B49\"><em>P(S) = 1; that is, the sum of the probabilities of all possible outcomes is 1.<\/em><\/p>\n<\/div>\n<\/div>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<h2>Comment<\/h2>\n<\/div>\n<\/div>\n<div id=\"N10B4F\" class=\"section\">\n<div class=\"sectionContain\">\n<p>This is a good place to compare and contrast what we\u2019re doing here with what we learned in the Exploratory Data Analysis (EDA) section. Notice that in this problem we are essentially focusing on a single categorical variable: blood type. We summarized this variable above, as we summarized single categorical variables in the EDA section, by listing what values the variable takes and how often it takes them. In EDA we used percentages, and here we\u2019re using probabilities, but the two convey the same information. In the EDA section, we learned that a pie chart provides an appropriate display when a single categorical variable is involved, and similarly we can use it here (using percentages instead of probabilities):<\/p>\n<p><span class=\"imagewrap\"><span class=\"image\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"A pie chart, titled &quot;Blood Types.&quot; Type O takes up 44% of the pie chart, A uses 42%, AB represents 4%, and B represents the rest, 10%.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image012.gif\" alt=\"A pie chart, titled &quot;Blood Types.&quot; Type O takes up 44% of the pie chart, A uses 42%, AB represents 4%, and B represents the rest, 10%.\" \/><\/span><\/span><\/p>\n<p id=\"N10B5F\">Even though what we\u2019re doing here is indeed similar to what we\u2019ve done in the EDA section, there is a subtle but important difference between the underlying situations in this section and the ones in the Exploratory Data Analysis section. In EDA, we summarized data that were obtained from a\u00a0<em>sample<\/em>\u00a0of individuals for whom values of the variable of interest were recorded. Here, when we present the frequency, or probability, of each blood type, we have in mind the entire\u00a0<em>population<\/em>\u00a0of people in the United States, for which we are presuming to know the overall frequency of values taken by the variable of interest.<\/p>\n<div class=\"textbox textbox--exercises\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p id=\"N1006E\">Marital status can be categorized into: never married, married, widowedor divorced.<\/p>\n<p id=\"N10070\">According to Infoplease.com, the following are the probabilities of those marital status categories for adults in the United States (data from 2000):<\/p>\n<div class=\"image shouldbeleft\"><img decoding=\"async\" id=\"N10072\" class=\"img-responsive popimg aligncenter\" title=\"\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/dig012.gif\" alt=\"\" \/><\/div>\n<div><\/div>\n<div>\n<div id=\"h5p-63\">\n<div class=\"h5p-iframe-wrapper\"><iframe id=\"h5p-iframe-63\" class=\"h5p-iframe\" data-content-id=\"63\" style=\"height:1px\" src=\"about:blank\" frameBorder=\"0\" scrolling=\"no\" title=\"4.2 Did I get this 1\"><\/iframe><\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<p>Let\u2019s move on to rule 3. In probability and in its applications, we are frequently interested in finding out the probability that a certain event will\u00a0<em>not<\/em>\u00a0occur. An important point to understand here is that \u201cevent A does not occur\u201d is\u00a0<em>a separate event<\/em>\u00a0that consists of all the outcomes in the sample space S that are not in A. It is for this reason that the event \u201cevent A does not occur\u201d is called\u00a0<em class=\"bold\">\u201cthe complement event of A,\u201d<\/em>\u00a0since it compares event A to the whole sample space. Notation: we will write\u00a0<em>\u201cnot A\u201d<\/em>\u00a0to denote the event that A does\u00a0<em>not<\/em>\u00a0occur. Here is a visual representation of how event A and its complement event \u201cnot A\u201d together represent the whole sample space.<\/p>\n<p><span class=\"imagewrap\"><span class=\"image\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"The entire sample space S is represented with a gray box. Inside of this box is a blue circle, representing all outcomes in A. Everything else in the gray box but outside of the blue circle is &quot;not A&quot;.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image013.gif\" alt=\"The entire sample space S is represented with a gray box. Inside of this box is a blue circle, representing all outcomes in A. Everything else in the gray box but outside of the blue circle is &quot;not A&quot;.\" \/><\/span><\/span><\/p>\n<div class=\"section\">\n<div class=\"sectionContain\">\n<h2><span title=\"Quick scroll up\">Comment<\/span><\/h2>\n<p>Such a visual display is called a \u201cVenn diagram.\u201d A Venn diagram is a simple way to visualize events and the relationships between them using rectangles and circles. We will use Venn diagrams throughout this module.<\/p>\n<\/div>\n<\/div>\n<p>Rule 3 deals with the relationship between the probability of an event and the probability of its complement event. Given that event A and event \u201cnot A\u201d together make up the whole sample space S, and since rule 2 tells us that P(S) = 1, the following rule should be quite intuitive:<\/p>\n<table id=\"N10B31_bx\" class=\"theorem labeled\">\n<thead>\n<tr>\n<th>\n<h5>Rule 3: The Complement Rule<\/h5>\n<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>\n<div class=\"theorem\">\n<div class=\"statement\">\n<p id=\"N10B39\"><em>P(not A) = 1 \u2013 P(A); that is, the probability that an event does not occur is 1 minus the probability that it does occur.<\/em><\/p>\n<\/div>\n<\/div>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<div class=\"examplewrap\">\n<div class=\"example clearfix\">\n<div class=\"textbox textbox--examples\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Example<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p id=\"N10B43\">Back to the blood type example:<\/p>\n<p><span class=\"imagewrap\"><span class=\"image\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"Data given in &quot;Blood Type: Probability&quot; Format: O: 0.44; A: 0.42; B: 0.10; AB: 0.04;\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image011.gif\" alt=\"Data given in &quot;Blood Type: Probability&quot; Format: O: 0.44; A: 0.42; B: 0.10; AB: 0.04;\" \/><\/span><\/span><\/p>\n<p>Here is some additional information:<\/p>\n<ul>\n<li>A person with type\u00a0<em>A<\/em>\u00a0can donate blood to a person with type\u00a0<em>A<\/em>\u00a0or\u00a0<em>AB<\/em>.<\/li>\n<li>A person with type\u00a0<em>B<\/em>\u00a0can donate blood to a person with type\u00a0<em>B<\/em>\u00a0or\u00a0<em>AB<\/em>.<\/li>\n<li>A person with type\u00a0<em>AB<\/em>\u00a0can donate blood to a person with type\u00a0<em>AB<\/em>\u00a0only.<\/li>\n<li>A person with type\u00a0<em>O<\/em>\u00a0blood can donate to anyone.<\/li>\n<\/ul>\n<p>What is the probability that a randomly chosen person cannot donate blood to everyone? In other words, what is the probability that a randomly chosen person does not have blood type O? We need to find P(not O). Using the Complement Rule, P(not O) = 1 \u2013 P(O) = 1 \u2013 .44 = .56. In other words, 56% of the U.S. population does not have blood type O:<\/p>\n<p><span class=\"imagewrap\"><span class=\"image\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"A pie chart, titled &quot;Blood Types.&quot; Type O takes up 44% of the pie chart, A uses 42%, AB represents 4%, and B represents the rest, 10%. Note that the types of blood which are &quot;not O&quot; take up 56% of the pie chart.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image014.gif\" alt=\"A pie chart, titled &quot;Blood Types.&quot; Type O takes up 44% of the pie chart, A uses 42%, AB represents 4%, and B represents the rest, 10%. Note that the types of blood which are &quot;not O&quot; take up 56% of the pie chart.\" \/><\/span><\/span><\/p>\n<\/div>\n<\/div>\n<h2>Comment<\/h2>\n<\/div>\n<\/div>\n<div id=\"N10B83\" class=\"section\">\n<div class=\"sectionContain\">\n<p id=\"N10B8A\">Note that the Complement Rule,\u00a0<em>P(not A) = 1 \u2013 P(A)\u00a0<\/em>can be re-formulated as\u00a0<em>P(A) = 1 \u2013 P(not A).\u00a0<\/em>This seemingly trivial algebraic manipulation has an important application, and actually captures the strength of the complement rule. In some cases, when finding P(A) directly is very complicated, it might be much easier to find P(not A) and then just subtract it from 1 to get the desired P(A). We will come back to this comment and see examples later in this module.<\/p>\n<div class=\"textbox textbox--exercises\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p id=\"N10B9F\">On the &#8220;Information for the Patient&#8221; label of a certain antidepressant it is claimed that based on some clinical trials, when taking this medication<\/p>\n<p id=\"N10BA2\">&#8211; there is a 14% chance of experiencing sleeping problems, or insomnia (denote this event by I)<\/p>\n<p id=\"N10BA5\">&#8211; there is a 26% chance of experiencing headaches (denote this event by H), and<\/p>\n<p id=\"N10BA8\">&#8211; there is a 35% chance of experiencing at least one of these two side effects (denote this event by L)<\/p>\n<div id=\"h5p-64\">\n<div class=\"h5p-iframe-wrapper\"><iframe id=\"h5p-iframe-64\" class=\"h5p-iframe\" data-content-id=\"64\" style=\"height:1px\" src=\"about:blank\" frameBorder=\"0\" scrolling=\"no\" title=\"4.2 Did I get this 2\"><\/iframe><\/div>\n<\/div>\n<\/div>\n<\/div>\n<hr \/>\n<p>We are now moving to rule 4, which deals with another situation of frequent interest, finding P(A\u00a0<em>or<\/em>\u00a0B), the probability of one event\u00a0<em>or<\/em>\u00a0another occurring. Before we get to the actual rule, however, we need some clarifications and definitions.<\/p>\n<p>When a parent says to his or her child in a toy store \u201cDo you want toy A or toy B?\u201d, this means that the child is going to get only one toy and he or she has to choose between them. Getting both toys is usually not an option.<\/p>\n<p>In contrast,<\/p>\n<p><em>In probability, \u201cOR\u201d means either one or the other or both.<\/em><\/p>\n<p id=\"N10B1E\">and so,<\/p>\n<p id=\"N10B21\"><em>P(A or B) = P(event A occurs or event B occurs or both occur)<\/em><\/p>\n<p>Having said that, it should be noted that there are some cases where it is simply impossible for the two events to both occur at the same time, in which case we don\u2019t have to worry about the possibility that both occur when we try to find P(A or B). The distinction between events that can happen together and those that cannot is an important one.<\/p>\n<p id=\"N10B2A\">Here are two examples:<\/p>\n<div class=\"examplewrap\">\n<div class=\"example clearfix\">\n<div class=\"textbox textbox--examples\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Example<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p>Consider the following two events:<\/p>\n<p>A\u2014a randomly chosen person has blood type A, and<\/p>\n<p>B\u2014a randomly chosen person has blood type B.<\/p>\n<p>In rare cases, it is possible for a person to have more than one type of blood flowing through his or her veins, but for our purposes, we are going to assume that each person can have only one blood type. Therefore, it is impossible for the events A and B to occur together.<\/p>\n<\/div>\n<\/div>\n<p>On the other hand \u2026<\/p>\n<\/div>\n<\/div>\n<div class=\"examplewrap\">\n<div class=\"example clearfix\">\n<div class=\"textbox textbox--examples\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Example<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<div class=\"examplewrap\">\n<div class=\"example clearfix\">\n<div>\n<p>Consider the following two events:<\/p>\n<p>A\u2014a randomly chosen person has blood type A<\/p>\n<p>B\u2014a randomly chosen person is a woman.<\/p>\n<p>In this case, it\u00a0<em>is possible<\/em>\u00a0for events A and B to occur together.<\/p>\n<p id=\"N10B50\"><em>Definition:<\/em>\u00a0Two events that cannot occur at the same time are called\u00a0<em>disjoint<\/em>\u00a0or\u00a0<em>mutually exclusive.<\/em>\u00a0(We will use disjoint.)<\/p>\n<p>We can therefore say that in the first example events A and B are disjoint, and in the second example they are not disjoint. Using Venn diagrams, we can visualize two events that are disjoint and compare them to two events that are not:<\/p>\n<p><span class=\"imagewrap\"><span class=\"image\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"A Venn diagram titled &quot;A and B are Disjoint.&quot; The entire sample space is represented as a rectangle. Inside the rectangle are two separate circles. One circle represents the events in A and the other represents the events in B.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image015.gif\" alt=\"A Venn diagram titled &quot;A and B are Disjoint.&quot; The entire sample space is represented as a rectangle. Inside the rectangle are two separate circles. One circle represents the events in A and the other represents the events in B.\" \/><\/span><\/span><span class=\"imagewrap\"><span class=\"image\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"A Venn diagram titled &quot;A and B are NOT Disjoint.&quot; The entire sample space is represented as a rectangle. Inside the rectangle are two circles. One circle represents the occurrences in A and the other represents the occurrences in B. These two are not disjoint, so the two circles partially overlap each other. (Being NOT disjoint, two circles could overlap each other completely, but in this example they do not.)\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image016.gif\" alt=\"A Venn diagram titled &quot;A and B are NOT Disjoint.&quot; The entire sample space is represented as a rectangle. Inside the rectangle are two circles. One circle represents the occurrences in A and the other represents the occurrences in B. These two are not disjoint, so the two circles partially overlap each other. (Being NOT disjoint, two circles could overlap each other completely, but in this example they do not.)\" \/><\/span><\/span><\/p>\n<\/div>\n<\/div>\n<\/div>\n<p id=\"N10B6C\">The Venn diagrams suggest that another way to think about disjoint versus not disjoint events is that disjoint events\u00a0<em>do not overlap<\/em>. They do not share any of the possible outcomes, and therefore cannot happen together. On the other hand, events that are not disjoint are overlapping in the sense that they share some of the possible outcomes and therefore can occur at the same time.<\/p>\n<\/div>\n<\/div>\n<div class=\"textbox textbox--exercises\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p id=\"N10B7F\">Recall the couple that is planning to have 3 children, where the sample space S of all possible outcomes is:<\/p>\n<p id=\"N10B82\">S={BBB, BBG, BGB, GBB, GGB, GBG, BGG, GGG}<\/p>\n<p><span style=\"text-align: initial; font-size: 1em; word-spacing: normal;\">Consider the following two events:<\/span><\/p>\n<p>A\u2014the middle child is a girl<\/p>\n<p id=\"N1007A\">C\u2014the three children are of the same gender<\/p>\n<p><img decoding=\"async\" class=\"aligncenter\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/webcontent\/flash\/images\/lbd002.gif\" alt=\"image\" \/><\/p>\n<div class=\"asx\">\n<div id=\"du3_m1_rules3_tutor1\" class=\"activitywrap sectionNest flash\">\n<div class=\"activityhead\">\n<div class=\"activityinfo\"><\/div>\n<\/div>\n<div class=\"actContain\">\n<div class=\"activity flash\">\n<div id=\"u3_m1_rules3_tutor1\" class=\"flash_obj asx testFlash mark_flash\">\n<div id=\"ou3_m1_rules3_tutor1\" class=\"page 2963789\">\n<div id=\"2963789\" class=\"question\">\n<div>\n<div id=\"h5p-65\">\n<div class=\"h5p-iframe-wrapper\"><iframe id=\"h5p-iframe-65\" class=\"h5p-iframe\" data-content-id=\"65\" style=\"height:1px\" src=\"about:blank\" frameBorder=\"0\" scrolling=\"no\" title=\"4.2 learn by doing 1\"><\/iframe><\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<div class=\"textbox textbox--exercises\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<div>\n<p id=\"N1006F\">A couple decides to have children until they have one boy and one girl, but they will not have more than three children. The sample space of possible outcomes is S = {GB, BG, BBG, GGB, BBB, GGG}.<\/p>\n<p>Consider the following events:<\/p>\n<p id=\"N10075\">A\u2013the couple has one boy<\/p>\n<p>C\u2013the couple has three children<\/p>\n<p id=\"N1007B\">D\u2013all of the children are the same gender<\/p>\n<p id=\"N1007E\">Determine if the following pairs of events are disjoint.<\/p>\n<\/div>\n<div id=\"2963832\" class=\"question ddfb\">\n<div><\/div>\n<\/div>\n<div id=\"2963834\" class=\"question ddfb\">\n<div>\n<p id=\"N1009F\">\n<div id=\"h5p-66\">\n<div class=\"h5p-iframe-wrapper\"><iframe id=\"h5p-iframe-66\" class=\"h5p-iframe\" data-content-id=\"66\" style=\"height:1px\" src=\"about:blank\" frameBorder=\"0\" scrolling=\"no\" title=\"4.2 Did I get this 3\"><\/iframe><\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<p>Now that we understand the idea of disjoint events, we can finally get to rule 4. Rule 4 actually has two versions, one for finding P(A or B) in the special case when events A and B are disjoint, and a more general version for when the events are not necessarily disjoint. We will first present the version of rule 4 that is restricted to disjoint events, and later in the module (after rule 5) we will revisit rule 4 and present the more general version.<\/p>\n<table id=\"N10B19_bx\" class=\"theorem labeled\">\n<thead>\n<tr>\n<th>\n<h5>Rule 4: The Addition Rule for Disjoint Events<\/h5>\n<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>\n<div class=\"theorem\">\n<div class=\"statement\">\n<p><em>The Addition Rule for Disjoint Events: If A and B are disjoint events, then P(A or B) = P(A) + P(B).<\/em><\/p>\n<\/div>\n<\/div>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<div class=\"section\">\n<div class=\"sectionContain\">\n<h2><span title=\"Quick scroll up\">Comment<\/span><\/h2>\n<p>When dealing with probabilities, the word \u201cor\u201d will always be associated with the operation of addition; hence the name of this rule, \u201cThe Addition Rule.\u201d<\/p>\n<\/div>\n<\/div>\n<div class=\"examplewrap\">\n<div class=\"example clearfix\">\n<div class=\"textbox textbox--examples\">\n<header class=\"textbox__header\">\n<h1 class=\"textbox__title\">Example<\/h1>\n<\/header>\n<div class=\"textbox__content\">\n<p>Recall the blood type example:<\/p>\n<p><span class=\"imagewrap\"><span class=\"image\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"Data given in &quot;Blood Type: Probability&quot; Format: O: 0.44; A: 0.42; B: 0.10; AB: 0.04;\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image011.gif\" alt=\"Data given in &quot;Blood Type: Probability&quot; Format: O: 0.44; A: 0.42; B: 0.10; AB: 0.04;\" \/><\/span><\/span><\/p>\n<p id=\"N10B40\">Here is some additional information:<\/p>\n<p>* A person with type\u00a0<em>A<\/em>\u00a0can donate blood to a person with type\u00a0<em>A<\/em>\u00a0or\u00a0<em>AB.<\/em><\/p>\n<p>* A person with type\u00a0<em>B<\/em>\u00a0can donate blood to a person with type\u00a0<em>B<\/em>\u00a0or\u00a0<em>AB.<\/em><\/p>\n<p>* A person with type\u00a0<em>AB<\/em>\u00a0can donate blood to a person with type\u00a0<em>AB<\/em>\u00a0only.<\/p>\n<p id=\"N10B64\">* A person with type\u00a0<em>O<\/em>\u00a0blood can donate to anyone.<\/p>\n<p id=\"N10B6A\">What is the probability that a randomly chosen person is a potential donor for a person with blood type A?<\/p>\n<p>From the information given, we know that being a potential donor for a person with blood type A means having blood type A or O. We therefore need to find P(A or O). Since the events A and O are disjoint, we can use the addition rule for disjoint events to get: P(A or O) = P(A) + P(O) = .42 + .44 = .86. It is easy to see why adding the probability actually makes sense. If 42% of the population has blood type A and 44% of the population has blood type O, then 42% + 44% = 86% of the population has either blood type A or O, and thus are potential donors to a person with blood type A. This reasoning about why the addition rule makes sense can be visualized using the pie chart below:<\/p>\n<p><span class=\"imagewrap\"><span class=\"image\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"A pie chart titled &quot;Blood Types.&quot; Type A takes up 42% of the pie chart, and type O takes up 44%. Together, as A or O, they take up 86% of the pie chart.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image017a.gif\" alt=\"A pie chart titled &quot;Blood Types.&quot; Type A takes up 42% of the pie chart, and type O takes up 44%. Together, as A or O, they take up 86% of the pie chart.\" \/><\/span><\/span><\/p>\n<\/div>\n<\/div>\n<div class=\"textbox textbox--exercises\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p>The probabilities in this table were calculated from data describing the highest level of educational attainment in 2005 for U.S. adults 25 years old or older. (Source: U.S. Census Bureau,\u00a0<em class=\"italic\">Current Population Survey<\/em>, March 2005)<\/p>\n<div class=\"image shouldbeleft\"><img decoding=\"async\" id=\"N10074\" class=\"img-responsive popimg aligncenter\" title=\"table of probability of highest level of education attained\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/u3_m1_rules4_tutor5.png\" alt=\"table of probability of highest level of education attained\" \/><\/div>\n<div><\/div>\n<div>\n<div id=\"h5p-67\">\n<div class=\"h5p-iframe-wrapper\"><iframe id=\"h5p-iframe-67\" class=\"h5p-iframe\" data-content-id=\"67\" style=\"height:1px\" src=\"about:blank\" frameBorder=\"0\" scrolling=\"no\" title=\"4.2 Did I get this 4\"><\/iframe><\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<div class=\"textbox textbox--exercises\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Practice Activity<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p id=\"N10BA0\">So far we have introduced the addition rule for the special case in which the events being considered are disjoint. The purpose of this activity is to make you aware of the danger in wrongly using the addition rule for disjoint events in cases where the events are actually not disjoint. Consider the blood type example again.<\/p>\n<p id=\"N10BA3\">Recall the blood type example:<\/p>\n<div class=\"image shouldbeleft\"><img decoding=\"async\" id=\"_i_2\" class=\"img-responsive popimg aligncenter\" title=\"Data given in &quot;Blood Type: Probability&quot; Format: O: 0.44; A: 0.42; B: 0.10; AB: 0.04;\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/lbd004.gif\" alt=\"Data given in &quot;Blood Type: Probability&quot; Format: O: 0.44; A: 0.42; B: 0.10; AB: 0.04;\" \/><\/div>\n<p id=\"N10BAB\">with the following additional information:<\/p>\n<p id=\"N10BAE\">A person with type\u00a0<em>A<\/em>\u00a0can donate blood to a person with type\u00a0<em>A<\/em>\u00a0or\u00a0<em>AB<\/em>.<\/p>\n<p id=\"N10BBA\">A person with type\u00a0<em>B<\/em>\u00a0can donate blood to a person with type\u00a0<em>B<\/em>\u00a0or\u00a0<em>AB<\/em>.<\/p>\n<p id=\"N10BC6\">A person with type\u00a0<em>AB<\/em>\u00a0can donate blood to a person with type\u00a0<em>AB<\/em>\u00a0only.<\/p>\n<p id=\"N10BCF\">A person with type\u00a0<em>O<\/em>\u00a0blood can donate to anyone.<\/p>\n<p id=\"N10BD5\">Suppose that there are two patients who are each in need of a blood donation. Patient 1 has blood type A and patient 2 has blood type B. Consider the following events:<\/p>\n<p id=\"N10BD8\">D1\u2014a randomly chosen person can be a donor for patient 1.<\/p>\n<p id=\"N10BDB\">D2\u2014a randomly chosen person can be a donor for patient 2.<\/p>\n<p id=\"N10BDE\">We are interested in finding the probability that a randomly chosen person can be a donor for patient 1 or patient 2. In other words, we are interested in finding P(D1 or D2).<\/p>\n<div id=\"h5p-68\">\n<div class=\"h5p-iframe-wrapper\"><iframe id=\"h5p-iframe-68\" class=\"h5p-iframe\" data-content-id=\"68\" style=\"height:1px\" src=\"about:blank\" frameBorder=\"0\" scrolling=\"no\" title=\"4.2 learn by doing 2\"><\/iframe><\/div>\n<\/div>\n<\/div>\n<\/div>\n<p>As we mentioned earlier, later on in this module we will establish a more general Addition Rule that applies even when two events are not disjoint.<\/p>\n<\/div>\n<\/div>\n<div class=\"asx\">\n<div id=\"du3_m1_rules4_tutor5\" class=\"activitywrap purpose didigetthis flash\">\n<div class=\"activityhead\">\n<div class=\"purposeType purposedidigetthis\" title=\"\">\n<div id=\"N10C43\" class=\"section\">\n<div class=\"sectionContain\">\n<h2><span title=\"Quick scroll up\">Comment<\/span><\/h2>\n<p id=\"N10C4A\">The Addition Rule for Disjoint Events can naturally be extended to more than two disjoint events. Let\u2019s take three, for example. If A, B, and C are three disjoint events,<\/p>\n<p><span class=\"imagewrap\"><span class=\"image\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"A Venn Diagram showing 3 disjoint events. As usual there is a gray box showing the entire sample space. Inside this gray box are three completely separate circles. The first circle is for the occurrences in A, the second for occurrences in B, and the third for occurrences in C.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image018.gif\" alt=\"A Venn Diagram showing 3 disjoint events. As usual there is a gray box showing the entire sample space. Inside this gray box are three completely separate circles. The first circle is for the occurrences in A, the second for occurrences in B, and the third for occurrences in C.\" \/><\/span><\/span><\/p>\n<p id=\"N10C53\">then P(A or B or C) = P(A) + P(B) + P(C). The rule is the same for any number of disjoint events.<\/p>\n<div class=\"textbox textbox--exercises\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p>The probabilities in this table were calculated from data describing North America\u2019s favorite car colors in 2003. (Source: DuPont Automotive as cited in money.cnn.com)<\/p>\n<div class=\"image shouldbeleft\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"table showing car colors and their popularity\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/dig011.gif\" alt=\"table showing car colors and their popularity\" \/><\/div>\n<div><\/div>\n<div><\/div>\n<div>\n<div id=\"h5p-69\">\n<div class=\"h5p-iframe-wrapper\"><iframe id=\"h5p-iframe-69\" class=\"h5p-iframe\" data-content-id=\"69\" style=\"height:1px\" src=\"about:blank\" frameBorder=\"0\" scrolling=\"no\" title=\"4.2 learn by doing 3\"><\/iframe><\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<p>We are now done with the first version of the Addition Rule (the version restricted to disjoint events) and we are ready to move on to rule 5. As mentioned before, the general version of the Addition Rule will be presented after rule 5.<\/p>\n<p>Rule 4, the addition rule, deals with finding P(A\u00a0<em>or<\/em>\u00a0B). We are now moving on to rule 5, which deals with yet another situation of frequent interest, finding P(A\u00a0<em>and<\/em>\u00a0B), the probability that both events A and B occur. In other words,<\/p>\n<p><em>P(A and B) = P(event A occurs and event B occurs)<\/em><\/p>\n<p>For example, we might be interested in the probability that if two people are chosen at random, both the first has blood type O\u00a0<em>and<\/em>\u00a0the second has blood type O. Since a person with blood type O can donate blood to anyone, this probability might be of particular interest in this context.<\/p>\n<p id=\"N10B26\">Using a Venn diagram, we can visualize \u201cA and B,\u201d which is represented by the overlap between events A and B:<\/p>\n<p><span class=\"imagewrap\"><span class=\"image\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"A rectangle represents the entire sample space. Inside this rectangle are two circles, one for the occurrences in A and one for the occurrences in B. These two circles partially overlap. The area in the overlap contains the ocurrences for A and B.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image019.gif\" alt=\"A rectangle represents the entire sample space. Inside this rectangle are two circles, one for the occurrences in A and one for the occurrences in B. These two circles partially overlap. The area in the overlap contains the ocurrences for A and B.\" \/><\/span><\/span><\/p>\n<div class=\"section\">\n<div class=\"sectionContain\">\n<h2><span title=\"Quick scroll up\">Comment<\/span><\/h2>\n<p>There is one special case for which we know what P(A and B) equals without applying any rule.<\/p>\n<div class=\"textbox textbox--exercises\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<div id=\"h5p-70\">\n<div class=\"h5p-iframe-wrapper\"><iframe id=\"h5p-iframe-70\" class=\"h5p-iframe\" data-content-id=\"70\" style=\"height:1px\" src=\"about:blank\" frameBorder=\"0\" scrolling=\"no\" title=\"4.2 learn by doing 4\"><\/iframe><\/div>\n<\/div>\n<\/div>\n<\/div>\n<p>So, if events\u00a0<strong><em class=\"bold\">A and B are disjoint<\/em><\/strong>, then (by definition)<strong>\u00a0<\/strong><em class=\"bold\"><strong>P(A and B)= 0<\/strong>.<\/em>\u00a0But what if the events are not disjoint?<\/p>\n<p>Recall that rule 4, the Addition Rule, has two versions. One is restricted to disjoint events, which we\u2019ve already covered, and we\u2019ll deal with the more general version later in this module. The same is true of rule 5. Rule 5 has two versions. The version we\u2019ll present here is restricted to a special case that we\u2019ll now discuss, and there is a more general version that we\u2019ll present in the next module.<\/p>\n<p>The version of rule 5 that will be presented here applies to the special case in which the two events are\u00a0<em>independent<\/em>\u00a0of each other.<\/p>\n<dl>\n<dd><strong>independent<\/strong><\/dd>\n<dd>\n<div class=\"meaning\">Two events A and B are said to be\u00a0<em>independent<\/em>\u00a0if the fact that one event has occurred\u00a0<em>does not affect<\/em>\u00a0the probability that the other event will occur. If whether or not one event occurs\u00a0<em>does affect<\/em>\u00a0the probability that the other event will occur, then the two events are said to be\u00a0<em>dependent.<\/em><\/div>\n<\/dd>\n<\/dl>\n<p id=\"N10B8F\">Here are a few examples:<\/p>\n<div class=\"examplewrap\">\n<div class=\"example clearfix\">\n<div class=\"textbox textbox--examples\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Example<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p>A woman\u2019s pocket contains two quarters and two nickels. She randomly extracts one of the coins and, after looking at it, replaces it before picking a second coin.<\/p>\n<p id=\"N10B97\">Let Q1 be the event that the first coin is a quarter and Q2 be the event that the second coin is a quarter.<\/p>\n<p id=\"N10B9A\">Are Q1 and Q2 independent events?\u00a0<em>Yes.<\/em>\u00a0Why?<\/p>\n<p>Since the first coin that was selected is\u00a0<em>replaced<\/em>, whether or not Q1 occurred (i.e., whether the first coin was a quarter) has no effect on the probability that the second coin will be a quarter, P(Q2). In either case (whether Q1 occurred or not), when she is selecting the second coin, she has in her pocket:<\/p>\n<p><span class=\"imagewrap\"><span class=\"image\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"The coins in the woman's pocket. There are 2 Quarters and 2 Nickels.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image020.gif\" alt=\"The coins in the woman's pocket. There are 2 Quarters and 2 Nickels.\" \/><\/span><\/span><\/p>\n<p id=\"N10BAC\">and therefore the P(Q2) = 2\/4 = 1\/2 regardless of whether Q1 occurred.<\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<div class=\"examplewrap\">\n<div class=\"example clearfix\">\n<div class=\"textbox textbox--examples\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Example<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p id=\"N10BB2\">A woman\u2019s pocket contains two quarters and two nickels. She randomly extracts one of the coins, and\u00a0<em>without placing<\/em>\u00a0it back into her pocket, she picks a second coin. As before, let Q1 be the event that the first coin is a quarter, and Q2 be the event that the second coin is a quarter.<\/p>\n<p>Are Q1 and Q2 independent events?\u00a0<em>No.<\/em>\u00a0Q1 and Q2 are\u00a0<em>not independent<\/em>. They are\u00a0<em>dependent.<\/em>\u00a0Why?<\/p>\n<p id=\"N10BC4\">Since the first coin that was selected is\u00a0<em>not replaced,<\/em>\u00a0whether Q1 occurred (i.e., whether the first coin was a quarter)\u00a0<em>does affect<\/em>\u00a0the probability that the second coin is a quarter, P(Q2).<\/p>\n<p id=\"N10BCD\">If Q1 occurred (i.e., the first coin was a quarter), then when the woman is selecting the second coin, she has in her pocket:<\/p>\n<p><span class=\"imagewrap\"><span class=\"image\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"One Quarter and Two Nickels\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image021.gif\" alt=\"One Quarter and Two Nickels\" \/><\/span><\/span><\/p>\n<p id=\"N10BD6\">In this case, P(Q2) = 1\/3. However, if Q1 has not occurred (i.e., the first coin was not a quarter, but a nickel), then when the woman is selecting the second coin, she has in her pocket:<\/p>\n<p><span class=\"imagewrap\"><span class=\"image\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"Two Quarters and One Nickel.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image022.gif\" alt=\"Two Quarters and One Nickel.\" \/><\/span><\/span><\/p>\n<p id=\"N10BDF\">In this case, P(Q2) = 2\/3.<\/p>\n<\/div>\n<\/div>\n<p id=\"N10BE2\">In these last two examples, we could actually have done some calculation in order to check whether or not the two events are independent or not. Sometimes we can just use common sense to guide us as to whether two events are independent. Here is an example.<\/p>\n<\/div>\n<\/div>\n<div class=\"examplewrap\">\n<div class=\"exHead\">\n<div class=\"textbox textbox--examples\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Example<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<div class=\"exHead\">A family has 4 children, two of whom are selected at random. Let B1 be the event that one child has blue eyes, and B2 be the event that the other chosen child has blue eyes. In this case, B1 and B2 are not independent, since we know that eye color is hereditary, so whether or not one child is blue-eyed will increase or decrease the chances that the other child has blue eyes, respectively.<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<div class=\"examplewrap\">\n<div class=\"example clearfix\">\n<div class=\"textbox textbox--examples\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Example<\/h3>\n<\/header>\n<div class=\"textbox__content\">Two people are selected at random from all people in the United States. Let B1 be the event that one of the people has blue eyes and B2 be the event that the other person has blue eyes. In this case, since they were chosen at random, whether one of them has blue eyes has no effect on the likelihood that the other one has blue eyes, and therefore B1 and B2 are independent. On the other hand \u2026<\/div>\n<\/div>\n<h4><em class=\"bold\">Note:<\/em><\/h4>\n<\/div>\n<\/div>\n<p id=\"N10BF7\">We can generalize what we learned in the last example and say that when two individuals are selected at random from a large population (like in the example, the entire U.S.) any event associated with one individual is independent of any event associated with the other individual. The fact that the two are chosen from a large population is key to the independence.<\/p>\n<p id=\"N10BFA\">If we were to change the example to: There are 10 people in a room, 4 of which have blue eyes. Two people are chosen at random. Let B1 be the event that the first person has blue eyes and let B2 be the event that the second person has blue eyes. In this case, since the two are chosen from a group of only 10 (rather than a large population) the events B1 and B2 are not independent. Clearly, whether or not the first person has blue eyes (i.e., whether or not B1 occurs) does have an effect on whether B2 occurs. You will get more practice on this point in the activities below the next comment.<\/p>\n<div id=\"N10BFD\" class=\"section\">\n<div class=\"sectionContain\">\n<h2><span title=\"Quick scroll up\">Comment<\/span><\/h2>\n<p id=\"N10C04\">It is quite common for students to initially get confused about the distinction between the idea of\u00a0<em>disjoint events<\/em>\u00a0and the idea of\u00a0<em>independent events<\/em>. The purpose of this comment (and the activity that follows it) is to help students develop more understanding about these very different ideas.<\/p>\n<p id=\"N10C0D\">The idea of\u00a0<em>disjoint events<\/em>\u00a0is about whether or not it is possible for the events to occur at the same time (see the examples on page 3 of the Probability Rules section).<\/p>\n<p id=\"N10C13\">The idea of\u00a0<em>independent events<\/em>\u00a0is about whether or not the events affect each other in the sense that the occurrence of one event affects the probability of the occurrence of the other (see the examples above).<\/p>\n<p id=\"N10C19\">The following activity deals with the distinction between these concepts.<\/p>\n<\/div>\n<\/div>\n<p id=\"N10C20\">The purpose of this activity is to help you strengthen your understanding about the concepts of disjoint events and independent events, and the distinction between them.<\/p>\n<div class=\"textbox textbox--exercises\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Activity<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p id=\"N10C2A\">In the following questions, you are presented with a random experiment and two events related to it. You are asked to decide whether the events are disjoint or not, and whether the events are independent or not.<\/p>\n<div class=\"asx\">\n<div id=\"du3_m1_rules5_tutor2\" class=\"activitywrap sectionNest flash\">\n<div class=\"activityhead\">\n<div class=\"activityinfo\"><\/div>\n<\/div>\n<div class=\"actContain\">\n<div class=\"activity flash\">\n<div id=\"u3_m1_rules5_tutor2\" class=\"flash_obj asx testFlash mark_flash\">\n<div id=\"ou3_m1_rules5_tutor2\" class=\"page 2963496\">\n<div id=\"2963496\" class=\"question ddfb\">\n<div>\n<p>Two people are selected simultaneously and at random from a very large population, and their blood type is checked.<\/p>\n<p><span class=\"B\"><span class=\"component\"><\/p>\n<div id=\"h5p-71\">\n<div class=\"h5p-iframe-wrapper\"><iframe id=\"h5p-iframe-71\" class=\"h5p-iframe\" data-content-id=\"71\" style=\"height:1px\" src=\"about:blank\" frameBorder=\"0\" scrolling=\"no\" title=\"4.2 learn by doing 5\"><\/iframe><\/div>\n<\/div>\n<p><\/span><\/span><\/p>\n<\/div>\n<\/div>\n<p><span style=\"color: #ff0000;\">THERE ARE TWO QUESTIONS MISSING THAT RELATE TO EXAMPLES 2 and 3<\/span><\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<p id=\"N10C56\">Let\u2019s summarize the three parts of the activity:<\/p>\n<ul>\n<li>In Example 1: A and B are\u00a0<em class=\"bold\">not disjoint<\/em>\u00a0and\u00a0<em class=\"bold\">independent<\/em><\/li>\n<li>In Example 2: A and B are\u00a0<em class=\"bold\">not disjoint<\/em>\u00a0and\u00a0<em class=\"bold\">not independent<\/em><\/li>\n<li>In Example 3: A and B are\u00a0<em class=\"bold\">disjoint<\/em>\u00a0and\u00a0<em class=\"bold\">not independent<\/em>.<\/li>\n<\/ul>\n<p id=\"N10C7B\">Why did we leave out the case when the events are disjoint and independent? The reason is that this case DOES NOT EXIST!<\/p>\n<table class=\"wbtable\">\n<tbody>\n<tr class=\"e\">\n<td><\/td>\n<td><em class=\"bold\">A and B Independent<\/em><\/td>\n<td><em class=\"bold\">A and B Not Independent<\/em><\/td>\n<\/tr>\n<tr>\n<td><em class=\"bold\">A and B Disjoint<\/em><\/td>\n<td><span style=\"background-color: #ffff00;\"><em class=\"highlight\">DOES NOT EXIST<\/em><\/span><\/td>\n<td>Example 3<\/td>\n<\/tr>\n<tr class=\"e\">\n<td><em class=\"bold\">A and B Not Disjoint<\/em><\/td>\n<td>Example 1<\/td>\n<td>Example 2<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p id=\"N10CAA\">If events are\u00a0<em class=\"bold\">disjoint<\/em>\u00a0then they\u00a0<em class=\"bold\">must be not independent (dependent)<\/em><\/p>\n<p id=\"N10CB4\">Why is that?<\/p>\n<p id=\"N10CB7\">Recall: A and B disjoint means that they cannot happen together. In other words, A and B disjoint implies that if event A occurs then B does not and vice versa. Well\u2026 if that\u2019s the case, knowing that event A has occurred dramatically changes the likelihood that event B occurs \u2013 that likelihood is\u00a0<span id=\"MathJax-Element-1-Frame\" class=\"mjx-chtml MathJax_CHTML\"><span id=\"MJXc-Node-1\" class=\"mjx-math\"><span id=\"MJXc-Node-2\" class=\"mjx-mrow\"><span id=\"MJXc-Node-3\" class=\"mjx-mrow\"><span id=\"MJXc-Node-4\" class=\"mjx-mn\"><span class=\"mjx-char MJXc-TeX-main-R\">0<\/span><\/span><\/span><\/span><\/span><\/span>. This implies that A and B are not independent.<\/p>\n<div class=\"textbox textbox--exercises\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<div class=\"asx\">\n<div id=\"du3_m1_rules5_tutor4\" class=\"activitywrap sectionNest flash\">\n<div class=\"actContain\">\n<div class=\"activity flash\">\n<div id=\"u3_m1_rules5_tutor4\" class=\"flash_obj asx testFlash mark_flash\">\n<div id=\"ou3_m1_rules5_tutor4\" class=\"page 2963337 2963338\">\n<div id=\"2963337\" class=\"question ddfb\">\n<div>\n<p>Roughly 7% of American males in U.S. have some sort of color blindness.<\/p>\n<p>Suppose that a medical researcher selects one American male at random.<\/p>\n<p><em class=\"bold\">Let A represent the event \u2019the selected male is color blind\u2019.<\/em><\/p>\n<p id=\"N10076\"><em class=\"bold\">Let B represent the event \u2019the selected male is not color blind\u2019.<\/em><\/p>\n<p>Determine whether A and B are disjoint or independent.<\/p>\n<\/div>\n<\/div>\n<div id=\"2963338\" class=\"question ddfb\">\n<div>\n<p id=\"N10088\">\n<div id=\"h5p-72\">\n<div class=\"h5p-iframe-wrapper\"><iframe id=\"h5p-iframe-72\" class=\"h5p-iframe\" data-content-id=\"72\" style=\"height:1px\" src=\"about:blank\" frameBorder=\"0\" scrolling=\"no\" title=\"4.2 Did I get this? 5\"><\/iframe><\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<div id=\"pagecontrols-5618fe3d0a0001dc5ef000e03fb742b6\" class=\"pageControls clearfix\"><\/div>\n<\/div>\n<\/div>\n<\/div>\n<div class=\"asx\">\n<div id=\"du3_m1_rules5_tutor5\" class=\"activitywrap sectionNest flash\">\n<div class=\"actContain\">\n<div class=\"activity flash\">\n<div id=\"u3_m1_rules5_tutor5\" class=\"flash_obj asx testFlash mark_flash\">\n<div id=\"ou3_m1_rules5_tutor5\" class=\"page 2963361 2963362\">\n<div id=\"2963361\" class=\"question ddfb\">\n<div>\n<p>Now, suppose the medical researcher selects two American males at random.<\/p>\n<p><em class=\"bold\">Let A represent the event \u201cthe first male is color blind.\u201d<\/em><\/p>\n<p><em class=\"bold\">Let B represent the event \u201cthe second male is not colorblind.\u201d<\/em><\/p>\n<p>Determine whether A and B are disjoint or independent.<\/p>\n<\/div>\n<\/div>\n<div id=\"2963362\" class=\"question ddfb\">\n<div>\n<p id=\"N10086\">\n<div id=\"h5p-73\">\n<div class=\"h5p-iframe-wrapper\"><iframe id=\"h5p-iframe-73\" class=\"h5p-iframe\" data-content-id=\"73\" style=\"height:1px\" src=\"about:blank\" frameBorder=\"0\" scrolling=\"no\" title=\"4.2 Did I get this 6\"><\/iframe><\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<p>Now that we understand the idea of independent events, we can finally get to rule 5. As mentioned before, Rule 5 actually has two versions, one for finding P(A and B) in the special case in which the events A and B are independent, and a more general version for use when the events are not necessarily independent. We will first present the version of rule 5 that is restricted to independent events, and in the next section we will revisit Rule 5 and present the more general version.<\/p>\n<table class=\"theorem labeled\">\n<thead>\n<tr>\n<th>\n<h5>Rule 5: The Multiplication Rule for Independent Events<\/h5>\n<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>\n<div class=\"theorem\">\n<div class=\"statement\">\n<p><em>If A and B are two independent events, then P(A and B) = P(A) * P(B).<\/em><\/p>\n<\/div>\n<\/div>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<div class=\"section\">\n<div class=\"sectionContain\">\n<h2><span title=\"Quick scroll up\">Comment<\/span><\/h2>\n<p>When dealing with probabilities, the word\u00a0<em>\u201cand\u201d<\/em>\u00a0will always be associated with the operation of\u00a0<em>multiplication<\/em>; hence the name of this rule, \u201cThe Multiplication Rule.\u201d<\/p>\n<\/div>\n<\/div>\n<div class=\"examplewrap\">\n<div class=\"example clearfix\">\n<div class=\"textbox textbox--examples\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Example<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p id=\"N10B3D\">Recall the blood type example:<\/p>\n<p><span class=\"imagewrap\"><span class=\"image\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"Data given in &quot;Blood Type: Probability&quot; Format: O: 0.44; A: 0.42; B: 0.10; AB: 0.04;\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image011.gif\" alt=\"Data given in &quot;Blood Type: Probability&quot; Format: O: 0.44; A: 0.42; B: 0.10; AB: 0.04;\" \/><\/span><\/span><\/p>\n<p id=\"N10B46\">Two people are selected simultaneously and at random from all people in the United States. What is the probability that both have blood type O?<\/p>\n<p>Let O1= \u201cperson 1 has blood type O\u201d and<\/p>\n<p>O2= \u201cperson 2 has blood type O\u201d<\/p>\n<p>We need to find P(O1 and O2)<\/p>\n<p>Since they were chosen simultaneously and at random, the blood type of one has no effect on the blood type of the other. Therefore, O1 and O2 are independent, and we may apply Rule 5:<\/p>\n<p>P(O1 and O2) = P(O1) * P(O2) = .44 * .44 = .1936.<\/p>\n<\/div>\n<\/div>\n<div class=\"textbox textbox--exercises\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p>A 2011 poll by the Pew Research Center for People and the Press estimated that 62% of U.S. adults favor the death penalty for persons convicted of murder, 31% oppose it, with the remaining 7% undecided.<\/p>\n<div id=\"h5p-74\">\n<div class=\"h5p-iframe-wrapper\"><iframe id=\"h5p-iframe-74\" class=\"h5p-iframe\" data-content-id=\"74\" style=\"height:1px\" src=\"about:blank\" frameBorder=\"0\" scrolling=\"no\" title=\"4.2 Did I get this 7\"><\/iframe><\/div>\n<\/div>\n<div class=\"ourAnswer\">OUR ANSWER<\/div>\n<p>Let A be the event that the first person supports the death penalty. Let B be the event that the second person supports the death penalty.<\/p>\n<p id=\"N10071\">We want to find P(A and B). Since the two people are chosen at random from a large population, A and B are independent and we can use the Multiplication Rule for Independent Events.<\/p>\n<p>P(A and B) = P(A) * P(B) = 0.62 * 0.62 = 0.3844<\/p>\n<\/div>\n<\/div>\n<div class=\"textbox textbox--exercises\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Learn by Doing<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<div id=\"h5p-75\">\n<div class=\"h5p-iframe-wrapper\"><iframe id=\"h5p-iframe-75\" class=\"h5p-iframe\" data-content-id=\"75\" style=\"height:1px\" src=\"about:blank\" frameBorder=\"0\" scrolling=\"no\" title=\"4.2 learn by doing 6\"><\/iframe><\/div>\n<\/div>\n<p>&nbsp;<\/p>\n<div class=\"ourAnswer\">OUR ANSWER<\/div>\n<p>Let A be the event that the person voted for Bush in 2000. Let B be the event that the person voted for Bush in 2004. The question asks us to determine P(A and B). We might be tempted to use the Multiplication Rule for Independent Events and write P(A and B) = P(A)*P(B) = 0.48*0.51 = 0.2448, but this would be incorrect because these events are not independent. If an individual voted for Bush in 2000, it is likely that the individual voted for him in 2004. So we are unable to answer the question with the information given.<\/p>\n<\/div>\n<\/div>\n<div class=\"textbox textbox--exercises\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p>Recall the estimate by the Pew Research Center that 62% of U.S. adults favor the death penalty for murder. The same report gave a much lower estimate for the percentage of U.S. college graduates supporting the death penalty in cases of murder. According to census data from 2000, roughly 28% of U.S. adults have a college degree.<\/p>\n<p><em class=\"bold\">What is the probability that a randomly selected U.S. adult has a college degree and favors the death penalty?<\/em><\/p>\n<p>Let A be the event that a U.S. adult has a college degree. Let B be the event that this person supports the death penalty. We want to find P(A and B).<\/p>\n<div id=\"h5p-76\">\n<div class=\"h5p-iframe-wrapper\"><iframe id=\"h5p-iframe-76\" class=\"h5p-iframe\" data-content-id=\"76\" style=\"height:1px\" src=\"about:blank\" frameBorder=\"0\" scrolling=\"no\" title=\"4.2 Did I get this 8\"><\/iframe><\/div>\n<\/div>\n<\/div>\n<\/div>\n<p>So far we have looked at examples where we have to consider and apply only one of the rules. The following example is a case where both the Addition Rule for Disjoint Events and the Multiplication Rule for Independent Events need to be applied in order to find the desired probability.<\/p>\n<div class=\"examplewrap\">\n<div class=\"example clearfix\">\n<div class=\"textbox textbox--examples\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Example<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p id=\"N10BBD\">Recall the blood types example:<\/p>\n<p><span class=\"imagewrap\"><span class=\"image\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"Data given in &quot;Blood Type: Probability&quot; Format: O: 0.44; A: 0.42; B: 0.10; AB: 0.04;\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image011.gif\" alt=\"Data given in &quot;Blood Type: Probability&quot; Format: O: 0.44; A: 0.42; B: 0.10; AB: 0.04;\" \/><\/span><\/span><\/p>\n<p>Two people are chosen simultaneously and at random. What is the probability that both have the same blood type? For both to have the same blood type there are four possibilities. Both have blood type O\u00a0<em>or<\/em>\u00a0both have blood type A\u00a0<em>or<\/em>\u00a0both have blood type B\u00a0<em>or<\/em>\u00a0both have blood type AB.<\/p>\n<p><span class=\"imagewrap\"><span class=\"image\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"A diagram showing the four possibilities.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image023.gif\" alt=\"A diagram showing the four possibilities.\" \/><\/span><\/span><\/p>\n<p>In other words, and using our regular notations,<\/p>\n<p>P(same blood type) = P([O1 and O2] or [A1 and A2] or [B1 and B2] or [AB1 and AB2])<\/p>\n<p>Since our four possibilities of both people having the same blood type are\u00a0<em>disjoint<\/em>, using our\u00a0<em>Addition Rule<\/em>\u00a0we can add their probabilities (i.e., replace every \u201cor\u201d with +). Also, within each of the four possibilities, we can use the\u00a0<em>Multiplication Rule<\/em>\u00a0and replace \u201cand\u201d with * (using the same\u00a0<em>independence<\/em>\u00a0argument as the first example on this page). Our answer is therefore,<\/p>\n<p><span class=\"imagewrap\"><span class=\"image\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"P(O and O) = .44 * .44 P(B and B) = .42 * .42 P(B and B) = .10 * .10 P(AB and AB) = .04 * .04 P(Both having the same blood type) = P(O and O) + P(A and A) + P(B and B) + P(AB and AB) = 0.3816\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image024.gif\" alt=\"P(O and O) = .44 * .44 P(B and B) = .42 * .42 P(B and B) = .10 * .10 P(AB and AB) = .04 * .04 P(Both having the same blood type) = P(O and O) + P(A and A) + P(B and B) + P(AB and AB) = 0.3816\" \/><\/span><\/span><\/p>\n<p id=\"N10BF3\">About 38% of the time, two randomly chosen U.S. people would have the same blood type. Note that in this example we used the Addition Rule and the Multiplication Rule one after the other, justifying along the way why it is appropriate to do so.<\/p>\n<\/div>\n<\/div>\n<div class=\"textbox textbox--exercises\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<div id=\"h5p-77\">\n<div class=\"h5p-iframe-wrapper\"><iframe id=\"h5p-iframe-77\" class=\"h5p-iframe\" data-content-id=\"77\" style=\"height:1px\" src=\"about:blank\" frameBorder=\"0\" scrolling=\"no\" title=\"4.2 Did I get this 9\"><\/iframe><\/div>\n<\/div>\n<\/div>\n<\/div>\n<h2><span title=\"Quick scroll up\">Comment<\/span><\/h2>\n<p id=\"N10C1F\">The purpose of this comment is to point out the magnitude of P(A or B) and of P(A and B) relative to either one of the individual probabilities. Since probabilities are never negative, the probability of one event\u00a0<em>or<\/em>\u00a0another is always at least as large as either of the individual probabilities. Since probabilities are never more than 1, the probability of one event\u00a0<em>and<\/em>\u00a0another generally involves multiplying numbers that are less than 1, therefore can never be more than either of the individual probabilities.<\/p>\n<p id=\"N10C28\">Here is an example:<\/p>\n<div class=\"examplewrap\">\n<div class=\"example clearfix\">\n<div class=\"textbox textbox--examples\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Example<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<div class=\"examplewrap\">\n<div class=\"example clearfix\">\n<div>\n<p id=\"N10C2D\">Consider the event A that a randomly chosen person has blood type A. Modify it to a more general event\u2014that a randomly chosen person has blood type A or B\u2014and the probability increases. Modify it to a more specific (or restrictive) event\u2014that not just one randomly chosen person has blood type A, but that out of two simultaneously randomly chosen people, person 1 will have type A and person 2 will have type B\u2014and the probability decreases.<\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<p>It is important to mention this in order to root out a common misconception. The word \u201cand\u201d is associated in our minds with \u201cadding more stuff.\u201d Therefore, some students\u00a0<em>incorrectly<\/em>\u00a0think that P(A and B) should be larger than either one of the individual probabilities, while it is actually smaller, since it is a more specific (restrictive) event. Also, the word \u201cor\u201d is associated in our minds with \u201chaving to choose between\u201d or \u201closing something,\u201d and therefore some students incorrectly think that P(A or B) should be smaller than either one of the individual probabilities, while it is actually larger, since it is a more general event.<\/p>\n<\/div>\n<\/div>\n<p id=\"N10C37\">Practically, you can use this comment to check yourself when solving problems. For example, if you solve a problem that involves \u201cor,\u201d and the resulting probability is smaller than either one of the individual probabilities, then you know you have made a mistake somewhere.<\/p>\n<div class=\"textbox textbox--exercises\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p>Pick a student at random. Let B denote the event that the student ate breakfast this morning; let M denote the event that the student is male.<\/p>\n<div id=\"h5p-78\">\n<div class=\"h5p-iframe-wrapper\"><iframe id=\"h5p-iframe-78\" class=\"h5p-iframe\" data-content-id=\"78\" style=\"height:1px\" src=\"about:blank\" frameBorder=\"0\" scrolling=\"no\" title=\"4.2 Did I get this 10\"><\/iframe><\/div>\n<\/div>\n<\/div>\n<\/div>\n<hr \/>\n<p>As you\u2019ve seen, the last three rules that we\u2019ve introduced (the Complement Rule, the Addition Rule for Disjoint Events, and the Multiplication Rule for Independent Events) are frequently used in solving problems. Before we move on to our next rule, here are two comments that will help you use these rules in broader types of problems and more effectively.<\/p>\n<div class=\"section\">\n<div class=\"sectionContain\">\n<h2><span title=\"Quick scroll up\">Comment<\/span><\/h2>\n<p>As we mentioned before, the Addition Rule can be extended to more than two disjoint events. Likewise, the Multiplication Rule can be extended to more than two independent events. So if A, B and C are three independent events, for example, then P(A and B and C) = P(A) * P(B) * P(C). These extensions are quite straightforward, as long as you remember that \u201cor\u201d requires us to add, while \u201cand\u201d requires us to multiply.<\/p>\n<p>An example of a situation where more than two independent events naturally occur is when a random sample of more than two individuals is chosen from a large population.<\/p>\n<p>Here is an example:<\/p>\n<div class=\"examplewrap\">\n<div class=\"example clearfix\">\n<div class=\"textbox textbox--examples\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Example<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p>Three people are chosen at random from a large population. What is the probability that all three have blood type B? We\u2019ll use the usual notation of B1, B2 and B3 for the events that persons 1, 2 and 3 have blood type B, respectively. We need to find P(B1 and B2 and B3). Let\u2019s solve this one together:<\/p>\n<div id=\"h5p-79\">\n<div class=\"h5p-iframe-wrapper\"><iframe id=\"h5p-iframe-79\" class=\"h5p-iframe\" data-content-id=\"79\" style=\"height:1px\" src=\"about:blank\" frameBorder=\"0\" scrolling=\"no\" title=\"4.2 learn by doing 11\"><\/iframe><\/div>\n<\/div>\n<\/div>\n<\/div>\n<p>Here is another example that might be quite surprising.<\/p>\n<\/div>\n<\/div>\n<div class=\"examplewrap\">\n<div class=\"example clearfix\">\n<div class=\"textbox textbox--examples\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Example<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p id=\"N10B48\">A fair coin is tossed 10 times. Which of the following two outcomes is more likely?<\/p>\n<p id=\"N10B4B\">(a) HHHHHHHHHH<\/p>\n<p>(b) HTTHHTHTTH<\/p>\n<div id=\"h5p-80\">\n<div class=\"h5p-iframe-wrapper\"><iframe id=\"h5p-iframe-80\" class=\"h5p-iframe\" data-content-id=\"80\" style=\"height:1px\" src=\"about:blank\" frameBorder=\"0\" scrolling=\"no\" title=\"4.2 learn by doing 12\"><\/iframe><\/div>\n<\/div>\n<p>&nbsp;<\/p>\n<p id=\"N10B72\">In fact, they are equally likely. The 10 tosses are independent, so we\u2019ll use the Multiplication Rule for Independent Events:<\/p>\n<p id=\"N10B75\">P(HHHHHHHHHH) = P(H) * P(H) * \u2026 *P(H) = 1\/2 * 1\/2 *\u2026 * 1\/2 = (1\/2)<sup>10<\/sup><\/p>\n<p id=\"N10B7B\">P(HTTHHTHTTH) = P(H) * P(T) * \u2026 * P(H) = 1\/2 * 1\/2 *\u2026 * 1\/2 = (1\/2)<sup>10<\/sup><\/p>\n<p id=\"N10B81\">Here is the idea:<\/p>\n<p id=\"N10B84\">My random experiment here is tossing a coin 10 times. You can imagine how huge the sample space is.<\/p>\n<p id=\"N10B87\">There are actually 1,024 possible outcomes to this experiment, all of which are equally likely. Therefore, while it is true that it is more likely to get an outcome that has 5 heads and 5 tails than an outcome that has only heads (since there is only one possible outcome of the latter kind, and many possible outcomes of the former), if I am comparing 2\u00a0<em>specific outcomes<\/em>\u00a0as I do here, they are equally likely.<\/p>\n<\/div>\n<\/div>\n<div class=\"textbox textbox--exercises\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p>Recall:<\/p>\n<div class=\"image shouldbeleft\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"probability of people having different blood types\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/dig001.gif\" alt=\"probability of people having different blood types\" \/><\/div>\n<p>Three people are chosen at random. (Assume the choices are independent events). What is the probability that they all have the same blood type?<\/p>\n<div id=\"h5p-81\">\n<div class=\"h5p-iframe-wrapper\"><iframe id=\"h5p-iframe-81\" class=\"h5p-iframe\" data-content-id=\"81\" style=\"height:1px\" src=\"about:blank\" frameBorder=\"0\" scrolling=\"no\" title=\"4.2 Did I get this 11\"><\/iframe><\/div>\n<\/div>\n<\/div>\n<\/div>\n<div class=\"section\">\n<div class=\"sectionContain\">\n<h2><span title=\"Quick scroll up\">Comment: Finding the Probability of \u201cAt least one of \u2026\u201d<\/span><\/h2>\n<p>Recall that when we talked about the Complement Rule, we mentioned that we would come back to it later and illustrate its strength. Well, the time has come to do that.<\/p>\n<p>Rule 3: The Complement Rule, P(A) = 1 \u2013 P(not A), together with the Multiplication Rule, is\u00a0<em>extremely<\/em>\u00a0useful for finding the probability of events like \u201cat least one of \u2026\u201d in several repetitions of a random experiment.<\/p>\n<p>For example,<\/p>\n<ul>\n<li>10 people were randomly chosen. Find P(at least one of the 10 has blood type O).<\/li>\n<li>A student uses a random guess to answer 10 true\/false questions on a test. Find P(the student gets at least one question right).<\/li>\n<\/ul>\n<p>The key here is to use the fact that the complement event is much easier to deal with than the actual event of interest. Going back to our example:<\/p>\n<p>The complement to\u00a0<em>\u201cat least one of<\/em>\u00a0the 10 has blood type O\u201d is\u00a0<em>\u201cnone<\/em>\u00a0of the 10 has blood type O.\u201d<\/p>\n<p>The complement to \u201cgetting\u00a0<em>at least one<\/em>\u00a0question right\u201d is \u201cgetting\u00a0<em>none<\/em>\u00a0of the questions right.\u201d<\/p>\n<p>(Note how \u201cat least one of\u201d changes to \u201cnone\u201d in the complement.)<\/p>\n<p>If you feel unsure about this, go back and redo the \u201cDid I Get This\u201d activity\u00a0on page 2 of the Probability Rules section.<\/p>\n<p>We\u2019ll start with a very simple example in which it is still manageable to find P(at least one of \u2026) directly, without using the complement rule. Then we\u2019ll alter the example slightly and see how trying to find P(at least one of \u2026) directly can get\u00a0<em>VERY COMPLICATED<\/em>, and how the complement rule comes to the rescue. Finally, you\u2019ll check your understanding by attempting to solve a similar problem yourself.<\/p>\n<\/div>\n<\/div>\n<div class=\"examplewrap\">\n<div class=\"example clearfix\">\n<div class=\"textbox textbox--examples\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Example<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p>Two people are selected at random. What is the probability that at least one of them has blood type O?<\/p>\n<p id=\"N10B63\">Here is our sample space S = { (O,O) (O, not O) (not O, O) (not O, not O) }<\/p>\n<p id=\"N10B66\">The event \u201cat least one person chosen has blood type O\u201d consists of the first three possible outcomes, and therefore:<\/p>\n<p id=\"N10B69\">P(at least one person chosen has blood type O) = P((O and O) or (O and not O) or (not O and O)) = (.44 * .44) + (.44 * .56) + (.56 * .44) = .6864.<\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<p>Now we\u2019ll just alter the example slightly by randomly choosing 10 people instead of 2:<\/p>\n<div class=\"examplewrap\">\n<div class=\"example clearfix\">\n<div class=\"textbox textbox--examples\">\n<header class=\"textbox__header\">\n<h4 class=\"textbox__title\">Example<\/h4>\n<\/header>\n<div class=\"textbox__content\">\n<p>A patient with blood type O desperately needs a blood transfusion. Since a person with blood type O can receive blood only from another person who has blood type O, the blood bank decides to choose 10 donors at random and hope that at least one of them has blood type O. Find P(at least one of the 10 donors has blood type O). To make things simpler, let\u2019s denote the event \u201cat least one has blood type O\u201d by L (for at\u00a0<em>L<\/em>east).<\/p>\n<p id=\"N10B78\">Solving this using the brute force method would require a prohibitive amount of work. As before, we would need to list all the possible outcomes of blood types of 10 people (using either \u201cO\u201d or \u201cnot O\u201d), but this time there are 1,024 of them! We would then need to identify those outcomes that L consists of (i.e., the outcomes in which at least one of the 10 people has blood type O). Next, we would need to find the probability of each of those outcomes and add those probabilities up.\u00a0<em>What a pain!\u00a0<\/em>There must be a better way.<\/p>\n<p id=\"N10B7E\">Instead of doing all the work listed above, we can use the Complement Rule, which says P(L) = 1 \u2013 P(not L). As we explained before, in this case \u201cnot L\u201d is the event \u201cnone of the 10 have blood type O,\u201d or in other words that all 10 have a blood type other than O. So we can simply solve (using our regular notation from this module):<\/p>\n<p>P(L) = 1 \u2013 P(not L) = 1 \u2013 P(not O1\u00a0<em>and<\/em>\u00a0not O2\u00a0<em>and<\/em>\u00a0not O3\u00a0<em>and<\/em>\u00a0not O4\u00a0<em>and<\/em>\u00a0not O5\u00a0<em>and<\/em>\u00a0not O6\u00a0<em>and<\/em>\u00a0not O7\u00a0<em>and<\/em>\u00a0not O8\u00a0<em>and<\/em>\u00a0not O9\u00a0<em>and\u00a0<\/em>not O10). Now, using the multiplication rule, = 1 \u2013 (.56 * .56 * .56 * .56 * .56 * .56 * .56 * .56 * .56 * .56) = 1 \u2013 .003 = .997.<\/p>\n<p>Therefore, it is almost certain that if we choose 10 people at random, we\u2019ll find that at least one of them has blood type O. This result makes sense, since 44% have blood type O, and so out of 10 people it is almost certain that at least one will have blood type O.<\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<p>&nbsp;<\/p>\n<div class=\"examplewrap\">\n<div class=\"example clearfix\">\n<div class=\"textbox textbox--exercises\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<div id=\"h5p-83\">\n<div class=\"h5p-iframe-wrapper\"><iframe id=\"h5p-iframe-83\" class=\"h5p-iframe\" data-content-id=\"83\" style=\"height:1px\" src=\"about:blank\" frameBorder=\"0\" scrolling=\"no\" title=\"4.2 Did I get this 12\"><\/iframe><\/div>\n<\/div>\n<\/div>\n<\/div>\n<p>We are now getting to the last rule in this module in which we\u2019ll go back to P(A or B).<\/p>\n<p>So far, we\u2019ve introduced the Addition Rule for finding P(A or B) in the special case when A and B are\u00a0<em class=\"bold\">disjoint\u00a0<\/em>events \u2013 that is when the events cannot happen together \u2192 P(A and B)=\u00a0<span class=\"mjx-chtml MathJax_CHTML\"><span class=\"mjx-math\"><span class=\"mjx-mrow\"><span class=\"mjx-mn\"><span class=\"mjx-char MJXc-TeX-main-R\">0<\/span><\/span><\/span><\/span><\/span>.<\/p>\n<div class=\"image shouldbeleft\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"A Venn Diagram titled &quot;A and B are Disjoint. The entire sample space S is represented as a gray rectangle. Inside are two, separate, non-overlapping blue circles. One circle is for the occurrences in A and the other for occurrences in B.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/prob_9_of_11\/image1.png\" alt=\"A Venn Diagram titled &quot;A and B are Disjoint. The entire sample space S is represented as a gray rectangle. Inside are two, separate, non-overlapping blue circles. One circle is for the occurrences in A and the other for occurrences in B.\" \/><\/div>\n<p>In this special case P(A or B) refers to the probability of either event A occurring or event B occurring and we said that P(A or B)=P(A) + P(B). Visually, in the Venn diagram above we can clearly see that P(A or B), represented by the total blue area, can be found by adding the areas of the two circles, one representing P(A) and the other P(B).<\/p>\n<p id=\"N10B3A\">As we mentioned above the case when A and B are disjoint is a special case and in many situations the events are\u00a0<em class=\"bold\">not disjoint \u2013<\/em>they can occur at the same time.<\/p>\n<div class=\"image shouldbeleft\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"A venn diagram titled &quot;A and B are NOT Disjoint.&quot; A gray box represents the sample space, and inside are two blue circles which have an overlapping area. One circle is labeled A and the other is labeled B. The area where the two circles overlap represents that Events A and B can occur at the same time, so P(A and B) \u2260 0.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/prob_9_of_11\/image2.png\" alt=\"A venn diagram titled &quot;A and B are NOT Disjoint.&quot; A gray box represents the sample space, and inside are two blue circles which have an overlapping area. One circle is labeled A and the other is labeled B. The area where the two circles overlap represents that Events A and B can occur at the same time, so P(A and B) \u2260 0.\" \/><\/div>\n<p>We are now ready to learn how to find P(A or B) in this more general case \u2013 when A and B are not necessarily disjoint. We\u2019ll call this rule the \u201cGeneral Addition Rule\u201d.<\/p>\n<p>Before we introduce this rule through an example, it is important to understand what P(A or B) represents in the case when A and B are not disjoint. Let\u2019s look at the Venn diagram above.<\/p>\n<p>Again, P(A or B) is represented by the total blue area which in this case looks different. In this case this area includes an overlap between the two circles which corresponds to the probability that both events A and B occur. This difference has an important implication to the meaning of P(A or B) when A and B are not disjoint.<\/p>\n<p>When A and B are not disjoint P(A or B) means P(A occurs or B occurs or both events occur).<\/p>\n<div class=\"examplewrap\">\n<div class=\"example clearfix\">\n<div class=\"textbox textbox--examples\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Example<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p>It is vital that a certain document reach its destination within one day. To maximize the chances of on-time delivery, two copies of the document are sent using two services, service A and service B. It is known that the probabilities of on-time delivery are:<\/p>\n<p id=\"N10B57\">0.90 for service A (<em class=\"bold\">P(A) = 0.90<\/em>)<\/p>\n<p id=\"N10B5E\">0.80 for service B (<em class=\"bold\">P(B) = 0.80<\/em>)<\/p>\n<p>0.75 for both services being on time (<em class=\"bold\">P(A and B) = 0.75<\/em>)<\/p>\n<p>(Note that A and B are n<em class=\"bold\">ot disjoint<\/em>. They can happen together with probability 0.75.)<\/p>\n<p>The Venn diagrams below illustrate the probabilities P(A), P(B), and P(A and B)<\/p>\n<p>[not drawn to scale]:<\/p>\n<div class=\"image shouldbeleft\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"Three Venn Diagrams. In all of them there is a large rectangle representing all of the sample space S. Inside this rectangle are two circles which overlap partially. One circle is labeled A and the other is labeled B. In the first Venn Diagram the circle for A is colored blue, and we see that P(A) = 0.90 . In some sense P(A) is the area of the A circle. In the second Venn Diagram the circle for B is colored blue, and it is marked that P(B) = 0.80 . Just like in the first Venn diagram it can be thought that the circle for B has an area of 0.80 . In the third Venn Diagram the area which is the overlap of circles A and B is colored blue. P(A and B) = 0.75 . The area of the overlap can be thought of as having an area of 0.75 .\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/prob_9_of_11\/image3.png\" alt=\"Three Venn Diagrams. In all of them there is a large rectangle representing all of the sample space S. Inside this rectangle are two circles which overlap partially. One circle is labeled A and the other is labeled B. In the first Venn Diagram the circle for A is colored blue, and we see that P(A) = 0.90 . In some sense P(A) is the area of the A circle. In the second Venn Diagram the circle for B is colored blue, and it is marked that P(B) = 0.80 . Just like in the first Venn diagram it can be thought that the circle for B has an area of 0.80 . In the third Venn Diagram the area which is the overlap of circles A and B is colored blue. P(A and B) = 0.75 . The area of the overlap can be thought of as having an area of 0.75 .\" \/><\/div>\n<p>In the context of this problem, the obvious question of interest is:<\/p>\n<p><em class=\"italic\">What is the probability of on-time delivery of the document using this strategy (of sending it via both services)?<\/em><\/p>\n<p id=\"N10B88\">The document will reach its destination on time as long as it is delivered on time by service A or by service B or by both services. In other words, when event A occurs or event B occurs or both occur. so\u2026.<\/p>\n<p>P(on time delivery using this strategy)=\u00a0<em class=\"bold\">P(A or B)<\/em>, which is represented the by the shaded region in the diagram below:<\/p>\n<div class=\"image shouldbeleft\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"The same Venn Diagram except the area of the two circles has been colored blue (shaded). This means the area in the overlap is also colored blue. Note that the overlap area has only been colored once, so even though it is in both circles we will count it once.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/prob_9_of_11\/image6.png\" alt=\"The same Venn Diagram except the area of the two circles has been colored blue (shaded). This means the area in the overlap is also colored blue. Note that the overlap area has only been colored once, so even though it is in both circles we will count it once.\" \/><\/div>\n<p>We can now use the three Venn diagrams representing P(A), P(B) and P(A and B) to see that we can find P(A or B) by:<\/p>\n<p>adding P(A) (represented by the left circle) and P(B) (represented by the right circle), then subtracting P(A and B) (represented by the overlap), since we included it twice, once as part of P(A) and once as part of P(B).<\/p>\n<p id=\"N10B9D\">This is shown in the following image:<\/p>\n<div class=\"image shouldbeleft\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"The area of both circles in the Venn diagram (counting the overlap area once) is calculated as: the area of A's circle (which includes the overlap) + the area of B's circle (which also includes the overlap) - the area of the overlap. We therefore get: P(A or B) = P(A) + P(B) - P(A and B).\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/prob_9_of_11\/image7.png\" alt=\"The area of both circles in the Venn diagram (counting the overlap area once) is calculated as: the area of A's circle (which includes the overlap) + the area of B's circle (which also includes the overlap) - the area of the overlap. We therefore get: P(A or B) = P(A) + P(B) - P(A and B).\" \/><\/div>\n<p id=\"N10BA7\">If we apply this to our example, we find that:<\/p>\n<p id=\"N10BAA\">P(A or B)= P(on-time delivery using this strategy)= 0.90 + 0.80 \u2013 0.75 = 0.95.<\/p>\n<p id=\"N10BAD\">So our strategy of using two delivery services increases our probability of on-time delivery to 0.95.<\/p>\n<\/div>\n<\/div>\n<p>After this example, the following General Addition Rule for the probability of finding P(A or B), should not be surprising:<\/p>\n<\/div>\n<\/div>\n<table id=\"N10BB4_bx\" class=\"theorem labeled\">\n<thead>\n<tr>\n<th>\n<h5>Rule 6: The General Addition Rule<\/h5>\n<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>\n<div class=\"theorem\">\n<div class=\"statement\">\n<p id=\"N10BBC\"><em>For any 2 events A and B, P(A or B) = P(A) + P(B) \u2013 P(A and B).<\/em><\/p>\n<\/div>\n<\/div>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p><em class=\"bold\">Comment:<\/em><\/p>\n<p id=\"N10BCA\">As we mentioned above P(A or B)= P(A occurs or B occurs or both occur).<\/p>\n<p>Another way to interpret P(A or B) is therefore P(At least one of the two events occur).<\/p>\n<div class=\"textbox textbox--exercises\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<div id=\"h5p-84\">\n<div class=\"h5p-iframe-wrapper\"><iframe id=\"h5p-iframe-84\" class=\"h5p-iframe\" data-content-id=\"84\" style=\"height:1px\" src=\"about:blank\" frameBorder=\"0\" scrolling=\"no\" title=\"4.2 learn by doing 14\"><\/iframe><\/div>\n<\/div>\n<\/div>\n<\/div>\n<div class=\"textbox textbox--exercises\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p id=\"N10BF9\">Suppose that Jim is applying to two colleges: College A, an \u201cIvy League\u201d school, and College B, a state university. Based on his credentials and the requirements of the two colleges, Jim estimates his chances with the following probabilities:<\/p>\n<ul>\n<li>Probability that he will be admitted to college A is 0.10.<\/li>\n<li>Probability that he will be admitted to college B is 0.75.<\/li>\n<li>Probability that he will be admitted to both colleges is 0.05.<\/li>\n<\/ul>\n<div id=\"h5p-85\">\n<div class=\"h5p-iframe-wrapper\"><iframe id=\"h5p-iframe-85\" class=\"h5p-iframe\" data-content-id=\"85\" style=\"height:1px\" src=\"about:blank\" frameBorder=\"0\" scrolling=\"no\" title=\"4.2 Did I get this 13\"><\/iframe><\/div>\n<\/div>\n<\/div>\n<\/div>\n<h2><span title=\"Quick scroll up\">Comments:<\/span><\/h2>\n<ol>\n<li id=\"N10C30\">Note that although the motivation for this rule was to find P(A or B) when A and B are not disjoint, this rule is general in the sense that if A and B happen to be disjoint (no overlap), then P(A and B) is zero, and we\u2019re back to the original version of Rule 4, the Addition Rule for Disjoint Events.<\/li>\n<li id=\"N10C33\">Note that in order to find P(A or B) using the General Addition Rule, you need to know P(A and B), the probability that both events occur. In all three examples above (document delivery, traffic lights and college admittance) P(A and B) was simply given to us. Sometimes instead of giving us P(A and B) directly, we are given a different piece of information which would allow us to find P(A and B). An example of that draws on our previous work with Rule 5. If A and B are independent, then we can multiply the individual probabilities to compute P(A and B)<\/li>\n<\/ol>\n<div>\n<div class=\"textbox textbox--exercises\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p>What is the probability that at least one of the next two strangers you meet shares your birth month? For this problem assume birth months are equally likely, so the probability of being born in a given month is 1\/12 (about 0.083).<\/p>\n<p><em class=\"bold\">Let A = first stranger shares your birth month<\/em><\/p>\n<p><em class=\"bold\">Let B = second stranger shares your birth month<\/em><\/p>\n<p id=\"N10078\">Assume that meeting two strangers is like randomly selecting two people from a large population.<\/p>\n<div id=\"h5p-87\">\n<div class=\"h5p-iframe-wrapper\"><iframe id=\"h5p-iframe-87\" class=\"h5p-iframe\" data-content-id=\"87\" style=\"height:1px\" src=\"about:blank\" frameBorder=\"0\" scrolling=\"no\" title=\"4.2 Did I get this 14\"><\/iframe><\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<h2><span title=\"Quick scroll up\">Comment:<\/span><\/h2>\n<p id=\"N10CC8\">The words \u201cat least one of\u201d might remind you of the Complement Rule strategy we used on the previous page for finding the probability that \u201cat least one of many independent events occurred.\u201d Note that P(A or B) can also be interpreted as the probability that \u201cat least one of the two events A, B occur.\u201d When the events are independent, the Complement Rule strategy and the General Addition Rule give the same results, as shown below for the birth month problem.<\/p>\n<p id=\"N10CCB\">* General Addition Rule when events are independent:<\/p>\n<p id=\"N10CCE\">P(at least one of the two shares your birth month)=<\/p>\n<p id=\"N10CD1\">P(A or B)=P(A)+P(B)\u2013P(A and B)=<\/p>\n<p id=\"N10CD4\">1\/12 +1\/12 -(1\/12)(1\/12)=0.16.<\/p>\n<p id=\"N10CD7\">* We could also have used the Complement Rule strategy:<\/p>\n<p id=\"N10CDA\">P(at least one of the two share your birth month)=<\/p>\n<p id=\"N10CDD\">1\u2013P(neither shares your birth month)=<\/p>\n<p id=\"N10CE0\">1- (11\/12)(11\/12)=0.16.<\/p>\n<hr \/>\n<p id=\"N10B2D\">In our delivery example, there are two categorical variables of interest in the background:<\/p>\n<ul>\n<li>On-time delivery by service A (yes\/no)<\/li>\n<li>On-time delivery by service B (yes\/no)<\/li>\n<\/ul>\n<p>Since each of the two has two possible values (yes\/no), there are four possible combinations altogether, which correspond to the four possible outcomes of using the two services.<\/p>\n<p id=\"N10B3C\">While the Venn diagrams were great to visualize the General Addition Rule, in cases like these it is much easier to display the information in and work with a two-way table of probabilities, much as we examined the relationship between two categorical variables in the Exploratory Data Analysis section.<\/p>\n<p>How do we build a two-way table of probabilities? Let\u2019s use our delivery example to illustrate this simple process:<\/p>\n<div id=\"uwrap__i_0\" class=\"youtube\">\n<p><iframe loading=\"lazy\" id=\"oembed-1\" title=\"Probability Rules\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/aN0eulm19MM?feature=oembed&#38;rel=0&#38;rel=0\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/p>\n<\/div>\n<p>Now that we\u2019ve completed the table, it is important to understand what each of the table\u2019s entries mean in context.<\/p>\n<div class=\"image shouldbeleft\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"The table has columns &quot;B,&quot; &quot;not B,&quot; and &quot;Total.&quot; The rows are &quot;A,&quot; &quot;not A,&quot; and &quot;Total.&quot; Here are is some information about the table, organized by cell: At the cell A,B, the value there (0.75) is P(A and B) = P(on-time delivery by both services). At the cell A,not B, the value there (0.15) is P(A and Not B) = P(on-time delivery ONLY by service A). At cell Not A and B, the value (0.05) is P(not A and B) = P(on-time delivery ONLY by service B). At cell Not A and Not B, the value (0.05) is P(not A and not B) = P(Neither service A nor B delivered on time).\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/prob_table_explained.png\" alt=\"The table has columns &quot;B,&quot; &quot;not B,&quot; and &quot;Total.&quot; The rows are &quot;A,&quot; &quot;not A,&quot; and &quot;Total.&quot; Here are is some information about the table, organized by cell: At the cell A,B, the value there (0.75) is P(A and B) = P(on-time delivery by both services). At the cell A,not B, the value there (0.15) is P(A and Not B) = P(on-time delivery ONLY by service A). At cell Not A and B, the value (0.05) is P(not A and B) = P(on-time delivery ONLY by service B). At cell Not A and Not B, the value (0.05) is P(not A and not B) = P(Neither service A nor B delivered on time).\" \/><\/div>\n<div class=\"section\">\n<div class=\"sectionContain\">\n<h2><span title=\"Quick scroll up\">Comment<\/span><\/h2>\n<p>A common mistake is to confuse between: P(A) = P(event A occurs) and P(A and Not B) = P(ONLY event A occurs)[and similarly, between P(B) = P(event B occurs) and P(Not A and B) = P(only event B occurs)].<\/p>\n<p>Looking at the probability table is a great way to clear-up this confusion:<\/p>\n<div class=\"image shouldbeleft\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"The table's first row has been highlighted. Here is the highlighted data in &quot;Row, Column&quot; format: A, B: P(A and B) = 0.75; A, not B: P(A and not B) = 0.15; A, Total: P(A) = 0.90 = P(A and B) + P(A and not B)\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/prob_table.png\" alt=\"The table's first row has been highlighted. Here is the highlighted data in &quot;Row, Column&quot; format: A, B: P(A and B) = 0.75; A, not B: P(A and not B) = 0.15; A, Total: P(A) = 0.90 = P(A and B) + P(A and not B)\" \/><\/div>\n<p>P(A) = 0.90 means that in 90% of the cases when service A is used, it delivers the document on time.<\/p>\n<p>These cases of on-time delivery by service A can be decomposed into two sub-cases:<\/p>\n<ul>\n<li>P(A and B) = 0.75 \u2192 75% of the time the document is delivered on time also by service B (i.e., the document is delivered on time by both services)<\/li>\n<li>P(A and Not B) = 0.15 \u2192 15% of the time the document is not delivered on time by service B (i.e., delivered on time only by service A).<\/li>\n<\/ul>\n<p>Similarly,<\/p>\n<div class=\"image shouldbeleft\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"The table's first column has been highlighted. Here is the highlighted data in &quot;Row, Column&quot; format: A,B: P(A and B) = 0.75; not A, B: P(not A and B) = 0.05; B,Total: P(B) = 0.80 = P(A and B) + P(not A and B)\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/prob_table2.png\" alt=\"The table's first column has been highlighted. Here is the highlighted data in &quot;Row, Column&quot; format: A,B: P(A and B) = 0.75; not A, B: P(not A and B) = 0.05; B,Total: P(B) = 0.80 = P(A and B) + P(not A and B)\" \/><\/div>\n<p id=\"N10B7A\">P(B) = 0.80 means that in 80% of the cases when service B is used, it delivers the document on time.<\/p>\n<p id=\"N10B7D\">These cases of on-time delivery by service B can be decomposed into two sub-cases:<\/p>\n<ul>\n<li>P(A and B) = 0.75 \u2192 75% of the time the document is delivered on time also by service A (i.e., the document is delivered on time by both services)<\/li>\n<li>P(Not A and B) = 0.05 \u2192 5% of the time the document is not delivered on time by service A (i.e., delivered on time\u00a0<em class=\"bold\">only by service B<\/em>).<\/li>\n<\/ul>\n<\/div>\n<\/div>\n<div class=\"examplewrap\">\n<div class=\"example clearfix\">\n<div class=\"textbox textbox--examples\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Example<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p id=\"N10B91\">Recall the smoke detector example from the last activity. Here is a quick recap:<\/p>\n<p>D\u2014the dining room alarm is set off by smoke in the kitchen<\/p>\n<p>B\u2014the bedroom alarm is set off by smoke in the kitchen<\/p>\n<p>P(D) = 0.95<\/p>\n<p>P(B) = 0.40<\/p>\n<p>D and B are independent \u2192 P(D and B) = 0.38<\/p>\n<p>Complete the table below. Start with the information that is given and go from there.<\/p>\n<p>Complete the following table: What is the probability that goes in each cell?<\/p>\n<table class=\"wbtable plain\">\n<tbody>\n<tr class=\"e\">\n<td><\/td>\n<td align=\"center\">B<\/td>\n<td align=\"center\">not B<\/td>\n<td align=\"center\">Total<\/td>\n<\/tr>\n<tr>\n<td align=\"center\">D<\/td>\n<td><span class=\"A\"><span class=\"component\"><br \/>\n\u2014<br \/>\n0.02<br \/>\n0.03<br \/>\n0.05<br \/>\n0.38<br \/>\n0.40<br \/>\n0.57<br \/>\n0.60<br \/>\n0.95<br \/>\n1.00<br \/>\n<\/span><\/span><\/td>\n<td><span class=\"B\"><span class=\"component\"><br \/>\n\u2014<br \/>\n0.02<br \/>\n0.03<br \/>\n0.05<br \/>\n0.38<br \/>\n0.40<br \/>\n0.57<br \/>\n0.60<br \/>\n0.95<br \/>\n1.00<br \/>\n<\/span><\/span><\/td>\n<td><span class=\"C\"><span class=\"component\"><br \/>\n\u2014<br \/>\n0.02<br \/>\n0.03<br \/>\n0.05<br \/>\n0.38<br \/>\n0.40<br \/>\n0.57<br \/>\n0.60<br \/>\n0.95<br \/>\n1.00<br \/>\n<\/span><\/span><\/td>\n<\/tr>\n<tr class=\"e\">\n<td align=\"center\">not D<\/td>\n<td><span class=\"D\"><span class=\"component\"><br \/>\n\u2014<br \/>\n0.02<br \/>\n0.03<br \/>\n0.05<br \/>\n0.38<br \/>\n0.40<br \/>\n0.57<br \/>\n0.60<br \/>\n0.95<br \/>\n1.00<br \/>\n<\/span><\/span><\/td>\n<td><span class=\"E\"><span class=\"component\"><br \/>\n\u2014<br \/>\n0.02<br \/>\n0.03<br \/>\n0.05<br \/>\n0.38<br \/>\n0.40<br \/>\n0.57<br \/>\n0.60<br \/>\n0.95<br \/>\n1.00<br \/>\n<\/span><\/span><\/td>\n<td><span class=\"F\"><span class=\"component\"><br \/>\n\u2014<br \/>\n0.02<br \/>\n0.03<br \/>\n0.05<br \/>\n0.38<br \/>\n0.40<br \/>\n0.57<br \/>\n0.60<br \/>\n0.95<br \/>\n1.00<br \/>\n<\/span><\/span><\/td>\n<\/tr>\n<tr>\n<td align=\"center\">Total<\/td>\n<td><span class=\"G\"><span class=\"component\"><br \/>\n\u2014<br \/>\n0.02<br \/>\n0.03<br \/>\n0.05<br \/>\n0.38<br \/>\n0.40<br \/>\n0.57<br \/>\n0.60<br \/>\n0.95<br \/>\n1.00<br \/>\n<\/span><\/span><\/td>\n<td><span class=\"H\"><span class=\"component\"><br \/>\n\u2014<br \/>\n0.02<br \/>\n0.03<br \/>\n0.05<br \/>\n0.38<br \/>\n0.40<br \/>\n0.57<br \/>\n0.60<br \/>\n0.95<br \/>\n1.00<br \/>\n<\/span><\/span><\/td>\n<td><span class=\"I\"><span class=\"component\"><br \/>\n\u2014<br \/>\n0.02<br \/>\n0.03<br \/>\n0.05<br \/>\n0.38<br \/>\n0.40<br \/>\n0.57<br \/>\n0.60<br \/>\n0.95<br \/>\n1.00<br \/>\n<\/span><\/span><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<\/div>\n<div class=\"textbox textbox--exercises\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<div id=\"h5p-88\">\n<div class=\"h5p-iframe-wrapper\"><iframe id=\"h5p-iframe-88\" class=\"h5p-iframe\" data-content-id=\"88\" style=\"height:1px\" src=\"about:blank\" frameBorder=\"0\" scrolling=\"no\" title=\"4.2 learn by doing 16\"><\/iframe><\/div>\n<\/div>\n<\/div>\n<\/div>\n<div class=\"textbox textbox--exercises\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p>Recall the example concerning the delivery of an important document. To maximize the chances of on-time delivery, two copies of the document are sent using two services, service A and service B. It is known that the probabilities of on-time delivery are:<\/p>\n<p>0.90 for service A: P(A) = 0.90<\/p>\n<p>0.80 for service B: P(B) = 0.80<\/p>\n<p>0.75 for both services being on time: P(A and B) = 0.75<\/p>\n<div id=\"h5p-89\">\n<div class=\"h5p-iframe-wrapper\"><iframe id=\"h5p-iframe-89\" class=\"h5p-iframe\" data-content-id=\"89\" style=\"height:1px\" src=\"about:blank\" frameBorder=\"0\" scrolling=\"no\" title=\"4.2 Did I get this 15\"><\/iframe><\/div>\n<\/div>\n<\/div>\n<\/div>\n<h2><span title=\"Quick scroll up\">Comment<\/span><\/h2>\n<p id=\"N10C35\">In both the delivery problem and the smoke detector problem, we knew P(A), P(B) and P(A and B). (In the smoke detector problem, we actually needed to work a bit to get P(A and B), but it wasn\u2019t too bad.) Visually, we had the probability for the three shaded cells below, which was enough information to complete the table.<\/p>\n<p><span class=\"imagewrap\"><span class=\"image\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"The table has columns &quot;B,&quot; &quot;not B,&quot; and &quot;Total.&quot; The rows are &quot;A,&quot; &quot;not A,&quot; and &quot;Total.&quot; We will be naming cells by &quot;{Row, Column}&quot; notation. Cells {A,B}, {A, Total}, and {Total, B} have been shaded.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image031.gif\" alt=\"The table has columns &quot;B,&quot; &quot;not B,&quot; and &quot;Total.&quot; The rows are &quot;A,&quot; &quot;not A,&quot; and &quot;Total.&quot; We will be naming cells by &quot;{Row, Column}&quot; notation. Cells {A,B}, {A, Total}, and {Total, B} have been shaded.\" \/><\/span><\/span><\/p>\n<p id=\"N10C3E\">This, however, is not the only combination of three cells that would provide sufficient information to complete the table. Essentially, as long as we are given (or can calculate) one cell in each of the margins (the total row and column), and one of the four cells in the body of the table, we\u2019ll be able to complete the entire table. Visually, we need:<\/p>\n<p><span class=\"imagewrap\"><span class=\"image\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"The same table. We need information about one of the cells in the body of the table. These cells are {A,B}, {A, not B}, {not A, B}, and {not A, not B}. In addition, we need information from one of the cells on the right margin. These cells are {A, Total} and {not A, Total}. The last group of cells we need information from is the bottom margin. These cells are {Total, B} and {Total, not B}. With one cell from each of these three groups we can fill in the entire table.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image032.gif\" alt=\"The same table. We need information about one of the cells in the body of the table. These cells are {A,B}, {A, not B}, {not A, B}, and {not A, not B}. In addition, we need information from one of the cells on the right margin. These cells are {A, Total} and {not A, Total}. The last group of cells we need information from is the bottom margin. These cells are {Total, B} and {Total, not B}. With one cell from each of these three groups we can fill in the entire table.\" \/><\/span><\/span><\/p>\n<div class=\"textbox textbox--exercises\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p id=\"N10C4E\">Researchers studied thousands of court cases. For each case, they recorded the jury\u2019s decision. In addition, they asked the judge in each case how he or she would have decided the same case if there were no jury. In 67% of the cases the jury voted to convict, in 83% of the cases the judge would have convicted, and in 19% of the cases only the judge would have convicted.<\/p>\n<p id=\"N10C51\">Let A be the event \u201cjury convicts\u201d.<\/p>\n<p id=\"N10C54\">Let B be the event \u201cjudge convicts\u201d.<\/p>\n<div id=\"h5p-90\">\n<div class=\"h5p-iframe-wrapper\"><iframe id=\"h5p-iframe-90\" class=\"h5p-iframe\" data-content-id=\"90\" style=\"height:1px\" src=\"about:blank\" frameBorder=\"0\" scrolling=\"no\" title=\"Complete the following table:\"><\/iframe><\/div>\n<\/div>\n<\/div>\n<\/div>\n<div class=\"textbox textbox--exercises\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p id=\"N10C84\">According to www.jointogether.com, in 2000, 87% of all suicides were committed by males, 56% of all suicides were committed using a gun, and 10% of all suicides were committed by women not using a gun.<\/p>\n<p id=\"N10C87\">(We&#8217;ll use M for suicide committed by a male, F [= not M] for suicide committed by female, and G for a suicide committed using a gun.)<\/p>\n<div class=\"asx\">\n<div id=\"du3_m1_rules10_tutor2\" class=\"activitywrap sectionNest flash\">\n<div class=\"activityhead\">\n<div class=\"activityinfo\"><\/div>\n<\/div>\n<div class=\"actContain\">\n<div class=\"activity flash\">\n<div id=\"u3_m1_rules10_tutor2\" class=\"flash_obj asx testFlash mark_flash\">\n<div id=\"ou3_m1_rules10_tutor2\" class=\"page 2962880\">\n<div id=\"2962880\" class=\"question\">\n<div><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"four datatables\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/webcontent\/flash\/_u4_m1_digtutor11a_image1.gif\" alt=\"four datatables\" \/><\/div>\n<div>\n<div id=\"h5p-91\">\n<div class=\"h5p-iframe-wrapper\"><iframe id=\"h5p-iframe-91\" class=\"h5p-iframe\" data-content-id=\"91\" style=\"height:1px\" src=\"about:blank\" frameBorder=\"0\" scrolling=\"no\" title=\"4.2 Did I get this 16\"><\/iframe><\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<h2><span title=\"Quick scroll up\">Comment<\/span><\/h2>\n<p>When we used two-way tables in the Exploratory Data Analysis (EDA) section, it was to record values of two categorical variables for a concrete\u00a0<em>sample<\/em>\u00a0of individuals. In contrast, the information in a probability two-way table is for an entire\u00a0<em>population<\/em>, and the values are rather abstract. If we had treated something like the delivery example in the EDA section, we would have recorded the actual numbers of on-time (and not-on-time) deliveries for samples of documents mailed with service A or B. In this section, the long-term probabilities are presented as being known. Presumably, those probabilities were based on relative frequencies recorded over many repetitions.<\/p>\n<hr \/>\n<p id=\"N10AFD\">Now that we know how to build a two-way probability table, let\u2019s see how we can use information from it to solve problems.<\/p>\n<div class=\"examplewrap\">\n<div class=\"example clearfix\">\n<div class=\"textbox textbox--examples\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Example<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p id=\"N10B02\">Let\u2019s go back to our delivery example and see how we can \u201clift\u201d probabilities from the two-way probability table in order to answer the question posed in that example and related questions. Here is the table again:<\/p>\n<p><span class=\"imagewrap\"><span class=\"image\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"The table has 3 columns and 3 rows. The columns are: &quot;B,&quot; &quot;not B,&quot; and &quot;Total.&quot; The rows are &quot;A,&quot; &quot;not A,&quot; and &quot;Total.&quot; Here is the cell data in &quot;Row, Column: Value&quot; format. A,B: 0.75; A,not B: .15; A,Total: .90; not A, B: .05; not A, not B: .05; not A, Total: .10; Total, B: .80; Total, not B: .20; Total, Total: 1.00\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image033.gif\" alt=\"The table has 3 columns and 3 rows. The columns are: &quot;B,&quot; &quot;not B,&quot; and &quot;Total.&quot; The rows are &quot;A,&quot; &quot;not A,&quot; and &quot;Total.&quot; Here is the cell data in &quot;Row, Column: Value&quot; format. A,B: 0.75; A,not B: .15; A,Total: .90; not A, B: .05; not A, not B: .05; not A, Total: .10; Total, B: .80; Total, not B: .20; Total, Total: 1.00\" \/><\/span><\/span><\/p>\n<p id=\"N10B0B\">What is the probability of on-time delivery of the document using the two services strategy?<\/p>\n<p>In other words, what is P(A or B)?<\/p>\n<p>We can use the table in two ways:<\/p>\n<p>(i) We can simply lift P(A), P(B) and P(A and B) from the table as shown in the table below and use the General Addition Rule to get 0.95. as we did before: P(A or B) = P(A) + P(B) \u2212 P(A and B) = 0.90 + 0.80 \u2212 0.75 = 0.95.<\/p>\n<p><span class=\"imagewrap\"><span class=\"image\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"Cells are given in &quot;{Row,Column: Value}&quot; format. The same table as the previous, except that the cells {A,B: 0.75}, {A, Total: 0.90}, and {Total, B: 0.80} have been highlighted.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image034.gif\" alt=\"Cells are given in &quot;{Row,Column: Value}&quot; format. The same table as the previous, except that the cells {A,B: 0.75}, {A, Total: 0.90}, and {Total, B: 0.80} have been highlighted.\" \/><\/span><\/span><\/p>\n<p>(ii) Another way to use the table is to use the fact that in probability, \u201cA or B\u201d actually means \u201cA or B or both.\u201d The corresponding cells for these three options are shaded below and are 0.15 (only A), 0.05 (only B), and 0.75 (both). We can add these up to get P(A or B) = 0.95.<\/p>\n<p><span class=\"imagewrap\"><span class=\"image\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"Cells are given in &quot;{Row,Column}&quot; format. The same table as the previous, except that the cells {A,B: 0.75}, {A, not B: 0.15}, and {not A, B: 0.05} have been highlighted.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image035.gif\" alt=\"Cells are given in &quot;{Row,Column}&quot; format. The same table as the previous, except that the cells {A,B: 0.75}, {A, not B: 0.15}, and {not A, B: 0.05} have been highlighted.\" \/><\/span><\/span><\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<div class=\"examplewrap\">\n<div class=\"example clearfix\">\n<div class=\"textbox textbox--examples\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Example<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p>What is the probability of on-time delivery by exactly one service?<\/p>\n<p>On-time delivery by exactly one service occurs if the document arrives on-time by service A and not B, or by service B and not A. The probabilities of these two possibilities are represented by the shaded cells in the table below, and are 0.15 and 0.05 respectively. Therefore, P(on-time delivery by exactly one service) = 0.15 + 0.05 = 0.20<\/p>\n<p><span class=\"imagewrap\"><span class=\"image\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"Cells are given in &quot;{Row,Column}&quot; format. The same table as the previous, except that the cells {A, not B: 0.15} and {not A, B: 0.05} have been highlighted.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image036.gif\" alt=\"Cells are given in &quot;{Row,Column}&quot; format. The same table as the previous, except that the cells {A, not B: 0.15} and {not A, B: 0.05} have been highlighted.\" \/><\/span><\/span><\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<div class=\"examplewrap\">\n<div class=\"example clearfix\">\n<div class=\"textbox textbox--examples\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Example<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p>What is the probability that the document will\u00a0<em>not<\/em>\u00a0get to its destination on time? This would be the occurrence of the event \u201cnot A and not B,\u201d whose probability is 0.05, as shown in the table:<\/p>\n<p><span class=\"imagewrap\"><span class=\"image\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"Cells are given in &quot;{Row,Column}&quot; format. The same table as the previous, except that the cell {not A, not B: 0.05} has been highlighted.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/image037.gif\" alt=\"Cells are given in &quot;{Row,Column}&quot; format. The same table as the previous, except that the cell {not A, not B: 0.05} has been highlighted.\" \/><\/span><\/span><\/p>\n<\/div>\n<\/div>\n<div class=\"textbox textbox--exercises\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p>Candace is applying to two colleges, Ross College and the more prestigious Cirus College. The probability table below represents her belief about whether she will be accepted. We use the following notation:<\/p>\n<p>R\u2014the event of being accepted to Ross College<\/p>\n<p>C\u2014the event of being accepted to Cirus College<\/p>\n<div class=\"image shouldbeleft\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"table of probabilities of acceptance to two different colleges\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m1_finding_probability\/webcontent\/dig010.gif\" alt=\"table of probabilities of acceptance to two different colleges\" \/><\/div>\n<div>\n<div id=\"h5p-92\">\n<div class=\"h5p-iframe-wrapper\"><iframe id=\"h5p-iframe-92\" class=\"h5p-iframe\" data-content-id=\"92\" style=\"height:1px\" src=\"about:blank\" frameBorder=\"0\" scrolling=\"no\" title=\"4.2 learn by doing 17\"><\/iframe><\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<p>We are now done with this section, which introduced various probability rules. Let\u2019s summarize what we\u2019ve learned.<\/p>\n<p>1. The Complement Rule states that<\/p>\n<p><em>P(not A) = 1 \u2212 P(A)<\/em><\/p>\n<p>or when rearranged<\/p>\n<p><em>P(A) = 1 \u2212 P(not A).<\/em><\/p>\n<p>The Complement Rule is very useful when we need to find probabilities of the sort: P(At least one of several events occur) which is hard to calculate. In this case, we apply the Complement Rule:<\/p>\n<p id=\"N10B80\"><em>P(At least one of several events occur) = 1 \u2212 P(None of the events occur)<\/em>, since P(None of the events occur) is usually much easier to find.<\/p>\n<p>2. The General Addition Rule states that for any two events,<\/p>\n<p><em>P(A or B) = P(A) + P(B) \u2212 P(A and B),<\/em><\/p>\n<p id=\"N10B8E\">where, by P(A or B) we mean P(A occurs or B occurs or both).<\/p>\n<p>In the special case when A and B are\u00a0<em class=\"italic\">disjoint<\/em>\u00a0events (which means that P(A and B) = 0), the general addition rule becomes P(A or B) = P(A) + P(B), which we call the Addition Rule for Disjoint Events.<\/p>\n<p id=\"N10B98\">Beware of wrongly using the Addition Rule for Disjoint events when the events are not disjoint.<\/p>\n<p id=\"N10B9B\">3. When we want to find P(A and B), we can use the Multiplication Rule, but so far we\u2019ve only learned the restricted version of this rule\u2014the Multiplication Rule for Independent Events. Events are independent if the occurrence of one of the events has no effect on the probability of the other occurring, in which case:<\/p>\n<p id=\"N10B9E\"><em>P(A and B) = P(A) * P(B).<\/em><\/p>\n<p id=\"N10BA4\">4. The Additional Rule for Disjoint Events can be naturally extended to more than two events. In other words, if events A, B, and C are disjoint, then<\/p>\n<p>P(A or B or C)=P(A)+P(B)+P(C).<\/p>\n<p>Similarly, the Multiplication Rule for Independent Events can be naturally extended to more than two independent events. In other words, if events A, B, and C are independent, then P(A and B and C) = P(A) * P(B) * P(C). The same is true for 4, 5, \u2026, disjoint\/independent events.<\/p>\n<p>5. When there are two categorical variables in the background, each with two possible values, a\u00a0<em class=\"italic\">two-way probability table<\/em>\u00a0is a quick and easy way to display the probabilities associated with the 4 possible combinations.<\/p>\n<h2>Conditional Probability and Independence<\/h2>\n<div class=\"textbox textbox--learning-objectives\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Learning Objectives<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<ul>\n<li id=\"explain_conditional_probability\">Explain the reasoning behind conditional probability, and how this reasoning is expressed by the definition of conditional probability.<\/li>\n<li id=\"find_conditional_probabilities\">Find conditional probabilities and interpret them.<\/li>\n<li id=\"determine_whether_two_events_are_independent\">Determine whether two events are independent or not.<\/li>\n<li id=\"use_general_multiplication_rule\">Use the General Multiplication Rule to find the probability that two events occur (P(A and B)).<\/li>\n<li id=\"use_probability_trees\">Use probability trees as a tool for finding probabilities.<\/li>\n<\/ul>\n<\/div>\n<\/div>\n<h2><span title=\"Quick scroll up\">Introduction<\/span><\/h2>\n<p id=\"N10AE3\">In the last section, we established the five basic rules of probability, which include the two restricted versions of the Addition Rule and Multiplication Rule: The Addition Rule for <em>Disjoint<\/em>\u00a0Events and the Multiplication Rule for\u00a0<em>Independent<\/em>\u00a0Events. We have also established a General Addition Rule for which the events need not be disjoint. In order to complete our set of rules, we still require a General Multiplication Rule for which the events need not be independent. In order to establish such a rule, however, we first need to understand the important concept of\u00a0<em>conditional probability.<\/em><\/p>\n<p id=\"N10AEF\">This section will be organized as follows: We\u2019ll first introduce the idea of conditional probability, and use it to formalize our definition of independent events, which in the first module was presented only in an intuitive way. We will then develop the General Multiplication Rule, a rule that will tell us how to find P(A <em>and<\/em>\u00a0B) in cases when the events A and B are not necessarily independent. We\u2019ll conclude with a discussion of probability trees, a method of displaying conditional probability visually that is very helpful in solving problems.<\/p>\n<div class=\"multi\">\n<div class=\"textbox textbox--learning-objectives\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Learning Objectives<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<ul>\n<li>Explain the reasoning behind conditional probability, and how this reasoning is expressed by the definition of conditional probability.<\/li>\n<li>Find conditional probabilities and interpret them.<\/li>\n<\/ul>\n<\/div>\n<\/div>\n<p>In the first part of this chapter, we\u2019ll introduce the concept of conditional probability. The idea here is that the probabilities of certain events may be affected by whether or not other events have occurred. Let\u2019s illustrate this idea with a simple example:<\/p>\n<\/div>\n<div class=\"examplewrap\">\n<div class=\"example clearfix\">\n<div class=\"textbox textbox--examples\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Example<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p id=\"N10AFA\">All the students in a certain high school were surveyed, then classified according to gender and whether they had either of their ears pierced:<\/p>\n<p><span class=\"imagewrap\"><span class=\"image\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"A table of the data. The column headings are &quot;Pierced,&quot; &quot;Not Pierced,&quot; and &quot;Total.&quot; The Rows are &quot;Male,&quot; &quot;Female,&quot; and &quot;Total.&quot; The data in the cells is given in &quot;Row, Column: Value&quot; format: Male, Pierced: 36; Male, Not Pierced: 144; Male, Total: 180; Female, Pierced: 288; Female, Not Pierced: 32; Female, Total: 320; Total, Pierced: 324; Total, Not Pierced: 176; Total, Total: 500;\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m2_conditional_probability\/webcontent\/image001.gif\" alt=\"A table of the data. The column headings are &quot;Pierced,&quot; &quot;Not Pierced,&quot; and &quot;Total.&quot; The Rows are &quot;Male,&quot; &quot;Female,&quot; and &quot;Total.&quot; The data in the cells is given in &quot;Row, Column: Value&quot; format: Male, Pierced: 36; Male, Not Pierced: 144; Male, Total: 180; Female, Pierced: 288; Female, Not Pierced: 32; Female, Total: 320; Total, Pierced: 324; Total, Not Pierced: 176; Total, Total: 500;\" \/><\/span><\/span><\/p>\n<p>(Note that this is a two-way table of counts that was first introduced when we talked about the relationship between two categorical variables. It is not surprising that we are using it again in this example, since we indeed have two categorical variables here:\u00a0<em>Gender:<\/em>\u00a0M or F (in our notation, \u201cnot M\u201d), and\u00a0<em>Pierced:<\/em>\u00a0Yes or No)<\/p>\n<p>Suppose a student is selected at random from the school. Let\u00a0<em>M<\/em>\u00a0and\u00a0<em>not M<\/em>\u00a0denote the events of being male and female, respectively, and\u00a0<em>E<\/em>\u00a0and\u00a0<em>not E<\/em>\u00a0denote the events of having ears pierced or not, respectively. We\u2019ll start by asking what will seem like simple questions, and we\u2019ll build our way to conditional probability:<\/p>\n<ol class=\"lower-alpha\">\n<li>What is the probability that the student has one or both ears pierced?Since a student is chosen at random from the group of 500 students, out of which 324 are pierced,P(E) = 324\/500 = .648<\/li>\n<li>What is the probability that the student is male?Since a student is chosen at random from the group of 500 students, out of which 180 are male,P(M) = 180\/500 = .36<\/li>\n<li>What is the probability that the student is male and has ear(s) pierced?Since a student is chosen at random from the group of 500 students out of which 36 are male and have their ear(s) pierced, P(M and E) = 36\/500 = .072Now something new:<\/li>\n<li><em>Given<\/em>\u00a0that the student that was chosen is male, what is the probability that he has one or both ears pierced?At this point, new notation is required, to express the probability of a certain event given that another event holds. We will write \u201cthe probability of having one or both ears pierced (E) , given that a student is male (M)\u201d as\u00a0<em>P(E | M).<\/em><\/li>\n<\/ol>\n<p>A word about this new notation: The event whose probability we seek (in this case E) is written first, the vertical line stands for the word \u201cgiven\u201d or \u201cconditioned on,\u201d and the event that is given (in this case M) is written after the \u201c|\u201d sign.<\/p>\n<p>We call this probability the\u00a0<em>conditional probability<\/em>\u00a0of having one or both ears pierced, given that a student is male: it assesses the probability of having pierced ears under the condition of being male. Now to solve for the probability, we observe that choosing from only the males in the school essentially alters the sample space S from all students in the school to all male students in the school. The total number of possible outcomes is no longer 500, but has changed to 180. Out of those 180 males, 36 have ear(s) pierced, and thus:<\/p>\n<p id=\"N10B53\">P(E | M) = 36\/180 = .20.<\/p>\n<\/div>\n<\/div>\n<p>A good visual illustration of this conditional probability is provided by the two-way table:<\/p>\n<p><span class=\"imagewrap\"><span class=\"image\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"The same table of the data for piercings. The column headings are &quot;Pierced,&quot; &quot;Not Pierced,&quot; and &quot;Total.&quot; The Rows are &quot;Male,&quot; &quot;Female,&quot; and &quot;Total.&quot; The data in the cells is given in &quot;Row, Column: Value&quot; format: Male, Pierced: 36; Male, Not Pierced: 144; Male, Total: 180; Female, Pierced: 288; Female, Not Pierced: 32; Female, Total: 320; Total, Pierced: 324; Total, Not Pierced: 176; Total, Total: 500; In this table, the first row (Male) has been highlighted. The {Male, Pierced: 36} cell is in dark green, and the rest is in light green, showing that we can use this row to calculate the conditional probability.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m2_conditional_probability\/webcontent\/image002.gif\" alt=\"The same table of the data for piercings. The column headings are &quot;Pierced,&quot; &quot;Not Pierced,&quot; and &quot;Total.&quot; The Rows are &quot;Male,&quot; &quot;Female,&quot; and &quot;Total.&quot; The data in the cells is given in &quot;Row, Column: Value&quot; format: Male, Pierced: 36; Male, Not Pierced: 144; Male, Total: 180; Female, Pierced: 288; Female, Not Pierced: 32; Female, Total: 320; Total, Pierced: 324; Total, Not Pierced: 176; Total, Total: 500; In this table, the first row (Male) has been highlighted. The {Male, Pierced: 36} cell is in dark green, and the rest is in light green, showing that we can use this row to calculate the conditional probability.\" \/><\/span><\/span><\/p>\n<p>which shows us that conditional probability is not very different from (and actually quite the same as) the conditional percents we calculated in the example above.<\/p>\n<div class=\"textbox textbox--exercises\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p id=\"N10B33\">Consider the piercing example, where the following two-way table is given,<\/p>\n<div class=\"image shouldbeleft\"><img decoding=\"async\" id=\"_i_1\" class=\"img-responsive popimg aligncenter\" title=\"The same table of the data for piercings. The column headings are &quot;Pierced,&quot; &quot;Not Pierced,&quot; and &quot;Total.&quot; The Rows are &quot;Male,&quot; &quot;Female,&quot; and &quot;Total.&quot; The data in the cells is given in &quot;Row, Column: Value&quot; format: Male, Pierced: 36; Male, Not Pierced: 144; Male, Total: 180; Female, Pierced: 288; Female, Not Pierced: 32; Female, Total: 320; Total, Pierced: 324; Total, Not Pierced: 176; Total, Total: 500;\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m2_conditional_probability\/webcontent\/dig001.gif\" alt=\"The same table of the data for piercings. The column headings are &quot;Pierced,&quot; &quot;Not Pierced,&quot; and &quot;Total.&quot; The Rows are &quot;Male,&quot; &quot;Female,&quot; and &quot;Total.&quot; The data in the cells is given in &quot;Row, Column: Value&quot; format: Male, Pierced: 36; Male, Not Pierced: 144; Male, Total: 180; Female, Pierced: 288; Female, Not Pierced: 32; Female, Total: 320; Total, Pierced: 324; Total, Not Pierced: 176; Total, Total: 500;\" \/><\/div>\n<p id=\"N10B3B\">Recall also that M represents the event of being a male (&#8220;not M&#8221; represents being a female), and E represents the event of having one or both ears pierced.<\/p>\n<div id=\"h5p-93\">\n<div class=\"h5p-iframe-wrapper\"><iframe id=\"h5p-iframe-93\" class=\"h5p-iframe\" data-content-id=\"93\" style=\"height:1px\" src=\"about:blank\" frameBorder=\"0\" scrolling=\"no\" title=\"4.2 learn by doing 18\"><\/iframe><\/div>\n<\/div>\n<\/div>\n<\/div>\n<p>Another way to visualize conditional probability is using a Venn diagram:<\/p>\n<p><span class=\"imagewrap\"><span class=\"image\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"A Venn Diagram, in which a large rectangle represents all of the sample space. There are two circles in the rectangle, labeled M (for Male) and E (for Ear Pierced). Circle M and circle E overlap (but not totally). P(M) = 180\/500 = .36, so this is somewhat like the area of circle M. The overlap is the event M and E. P(M and E) = 36\/500 = .072, which is also like the area of the overlap area.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m2_conditional_probability\/webcontent\/image003.gif\" alt=\"A Venn Diagram, in which a large rectangle represents all of the sample space. There are two circles in the rectangle, labeled M (for Male) and E (for Ear Pierced). Circle M and circle E overlap (but not totally). P(M) = 180\/500 = .36, so this is somewhat like the area of circle M. The overlap is the event M and E. P(M and E) = 36\/500 = .072, which is also like the area of the overlap area.\" \/><\/span><\/span><\/p>\n<p id=\"N10B68\">In both the two-way table and the Venn diagram, the reduced sample space (comprised of only males) is shaded light green, and within this sample space, the event of interest (having ears pierced) is shaded darker green. The two-way table illustrates the idea via counts, while the Venn diagram converts the counts to probabilities, which are presented as regions rather than cells.<\/p>\n<p id=\"N10B6B\">We may work with counts, as presented in the two-way table, to write<\/p>\n<p id=\"N10B6E\">P(E | M) = 36\/180.<\/p>\n<p id=\"N10B71\">Or we can work with probabilities, as presented in the Venn diagram, by writing<\/p>\n<p id=\"N10B74\">P(E | M) = (36\/500) \/ (180\/500).<\/p>\n<p id=\"N10B77\">We will want, however, to write our formal expression for conditional probabilities in terms of other, ordinary, probabilities and therefore the definition of conditional probability will grow out of the Venn diagram.<\/p>\n<p>Notice that<\/p>\n<p>P(E | M) = (36\/500) \/ (180\/500) = P(M and E) \/ P(M). Generalized, we have a formal definition of conditional probability:<\/p>\n<dl>\n<dt>conditional probability<\/dt>\n<dd>\n<div class=\"meaning\">The\u00a0<em>conditional probability of event B, given event A,<\/em>\u00a0is\u00a0<em>P(B | A) = P(A and B) \/ P(A)<\/em><\/div>\n<\/dd>\n<\/dl>\n<div class=\"section\">\n<div class=\"sectionContain\">\n<h2><span title=\"Quick scroll up\">Comments<\/span><\/h2>\n<ol>\n<li>Note that when we evaluate the conditional probability, we always divide by the probability of the given event. The probability of both goes in the numerator.<\/li>\n<li id=\"N10BA1\">The above formula holds as long as P(A) &gt; 0, since we cannot divide by 0. In other words, we should not seek the probability of an event given that an impossible event has occurred.<\/li>\n<\/ol>\n<p>Let\u2019s see how we can use this formula in practice:<\/p>\n<\/div>\n<\/div>\n<div class=\"examplewrap\">\n<div class=\"exHead\">\n<div class=\"textbox textbox--examples\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Example<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<div class=\"exHead\">On the \u201cInformation for the Patient\u201d label of a certain antidepressant, it is claimed that based on some clinical trials, there is a 14% chance of experiencing sleeping problems known as insomnia (denote this event by I), there is a 26% chance of experiencing headache (denote this event by\u00a0<em>H<\/em>), and there is a 5% chance of experiencing both side effects (<em>I and H<\/em>).<\/div>\n<div class=\"example clearfix\">\n<p id=\"N10BB4\">(a) Suppose that the patient experiences insomnia; what is the probability that the patient will also experience headache?<\/p>\n<p id=\"N10BB7\">Since we know (or it is given) that the patient experienced insomnia, we are looking for P(H | I). According to the definition of conditional probability:<\/p>\n<p>P(H | I) = P(H and I) \/ P(I) = .05\/.14 = .357.<\/p>\n<p>(b) Suppose the drug induces headache in a patient; what is the probability that it also induces insomnia?<\/p>\n<p id=\"N10BC0\">Here, we are given that the patient experienced headache, so we are looking for P(I | H).<\/p>\n<p id=\"N10BC3\">Using the definition P(I | H) = P(I and H) \/ P(H) = .05\/.26 = .1923.<\/p>\n<\/div>\n<\/div>\n<\/div>\n<h2>Comment<\/h2>\n<\/div>\n<\/div>\n<div id=\"N10BC7\" class=\"section\">\n<div class=\"sectionContain\">\n<p id=\"N10BCE\">Note that the answers to (a) and (b) above are different. In general, P(A | B) does not equal P(B | A). We\u2019ll come back and illustrate this point later in this module.<\/p>\n<\/div>\n<\/div>\n<p>The purpose of the following activity is to give you guided practice in using the definition of conditional probability, and teach you how the Complement Rule works with conditional probability.<\/p>\n<div class=\"textbox textbox--exercises\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p id=\"N10BE0\">Recall the delivery services example:<\/p>\n<p id=\"N10BE3\">It is vital that a certain document reach its destination within one day. To maximize the chances of on-time delivery, two copies of the document are sent using two services, service A and service B, and the following probability table summarizes the chances of on-time delivery:<\/p>\n<div class=\"image shouldbeleft\"><img decoding=\"async\" id=\"_i_3\" class=\"img-responsive popimg aligncenter\" title=\"A table. The column headings are &quot;B,&quot; &quot;not B,&quot; and &quot;Total.&quot; The rows are &quot;A,&quot; &quot;not A,&quot; and &quot;Total.&quot; Here is the cell data in &quot;Row, Column: Value&quot; format: A,B : .75; A, not B: .15; A, Total: .90; not A, B: .05; not A, not B: .05; not A, Total: .10; Total, B: .80; Total, not B: .20; Total, Total: 1.00;\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m2_conditional_probability\/webcontent\/lbd001.gif\" alt=\"A table. The column headings are &quot;B,&quot; &quot;not B,&quot; and &quot;Total.&quot; The rows are &quot;A,&quot; &quot;not A,&quot; and &quot;Total.&quot; Here is the cell data in &quot;Row, Column: Value&quot; format: A,B : .75; A, not B: .15; A, Total: .90; not A, B: .05; not A, not B: .05; not A, Total: .10; Total, B: .80; Total, not B: .20; Total, Total: 1.00;\" \/><\/div>\n<div><\/div>\n<div>\n<div id=\"h5p-94\">\n<div class=\"h5p-iframe-wrapper\"><iframe id=\"h5p-iframe-94\" class=\"h5p-iframe\" data-content-id=\"94\" style=\"height:1px\" src=\"about:blank\" frameBorder=\"0\" scrolling=\"no\" title=\"4.2 learn by doing 19\"><\/iframe><\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<div class=\"textbox textbox--exercises\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p>Recall the smoke alarms example from the previous module. A homeowner has smoke alarms installed in the dining room (adjacent to the kitchen) and an upstairs bedroom (above the kitchen). The two-way table below shows probabilities of smoke in the kitchen triggering the alarm in the dining room (D) or not, and in the bedroom (B) or not. Use this two-way table to answer the following:<\/p>\n<div class=\"image shouldbeleft\"><img decoding=\"async\" id=\"_i_4\" class=\"img-responsive popimg aligncenter\" title=\"A table, in which the column headings are &quot;B,&quot; &quot;not B,&quot; and &quot;Total.&quot; The rows are &quot;D,&quot; &quot;not D,&quot; and &quot;Total.&quot; Here is the data in &quot;Row,Column: Value&quot; format: D, B: .38; D, not B: .57; D, Total: .95; not D, B: .02; not D, not B: .03; not D, Total: .05; Total, B: .40; Total, not B: .60; Total, Total: 1.00;\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m2_conditional_probability\/webcontent\/dig002.gif\" alt=\"A table, in which the column headings are &quot;B,&quot; &quot;not B,&quot; and &quot;Total.&quot; The rows are &quot;D,&quot; &quot;not D,&quot; and &quot;Total.&quot; Here is the data in &quot;Row,Column: Value&quot; format: D, B: .38; D, not B: .57; D, Total: .95; not D, B: .02; not D, not B: .03; not D, Total: .05; Total, B: .40; Total, not B: .60; Total, Total: 1.00;\" \/><\/div>\n<div>\n<div id=\"h5p-95\">\n<div class=\"h5p-iframe-wrapper\"><iframe id=\"h5p-iframe-95\" class=\"h5p-iframe\" data-content-id=\"95\" style=\"height:1px\" src=\"about:blank\" frameBorder=\"0\" scrolling=\"no\" title=\"4.2 Did I get this 17\"><\/iframe><\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<div class=\"\">\n<div class=\"textbox textbox--learning-objectives\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Learning Objectives<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<ul>\n<li>Determine whether two events are independent or not.<\/li>\n<\/ul>\n<\/div>\n<\/div>\n<p>As we saw in the Exploratory Data Analysis section, whenever a situation involves more than one variable, it is generally of interest to determine whether or not the variables are related. In probability, we talk about independent events, and in the first module we said that two events A and B are\u00a0<em>independent<\/em>\u00a0if event A occurring\u00a0<em>does not affect<\/em> the probability that event B will occur. Now that we\u2019ve introduced conditional probability, we can formalize the definition of independence of events and develop four simple ways to check whether two events are independent or not. We will introduce these \u201cindependence checks\u201d using examples, and then summarize.<\/p>\n<div class=\"textbox__content\">\n<div class=\"textbox textbox--examples\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Example<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<div class=\"\">\n<div class=\"textbox__content\">\n<p>Consider again the two-way table for all 500 students in a particular high school, classified according to gender and whether or not they have one or both ears pierced.<\/p>\n<p><span class=\"imagewrap\"><span class=\"image\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"The same table of the data for piercings. The column headings are &quot;Pierced,&quot; &quot;Not Pierced,&quot; and &quot;Total.&quot; The Rows are &quot;Male,&quot; &quot;Female,&quot; and &quot;Total.&quot; The data in the cells is given in &quot;Row, Column: Value&quot; format: Male, Pierced: 36; Male, Not Pierced: 144; Male, Total: 180; Female, Pierced: 288; Female, Not Pierced: 32; Female, Total: 320; Total, Pierced: 324; Total, Not Pierced: 176; Total, Total: 500;\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m2_conditional_probability\/webcontent\/image001.gif\" alt=\"The same table of the data for piercings. The column headings are &quot;Pierced,&quot; &quot;Not Pierced,&quot; and &quot;Total.&quot; The Rows are &quot;Male,&quot; &quot;Female,&quot; and &quot;Total.&quot; The data in the cells is given in &quot;Row, Column: Value&quot; format: Male, Pierced: 36; Male, Not Pierced: 144; Male, Total: 180; Female, Pierced: 288; Female, Not Pierced: 32; Female, Total: 320; Total, Pierced: 324; Total, Not Pierced: 176; Total, Total: 500;\" \/><\/span><\/span><\/p>\n<\/div>\n<div class=\"textbox__content\" style=\"text-align: left;\"><span class=\"imagewrap\"><span class=\"image\">Would you expect those two variables to be related? That is, would you expect having pierced ears to depend on whether the student is male or female? Or, to put it yet another way, would knowing a student\u2019s gender affect the probability that the student\u2019s ears are pierced? To answer this, we may compare the overall probability of having pierced ears to the conditional probability of having pierced ears, given that a student is male. Our intuition would tell us that the latter should be lower: male students tend not to have their ears pierced, whereas female students do. Indeed, for students in general, the probability of having pierced ears (event E) is P(E) = 324\/500 = .648. But the probability of having pierced ears given that a student is male is only P(E | M) = 36\/180 = .20.<\/span><\/span><\/div>\n<div class=\"textbox__content\" style=\"text-align: left;\">As we anticipated, P(E | M) is lower than P(E). The probability of a student having pierced ears changes (in this case, gets lower) when we know that the student is male, and therefore the events E and M are dependent. (If E and M were independent, knowing or not knowing that the student is male would not have made a difference \u2026 but it did.)<\/div>\n<div class=\"textbox__content\" style=\"text-align: left;\">This example illustrates that one method for determining whether two events are independent is to compare\u00a0<em>P(B | A)<\/em>\u00a0and\u00a0<em>P(B)<\/em>.<\/div>\n<\/div>\n<div class=\"examplewrap\">\n<div class=\"example clearfix\">\n<p>If the two are\u00a0<em>equal<\/em>\u00a0(i.e., knowing or not knowing whether A has occurred has no effect on the probability of B occurring) then the two events are\u00a0<em>independent<\/em>. Otherwise, if the\u00a0<em>probability changes<\/em>\u00a0depending on whether we know that A has occurred or not, then the two events are\u00a0<em>not independent<\/em>. Similarly, using the same reasoning, we can compare\u00a0<em>P(A | B)<\/em>\u00a0and\u00a0<em>P(A)<\/em>.<\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<div class=\"textbox textbox--examples\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Example<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p>Recall the side effects example. On the \u201cInformation for the Patient\u201d label of a certain antidepressant it is claimed that based on some clinical trials, there is a 14% chance of experiencing sleeping problems known as insomnia (denote this event by\u00a0<em>I<\/em>), there is a 26% chance of experiencing headache (denote this event by\u00a0<em>H<\/em>), and there is a 5% chance of experiencing both side effects (<em>I and H<\/em>).<\/p>\n<p>Are the two side effects independent of each other?<\/p>\n<p>To check whether the two side effects are independent, let\u2019s compare P(H | I) and P(H).<\/p>\n<p>In the previous part of this module, we found that\u00a0<em>P(H | I)<\/em>\u00a0= P(H and I) \/ P(I) = .05\/.14 =\u00a0<em>.357<\/em>, while\u00a0<em>P(H) = .26.\u00a0<\/em>Knowing that a patient experienced insomnia increases the likelihood that he\/she will also experience headache from .26 to .357. The conclusion, therefore is that the two side effects are not independent, they are dependent.<\/p>\n<p>Alternatively, we could have compared P(I | H) to P(I).\u00a0<em>P(I) = .14<\/em>, and previously we found that\u00a0<em>P(I | H)<\/em>\u00a0= P(I and H) \/ P(H) = .05\/.26 =\u00a0<em>.1923<\/em>, and again, since the two are not equal, we can conclude that the two side effects I and H are dependent.<\/p>\n<\/div>\n<\/div>\n<div class=\"textbox textbox--exercises\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p>Recall again the smoke alarms example.<\/p>\n<p>A homeowner has smoke alarms installed in the dining room (adjacent to the kitchen) and an upstairs bedroom (above the kitchen). The two-way table below shows probabilities of smoke in the kitchen triggering the alarm in the dining room (D) or not, and in the bedroom (B) or not.<\/p>\n<div class=\"image shouldbeleft\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"A table, in which the column headings are &quot;B,&quot; &quot;not B,&quot; and &quot;Total.&quot; The rows are &quot;D,&quot; &quot;not D,&quot; and &quot;Total.&quot; Here is the data in &quot;Row,Column: Value&quot; format: D, B: .38; D, not B: .57; D, Total: .95; not D, B: .02; not D, not B: .03; not D, Total: .05; Total, B: .40; Total, not B: .60; Total, Total: 1.00;\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m2_conditional_probability\/webcontent\/dig002.gif\" alt=\"A table, in which the column headings are &quot;B,&quot; &quot;not B,&quot; and &quot;Total.&quot; The rows are &quot;D,&quot; &quot;not D,&quot; and &quot;Total.&quot; Here is the data in &quot;Row,Column: Value&quot; format: D, B: .38; D, not B: .57; D, Total: .95; not D, B: .02; not D, not B: .03; not D, Total: .05; Total, B: .40; Total, not B: .60; Total, Total: 1.00;\" \/><\/div>\n<div>\n<div id=\"h5p-96\">\n<div class=\"h5p-iframe-wrapper\"><iframe id=\"h5p-iframe-96\" class=\"h5p-iframe\" data-content-id=\"96\" style=\"height:1px\" src=\"about:blank\" frameBorder=\"0\" scrolling=\"no\" title=\"4.2 Did I get this 18\"><\/iframe><\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<div class=\"examplewrap\">\n<div class=\"example clearfix\">\n<h2><span title=\"Quick scroll up\">Comment<\/span><\/h2>\n<p id=\"N10B08\">Recall the pierced ears example. We checked the independence of the events M (being a male) and E (having pierced ears) by comparing P(E) to P(E | M).<\/p>\n<p>An alternative method of checking for dependence would be to compare P(E | M) with P(E | not M) [same as P(E | F)]. In our case, P(E | M) = 36\/180 = .2, while P(E | not M) = 288\/320 = .9, and since the two are very different, we can say that the events E and M are not independent.<\/p>\n<p>In general, another method for checking the independence of events A and B is to compare\u00a0<em>P(B | A) and P(B | not A)<\/em>. In other words, two events are independent if the probability of one event does not change whether we know that the other event has occurred or we know that the other event has not occurred. It can be shown that\u00a0<em>P(B | A) and P(B | not A)<\/em>. would differ whenever P(B) and P(B | A) differ, so this is another perfectly legitimate way to establish dependence or independence.<\/p>\n<div class=\"textbox textbox--exercises\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p id=\"N10B23\">Recall again the smoke alarms example.<\/p>\n<p>A homeowner has smoke alarms installed in the dining room (adjacent to the kitchen) and an upstairs bedroom (above the kitchen). The two-way table below shows probabilities of smoke in the kitchen triggering the alarm in the dining room (D) or not, and in the bedroom (B) or not.<\/p>\n<div class=\"image shouldbeleft\"><img decoding=\"async\" id=\"_i_0\" class=\"img-responsive popimg aligncenter\" title=\"\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m2_conditional_probability\/webcontent\/dig002.gif\" alt=\"\" \/><\/div>\n<div>\n<div id=\"h5p-97\">\n<div class=\"h5p-iframe-wrapper\"><iframe id=\"h5p-iframe-97\" class=\"h5p-iframe\" data-content-id=\"97\" style=\"height:1px\" src=\"about:blank\" frameBorder=\"0\" scrolling=\"no\" title=\"4.2 Did I get this 19\"><\/iframe><\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<p>Before we establish a general rule for independence, let\u2019s consider an example that will illustrate another method that we can use to check whether two events are independent:<\/p>\n<div class=\"examplewrap\">\n<div class=\"exHead\"><\/div>\n<div class=\"example clearfix\">\n<div class=\"textbox textbox--examples\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Example<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<div class=\"examplewrap\">\n<div class=\"example clearfix\">\n<div>\n<p>A group of 100 college students were surveyed about their gender and whether they had decided on a major.<\/p>\n<p><span class=\"imagewrap\"><span class=\"image\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m2_conditional_probability\/webcontent\/image004.gif\" alt=\"\" \/><\/span><\/span><\/p>\n<p>Offhand, we wouldn\u2019t necessarily have any compelling reason to expect that deciding on a major would depend on a student\u2019s gender. We can check for independence by comparing the overall probability of being decided to the probability of being decided given that a student is female:<\/p>\n<p>P(D) = 45\/100 = .45 and P(D | F) = 27\/60 = .45.<\/p>\n<p>The fact that the two are equal tells us that, as we might expect, deciding on a major is independent of gender. Note from the comment that these must also equal P(D | M), which is 18\/40 = .45.<\/p>\n<p>Now let\u2019s approach the issue of independence in a different way: first, we may note that the overall probability of being decided is 45\/100 = .45.<\/p>\n<p><span class=\"imagewrap\"><span class=\"image\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m2_conditional_probability\/webcontent\/image005.gif\" alt=\"\" \/><\/span><\/span><\/p>\n<p>And the overall probability of being female is 60\/100 = .60.<\/p>\n<p><span class=\"imagewrap\"><span class=\"image\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m2_conditional_probability\/webcontent\/image006.gif\" alt=\"\" \/><\/span><\/span><\/p>\n<p>If being decided is independent of gender, then 45% of the 60% of the class who are female should have a decided major; in other words, the probability of being female and decided should equal the probability of being female multiplied by the probability of being decided. If the events F and D are independent, we should have P(F and D) = P(F) * P(D).<\/p>\n<p>In fact, P(F and D) = 27\/100 = .27 = P(F) * P(D) = .45 * .60. This confirms our alternate verification of independence.<\/p>\n<\/div>\n<\/div>\n<\/div>\n<p id=\"N10B8D\">\n<\/div>\n<\/div>\n<p>In general, another method for checking the independence of events A and B is to compare P(A and B) to P(A) * P(B). If the two are equal, then A and B are independent, otherwise the two are not independent.<\/p>\n<p>Let\u2019s summarize all the possible methods we\u2019ve seen for checking the independence of events in one rule:<\/p>\n<p>Two events A and B are independent if any one of the following hold:<\/p>\n<p>P(B | A) = P(B)<\/p>\n<p>P(A | B) = P(A)<\/p>\n<p>P(B | A) = P(B | not A)<\/p>\n<p>P(A and B) = P(A) * P(B)<\/p>\n<\/div>\n<\/div>\n<div id=\"N10B90\" class=\"section\">\n<div class=\"sectionContain\">\n<h2><span title=\"Quick scroll up\">Comment<\/span><\/h2>\n<p>These various equalities turn out to be equivalent, so that if one equality holds, all are equal, and if one equality does not hold, all are not equal. (This is the case for the same reason that knowing one of the values P(A and B), P(A and not B), P(not A and B), or P(not A and not B), along with P(A) and P(B), allows you to determine the remaining cells of a two-way probability table.)<\/p>\n<p>Therefore, in order to check whether events A and B are independent or not, it is sufficient to check only whether one of the four equalities holds\u2014whichever is easiest for you.<\/p>\n<\/div>\n<\/div>\n<p>The purpose of the next activity is to practice checking the independence of two events using the four different possible methods that we\u2019ve provided, and see that all of them will lead us to the same conclusion, regardless of which of the four methods we use.<\/p>\n<div class=\"textbox textbox--exercises\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p>Recall the delivery services example:<\/p>\n<p>It is vital that a certain document reach its destination within one day. To maximize the chances of on-time delivery, two copies of the document are sent using two services, service A and service B, and the following probability table summarizes the chances of on-time delivery:<\/p>\n<div class=\"image shouldbeleft\"><img decoding=\"async\" class=\"img-responsive popimg\" title=\"probability tables of two different delivey services\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m2_conditional_probability\/webcontent\/lbd001.gif\" alt=\"probability tables of two different delivey services\" \/><\/div>\n<div><\/div>\n<p id=\"N10079\">Are the delivery times of the two services independent? In other words, are the events A and B independent? Common sense would say that there will be some degree of dependence between A and B, since the reasons that would cause one service to be delayed (like bad weather, airport delays, etc), would most likely also affect the other service, and cause it to be delayed too. Let&#8217;s review the four possible methods that we can use to check whether events A and B are independent:<\/p>\n<p id=\"N1007C\">Two events A and B are independent if any one of the following hold:<\/p>\n<p id=\"N1007F\">P(B | A) = P(B)<\/p>\n<p id=\"N10082\">P(A | B) = P(A)<\/p>\n<p id=\"N10085\">P(B | A) = P(B | not A)<\/p>\n<p>P(A and B) = P(A) * P(B)<\/p>\n<p id=\"N1008B\">Use the four different methods to check whether events A and B are independent, and see that indeed all four are leading you to the same conclusion.<\/p>\n<div id=\"h5p-98\">\n<div class=\"h5p-iframe-wrapper\"><iframe id=\"h5p-iframe-98\" class=\"h5p-iframe\" data-content-id=\"98\" style=\"height:1px\" src=\"about:blank\" frameBorder=\"0\" scrolling=\"no\" title=\"4.2 learn by doing 20\"><\/iframe><\/div>\n<\/div>\n<\/div>\n<\/div>\n<div class=\"\">\n<div class=\"textbox textbox--learning-objectives\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Learning Objectives<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<ul>\n<li>Use the General Multiplication Rule to find the probability that two events occur (P(A and B)).<\/li>\n<\/ul>\n<\/div>\n<\/div>\n<p>Now that we have an understanding of conditional probabilities and can express them with concise notation, and have a more formal understanding of what it means for two events to be independent, we can finally establish the General Multiplication Rule, a formal rule for finding P(A and B) that applies to any two events, whether they are independent or dependent.<\/p>\n<\/div>\n<p id=\"N10AF4\">We begin with an example that contrasts P(A and B) for independent and dependent cases.<\/p>\n<div class=\"examplewrap\">\n<div class=\"example clearfix\">\n<div class=\"textbox textbox--examples\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Example<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p>Suppose you pick two cards at random from four cards consisting of one of each suit: club, diamond, heart, and spade, where the first card is replaced before the second card is picked. What is the probability of picking a club and then a diamond? Because the sampling is done with replacement, whether or not a diamond is picked on the second selection is independent of whether or not a club has been picked on the first selection. Rule 5, the multiplication rule for independent events, tells us that:<\/p>\n<p id=\"N10AFC\">P(C1 and D2) = P(C1) * P(D2) = 1\/4 * 1\/4 = 1\/16.<\/p>\n<p>[Here we denote the event \u201cclub picked on first selection\u201d as C1 and the event \u201cdiamond picked on second selection\u201d as D2.] The display below shows that 1\/4 of the time we\u2019ll pick a club first, and of these times, 1\/4 will result in a diamond on the second pick: 1\/4 * 1\/4 = 1\/16 of the selections will have a club first and then a diamond.<\/p>\n<p><span class=\"imagewrap\"><span class=\"image\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"All of the suit possibilities of picking one card, then replacing it and picking a second card. These possibilities are: SC, SD, SH, SS, HC, HD, HH, HS, DC, DD, DH, DS, CC, CD, CH, CS. Note that 1\/4 of these have C picked first (the last 4, out of 16 total). Out of these, only one is CD, which is 1\/4 of all of the possibilities with C picked first.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m2_conditional_probability\/webcontent\/image007.gif\" alt=\"All of the suit possibilities of picking one card, then replacing it and picking a second card. These possibilities are: SC, SD, SH, SS, HC, HD, HH, HS, DC, DD, DH, DS, CC, CD, CH, CS. Note that 1\/4 of these have C picked first (the last 4, out of 16 total). Out of these, only one is CD, which is 1\/4 of all of the possibilities with C picked first.\" \/><\/span><\/span><\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<div class=\"examplewrap\">\n<div class=\"example clearfix\">\n<div class=\"textbox textbox--examples\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Example<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p>Suppose you pick two cards at random from four cards consisting of one of each suit: club, diamond, heart, and spade, without replacing the first card before the second card is picked. What is the probability of picking a club and then a diamond? The probability in this case is not 1\/4 * 1\/4 = 1\/16; because the sampling is done without replacement, so whether or not a diamond is picked on the second selection\u00a0<em>does<\/em>\u00a0depend on what was picked on the first selection. (For instance, if a diamond was picked on the first selection, the probability of another diamond is zero!) As in the example above, 1\/4 of the time we\u2019ll pick a club first. But since the club has been removed, 1\/3 of these selections with a club first will have a diamond second. The probability of a club and then a diamond is 1\/4*1\/3=1\/12; this is the probability of getting a club first, multiplied by the probability of getting a diamond second, given that a club was picked first. Using the notation of conditional probabilities, we can write<\/p>\n<p>P(C1 and D2) = P(C1) * P(D2 | C1) = 1\/4 * 1\/3 = 1\/12.<\/p>\n<p><span class=\"imagewrap\"><span class=\"image\"><img decoding=\"async\" class=\"img-responsive popimg aligncenter\" title=\"All of the suit possibilities of picking one card then a second card, without replacing any cards. These possibilities are: SC, SD, SH, HC, HD, HS, DC, DH, DS, CD, CH, CS. Note that 1\/4 of these have C picked first (the last 3, out of 12 total). Out of these, only one is CD. CD is 1\/3 of all of the possibilities with C picked first.\" src=\"https:\/\/oli.cmu.edu\/repository\/webcontent\/72712ec00a0001dc418a87e73e8ebb77\/_u4_probability\/_m2_conditional_probability\/webcontent\/image008.gif\" alt=\"All of the suit possibilities of picking one card then a second card, without replacing any cards. These possibilities are: SC, SD, SH, HC, HD, HS, DC, DH, DS, CD, CH, CS. Note that 1\/4 of these have C picked first (the last 3, out of 12 total). Out of these, only one is CD. CD is 1\/3 of all of the possibilities with C picked first.\" \/><\/span><\/span><\/p>\n<\/div>\n<\/div>\n<p>For independent events A and B, we had the rule P(A and B) = P(A) * P(B). Due to independence, to find the probability of both, we could multiply the probability of A by the simple probability of B, because the occurrence of A would have no effect on the probability of B occurring. Now, for events A and B that may be dependent, to find the probability of both, we multiply the probability of A by the conditional probability of B, taking into account that A has occurred. Thus, our general multiplication rule is stated as follows:<\/p>\n<\/div>\n<\/div>\n<table id=\"N10B1E_bx\" class=\"theorem labeled\">\n<thead>\n<tr>\n<th><\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>\n<div class=\"theorem\">\n<div class=\"statement\">\n<p><em>The General Multiplication Rule:\u00a0<\/em>For any two events A and B,\u00a0<em>P(A and B) = P(A) * P(B | A)<\/em><\/p>\n<\/div>\n<\/div>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<hr \/>\n<p>Here, again, is the General Multiplication Rule:<\/p>\n<p><em>For any two events A and B, P(A and B) = P(A) * P(B | A)<\/em><\/p>\n<div class=\"section\">\n<div class=\"sectionContain\">\n<h2><span title=\"Quick scroll up\">Comments<\/span><\/h2>\n<ol>\n<li>Note that although the motivation for this rule was to find P(A and B) when A and B are not independent, this rule is general in the sense that if A and B happen to be\u00a0<em>independent<\/em>, then P(B | A) = P(B) is true, and we\u2019re back to Rule 5\u2014the Multiplication Rule for Independent Events: P(A and B) = P(A) * P(B).<\/li>\n<li>The General Multiplication Rule is just the definition of conditional probability in disguise. Recall the definition of conditional probability:\u00a0<em>P(B | A) = P(A and B) \/ P(A)<\/em>\u00a0Let\u2019s isolate P(A and B) by multiplying both sides of the equation by P(A), and we get:\u00a0<em>P(A and B) = P(A) * P(B | A)<\/em>. That\u2019s it \u2026 this is the General Multiplication Rule.<\/li>\n<li>The General Multiplication Rule is useful when two events, A and B, occur in stages, first A and then B (like the selection of the two cards in the previous example). Thinking about it this way makes the General Multiplication Rule very intuitive. For both A and B to occur you first need A to occur (which happens with probability P(A)),\u00a0<em>and<\/em>\u00a0then you need B to occur, knowing that A has already occurred (which happens with probability P(B | A)).<\/li>\n<\/ol>\n<div class=\"textbox textbox--exercises\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Did I get this?<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p>A woman&#8217;s pocket contains 2 quarters and 2 nickels; she randomly extracts one of the coins, and without replacing it picks a second coin.<\/p>\n<div id=\"h5p-99\">\n<div class=\"h5p-iframe-wrapper\"><iframe id=\"h5p-iframe-99\" class=\"h5p-iframe\" data-content-id=\"99\" style=\"height:1px\" src=\"about:blank\" frameBorder=\"0\" scrolling=\"no\" title=\"4.2 Did I get this 20\"><\/iframe><\/div>\n<\/div>\n<\/div>\n<\/div>\n<p>Let\u2019s look at another, more realistic example:<\/p>\n<div class=\"examplewrap\">\n<div class=\"example clearfix\">\n<div class=\"textbox textbox--examples\">\n<header class=\"textbox__header\">\n<h3 class=\"textbox__title\">Example<\/h3>\n<\/header>\n<div class=\"textbox__content\">\n<p>In a certain region, one in every thousand people (0.001) of all individuals are infected by the HIV virus that causes AIDS. Tests for presence of the virus are fairly accurate but not perfect. If someone actually has HIV, the probability of testing positive is .95. Let\u00a0<em>H<\/em>\u00a0denote the event of having HIV, and\u00a0<em>T<\/em>\u00a0the event of testing positive.<\/p>\n<p id=\"N10B6F\">(a) Express the information that is given in the problem in terms of the events H and T.<\/p>\n<p>\u201cone in every thousand people (0.001) of all individuals are infected with HIV\u201d \u2192\u00a0<em>P(H) = .001<\/em><\/p>\n<p>\u201cIf someone actually has HIV, the probability of testing positive is .95\u201d \u2192\u00a0<em>P(T | H) = .95<\/em><\/p>\n<p>(b) Use the General Multiplication Rule to find the probability that someone chosen at random from the population has HIV and tests positive.<\/p>\n<p><em>P(H and T)<\/em>\u00a0= P(H) * P(T | H) = .001*.95 = .00095.<\/p>\n<p>(c) If someone has HIV, what is the probability of testing negative? Here we need to find P(not T | H).<\/p>\n<p>Recall from an activity earlier in this module that the Complement Rule works with conditional probabilities as long as we condition on the same event, therefore:\u00a0<em>P(not T | H)<\/em> = 1 \u2013 P(T | H) = 1 \u2013 .95 = .05.<\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n","protected":false},"author":150,"menu_order":3,"template":"","meta":{"pb_show_title":"on","pb_short_title":"","pb_subtitle":"","pb_authors":[],"pb_section_license":""},"chapter-type":[48],"contributor":[],"license":[],"class_list":["post-502","chapter","type-chapter","status-publish","hentry","chapter-type-numberless"],"part":419,"_links":{"self":[{"href":"https:\/\/pressbooks.ccconline.org\/mat1260\/wp-json\/pressbooks\/v2\/chapters\/502","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/pressbooks.ccconline.org\/mat1260\/wp-json\/pressbooks\/v2\/chapters"}],"about":[{"href":"https:\/\/pressbooks.ccconline.org\/mat1260\/wp-json\/wp\/v2\/types\/chapter"}],"author":[{"embeddable":true,"href":"https:\/\/pressbooks.ccconline.org\/mat1260\/wp-json\/wp\/v2\/users\/150"}],"version-history":[{"count":15,"href":"https:\/\/pressbooks.ccconline.org\/mat1260\/wp-json\/pressbooks\/v2\/chapters\/502\/revisions"}],"predecessor-version":[{"id":874,"href":"https:\/\/pressbooks.ccconline.org\/mat1260\/wp-json\/pressbooks\/v2\/chapters\/502\/revisions\/874"}],"part":[{"href":"https:\/\/pressbooks.ccconline.org\/mat1260\/wp-json\/pressbooks\/v2\/parts\/419"}],"metadata":[{"href":"https:\/\/pressbooks.ccconline.org\/mat1260\/wp-json\/pressbooks\/v2\/chapters\/502\/metadata\/"}],"wp:attachment":[{"href":"https:\/\/pressbooks.ccconline.org\/mat1260\/wp-json\/wp\/v2\/media?parent=502"}],"wp:term":[{"taxonomy":"chapter-type","embeddable":true,"href":"https:\/\/pressbooks.ccconline.org\/mat1260\/wp-json\/pressbooks\/v2\/chapter-type?post=502"},{"taxonomy":"contributor","embeddable":true,"href":"https:\/\/pressbooks.ccconline.org\/mat1260\/wp-json\/wp\/v2\/contributor?post=502"},{"taxonomy":"license","embeddable":true,"href":"https:\/\/pressbooks.ccconline.org\/mat1260\/wp-json\/wp\/v2\/license?post=502"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}