Contents

1. Introduction

2. The original Prisoner’s Dilemma scenario in game theory

3. Replication of the payoff matrix using E. coli

3.1 Prisoner coli’s dilemma payoff matrix

3.1.1 Both cooperation leads to low growth inhibition

3.1.2 Both defection leads to middle growth inhibition

3.1.3 When one is fooled, two types of growth inhibition

3.2 Modeling selected a solution for leaky expression problem to satisfy the requirement of the payoff matrix

3.3 Improvement of CmR protein property by addition of ssrA degradation tag

3.4 Succeeded to replicate the payoff matrix through wet lab

4. Prisoner coli decides its option : Cooperation or Defection

4.1 How to decide?

4.1.1 FimB assay: recombinase that inverts fim switch at random

5. Iterated game with several strategies

5.1 The four strategies

5.1.1 Random strategy

5.1.2 Always cooperate strategy

5.1.3 Always defect strategy

5.1.4 Tit-for-tat strategy

5.1.4.1 FimE assay: recombinase that inverts fim switch uniderectionally

6. Dilemma game in general public

7. Reference

With the title of Prisoner’s Dilemma, we, iGEM Team Tokyo_Tech 2015 integrates our project by connecting the results in wet lab and modeling with the policy & practices.

1. Introduction

We decided to replay the Prisoner’s Dilemma game, in which one’s profit depend on options of cooperation and defection, by using E. coli. The Prisoner’s Dilemma, a well-known game analyzed in game theory, involves dilemma between cooperation and defection. To pursue his or her own profit, one will choose to cooperate or to defect in the game.

In our E. coli’s version of Prisoner’s Dilemma game involving two prisoner coli, the results of their options define the profit they obtained. Here, profit means the growth of E. coli. Like the prisoners in the game theory, we genetically engineered two E. coli to act as the prisoners, Prisoner A and Prisoner B. The prisoner colis are able to cooperate or to defect in our game. The combinations of their options (cooperation or defection) affect the profit they obtained which equals to their growth. To cooperate, they produce AHL while to defect, they do not produce AHL. Each prisoner coli is designed to produce different type of AHL (C4HSL or 3OC12HSL). The act of producing AHL imposes a metabolic burden on both prisoner coli.

2. The original Prisoner’s Dilemma scenario in game theory

The original Prisoner’s Dilemma scenario involves two members of a criminal gang who were given an option-selection opportunity either to cooperate or to defect, in order to pursue for the best profit defined in the payoff matrix (Fig.2-1-2-1). This Prisoner’s Dilemma game is a typical example analyzed in game theory. The two gangs were arrested by the police. They were separated into two different rooms so that they can’t communicate. In these individual rooms, each prisoner was given an the opportunity either (1) to cooperate with the other prisoner by remaining silent, or (2) to defect the other criminal by confessing to his crime. Their corresponding punishment is shown in Fig.2-1-2-1. This table is called the payoff matrix.

Fig.2-1-2-1. The payoff matrix in Prisoner’s Dilemma (punishment = imprisoned years)

From the payoff matrix, one rational option combination, called Nash equilibrium, is both defections. From A’s point of view, if B were to defect, A should choose to defect, comparing 10 years to 5 years of imprisonment. If B were to cooperate, A should also choose to cooperate, comparing 2 years to 0 year of imprisonment. In other words, regardless of which option the other decides, each prisoner is punished less by defecting the other. B’s rational decision is the same to A, so option of both defections is one rational option combination.

Although both players’ defections result from combination of selfish option selections, the combination of both player’s simultaneous cooperation actually bring more profit to both players than the combination of selfish selections. Apparently, 2 years punishment for both prisoners is not severe than 5 years for both. Thus the combination of both defections is not called Pareto efficiency. This game with such payoff matrix where Nash equilibrium is not Pareto efficiency is called the Prisoner’s Dilemma.

3. Replication of the payoff matrix using E.coli

3.1 Prisoner coli’s dilemma payoff matrix

Referring to Fig.2-1-2-1 shown above, we replicated the payoff matrix using E. coli whose growth inhibition stand for punishment (Fig.2-1-3-1). Prisoner A and B are able to cooperate or to defect. As a result of combination of option, each prisoner coli is applied a corresponding growth inhibition, (none, low, middle, or high).

Fig.2-1-3-1. Our replicated payoff matrix for growth inhibition effect on Prisoner coli (A: Prisoner A, B: Prisoner B, C: Cooperation, D: Defection)

In the implementation of our replicated payoff matrix, combined effect by antibiotics and metabolic burden can apply 4 types of growth inhibitions (none, low, middle, high) which our prisoner coli will face with. Because our game procedure includes exchange of culture supernatant (Fig.2-1-3-2) (See the experiment page for detailed protocol), AHL produced by a prisoner’s cooperation induces the opponent’s expression of an antibiotic resistant gene, and thus circumvents growth inhibition of the opponent. Note that AHL produced by a prisoner has no effect to itself due to binding specificity among AHLs and corresponding transcription activator proteins. The production of AHL also cause metabolic burden in the cooperating prisoner coli. The initial designed genetic circuits of Prisoner A and B in cooperating and defecting mode are shown in Fig.2-1-3-3.

Fig.2-1-3-2. Experimental procedure in the implementation of our replicated payoff matrix

Fig.2-1-3-3. The genetic circuits of prisoner coli with the options of cooperation or defection

3.1.1 Both cooperation leads to low growth inhibition

When two prisoner coli cooperate, both of them will experience “low” growth inhibition caused by metabolic burden in producing AHL. By exchanging the culture’s supernatant, prisoner coli will receive their corresponding AHL, inducing the expression of chloramphenicol resistant gene (CmR). Thus, both of them will not receive any growth inhibition from antibiotic chloramphenicol (Cm) while will experience metabolic burden by producing AHL (Fig.2-1-3-4). In this case, we define the growth inhibition as “low”.

Fig.2-1-3-4. Growth inhibition caused by metabolic burden in producing AHL as both prisoners cooperate

3.1.2 Both defection leads to middle growth inhibition

In case of both prisoner coli defection which means absence of AHL induction, both of them will experience “middle” growth inhibition because lack of chloramphenicol resistant protein (CmR) does not circumvent antibiotic effect of Cm. Since defecting prisoner coli do not produce AHL, they will not receive their corresponding AHL during the exchange of culture’s supernatant. Thus, both of them will free from metabolic burden by producing AHL but receive moderate growth inhibition from Cm (Fig.2-1-3-5). In this case, we define the growth inhibition as “middle”.

Fig.2-1-3-5 Growth inhibition caused by Cm antibiotic without CmR expression as both prisoners defect

3.1.3 When one is fooled, two types of growth inhibition (high and none)

When Prisoner A cooperates while Prisoner B defects, Prisoner A will experience “high” growth inhibition caused by metabolic burden and chloramphenicol (Cm) antibiotic while Prisoner B will experience “none” growth inhibition. By exchanging the culture’s supernatant, Prisoner A will not receive C4HSL, as being defected by B while Prisoner B will receive 3OC12HSL produced by cooperating A. Thus, Prisoner A will experience both of metabolic burden by producing AHL and moderate growth inhibition from Cm. On the other hand, Prisoner B will not experience any growth inhibition given that Cm resistance is acquired (Fig.2-1-3-6). We define the growth inhibition as “high” and “none” respectively.

Fig.2-1-3-6 Growth inhibition caused by both metabolic burden in producing AHL and Cm antibiotic as cooperating prisoner being defected while nothing will happen to defecting prisoner being cooperated.

3.2 Modeling selected a solution for leaky expression problem to satisfy the requirement of the payoff matrix

At the first stage of wet experiment, initial designed circuits showed leaky expression of chloramphenicol resistant protein (CmR). “Middle” growth inhibition is required for implementation of our payoff matrix (Fig.2-1-3-7A) (See the experiment page for details). However, cells showed active growth even in the absence of AHL when the cell harboring either of our firstly designed genetic circuit Pcon_rhlR_TT_Plux_CmR in Prisoner A coli or Pcon_lasR_TT_Plux_CmR in Prisoner B coli (Fig.2-1-3-7B). Please refer to modeling page for Prisoner B coli’s results.

Fig.2-1-3-7. We compared the results in modeling and wet lab

To solve this problem, our series of modeling suggested us select next circuits design to add ssrA degradation tag to the C-terminal of the chloramphenicol resistant protein (CmR). Firstly, we adjusted the model to include leaky expression of CmR protein (Fig.2-1-3-7C) (Further information of modeling is in here). We then planned two solutions, each of which is evaluated by modeling, to circumvent the effect of leaky expressions (Fig.2-1-3-7DE). Because increase of degradation rate of CmR showed more effective suppression of growth than increase of Cm concentration, we created CmR coding sequence with ssrA degradation tag (BBa_K1632020).

3.3 Improvement of CmR protein property by addition of ssrA degradation tag

For precise implementation of our payoff matrix, suggestions from modeling allow us successfully improving the former plasmid by adding an ssrA tag right after the CmR gene (Fig.2-1-3-8). The ssrA tag helps to degrade the leaked chloramphenicol resistant protein (CmR). The improved part (BBa_K1632020) was used for construction of BBa_K1632023 circuit for C4HSL inducible expression of CmR. Compared with circuits without ssrA tag BBa_K1632025, our improved BBa_K1632023 indeed showed much slower growth which corresponds to “middle” growth inhibition (Fig.2-1-3-9 pink dotted line). Furthermore, addition of C4HSL recovers active cell growth which corresponds to “none” growth inhibition (Fig.2-1-3-9 blue line). These results show the improved function of AHL-dependent CmR expression by measuring the concentration of cells.

Fig.2-1-3-8. An improved plasmid is constructed by adding ssrA tag to CmR

Fig.2-1-3-9. Our wet lab result suits the modeling result

3.4 Succeeded to replicate the payoff matrix through wet lab

Using the improved plasmids we constructed, our E.coli version payoff matrix is replicated through wet lab experiments. As mentioned earlier, we genetically engineered two prisoner coli, Prisoner A and Prisoner B. They are able to cooperate or to defect. The genetic circuits, with the improved chloramphenicol resistant protein (CmR) part, of Prisoner A and B are shown in Fig.2-1-3-10.

Fig.2-1-3-10. The genetic circuits of prisoner colis with the options of cooperation or defection

With the combination of four options between two prisoner coli, we succeeded to replicate the four types of growth inhibition (Fig.2-1-3-11) prisoner colis will face with in our payoff matrix. Because AHL production from those parts has already confirmed in descriptions in Partsregistry (http://parts.igem.org/Part:BBa_K1529302), in our experiment, corresponding AHL is added to prisoner colis when the opponent decided to cooperate. AHL is not added when the opponent decided to defect. Besides that, 100 microg/mL of chloramphenicol (Cm) is added to both prisoner colis. Prisoner coli will acquire Cm resistance when the opponent decided to cooperate. (Without Cm resistance, prisoner colis will face with growth inhibition.)

In the C4HSL absence which stand for defection of Prisoner B (Fig.2-1-3-10 case 3 and 4), growth of Prisoner A is inhibited some extents by Cm antibiotic effect. Even without metabolic burden, case 3, Prisoner A with defection, showed more severe growth inhibition than case 2. Furthermore, additional cooperation by Prisoner A (case 4) causes little growth due to metabolic burden by producing AHL. Thus we can define “middle” growth inhibition on case 3 and “high” growth inhibition on case 4.

The experiment was also repeated by using 3OC12HSL, in this case Prisoner B showed similar results showing expected growth inhibition effects similar to those for Prisoner A (Fig.2-1-3-11).

Fig.2-1-3-10. The results from our wet lab replicated the payoff matrix

Fig.2-1-3-11. The results from our wet lab replicated the payoff matrix

4. Prisoner coli decides its option : Cooperation or Defection

4.1 How to decide?

In order to enable prisoner coli to randomly select its option between cooperation and defection, we noticed that fim switch, which can invert promoter bidirectional in the presence of FimB recombinase, is the part we need (Fig. 2-1-4-1). Containing [ON] and [OFF] states, fim switch controls the direction of transcriptions. The promoter in fim switch directs transcription to the right when fim switch is in the [ON] state. In the [OFF] state of fim switch, on the other hand, the promoter directs transcription to the left. We further designed to allocate AHL-producing enzyme coding sequence at left side of the fim switch. Note that, [ON] state fim switch will make prisoner coli to produce AHL, indicating cooperation. On contrary, [OFF] state fim switch will prevent prisoner coli from producing AHL, indicating defection. In FimB presence, random bidirectional inversion of the promoter-containing fim switch occurs, indicating random decision making.

Fig.2-1-4-1. In the presence of FimB recombinase, promoter fim switch can invert at random.

To enable prisoner coli to have their own option selected randomly, the AHL-producing plasmid containing fim switch and another newly constructed plasmid, PBAD/araC_rbs_fimB (BBa_K1632012) that produce wild type FimB, are designed to be introduced into the decision making coli (Fig.2-1-4-2). In FimB presence, two types of plasmids, plasmids in cooperating mode and defecting mode, co-exist in the single cell. Because either one will be introduced into prisoner coli, we cannot know the prisoner coli’s option at that time.

Fig.2-1-4-2.

4.1.1 FimB assay : recombinase that inverts fim switch at random

For the confirmation of the function of newly constructed plasmid, PBAD/araC_rbs_fimB (BBa_K1632012), we also prepared two new plasmids, BBa_K1632007 and BBa_K1632008 (Fig.2-1-4-3). BBa_K1632012 enables arabinose-inducible expression of wild type FimB. In BBa_K1632007 and BBa_K1632008, either [ON] or [OFF] fim switch is placed upstream of GFP coding sequence.

Fig.2-1-4-3. New plasmids we constructed to confirm the function of BBa_K1632012 plasmid

From our wet lab results, FimB expressed from our new part, BBa_K1632012, is confirmed to randomly invert the fim switch bidirectional, from [ON] to [OFF] state and from [OFF] to [ON] state (Fig.2-1-4-4). This is the first case in iGEM to show random inversion of a promoter. From the histogram C and D in Fig.2-1-4-4, forward move of the peak indicates increased accumulation of GFP by the FimB expression. This shows that some amount of fim switch [default OFF] state is inverted into the [ON] state in the presence of FimB. Although only slight decrease of fluorescence from A to B was observed, the histogram B, after expression of FimB, shows close peak fluorescence to that in histogram D. This implies that fim switch [default ON] state is also inverted in some extent into the [OFF] state in the presence of FimB (Fig.2-1-4-4). Thus we tried to confirm such inversion by colony formation by each plasmid molecule and DNA sequencing. Fig.2-1-4-5 and Fig.2-1-4-6 clearly shows inversion from [default ON] to [OFF] state; E.coli harboring the [ON] fim switch plasmid glows in green fluorescence while E.coli harboring the [OFF] fim switch plasmid does not glow under ultra violet light. Also, sequence complementarity in the specific region of the switch shows intended inversion of the switch from [ON] to [OFF]. Furthermore, the nearly equal number of the colonies between fluorescent and non-fluorescent suggest random inversion of the fim switch by FimB expression. Similar analysis for [OFF] to [ON] also showed random inversion. (三階層へのリンク)

Fig.2-1-4-4. The intensity of fluorescence in cells measured using flow cytometer

Fig.2-1-4-5.

Fig.2-1-4-6.

Iterated game with several strategies

We decided to make prisoner coli to have their own strategies like human, finding out that humans do have strategies while playing the game in our policy and practices. In our game, we prepared four types of different strategies. Because evaluation of some strategies requires iterated games, we also created an E.coli version of iterated prisoner’s dilemma game.

5.1 The four strategies

We prepared four strategies: Random strategy, always cooperate strategy, always defect strategy and tit-for-tat strategy. In the in silico game tournaments around 1980, tit-for-tat strategy, written lastly in 5.1.4, was the successful among the four. (文献)

5.1.1 Random strategy

The prisoner coli with this strategy makes every decisions randomly in each iterated game. After each game, the former cooperating or defecting plasmid is introduced into the decision making coli. The decision making coli will then produce two types of plasmids, cooperation and defection, in the single cell (refer 4.2). We cannot know if each molecule of the plasmid is either in the cooperating state or the defecting state. Because only one molecule of the plasmid is introduced to a competent prisoner cell, the decision will become random, regardless of what the other decides in the last game in the iterated games (Fig. 2-1-5-1).

Fig.2-1-5-1.

5.1.2 Always cooperate

The prisoner coli with this strategy will always cooperate no matter what the other decides. The plasmid will be recovered and again introduced into fresh prisoner coli. By this, the fresh one will have the same plasmid with the previous prisoner coli. So, the certain prisoner coli (as shown in Fig. 2-1-5-2) will always cooperate.

Fig.2-1-5-2. Prisoner A with always cooperate strategy

5.1.3 Always defect

The prisoner coli with this strategy will always defect no matter what the other decides. Similarly, the plasmid will be recovered and again introduced into fresh prisoner coli. By this, the fresh one will have the same plasmid with the previous prisoner coli. So, the certain prisoner coli (as shown in Fig.2-1-5-3) will always defect.

Fig.2-1-5-3. Prisoner B with always defect strategy

5.1.4 Tit-for-tat strategy

The prisoner coli with tit-for-tat strategy cooperates in the first game, then copies the other’s decision in the last game from second game onwards (Fig.2-1-5-4). If Prisoner B cooperated in the 1st game, Prisoner A’s option in the second game will be cooperate. In the third game, Prisoner A’s option will be defection given that Prisoner B defected in the last game. Prisoner A will just copy Prisoner B’s option in the last game. Because mutual cooperation leads to lowest growth inhibition while mutual defection leads to highest growth inhibition, given that the opponent also experienced the same inhibition, tit-for-tat strategy became the most successful strategy.

Fig.2-1-5-4. The tit-for-tat strategy in our iterated game

To realize tit-for-tat strategy in prisoner coli, we designed AHL-dependent modification of prisoner plasmid. AHL released from the cooperating opponent B in the last game turn the Prisoner A plasmid into the cooperation mode. On contrary, defection by opponent B in the last game caused nothing to the Prisoner A plasmid which does not produce AHL at initial defection mode.

For mirroring the option of the opponent in the last game, we used C4HSL-dependent expression of FimE, which inverts the fim switch unidirectional (Fig.2-1-5-5). C4HSL released form the cooperating opponent B in the last game cause inversion of the switch and make Prisoner plasmid A produce C12HSL in the present game. Because all of the prisoner plasmid molecules extracted from the decision making coli in this case can produce 3OC12HSL, Prisoner A coli transformed by the plasmids shows cooperation by producing 3OC12HSL. Note that, in the presence of FimE, the fim switch can be inverted from [ON] to [OFF] but not from [OFF] to [ON]. Thus Prisoner plasmid A in this strategy initially has IasI-coding sequence in the opposite direction of the promoter in the [ON] switch.

Fig.2-1-5-5.

5.1.2.1 FimE assay: recombinase that inverts fim switch in only one way

To confirm the function of fim switch in the presence of FimE, we constructed two new genetic circuit parts, BBa_K1632013 and BBa_K1632002 (Fig.2-1-5-6). BBa_K1632013 enables arabinose-inducible expression of wild type FimE. In BBa_K1632013 and BBa_K1632002, either [ON] or [OFF] fim switch is placed upstream of GFP coding sequence.

　From our wet lab results, the FimE is confirmed to invert fim switch only from [ON] state to [OFF] state (Fig.2-1-5-7). From the histogram A and B in Fig.2-1-5-7, the peak moved backwards, indicating weakened intensity of the fluorescence in cells. This shows that fim switch [default ON] state is inverted into the [OFF] state in the presence of FimE. E.coli being cultured in LB agar-plates shows glowing (cooperating coli) and non-glowing (defecting coli) colonies under UV light. Furthermore, results from DNA sequencing also confirmed that fim switch inverts promoter from [ON] to [OFF], showing different DNA sequence.On the other hand, the peak hardly moved between the histograms C and D in Fig.2-1-5-7 we considered that fim switch [default OFF] state cannot be inverted into the [ON] state in the presence of FimE.

Fig.2-1-5-6. New plasmids we constructed to confirm the function of fim switch

Fig.2-1-5-7. The intensity of fluorescence in cells

6. Dilemma game in general public

Through the dilemma game we held among students in our policy & practices, we realized the importance of continuously pursuing the process of our project and the risk evaluation of synthetic biology as a research student. Firstly, through our school’s May festival, we got to know that the public seemed to have some misunderstanding on GMO, which influenced the direction of our project should take. In order to increase people’s awareness on GMO, we held a modified dilemma game among high school students and students from our biology department. The game we designed, involving payoff matrices with or without dilemma and also payoff matrices associated with the idea of GMO, has four types of payoff matrix (Fig. X).

　The public were influenced by preconceptions we predicted about GMO while making their option in the game. Comparing XX with XX, results in the summary of the players’ option in Fig. XA, regardless the presence of dilemma in the payoff matrix, most of the players chose not to use GM crops. We considered the preconceptions of “GMO is dangerous” seemed to have influenced the player’s option selection in the game. We planned to increase subject to play the dilemma game in order to obtain a better discussion. 　Interestingly, we found the example of a player realized they being influenced by the word “GMO” in the middle of the iterated game. Player A, in Fig. X, experienced option selection influenced by preconceptions we gave in the beginning. From XX cycle of the game, realizing that higher points is needed to win the game, her option became ‘use’.

In other words, we can say that the understanding of accurate payoff matrix can lead to the increase of overall society’s point. 　However, from our one year of experience in iGEM activities, we realized the importance to confirm our interpretation, continuously pursuing the cost, profit and risk in making science as a research student, from a different viewpoint (Fig. X). In earliest stage of our project, we learned about the risk of general public’s knowledge based on deficit model, and the importance of two-way communications between researcher and society through a social science workshop. From this workshop, we realized that rather than the players of our dilemma game, influenced by the word “GMO”, misread the payoff matrix, we, members of iGEM Tokyo_Tech, mistakenly understood the cost and profit of GMO. In order to accurately understand the technical payoff matrix, we felt the importance of having connection with the general public and thinking with them together, instead of imposing the thinking of professionals to the general public one-sidedly. （リンク：policy & practices）

7. Reference