Next Article in Journal
DADE-DQN: Dual Action and Dual Environment Deep Q-Network for Enhancing Stock Trading Strategy
Previous Article in Journal
Global Tracking Control for High-Order Odd-Rational-Powers Systems with Unknown Nonlinearities and Powers
Previous Article in Special Issue
Approximate Subdifferential of the Difference of Two Vector Convex Mappings
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Two-Person Stochastic Duel with Energy Fuel Constraint Ammo

by
Song-Kyoo (Amang) Kim
Faculty of Applied Sciences, Macao Polytechnic University, R. de Luis Gonzaga Gomes, Macao, China
Mathematics 2023, 11(17), 3625; https://doi.org/10.3390/math11173625
Submission received: 23 June 2023 / Revised: 8 August 2023 / Accepted: 20 August 2023 / Published: 22 August 2023
(This article belongs to the Special Issue New Advance in Operations Research and Analytics)

Abstract

:
This paper deals with a novel variation of the versatile stochastic duel game that incorporates an energy fuel constraint into a two-player duel game. The energy fuel not only measures the vitality of players but also determines the power of the shooting projectile. The game requires players to carefully balance their energy usage, while trying to outmaneuver their opponent. This unique theoretical framework for the stochastic game model provides a valuable method for understanding strategic behavior in competitive environments, particularly in decision-making scenarios with fluctuating processes. The proposed game provides players with the challenge of optimizing their energy fuel usage, while managing the risk of losing the game. This novel model has potential for implementation across diverse fields, as it allows for a versatile conception of energy fuel. These energy fuels may encompass conventional forms, such as natural gas, petroleum, and electrical power, and even financial budgets, human capital, and temporal resources. The unique rules and constraints of the game in this research are expected to contribute insights into the decision-making strategies and behaviors of players in a wide range of practical applications. This research primarily focuses on deriving compact closed-form solutions, utilizing transformation and flexible analysis techniques adapted to varying the concept of the energy fuel level. By presenting a comprehensive description of our novel analytical approach and its application to the proposed model, this study aims to elucidate the fundamental principles underlying the energy fuel constraint stochastic duel game model.

1. Introduction

Game theory is a powerful tool for modeling and analyzing strategic decision-making in a wide range of fields, from economics and political science to computer science and engineering [1,2,3,4,5,6]. Modern game theory has seen significant developments in recent years, particularly in the areas of repeated games, evolutionary game theory, and network games. One important recent development is the use of machine learning techniques in game theory, which has led to advances in predicting and optimizing outcomes in complex, multi-player games [7]. Another area of active research is the analysis of games in which players have incomplete information, which has applications in contract theory, mechanism design, and more [8]. Network games have also become an important area of research, as they model interactions among agents in a social or economic network, with implications for contagion and diffusion dynamics [9]. Another growing area of interest is the use of game theory in analyzing cybersecurity, particularly in the context of defending against cyber-attacks [3,5,10]. Overall, modern game theory has seen exciting developments and applications in a wide range of fields. As researchers continue to develop new methods and models, game theory is likely to remain a valuable tool for understanding strategic decision-making in complex, dynamic environments. Duel games have become the focus of study in game theory, due to their applicability to modeling competitive situations, ranging from military conflicts to economic decisions [11]. Recent research has explored variations of the duel game, such as the generalized stochastic duel game [12] and the duel game with multiple asymmetric players [13,14] and penalties. Other studies have examined the impact of different strategies on the outcome of duel games, including the use of mixed strategies [15] and time-dependent strategies with two players [16] or multiple players [17,18]. Several studies have also explored the application of duel games in specific contexts, such as decision-making in the presence of incomplete information [19], analysis of political competitions [20], and modeling of predator–prey interactions in ecological systems [21].
The versatile stochastic duel game is a game-theoretic model that incorporates elements of the fluctuation process [16]. This hybrid model has practical applications in a wide range of decision-making scenarios. Specifically, the model is designed to analyze a two-person duel-type game in the time domain. This unique theoretical framework for the stochastic game model allows the analysis of complex decision-making scenarios and provides a valuable tool for understanding strategic behavior in competitive environments. In OneToN stochastic duel games [13], a player who decides to shoot does so in an attempt to kill all other players simultaneously (i.e., one-shooting-to-kill-all). This is akin to using an automatic machine gun, as opposed to a single bullet gun. However, it is important to note that each player is only permitted to shoot once on their turn. This robust method was developed to identify the optimal strategies in a general antagonistic multi-person stochastic duel game [14]. This game consists of multiple stages, each with different pairs of players and corresponding optimal shooting moments. Despite the participation of multiple players across multiple battlefields, each player is limited to one bullet in the entire game. Although players may have a limited number of opportunities to shoot, they must carefully consider their options and wait for the optimal shooting opportunity. Once a fixed threshold is reached, players are allowed to take the best shooting opportunity at a random time with a random impact. This highly strategic game presents a challenge for identifying optimal strategies, which this robust method was designed to address.
This research proposes a novel version of the stochastic duel game, introducing a shooting projectile that is subject to energy fuel constraints. Energy fuel is the cost of sustaining player life and is slowly and randomly used up. This variant of a stochastic duel includes an expansion of describing various game situations with limited shooting resources. In practical applications of this new model, energy fuel (i.e., limited shooting resources) can take various forms, including energy sources, such as gas, oil, and coal; electrical power; and even financial assets, such as budgets, human resources, and time. Specifically, this game model is well-suited for analyzing funding strategies involving two competitive firms, thus rendering it a suitable framework for a two-player game. In this context, the financial budget may be perceived as the energy fuel, which is incrementally expended, while allocating the remaining budget for the development and launch of a new product or service. Notably, within the scope of the mathematical game model, a product launch parallels the concept of “shooting”. In a scenario where the opposing player (i.e., player B) possesses insufficient remaining budget to fund a product launch, player A is declared the winner. Conversely, should player B maintain an adequate budget to counter the product launch by player A, player A loses the game. Basically, player A loses the game if their single shot totally misses the target or their shooting strength is less than the remaining energy fuel of the target player. Intriguingly, we can determine the result before even starting the game. Each player can find the best moment for shooting and the optimal energy fuel level.
This paper is constructed in the following manner: Section 2 presents the innovative stochastic duel game model, incorporating a unique variant that takes into account fuel-constrained ammo. This means that each player possesses a shooting power based on their individual energy level. Finally, the conclusions of this paper are provided in Section 3.

2. Stochastic Duel Game with Fuel Constraint Ammo

An antagonistic duel game of two players (called “A” and “B”) in the time domain is considered and both players know the full information regarding the success probabilities based on the time domain [16]. Let us assigned P a t as the monotone increasing CDF (cumulative distribution function) for player A regarding hitting the opponent player (player B) at time t. Similarly, P b t is the probability of player B hitting the opponent player (player A) at time t. Each hitting probability (CDF) may be arbitrary chosen and this reaches 1 when the time t goes to the infinite < . The strategic decision of the shooting moment means finding the moment when a player will have the best chance to hit the other player. There is a certain point that maximizes the chance of succeeding in the shot, and this optimal point becomes the moment of success in the continuous time domain. This moment t * is actually the same as the single bullet case and it is defined as follows [11,13]:
t * = inf t 0 : P a t + P b t 1 ,
which indicates that the probability of hitting the other player is higher than the probability of the other player missing. According to any conventional duel games [11], it is important to note that the individual who fires the initial shot does not necessarily possess superior or inferior shooting skills. Instead, success in these games is contingent upon surpassing a critical point, referred to as t * , which is influenced by the collective abilities of both participants from (1). Additionally, each player has an energy fuel level which randomly drops, and the spending (or usage) of the energy fuel for each player is monotone and non-decreasing. Let ( Ω , F Ω , P ) be the probability space F A ,   F B ,   F τ F Ω independent σ -subalgebras. Suppose
A : = k 0 ε s k , s 0 = 0 < s 1 < s 2 < , a.s.
B : = j 0 ε t j , t 0 = 0 < t 1 < t 2 < , a.s.
are F A -measurable and F B -measurable renewal point processes ( ε a is a point mass at a) with intensities λ a and λ b and position and point independent marking. The energy fuel level of each player becomes the shooting power to hit a opponent player. The energy fuel of player A drains at times s 1 , s 2 , and the magnitudes of energy drains are formalized using process A . The energy drain of player B is described by the process B . The processes A and B are specified by their transforms:
E g A s = e λ a s g 1 , E h B t = e λ b t h 1 .
The game is observed at random times, in accordance with the point process
T : = i 0 ε τ i , τ 0 > 0 ) , τ 1 , ,
which is assumed to be delayed renewal process.
A t , B t : = A B 0 , τ k , k = 0 , 1 , ,
forms an observation process upon A B embedded over T , with respective increments
X k , Y k : = A B τ k 1 , τ k , k = 1 , 2 , ,
and
X 0 = A 0 , Y 0 = B 0 .
The observation process can be formalized as
A τ B τ : = k 0 X k , Y k ε τ k ,
where
A τ = i 0 X i ε τ i , B τ = i 0 Y i ε τ i ,
with position-dependent marking and with X k and Y k being dependent on the notation
Δ k : = τ k τ k 1 , k = 0 , 1 , , τ 1 = 0 ,
and
σ z , θ = E z X i Y i + e θ Δ i , z > 0 .
By using the double expectation, we have
σ z , θ = σ θ + λ a λ b 1 z
where
σ θ = E e θ Δ i , σ 0 θ = E e θ τ 0 .
Let us consider the maximum energy levels of players M a and M b . The energy level of player A after draining fuel is M a A τ , with M b B τ for player B from (9). The stochastic processes for the energy level of each player are as follows:
M a A τ M b B τ : = M a , M b k 0 X k , Y k ε τ k ,
and the game is over when the k-th observation epoch τ k , the shooting power of player A, which is equivalent to the remaining energy level at the moment of the shooting being greater than the energy fuel level of player B:
M a A τ k M b B τ k .
For further formalization of the game, the exit index can be defined as follows:
ν : = inf k : A k = A 0 + X 1 + + X k Σ a ,
μ : = inf j : B j = H 0 + Y 1 + + Y j Σ b .
where
Σ a = M a M b B j , Σ b = M b M a A k
Since player A is assumed to win the game at time τ ν , we will target the confined game from the point of view of player A. The passage time τ ν is associated exit time from the confined game and the formula (15) will be modified as
M a A τ ¯ M b B τ ¯ : = M a , M b k 0 ν X k , Y k ε τ k ,
where the path of the game from F Ω A ν B ν | M a M b | T t * , which gives an exact definition of the model observed until τ ν . The joint functional of the stochastic duel with the fuel limited ammunition is as follows:
Φ ν , μ = Φ ν Σ a , μ Σ b ζ , z 0 , z 1 , θ 0 , θ 1 = E ζ ν z 0 A ν 1 B μ 1 z 1 A ν B μ e θ 0 τ ν 1 e θ 1 τ ν 1 ν μ M a b σ ¯ 1 ν t * σ ¯ ,
where
A ν B μ | M a M b | T t * ν μ M a b σ ¯ ν t * σ ¯ ,
M a b = | M a M b | , σ ¯ = E Δ k .
The functional Φ ν , μ in this model shall represent the status of both players upon the exit time τ ν and the pre-exit time τ ν 1 . The pre-exit time is of particular interest because player A wants to predict not only her time for the highest chance, but also the moment for the next highest chance prior to this. The Theorem 1 establishes an explicit formula for Φ μ , ν and we abbreviate with (23)–(27):
γ z , θ = σ z , θ , γ 0 z , θ = σ 0 z , θ ,
ϕ A x , θ = E x X k e θ Δ j = σ θ λ a 1 x ,
ϕ A 0 x , θ = E x A 0 e θ τ 0 = σ 0 θ λ a 1 x ,
ϕ B y , θ = E y Y j e θ Δ j = σ θ λ b 1 y ,
ϕ B 0 y , θ = E y B 0 e θ τ 0 = σ 0 θ λ b 1 y .
The linear operators are defined as follows:
D p , q f p , q x , y : = 1 x 1 y p 0 q 0 f p , q x p y q ,
then
f p , q = D x , y p , q D p , q f p , q ,
where f p , q is a sequence, with the inverse
D x , y p , q = 1 p ! · q ! lim x , y 0 p q x p y q 1 1 x 1 y , p 0 , q 0 , 0 , otherwise .
Theorem 1.
The functional Φ μ ν of the game on trace σ-algebra
F Ω A ν B ν | M a M b | T t * satisfies the following formula:
Φ μ , ν = D x , y M a , M b ζ Γ 0 γ 1 1 ϕ x ζ Γ t * σ ¯ ϕ y M a b σ ¯ 1 ζ Γ ,
where
Γ = γ z 0 z 1 x , θ 0 + θ 1 ,
Γ 0 = γ 0 z 0 z 1 x , θ 0 + θ 1 ,
γ 1 = γ z 1 , θ 1 ,
ϕ x = ϕ A x , 0 , ϕ y = ϕ B y , 0 ,
Proof. 
We find the explicit formula of the joint function Φ μ , ν that starts from (19):
Φ ν , μ = Φ ν Σ a , μ Σ b ζ , z 0 , z 1 , θ 0 , θ 1
= j 0 k 0 ζ j E [ z 0 A ν 1 B ν 1 z 1 A ν B ν e θ 0 τ ν 1 e θ 1 τ ν 1 j k M a b σ ¯ 1 j t * σ ¯ 1 ν = j , μ = k ]
and applying the operator D to random family 1 ν x = p , μ y = q : x 0 , we have
D p , q 1 ν x = k , μ y = j x , y = x A k 1 x A k y B j 1 y B j
and, from previous research [1,2,3,4,5],
Ψ x , y = j 0 k 0 ζ j D x , y E [ z 0 A ν 1 B ν 1 z 1 A ν B ν e θ 0 τ ν 1 e θ 1 τ ν
1 j k M a b σ ¯ 1 j t * σ ¯ 1 ν = j , μ = k ]
= j t * σ ¯ k j M a b σ ¯ ζ j E [ z 0 z 1 A j 1 B j 1 e θ 0 + θ 1 τ j 1 z 1 X j Y j e θ 1 Δ j
x A j 1 1 x X j y B k 1 1 y Y k 1 ν = j , μ = k ]
= j t * σ ¯ L 1 j L 2 j k j M a b σ ¯ L 3 j k L 4 j k .
where
L 1 j = ζ j E z 0 z 1 A j 1 B j 1 x y B j 1 e θ 0 + θ 1 τ j 1 = ζ j Γ 0 Γ j 1 ,
L 2 j = E z 1 X j Y j e θ 1 Δ j 1 x X j = γ 1 1 ϕ x ,
L 3 j k = E y Y j + Y j + 1 + + Y k 1 = ϕ y k j ,
L 4 j k = E 1 y Y k = 1 ϕ y .
From (39)–(42), we have
Ψ x , y = j t * σ ¯ ζ j Γ 0 Γ j 1 γ 1 1 ϕ x ϕ y M a b σ ¯ .
Therefore,
Ψ x , y = ζ Γ 0 γ 1 1 ϕ x ζ Γ t * σ ¯ ϕ y M a b σ ¯ 1 ζ Γ .
From (29) and (44), finally, we have:
Φ μ , ν = D x , y M a , M b ζ Γ 0 γ 1 1 ϕ x ζ Γ t * σ ¯ ϕ y M a b σ ¯ 1 ζ Γ .
The functional Φ ν , μ contains all decision making parameters regarding this standard stopping game. The information includes the optimal number of iterations of players (i.e., ν and μ ), the best moments for shooting ( τ ν , τ μ ; exit time) and step prior to the best shooting times ( τ ν 1 , τ μ 1 ; pre-exit time). The information for player A from the closed functional is as follows:
E ν = lim ζ 1 ζ Φ ν , μ ζ , 1 , 1 , 0 , 0 ,
E τ ν 1 = lim θ 0 θ Φ ν , μ 1 , 1 , 1 , θ , 0 .
Additionally, there are some special cases that can be considered. The first case is where the assets of both players are the same (i.e., M a b = 0 ). From (31), the formula is changed as follows:
Φ μ , ν = D x , y M a , M b ζ Γ 0 γ 1 1 ϕ x ζ Γ t * σ ¯ 1 ζ Γ ,
where M a b = 0 . This implication means that both players have the same energy fuel level and the winning strategy for this game would be to take the shot as soon as passing the threshold from (1). The other case would be where the initial energy level of player A is smaller than that of player B (i.e., M a < M b ). The best strategy for player A would be to wait until player B shoots (and fails), because player A has no chance of winning, even if he hits the target correctly.

3. Conclusions

A new successor to the antagonistic stochastic duel game was studied. This research primarily focused on deriving compact closed-form solutions utilizing transformation and flexible analysis techniques, which were adapted by varying the concept of the energy fuel level. In this innovative duel game, a player can win the game only if their bullets hit the target player and if their shooting power exceeds the remaining energy fuel level of the target player at the moment of shooting. A joint functional of the standard stopping game was constructed to analyze the strategic decision parameters, which indicated the best moment for shooting in the time domain stochastic game. This study provides a thorough account of the innovative analytic approach, shedding light on the fundamental principles that underlie the stochastic duel game model with energy fuel constraints.

Funding

This work was supported in part by the Macao Polytechnic University (MPU), under Grant RP/FCA-04/2023.

Data Availability Statement

There are no available data to be stated.

Acknowledgments

This paper was revised using AI/ML-assisted tools. Special thanks to the reviewers who provide valuable advice for improving this paper.

Conflicts of Interest

The author declare no conflict of interest.

References

  1. Kim, S.-K. Blockchain Governance Game. Comp. Indust. Eng. 2019, 136, 373–380. [Google Scholar] [CrossRef]
  2. Kim, S.-K. Strategic Alliance for Blockchain Governance Game. Probab. Eng. Inf. Sci. 2022, 36, 184–200. [Google Scholar] [CrossRef]
  3. Kim, S.-K. Enhanced IoV Security Network by Using Blockchain Governance Game. Mathematics 2021, 9, 109. [Google Scholar] [CrossRef]
  4. Kim, S.-K. Multi-Layered Blockchain Governance Game. Axioms 2022, 11, 27. [Google Scholar] [CrossRef]
  5. Kim, S.-K. Advanced Drone Swarm Security by Using Blockchain Governance Game. Mathematics 2022, 10, 3338. [Google Scholar] [CrossRef]
  6. Moschini, G. Nash equilibrium in strictly competitive games: Live play in soccer. Econ. Lett. 2004, 85, 365–371. [Google Scholar] [CrossRef]
  7. Piergigli, D.; Ripamonti, L.A.; Maggiorini, D.; Gadia, D. Gadia, Deep Reinforcement Learning to train agents in a multiplayer First Person Shooter: Some preliminary results. In Proceedings of the 2019 IEEE Conference on Games, London, UK, 20–23 August 2019; pp. 1–8. [Google Scholar]
  8. Peters, H. Finite Games with Incomplete Information, Game Theory; Springer: Berlin/Heidelberg, Germany, 2008; pp. 59–71. [Google Scholar]
  9. Charilas, D.E.; Panagopoulos, A.D. A survey on game theory applications in wireless networks. Comput. Netw. 2010, 54, 3421–3430. [Google Scholar] [CrossRef]
  10. Do, C.T.; Tran, N.H.; Hong, C.; Kamhoua, C.A.; Kwiat, K.A.; Blasch, E.; Ren, S.; Pissinou, N.; Iyengar, S.S. Game Theory for Cyber Security and Privacy. ACM Comput. Surv. 2017, 50, 1–37. [Google Scholar] [CrossRef]
  11. Polak, B. Discussion of Duel, Open Yale Courses. 2008. Available online: http://oyc.yale.edu/economics/econ-159/lecture-16 (accessed on 1 March 2023).
  12. Cardaliaguet, P.; Rainer, C. Stochastic Differential Games with Asymmetric Information. Appl. Math. Optim. 2009, 59, 1–36. [Google Scholar] [CrossRef]
  13. Kim, S.-K. Antagonistic One-To-N Stochastic Duel Game. Mathematics 2020, 8, 1114. [Google Scholar] [CrossRef]
  14. Kim, S.-K. Robust Pairwise n-Person Stochastic Duel Game. Mathematics 2021, 9, 825. [Google Scholar] [CrossRef]
  15. Reny, P.J. On the Existence of Pure and Mixed Strategy Nash Equilibria in Discontinuous Games. Econometrica 1999, 67, 1029–1056. [Google Scholar] [CrossRef]
  16. Kim, S.-K. A Versatile Stochastic Duel Game. Mathematics 2020, 8, 678. [Google Scholar] [CrossRef]
  17. Merlevede, J.; Johnson, B.; Grossklags, J.; Holvoet, T. Time-Dependent Strategies in Games of Timing. Lect. Notes Comput. Sci. 2019, 11836, 310–330. [Google Scholar]
  18. Park, A.; Smith, L. Caller Number Five and related timing games. Theor. Econ. 2008, 3, 231–256. [Google Scholar]
  19. Reif, J.H. The complexity of two-player games of incomplete information. J. Comput. Syst. Sci. 1984, 29, 274–301. [Google Scholar] [CrossRef]
  20. McCarty, N.; Meirowitz, A. A Political Game Theory: An Introduction; Cambridge University Press: Cambridge, MA, USA, 2007. [Google Scholar]
  21. Tolon, V.; Martin, J.; Dray, S.; Loison, A.; Fischer, C.; Baubet, E. Predator-prey spatial game as a tool to understand the effects of protected areas on harvester-wildlife interactions. Ecol. Appl. 2012, 22, 648–657. [Google Scholar] [CrossRef] [PubMed]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Kim, S.-K. Two-Person Stochastic Duel with Energy Fuel Constraint Ammo. Mathematics 2023, 11, 3625. https://doi.org/10.3390/math11173625

AMA Style

Kim S-K. Two-Person Stochastic Duel with Energy Fuel Constraint Ammo. Mathematics. 2023; 11(17):3625. https://doi.org/10.3390/math11173625

Chicago/Turabian Style

Kim, Song-Kyoo (Amang). 2023. "Two-Person Stochastic Duel with Energy Fuel Constraint Ammo" Mathematics 11, no. 17: 3625. https://doi.org/10.3390/math11173625

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop