Unmanned Aircraft Systems Airspace Integration: A Game Theoretical Framework for Concept Evaluations

The focus of this paper is to present a game theoretical modeling framework for the integration of unmanned aircraft systems into the National Airspace System. The problem of predicting the outcome of complex scenarios, where manned and unmanned air vehicles coexist, is the research problem of this work. The fundamental gap in the literature is that the models of interaction between manned and unmanned vehicles are insufficient: 1) They assume that pilot behavior is known a priori, and 2) They disregard pilot reaction and the decision-making process. The contribution of this paper is to propose a realistic modeling framework that will fill this gap. The foundations of the proposed method are formed by game theory, which investigates strategic decision making between intelligent agents; bounded rationality concept, which is based on the fact that humans cannot always make perfect decisions; and reinforcement learning, which is shown to be effective in human learning in psychology literature. An analysis of integration is conducted using an example scenario in the presence of manned aircraft and fully autonomous unmanned aircraft systems equipped with sense-and-avoid algorithms.