Advance multi armed bandit

پروژه کوچک  در زمینه Combinatorial multi arm bandit based  تعریف الگوریتم  و simulation  نیاز هاست آشنایی خوبی با داشته باشد.Advance level Computer science theory algorithms of these papers"Combinatorial Multi-Armed Bandit with General Reward Functions""Contextual Combinatorial Multi-armed Bandits with Volatile Arms and Submodular Reward" "BUDGETED COMBINATORIAL MULTI-ARMED BANDITS"We need these specifically step by step: IMPORTANT TO READ CAREFULLY  Defining the environment : arms: each arm has a distribution which the agent doesn't know, and some characteristics. . Creating an Agent (algorithm) at each time stage, the agent selects a set of arms (max k number out of all N arms), then observes the rewards of the selected set.  Training .test of Algorithm and seeing result.. Printing graphs After reading the papers carefully and understanding the problem we can start. Thanks