Open Access. Powered by Scholars. Published by Universities.®
Articles 1 - 2 of 2
Full-Text Articles in Engineering
Actor-Critic Reinforcement Learning For Bidding In Bilateral Negotiation, Furkan Arslan, Reyhan Aydoğan
Actor-Critic Reinforcement Learning For Bidding In Bilateral Negotiation, Furkan Arslan, Reyhan Aydoğan
Turkish Journal of Electrical Engineering and Computer Sciences
Designing an effective and intelligent bidding strategy is one of the most compelling research challenges in automated negotiation, where software agents negotiate with each other to find a mutual agreement when there is a conflict of interests. Instead of designing a hand-crafted decision-making module, this work proposes a novel bidding strategy adopting an actor-critic reinforcement learning approach, which learns what to offer in a bilateral negotiation. An entropy reinforcement learning framework called Soft Actor-Critic (SAC) is applied to the bidding problem, and a self-play approach is employed to train the model. Our model learns to produce the target utility of …
Blmdp: A New Bi-Level Markov Decision Process Approach To Joint Bidding Andtask-Scheduling In Cloud Spot Market, Mona Naghdehforoushha, Mehdi Dehghan Takht Fooladi, Mohammad Hossein Rezvani, Mohammad Mehdi Gilanian Sadeghi
Blmdp: A New Bi-Level Markov Decision Process Approach To Joint Bidding Andtask-Scheduling In Cloud Spot Market, Mona Naghdehforoushha, Mehdi Dehghan Takht Fooladi, Mohammad Hossein Rezvani, Mohammad Mehdi Gilanian Sadeghi
Turkish Journal of Electrical Engineering and Computer Sciences
In the cloud computing market (CCM), computing services are traded between cloud providers and consumers in the form of the computing capacity of virtual machines (VMs). The Amazon spot market is one of the most well-known markets in which the surplus capacity of data centers is auctioned off in the form of VMs at relatively low prices. For each submitted task, the user can offer a price that is higher than the current price. However, uncertainty in the market environment confronts the user with challenges such as the variable price of VMs and the variable number of users. An appropriate …