Wednesday, September 11, 2019

New Cash Single Raise Pots GTO Trainer Pack Released

I'm excited to announce that my new GTO Trainer Cash Games SRP pack has been released and is now available for purchase in the Simple GTO Trainer software which you can download for free here: http://simplepoker.com/en/Solutions/Simple_GTO_Trainer.  This pack includes drills and full games for single raised pots for SB vs BB, UTG/HJ/CO/BTN vs BB, UTG/HJ/CO vs BTN, all with multiple preflop raise sizes and in my opinion is the most time effective and cost effective way to master single raised pot play in NLHE cash games.  The pack is $99 and does not require that you own any additional software

For more details check out the video below:



Wednesday, June 12, 2019

GTO Trainer Updates and Play Mode Tutorial

The Simple Postflop team has been hard at work improving GTO Trainer so I made a new tutorial video showing off some of the new features.  They've also added a bunch of new pre-computed solution packs that are fully stand-alone (so you don't need Pio or SPF at all) for MTTs, Spin and Go's, HU Cash, 3-bet pots, etc.  The packs are all in the range of $50-$150 making them the by far the most cost effective way to learn GTO play in your game type of choice.

In addition to releasing new packs, the "regular" games in GTO Trainer packs can now be used in "play" mode which lets you continue to play out the hand even after making a non-GTO play.  This means that the software now shows you your showdown and non-showdown winnings by hand, session and in aggregate which can be a useful way to spot if you are playing to passively or to aggressively relative to GTO.

Some other new features include some quality of life improvements such as table layouts, displaying bet sizes in BBs, etc as well as the ability to play entire hands from preflop through to the river which I show how to set up in this tutorial.



If you're interested you can download the software for free here: http://simplepoker.com/en/Solutions/?partner=gtorangebuilder

Wednesday, January 2, 2019

Deliberate Practice in Poker and GTO Trainer

As both a poker player, poker coach, competitive tennis player, magic the gathering player, and starcraft player I've always believe that deliberate practice is the key differentiating factor that separates "good" players from elite players.  Games like tennis or chess have very natural easy ways for a player to deliberately isolate and practice specific skills either alone or with a partner, but in the poker world deliberate practice has always been quite difficult.

If you wanted to hone your play in BB vs BTN, 3-bet pots, that might be a situation that would only come up in a dozen hands over the course of an hour or two, and the variance in the results would make it hard to systematically analyze and improve your play without weeks worth of hand data and hours of analysis.

Over the last year I've been working with the SimplePostflop team to solve this problem with a new piece of software called GTO Trainer.  In my latest video I talk about the theory and impact of deliberate practice and how to execute it with GTO trainer, check it out below.




GTO trainer lets anyone deliberately practice specific scenarios repeatedly and hone specific skills with real time feedback.  The program is free to download and integrates with either Piosolver or SimplePostflop.  You can also purchase any of my stand-alone solution packs (including my brand new 3-bet pots pack) and start training against them in a matter of minutes.

Some screen shots:


GTO Trainer also gives you aggregated session results and range composition analysis:



If you're interested you can download the software for free here: http://simplepoker.com/en/Solutions/?partner=gtorangebuilder

Saturday, November 4, 2017

Poker AI Info Graphic from Josh Wardini

Hi all,

Today I have a guest post from Josh Wardini who wanted to share a nice infographic that he made on AI in poker.  You can check out the infographic here: https://pokersites.me.uk/poker-ai/

Enjoy,

Alex

Researching The Facts About The Rise Of Poker AI & Curating The Data
My name is Josh Wardini and I am the editorial contributor and community manager for PokerSites.me.uk. Living in Portland, Oregon and an avid poker enthusiast, I first came across a few tidbits of information about Libratus - a poker-playing AI that was capable of actually beating the poker pros. Growing up watching movies like Terminator, I wanted to find out how close we are, as a species, to creating AI capable of actually out-thinking us.

Even though AI (Artificial intelligence) has been receiving media coverage in the last few years, the idea of an AI actually being capable of human-level functions seems years, if not decades, away for many. In actual fact, the future is a lot closer than you may think, and recently, AI has become functional enough to beat humans at the most widely played card strategy game on earth: Poker. The growth of this technology has already grown beyond what we imagined, and you can get a good idea of how this is so from my data.

Best wishes,

Josh Wardini




Sunday, May 28, 2017

GTORB 6-max Cash Study Group Season 3

I am gauging interest in the 3rd season of my 6-max study sessions this summer.  Current the season consists of 6, 1+hr sessions similar to my strategy packs, but live over Skype with real-time Q&A.  The cost $750 for the 6 sessions and sessions are held every other week.  In addition to the coaching sessions there is an ongoing Skype group chat the I personally answer, and a shared google drive folder where I upload spread-sheets and GTO solution files.  I've done two seasons of this so far and gotten very positive feedback.  The group has been capped at 10 people.

Anyone who wants to join this season can also get access to the VODs (at an additional price of $500 per season) from previous seasons so that you are up to date on all the material we covered.

This season I am considering offering a VOD only option where at a reduced price of $500.  With the VOD only option, you can get access to recordings of the sessions and access to the shared drive folder but you cannot attend the sessions live or access the Skype group.

If you're interested please let me know via email at gtorangebuilder@gmail.com and I can give you access to one of the VODs from a previous season so that you can assess the material.

Generally, the people in the group are midstakes+ NL cash game players.  Depending on interest and scheduling I'll announce the dates for the summer session in a few weeks time.

Friday, January 13, 2017

Brains vs AI: My Prediction and some Tips for the brains

My skype has been inundated with questions and prediction requests regarding the ongoing brains vs AI matchup so I thought I'd take some time to write down my official prediction and to also help point the brains in the right direction for beating the bot.

For those of you who haven't been following it, after the brains defeated Claudico in the last major human vs bot challenge, the latest AI from CMU/Alberta is named Liberatus and he is back to play 120,000 hands vs Dong Kim, Jason Les, Jimmy Chou, and Daniel Mcaulay.  Furthermore, after two days of play (~8k of the 120k hands) the AI is up against 3 of the 4 players and significantly (1500bbs) overall.



As a result the betting lines have moved such that the AI is now favored to win the whole thing after starting out as a 4-1 dog.  I'm going to boldly go on record as saying that the betting lines are wrong, the humans will stage a comeback, and the AI will not win this year.  All that is under the assumption that the humans actively look for leaks not just in its ranges but in its reactions to bet sizing.  If they just play their standard game they will likely lose.  I'll give some specific advice on how to attack the AI below.

For what its worth I think the technology to make a human level HUNLHE bot is there, but that it involves combining a lot of state of the art techonology in just the right way and I don't believe the researchers will get it right this try.  My medium to longer term outlook for the future of humanity in HUNLHE is very bleak.

How to beat a GTO bot


GTO bots are generally constructed around the principal of taking a set of pre-computed GTO solutions and then interpolating them (often with some learning component) to figure out how to react to bet sizing that is outside of the pre-computed game tree.  As far as I know the details of Liberatus' specific algorithms have not been released so I'll have to make some assumptions about the general construction of GTO bots.  Deepstack, a cutting edge bot that recently made some questionable claims about "beating" human professionals, has detailed more of their architecture in a published paper so I am basing some of this analysis on their approach.

Because of the way GTO bots are constructed, if you play within the precomputed GTO solutions bet sizing abstraction you are guaranteed to lose.  When HU limit hold'em  was solved it directly implicated that any version of NLHE which was restricted to a small number of "fixed" sizes, even if they are percentages of the pot rather than fixed amounts, was also solvable.  Anyone with a bit of programming experience and a budget could go to SPF, buy some preflop solution, and trivially make a GTO bot that would be unbeatable if you agreed in advance to only ever bet some specific pot %s, eg 50% or 100% pot postflop, always 3x, limp or fold pre, always 3-bet to 9, etc.

The only way to attack the bot is going to be to attack its bet sizing abstraction.  The difficult and to date unsolved part of building an unbeatable poker bot comes entirely from correctly determining how to react to bet sizings outside of its abstracted solutions.  Note that by the definition of GTO strategies you cannot play within its bet sizing abstraction but with non-standard ranges preflop and on the flop and then hope to somehow exploit it on the turn and river unless you can somehow go outside its bet sizing abstraction in a systematic exploitative way on those later streets.  Understanding that the only way to beat the bot is to attack its abstractions is the first key step.


Liberatus seems to be taking things a step further than the naive approach I suggested above, by resolving the turn and river dynamically during a hand, presumably with a large number of bet sizes.  This adaptation allows the bot to play a preflop/flop strategy that may be based on a GTO computation that only had 2 turn and river sizes, but then resolve the turn and river with a much larger set of bet sizings on the fly.  What this addition means is that if you play a strategy such that reaching the turn with a range that is close to what the preflop and flop components of the bots solution dictate, then you are likely already screwed.  It will be able to solve a very large version of that turn/river branch of the game tree with a large number of bet sizes and your ability to attack it on the turn and river will be very limited IF you play within its bet sizing abstraction preflop and on the flop.  

Thus the key to beating the bot is to find holes in the preflop and flop bet sizing abstraction.  In particular, one should look for weak reactions to non-standard 3-bet sizes and 4 bet sizes as a primary means of attack.  Flop check raises may be vulnerable as well.  The tricky part to this is doing so with a sensible range.  

I'm going to illustrate how you would attack a bot by using non-standard 3-bet sizing as an example.  This all assumes that one has unlimited time and unlimited resources which of course the brains in this challenge do not.  That said, a reasonable approach would be to do the following.

  1. Get a HUNL GTO preflop solution with the sizes the bot seems to use itself
  2. Run a few HUNL GTO preflop simulations with unusual 3-bet sizes, pick one that performs well even against a perfect response
  3. See if the bot ever shows down a hand that should be in the range of the solution from step 1 but should not be in the range of the solution from step 2
  4. If so you've found a leak
  5. Take the reaction to a 3-bet from step 1 and lock that strategy in to the solution you chose from step 2
  6. Observe what a minimally exploitative strategy is
  7. Keep an eye on what you observe in terms of the bots reaction ranges to your non-standard 3-bet size.  Its reaction strategy may be interpolated from two GTO solutions with bet sizes near your 3-bet size (eg if you 3-bet to 7 it might interpolate between a 3-bet to 5 and a 3-bet to 9) or it might be using some learning algorithm to try and reduce its mistakes over time, or they might be updating it at night
I think that if the brains use the next 10-20k hands to test the bots reactions to unusual preflop and flop sizes in situations where the odd sizing is only slightly inefficient to start with that they will be able to find some wholes that they can attack for the remainder of the match.

If they can consistently reach the turn in spots where the bots estimate of the GTO range for them (and it) to hold at that point is significantly wrong, then its dynamically solving will only lead it astray as it will input incorrect starting ranges and thus output an incorrect strategy.  The key is just to get outside of its bet sizing abstraction early in the hand were it has to be more sparse.

Despite the bad early start for the brains, I still think that it is unlikely that Liberatus is unexploitable and that assuming it is attempting to play near GTO then the brains, given time should be able to find those leaks and attack them without fear of counter exploitation.  As long as the brains realize that their "standard game" isn't sufficient and take a focused and structured approach to identifying leaks that the bot has as a result of its bet sizing abstraction and attacking them I think there is still hope for humanity.



Sunday, September 4, 2016

New MTT Focused Strategy Pack Released -- Plus Strategy Pack Sale through 9/21/2016

I'm very excited to announce the launch of my latest strategy pack which explores the underlying theory behind MTT tournaments focusing on early and midstage chip valuations, preflop strategy and postflop play. The pack is one of biggest undertakings I've done to date and includes new techniques for modeling skill edge and chip value in early/mid stage tournaments as well as a lot of specific strategy recommendations.  The pack is available for purchase in the GTO dojo here: http://gtorangebuilder.com/#gto-dojo. A preview of the main video is below.


And through September 21st we're offering a special discount where anyone who buys the new MTT Theory and Practice strategy pack can get $50 off any one other strategy pack of their choice.  Just purchase both packs from our website and email gtorangebuilder@gmail.com and I'll refund $50 to you within 24 hours.

Note that the $50 off only applies to strategy packs that I made, so it applies to any pack in the GTO Dojo with the exception of the the Spins/HUSNG packs.