The more I've delved into usage of AI LLMs, the more obvious it seems to me that people shouldn't rely upon them without some sort of verification.
Okay, everybody say it with me now:
No, I never watched the show, I was at university at the time. From Full House via Tenor.
But the thing is that the companies are very up front in how you should approach using prompts and evaluating the results.
Back when I last posted about my initial exploration into LLMs, I spoke about how the confidence and overall collegiality the AIs had were dangerous because you have to always always ALWAYS verify whether what the AI is stating is true. Apparently even the AI companies agree*, because the instructional materials are filled with cautionary information about not being seduced (my term) by the confidence an LLM might respond with when you ask it to perform a task or answer a question. There are also tips and tricks to be certain LLMs provide accurate results by essentially defeating an LLM's tendency to invent stuff in its desire to provide you with what it thinks you want.
When AI companies talk about bias, they mean something completely different than what Joe Average might think about bias. Chalk it up to punditry and family/friend groups, but when average people think about bias they think about social issues such as minority groups and civil rights. What AI companies mean by bias is feeding queries (and information itself) into LLMs that presuppose a specific outcome. If you provide an LLM with data and say as part of the query "...and provide some highlights on the positive results" the LLM is going to be biased into thinking the project was successful and will provide answers that verify that, whether or not the answers were true. If, on the other hand, you say "...and provide some highlights on the positives and the negatives of the project" you will get a more balanced and nuanced result.
I'm obviously simplifying things a bit here, but to get into the headspace of LLMs, you have to understand all of the potential pitfalls. The documentation surrounding things such as being trained for LLMs in a business environment means those pitfalls are up front and center.
Not so much in all the hype surrounding LLMs and agents for regular consumer use.
If nothing else, THAT bothers me. Remember the "trust but verify" mantra? Imagine having to do that for every single fucking thing that Muse does for you. At that point, you simply throw your hands up and either stop using Muse or simply accept it's "going to be fine".
You bet your ass I was going to pull this one out again.
I don't buy it. That's a dangerous supposition, particularly when you realize that tokens are a word or phrase each, not a query each. The usage of tokens can quickly eclipse the greatest dreams of avarice from video game companies trying to use microtransactions to make insane amounts of money. That also explains why companies are discovering that AI usage is becoming more expensive than the employees the AI replaced.
Oopsie.
*Or at least one of them does. Not sure about the others.
I'm old enough to remember when both Activision and Electronic Arts were well regarded by gamers.
Statler and Waldorf are my spirit animals. From The Muppet Show via Tenor.
Activision was founded by disgruntled Atari game developers who felt they weren't treated well by Atari, and their games were arguably better than Atari's own in-house games: Pitfall, Chopper Command, Grand Prix, Starmaster, and other games were my favorites of that era.
Electronic Arts, in a similar vein, was founded by Trip Hawkins to give greater recognition to game developers as well as treat video games as more of an art form than anything that came before. Games such as The Bard's Tale, Starflight, Earl Weaver's Baseball, and Populous were games that I played in college, along with some new game that they'd come out with called John Madden Football.
Perhaps it was merely naivete, but I looked at those early game companies as what could be accomplished with everybody on board to help make their endeavor a success. It was more than just esprit de corps or shared desire for success, but a nerdy belief in that if you had a vision for a game or software that was implemented well, you deserved some success from it.
Unfortunately, success also attracts those looking to exploit it for maximum gain.
The lure is so tempting.
"Why not maximize our profits?"
"Think of what we could do with an infusion in cash."
"We could use more stability in our business model."
And so it goes.
***
It feels strange, knowing what was in the past, seeing what these companies had become. EA morphed into a business that would buy other software companies just to kill them off and take their intellectual property, cherry picking the best pieces for themselves. Activision became, well, a Bobby Kotick-owned monster. Both have now faced somewhat ignominious ends: EA at the hands of the Saudi investment fund and the obscene amount of debt piled on the corporation as part of the leveraged buyout, and Activision just another line on a Microsoft balance sheet, small enough to not really warrant a separate entry under XBox.
Be careful of what you wish for, because you may end up becoming that which you hate.
If you're like me, you're knee deep in studying for a certification.
Businesses love love LOVE certifications, because it signifies to them that you are qualified to whatever the certification is for. Of course, not all certs are created equal, as a certification I decided not to obtain about 25 years ago didn't help the people who took it (and passed!) be able to perform very basic functions that were covered in the first 2 hours of the certification class.
And with the proliferation of new technologies comes new certifications. Even old tech requires new certifications, and that's why I'm studying right now.
In honor of all of us who are going through an different type of grind.... here's some memes.
There are days when it certainly seems like this is the case. From the Journal of Emerging Technologies.
This is my life right now. From makeameme.org.
Neither; it's a huge inconvenience that isn't helping me finish the work on my plate. From imgflip.
I think that's par for the course. Just because you're certified means you're good at passing a test. That's it. From Pinterest.
Okay, this is a meme I never really understood until the other day. It started as someone using "I'm a CFO" as a pickup line. The other person thought they meant Chief Financial Officer, a c-suite executive, but the person ACTUALLY meant "Certified Forklift Operator". So there you go. From Reddit.
And then there are people who try to fake it. I can usually smell them from a mile away. From Reddit and imgflip.
This year has been pretty rough for local-ish musicians. In the case of Donnie Iris, I say "local-ish" because he was from the Pittsburgh area and most of his musical career he was centered in the Pittsburgh area along with Northeast Ohio and the northern part of West Virginia. I can't claim Donnie as a local musician, but there's always musicians just like him in all parts of the country: a local legend who, outside of a big hit or two, never really caught on beyond their local territory. Until Night Moves in 1976, Bob Seger would have definitely been in this category (in the Detroit Michigan area) with his lone hit prior to that Ramblin' Gamblin' Man back in 1968.
For Donnie, after being part of The Jaggerz and the last years of Wild Cherry, his big hit was in 1980 with "Ah Leah".
Donnie benefitted from the early days of MTV, because the (admittedly really bare bones) video for the song helped get him into heavy airplay on the Album Oriented Rock stations around the country. I know I heard it quite a bit back in the day here in Cincinnati on WEBN and Q102, and I still cringe when I see the video on YouTube.
The sad thing about the aftermath of that song's release is that Donnie and his co-writer Mark Avsec were sued for plagiarism. While they successfully fended off the lawsuit, it had an effect on Donnie and the rest of the band, The Cruisers. Here's Adam Reader, YouTube's Professor of Rock, with the story behind the song (along with his first encounter with the song at age 9):
Donnie continued to record and play in the Pittsburgh and NE Ohio area, and he was considered a local treasure. He suffered from bladder cancer and people thought he'd beaten it a year ago when he returned to playing on stage after a couple of years' worth of absence, but it was not to be.
Apparently the only WoW player to actively avoid every single piece of information or hype about WoWF has been found by Blizzard.
Apparently I like playing with a cat. Isn't that right, Twinkle?
Yes, I received an email by Blizzard asking me to participate in a survey.
(Sorry, I agreed to not share screenshots as part of the agreement to take said survey.)
In case you're wondering, yes, the survey mainly focused on WoW Forever. Courtesy of said NDA, I can't speak beyond that, but I made sure I wrote a book in the "Do you have any additional comments?" section at the end of the survey. I'm sure that Copilot looked at my screed and said "Oh shit, not THIS GUY again," before placing it in a virtual wastebasket.
If I were a betting man, I'd wager I'm very much the outlier in their survey. I can't see any real value in what I provided, given that I don't play WoWF and I'm very much in "The Emperor Has No Clothes" mode as far as video games are concerned*, but I will say that I was completely surprised that both I was reached out to in the first place for my opinion and that WoWF ended up being a thing.
Jason Schreier (above) has a good take on how WoWF came about, given that he interviewed people on the WoWF team at Blizzard. After watching the video, I have to admit that not only was I wrong in that Blizzard did bring out WoWF in the first place, but that the WoWF team actually convinced Blizzard management to develop the game. In the day and age when companies taking risks are few and far between (just look at the number of movies that are sequels or reboots or forks off of already existing intellectual property) that Holly Longdale and Co. actually agreed to let WoWF see the light of day is a minor miracle in itself.
Sure, you could argue quite strongly that WoWF is a fork off of an existing IP --it is, after all-- but creating a third major version of WoW is quite a risk given that Retail could use some shoring up and Classic seems to be stuck with Warlords of Draenor Classic looming on the horizon. There's no given it will succeed in the long term, as my Questing Buddy has informed me there's some stressful aspects to Retail players coming into WoWF and not realizing the intricacies of how things worked in the old days (such as only the first person to hit a mob gets credit for that mob's kill). I'm fully expecting that by Christmas the crowd will have thinned out enough that I could start poking my nose into the game, so we'll see if the WoW community does what they typically do, along with all of the associated bad actor behavior, or whether they'll actually be better than that.
*Okay, I'm like that about a LOT of things these days. What, you were actually surprised? It's pretty right out in front on the blog, you know. The only thing I will say is that my belief in that "The Emperor has no clothes" runs a lot deeper in a lot more topics than I typically let on.
Ben Milton, of the YouTube Channel Questing Beast and the creator of the RPG Knave, had a video up a couple of days ago that got me to thinking.
It's about 21 minutes, and he does a great job discussing this particular topic.
The big theme that he had in this video was that D&D is going to be the top dog in RPGs not because of a superior ruleset but because it is the game people think of first that satisfies what he calls Rule 1: "To play the game, you simply describe what your character is doing, and then that conversation, that description affects the game world."*
Ben references Mike Mearls, one of the major creators behind D&D 4e, and even provided a clip of a recent video Mike had released concerning why D&D 4e failed. What Mike discovered during playtesting for 4e was that people would have these character sheets full of powers, and they'd look down them and say "I swing my sword," instead of using said powers. This led Mike Mearls to the realization that the majority of D&D players aren't there for the ruleset, but for their friends and to have a good time.
While watching this video, I swear you could have swapped D&D for WoW and a lot of this stuff would still track.
There are the people who want complexity and all the crunch and huge rotations and mechanical difficulty out of their MMOs, and then there are the folks who are just there to chill, slay a few internet dragons, and enjoy the show. Those who are into min/maxing, utilizing all their abilities in interesting ways, are a minority of players but a majority of the crowd found on the company forums, on Reddit, and on the hardcore websites.
WoW will always be the number one MMO, and in general it remains so, because people will equate MMO = WoW in the same way RPG = D&D, and it satisfies that itch to allow you to pretty much go wherever you want to go in a massively multiplayer world that makes MMOs a distinct genre from other video games. You're not going to "beat" WoW by having superior raid fights or ability combos, but rather you get enough people who just want to chill with their friends to come along and hang out.
Now, this doesn't exactly map to WoW, because I believe the WoW Endgame playerbase comprises a larger portion of WoW players than the hardcore RPG crowd does to D&D, but that's also a function of WoW catering to that crowd as the more ephemeral casual crowd ebbs and flows over the course of an expansion. D&D itself was temporarily eclipsed by Pathfinder in the early 2010s because, well, RPG players wanted to keep playing D&D 3e and Pathfinder was essentially D&D 3e with some minor changes. Once Wizards of the Coast pivoted back to a more traditional design for D&D with 5e, they reclaimed their top spot and kept it as of date of this post.
The video does strike me as having a salient point: don't shoot for the Moon, shoot for a niche. That is something that both tabletop RPG and video game designers can heed, particularly AAA designers who think that they'll make World of Warcraft amounts of money by creating their own WoW-killer. You're much better off carving off a niche and making a somewhat smaller amount of money.
*From "It's time to face reality..." by Questing Beast, at the 6:18 mark.
After my post last Thursday, when I said in so many words that I prefer the peace and quiet in my MMOs, I spent some time in reflection. Why, after all this time, do I prefer a quiet and empty world so much?
I enjoy group content, and I've often complained about how changes to games to make them more solo friendly* haven't led to an enjoyable time for me. I also enjoy --to a certain extent, I might add-- reading Gen/World chat in MMOs. Yes, often it reads like watching a train wreck in real time, but other times the flow of snarky and humorous conversation brightens up an otherwise dull day.
Still, despite all of this, why do I prefer the solitude of empty zones while questing?
***
Part of it is my history, I suppose.
When I first started playing WoW in 2009, Wrath of the Lich King was in full swing. What I didn't know at the time was that the vast majority of players were at max level in Northrend while I was toiling away in what is now standard MMO behavior: empty zones save for the occasional new player or leveling alt. To me, the world seemed so huge that I didn't run into too many people while leveling, particularly in the Old World or Outland.
To be fair, when you cut your MMO teeth on a PvP server, the fewer people you encounter the better. I still get twitchy when I'm near Tarren Mill**, despite I've not been on a PvP server in well over a decade. Encountering anybody out in the field while on a PvP server is a cause for concern unless you know the person is on your faction, although that's not always a guarantee of safety as there are people who create "spy" toons to find lone targets to hunt.
But regardless, the vast open expanse of the Barrens and other places in WoW are made even larger when there are so few people out and about. By nature, a game world can't approximate the real world because the size would become unplayable for those wishing to interact with others --not to mention the amount of storage and horsepower required to keep a fully realized world-equivalent running-- so the limited size of Azeroth is made larger by artificial means, such as the more modern layering systems.
When I finally arrived at Dalaran in Northrend***, I was both overwhelmed and stunned by the sheer number of toons roaming throughout the place. I now understood just how many people actually played WoW: enough people that when Dalaran was busy, the resulting lag would drop framerates down to the mid-teens or single digits. It took a short time before I grew used to the crowds, but it never quite felt home to me in the way some of the lesser populated cities, such as Silvermoon, were.****
***
As much as I want other people to actively play in the MMOs I participate in, I'm also perfectly happy that they are all off somewhere else. I don't have to deal with random invites to either group up/join a guild, worry about my quest targets being overwhelmed by people rushing to level past me, or bots farming everything that isn't nailed down.
Being an introvert does mean that I'm perfectly happy doing my own thing and being social when I want to be, not when it's foisted on me.
***
I can understand people who do not like lines.
From Icy Veins' Facebook page.
Me, I grew up attending Kings Island, the local amusement park and home of several iconic roller coasters, such as The Beast...
The ride on the world's longest wooden roller coaster is worth it, in my opinion, but some people are put off by the 1+ hour wait on the weekends.***** Me, I don't mind if I'm with friends; there's plenty of time to chat and dry off from getting splashed in some of the water rides. (And to be fair, there's plenty of women in bikini tops on a hot Summer day, so a lot of views as well.)
Still, I get where people have places to go and people to see when they're playing WoW, so waiting in line isn't for them.
In WoW, waiting in line isn't for me for another reason. The last time I did that, in Classic WoW Era, the number of random whispers for guild invites was highly annoying. So, it wouldn't be so bad were it not for the crowd itself.
From what I've observed, courtesy of social media and anecdotes, I'm perfectly happy to avoid all that in WoWF. Holding out until Christmas might seem a bit excessive, but it's not like I'm not doing anything at all. I've got toons to level on the Anniversary server, so there's that, and I have some other games to play as well.
*Such as the removal of 4-person Heroic events out in the world in SWTOR or the removal of group quests in a post-Cataclysm WoW. Or the removal of elite mobs entirely.
**For those not in the know, Tarren Mill and Southshore, the Horde and Alliance hubs in Hillsbrad Foothills, have been a traditional spot for PvP in WoW. The Horde players are typically about 5-10 levels lower than the Alliance players, so while there are far more Horde players in the area due to the proximity to The Undercity, they are also cannon fodder for the Alliance players. PvP fights also escalate quickly to where one side invades the other home base, often with max level toons, and wreaks havoc on the area. There were plenty of times when I'd login to WoW and a Horde toon in Tarren Mill, only to find myself almost instantly killed. I learned very quickly to avoid certain spots on the map, such as Tarren Mill and the entirety of Stranglethorn Vale.
***It bears a repeat explanation that I was always confused when I'd do a "/who" on a player and find them in Dalaran, when I knew where Dalaran was in the Old World map and saw a crater whenever I visited the place. It was only when I finally made it to Dalaran as the central hub in Northrend did I fully understand the meaning for the crater: the Mages of Dalaran had used the arcane to basically turn their city into a floating citadel.
****The irony is that Silvermoon is now the main hub (or it was, anyway) for Retail's Midnight expac.
*****If you want to avoid the lines, go midweek during the Summer. Tuesday and Thursday work really well.