The first(?) AI designed mod - "The Heart of Baldur's Gate"

[ahungry]

So, I was playing with OpenAI again - this time exploring the text prompts, and I decided to see what it might come up with for a mod design.

This is the back and forth, and it honestly sounds pretty amazing (although I'm curious if it overlaps with any existing mods, or D&D campaigns):

http://sprunge.us/pzA8N8

High Level Synopsis:

A powerful artifact is discovered under the city of Baldur's Gate - "The Heart of Baldur's Gate".  Rumors say that this artifact is responsible for the protection of Baldur's Gate from evil forces.  The heart is believed to be powerful enough to cast a multitude of spells, from arcane to divine, as well as summon beings, up to and including dragons.  Diviners have inferred that the holder of this artifact (even a peasant) would be more powerful than Jon Irenicus or Bhaal himself (and potentially as strong as Melissan).

A triangular power struggle is occurring - a race to obtain this artifact (currently guarded by The Guardian of the Heart, a sorcerer of immense power and indeterminate origin).

Who will succeed in acquiring it first? 

Horvath and his undead hordes?   He is a powerful necromancer, cursed by an unknown being, to spend eternity in undeath after dabbling in dark arts he had no right to.  He seeks to regain his lost power no matter what the cost.

Viconia (no, not that Viconia), a former cleric, now a powerful sorceress - and her Cult of the Dragon, consisting of evil beings of all races?

Or YOU, the hero of Baldur's Gate, and your new found allies:

• Athar, the noble paladin
• Anari, a wild elf from the woods near Baldur's Gate
• Olrun, a dwarven barbarian
• Zariel, a tiefling thief who grew up on the streets
• The Voice, a mysterious androgynous being, who has been the protector of Baldur's Gate from the shadows for as long as history can recall?

 

Will you get the heart?  Will you keep it or return it? 

A mod featuring AI generated characters, items, banters, and story lines as the guidance for mod direction.

 

 

 

 

 

Edited December 7, 2022 by ahungry

[ahungry]

The giant interaction dump is too much, I put it in a sprunge if anyone cares to view and be amazed at the tech.

The actual output will be parsed/organized by me in the following posts, to be in the form of what might be a coherent mod design.

First I'll break down the heroes/joinable NPCs (all descriptions, stats, ideas, items, banters directly produced by the AI, without interpretation by me).

The images are also produced by AI, by curating the text descriptions into art descriptions for DALL-E (I'll try MidJourney and some others later).

Edited December 4, 2022 by ahungry

[ahungry]

Athar

** Summary
A Paladin of Lawful Good alignment. He would be skilled in the ways of
melee combat and have knowledge of ancient magical arts.

In his mid-thirties.

Athar is a muscular human with short, dark brown hair and hazel
eyes. He has a strong jawline and a noble air about him.

He is a muscular human with an authoritative presence. He stands tall
and proud, his back straight with confidence. His hazel eyes are like
a beacon of justice, a reminder of the chivalrous ideals he holds
dear. His dark brown hair is cropped short and neat, emphasizing his
strong jawline. Athar wears a suit of light plate armor, adorned with
symbols of his faith, and a cloak of azure blue. On his belt hangs a
shining silver longsword, its hilt bearing a crest of a lion rampant.

Athar would have an above-average Strength and Constitution, along
with a high Charisma and Wisdom. He would also have a proficiency in
Religion and Insight.

** Biography
Athar, a curious and helpful warrior of Baldur's Gate who was born
into a noble family. He is knowledgeable and wise, with a great
affinity for the ancient ways of magic and combat. He joined your
quest to obtain the Heart of Baldur's Gate, driven by a sense of
adventure and a desire to protect his home from those who seek to use
its power for ill. Together, you will overcome the dangers of your
journey and ensure the safety of Baldur's Gate.

** Relationships
Athar and Anari are both passionate about protecting Baldur's Gate,
but they often have differing opinions on how to do so. Despite this,
they are friends who share a mutual understanding and respect for each
other. They help each other out in difficult times and are loyal
allies to one another in their shared quest.

Athar and Anari both have families, but neither of them have any
romantic relationships. However, they both care deeply for their
families and are willing to do anything to protect them from harm.

Athar admires Anari for her courage and determination, praising her
for her skill in combat. He respects Olrun's bravery and dedication to
the gods, and admires Zariel's cunning and agility. He views The Voice
with a great deal of reverence, believing they are our best chance at
achieving success in our quest. Athar is grateful to have such
powerful allies by his side.


** Items

- Sword of Justice – A shining blade forged by Athar which increases
  his strength in battle. +2 attack bonus, +1 damage per hit, 2d6
  slashing damage.

– Shield of Honor – A magical shield that grants additional protection
  when defending against attacks. +4 AC bonus, +5 vs physical attacks.

 

 

 

Edited December 7, 2022 by ahungry
New image

[ahungry]

Anari

** Summary
Anari would be a Ranger of Chaotic Good alignment. She is skilled in
the ways of ranged combat and has knowledge of the natural world.

In her late twenties.

Anari is an agile wild elf with waist-length black hair and emerald
green eyes. She has an athletic build and a mischievous glint in her
eye.

She is an agile wild elf with a slender figure and darkly tanned
skin. Her waist-length, jet-black hair is streaked with bright green
highlights, and her captivating emerald green eyes sparkle with
mischief. She often wears a green leather tunic, cinched at the waist
with a belt, and studded leather boots. A quiver of arrows hangs at
her side, and a longbow slung over her shoulder. Anari is fiercely
loyal to her friends, but her headstrong nature often leads her into
dangerous situations.

Anari would have an above-average Strength and Constitution, along
with a high Dexterity and Intelligence. She would also have a
proficiency in Nature, Perception, and Survival.

** Biography
A wild elf from the woods of Baldur's Gate. She is a master archer and
swordsman, as well as a powerful spellcaster. Anari is brave and
fiercely loyal to her friends and allies, and will do whatever it
takes to protect them from harm. She too has joined your quest to
discover the Heart of Baldur's Gate, and together you will face the
many obstacles and challenges that await.

** Relationships
Athar and Anari are both passionate about protecting Baldur's Gate,
but they often have differing opinions on how to do so. Despite this,
they are friends who share a mutual understanding and respect for each
other. They help each other out in difficult times and are loyal
allies to one another in their shared quest.

Athar and Anari both have families, but neither of them have any
romantic relationships. However, they both care deeply for their
families and are willing to do anything to protect them from harm.

Anari deeply respects Athar for his strong sense of justice and
unwavering loyalty. She is impressed by Olrun's strength and courage,
and appreciates Zariel's agile and stealthy skills. She is also in awe
of The Voice's powerful magics and wisdom. Anari is proud to fight
alongside such an impressive group of heroes.

** Items

- Bow of the Wild – A magical bow that grants its wielder an extra
  boost of speed and power in battle. +2 attack bonus, +2 damage per
  hit, 2d6 piercing damage.

– Armor of the Wild – A mystical armor crafted from the hides of wild
  animals, granting its wearer increased agility in battle. +3 AC bonus,
  +2 AC vs ranged attacks.

 

 

 

Edited December 7, 2022 by ahungry

[ahungry]

Olrun

** Summary
Olrun would be a Barbarian of Chaotic Neutral alignment. He is skilled
in the ways of melee combat and has a deep connection with the gods.

In his late twenties.

Olrun is a stout dwarven barbarian with a thick beard, brown eyes, and
a bald head. He has a rugged and weathered look, and his strong arms
are covered with intricate tattoos.

Olrun is a stout dwarven barbarian with a wild, unkempt look. He has a
bald head, a thick brown beard, and deep brown eyes that twinkle with
humor. His strong arms are covered with intricate tattoos depicting
the tales of his adventures. He often wears heavy leather armor, a
belt festooned with axes, and carries a special hammer he crafted
himself. Despite his gruff exterior, Olrun is deeply loyal to his
friends and always ready for a good fight.

Olrun would have an above-average Strength and Constitution, along
with a high Charisma and Intelligence. He would also have a
proficiency in Athletics and Intimidation.


** Biography
The dwarf berserker is named Olrun. He is a fierce
warrior, deeply devoted to the gods of his people, and driven by a
need to prove his strength in battle. Olrun has a penchant for
charging straight into danger, often without much thought or regard
for his own safety. However, his courage and bravery make him an
invaluable ally in difficult situations.

** Relationships
Olrun has a deep admiration for Athar's noble ideals and bravery. He
appreciates Anari's strength and skill in battle, and admires Zariel's
cunning and agility. Olrun also holds The Voice in high esteem,
believing they have a powerful connection with the gods. Olrun is
proud to fight alongside such a talented group of heroes.

** Items

- Hammer of Olrun – A powerful hammer crafted by Olrun for extra
  crushing power in combat. +3 attack bonus, +3 damage per hit, 2d6
  bludgeoning damage.

– Hauberk of Strength – A heavy chainmail hauberk that increases its
  wearer's strength in battle. +4 AC bonus, +1 damage per hit.

 

 

 

Edited December 7, 2022 by ahungry

[ahungry]

Zariel

Summary
Zariel would be a Rogue of Neutral Evil alignment. She is skilled in
the ways of stealth and subterfuge, and is driven by her own personal
gain.

In her early twenties.

Zariel is a tiefling rogue with striking, bright yellow eyes. She has
silver hair that is cut into a bob.

Zariel has a petite frame that is accentuated by her sinuous body
and curves. She has a tattoo of a coiled serpent adorning her left
shoulder. Her skin is a deep reddish brown, with hints of grey in
certain areas. She wears a dark green tunic, tight black leggings, and
leather arm guards. She also wears two daggers on her belt, one with a
golden hilt and the other with an obsidian blade.

Zariel would have an above-average Dexterity and Intelligence, along
with a high Charisma and Wisdom. She would also have a proficiency in
Deception, Stealth, and Sleight of Hand.

** Biography
The tiefling rogue is named Zariel. She is a cunning and skilled
thief, who grew up on the streets of Baldur's Gate. She is incredibly
agile and stealthy, able to slip through almost any situation
undetected. Zariel is driven by a need to prove her worth, and is
willing to do whatever it takes to get the job done.


** Relationships
Zariel sees Athar as a great leader and a brave warrior, respecting
his noble sense of justice. She admires Anari's skill in combat and
acknowledges Olrun's formidable strength. She also views The Voice
with a great deal of awe, appreciating their wisdom and power. Zariel
is proud to be part of such a talented group of heroes.


** Items
- Dagger of Zariel – An enchanted dagger that grants its wielder
  greater agility and accuracy

– Shadow Cloak – A magical cloak that allows its wearer to become
  invisible and pass through shadows undetected

 

 

 

Edited December 7, 2022 by ahungry

[ahungry]

The Voice

** Summary
The Voice would be a Cleric of Lawful Neutral alignment. They are
skilled in the ways of divine magic and have a deep connection to the
gods.

The Voice is ancient and difficult to determine an exact age for.

The Voice is mysterious, but their presence is palpable. They are of
medium stature, wearing a flowing cloak and hood that obscures their
features. However, their piercing blue eyes can be seen underneath the
hood. They have light-colored skin and long, white hair that reaches
to their shoulders. On their back they carry a large staff adorned
with intricate runes and symbols.

The Voice's gender is unknown and they do not seem to identify
with any specific gender. They are very mysterious in that regard and
it is unclear if they have any particular gender preference or
identity.

The Voice speaks in a deep, calming yet authoritative tone. They
use a mix of vocalization and mannerisms to get their point across,
emphasizing certain words and phrases. They speak with a melodic
cadence, like they're singing rather than speaking. Their voice is
soothing and captivating, as if they were born to weave stories with
just their voice.

The Voice would have an above-average Wisdom and Charisma, along with
a high Constitution and Intelligence. They would also have a
proficiency in Religion and Medicine.

** Biography
The mysterious cleric is known only as The Voice. Little is known
about them, except that they have a great and powerful connection to
the gods. They are enigmatic and wise, offering guidance and advice to
those who seek it. It is said that The Voice can be found in the
darkest corners of Baldur's Gate, where they protect the city from its
enemies.


** Relationships
The Voice holds each of their teammates in high regard, believing that
all of them have their own unique strengths and talents. They view
Athar as a valiant leader, Anari as a skilled warrior, Olrun as a
valiant fighter, and Zariel as a shrewd and agile rogue. The Voice is
proud to be part of such a powerful and capable group of heroes.


** Items
- Ring of The Voice – A powerful ring forged by The Voice which grants
  its wearer increased mental power. +3 Intelligence, +2 Willpower.

- The Staff of The Voice grants its wielder additional power
  when casting spells. It also allows the user to channel divine
  energy more effectively, granting +2 to spell DCs and +1 damage per
  hit when spellcasting.

- Robes of the Canon - A set of magical robes that grant its wearer
  increased power when casting spells. +2 AC bonus, +2 to spell DCs
  and +1 damage per hit while spellcasting.
 

 

 

 

Edited December 7, 2022 by ahungry

[Endarire]

I'm glad we're getting something more comprehensible than this.

[ahungry]

6 minutes ago, Endarire said:

I'm glad we're getting something more comprehensible than this.

[polytope]

I'm interested in the possibility of AI generated art to make new large area images that could be cut up into tilesets for instance, as map creation is otherwise notoriously slow in these games (hence both designers and modders reusing quite a few indoor areas).

About the text itself, I can see a few clues that it was written by an AI, not a person.

Firstly, the game mechanical descriptions of the items:

Shield of Honor – A magical shield that grants additional protection
  when defending against attacks. +4 AC bonus, +5 vs physical attacks.

Technically, it could give different AC against touch attacks vs straightforward melee/missile attacks but generally speaking AC is always a protection against physical attacks, something which I'm not sure the AI has picked up on.

Also, it seems to think weapons should all do 2d6 damage (the bow, the hammer and the sword all do).

Robes of the Canon - A set of magical robes that grant its wearer
  increased power when casting spells. +2 AC bonus, +2 to spell DCs
  and +1 damage per hit while spellcasting.

Per hit when spellcasting? Again, could be touch attacks, but it seems wrong and the AI is using 5th edition (or at least post 2nd edition) terminology like DCs and willpower, the latter being forgivable I guess because it's the default assumption these days.

Moving on to the characters:

Athar admires Anari for her courage and determination, praising her
for her skill in combat. He respects Olrun's bravery and dedication to
the gods, and admires Zariel's cunning and agility.

Zariel sees Athar as a great leader and a brave warrior, respecting
his noble sense of justice.

A paladin admiring a neutral evil rogue's cunning? Or the latter respecting his sense of justice?

The Voice speaks in a deep, calming yet authoritative tone. They
use a mix of vocalization and mannerisms to get their point across,
emphasizing certain words and phrases. They speak with a melodic
cadence, like they're singing rather than speaking.

Singing authoritatively doesn't sound right. The ranger Anari is also described as a "powerful spellcaster", which rangers aren't... indeed if this is supposed to happen around Baldur's Gate, they probably aren't spellcasters at all yet.

Apart from that, some small stuff which human authors also do: OpenAI rehashed description texts a few times i.e. The Voice is "skilled in the ways of divine magic and have a deep connection to the gods" whereas Olrun is "skilled in the ways of melee combat and has a deep connection with the gods." Zariel is described as having two unusual daggers, but only stats for one... meh, as I say small mistakes which a human writer without an editor might also make.

Edited December 4, 2022 by polytope

[ahungry]

Unfortunately, the python code gen is not adequate to produce weidu mods (I tried, it got stuck in a python import loop for the suggestion code to write the most simple weidu tp2 file generator ) - which means if I work hard to see this come to fruition, it's going to require hand tuning a few things.

However, I think using the guiding principle of, "What does the AI say the character would do in XYZ scenario" will prove a lot more interesting than just taking artistic liberty with it (at least, until the point I get too fond of the characters perhaps).

Updating the images with some Midjourney ones now - I'm liking it better than dall-e, although the images are a bit too hyper realistic (thanks to my prompts) - but I can apply filters to cartoonize/artify them from a realistic POV, vs vice-versa.

[ahungry]

I tried generating some AI tilesets - either I have no idea the keywords to use, or it's incapable of grokking the concept of tiling and what that would require.

On the mod itself, I think the AI was a great boon to get the creative juices flowing - at this point, I've got the 5 characters developed (sprites, custom items, soundsets, theme songs), as well as rudimentary dialogue from the Branwen NPC project/guide.

Now onto the real work (integrating these characters into the world).

I will say, having the portraits + voices really makes them feel alive and incentivizes me on this effort.

[Endarire]

As an aside, how did you get the AI pictures?  I've tried various AI art sites and none could grasp the concept of a happy male human knight with his face uncovered and wearing a mustache.

[polytope]

On 12/7/2022 at 2:23 PM, ahungry said:

I tried generating some AI tilesets - either I have no idea the keywords to use, or it's incapable of grokking the concept of tiling and what that would require.

If you can get the AI to generate a decent large landscape image in isometric perspective it should be easy enough to chop it up into a tileset (so long as it doesn't involve water and static animations, that's fiddly). The searchmap, lightmap and heightmap .bmp files aren't too difficult to draw by hand once you've got an idea of the area layout, it's the detail of the background image that really slows map creation.

The difficulty is getting the AI to make something both isometric and navigable, I may try sometime this holiday season.

(These images aren't mine, these're from Nightcafe authors)

 

There's also obviously a problem with scale of structures like doors and storied buildings vs the in game character avatars.

 

Edited December 8, 2022 by polytope

[ahungry]

Just made a blog post/week review: https://ahungry.com/blog/2022-12-10-Creative-AI-and-Baldurs-Gate-Modding.html