telophase: (Default)
telophase ([personal profile] telophase) wrote2022-07-14 09:55 am

Midjourney!

I believe Midjourney might be based on DALL-E2, or a subset derived from it... [edit: someone in a conversation elsewhere says that they think it's not DALL-E2 as researchers for that aren't allowed to show much of what they do with it. They think it's from an independent lab.] ...but they're not particularly forthcoming about it. It works wonderfully on art prompts, not so much on ones that force it to pull from photographic-based stuff. I admit I almost exclusively add "artstation" to my prompts because it gives me concept art type images, so I haven't explored too much beyond that. The FAQ says to try different artist names or combining different artist names, so I think Midjourney may be a DALL-E2 variant specifically fine-tuned on artworks.

It is also BLINDINGLY FAST, in that it will give me 4 variants of my prompt in less than a minute, and I can get it to do more variants or to upscale one of the variants, and that also takes only a minute or two.

As far as the art it produces:

Yesterday I got this (prompt: a woman historian of magic. artstation.):



If I type "scholar of magic" I get what I think of as "variants on Sirius Black"...



and "woman scholar of magic" has a distinct whiff of Hermione (and whatshername from Wheel of Time)...



...but using "historian" instead of "scholar" got me the above image, which I adore and want to make into a painting. I love how her clothing is reminiscent of books.

And this a couple of days ago, "assassin of jade sorceries. artstation." courtesy of my Epic Fantasy Title Generator (I'm using this and several similar ones to come up with a painting, actually!):



As well as this ("Someone in a powerful secret society and an assassin enter a teahouse in a great city. artstation." - that one came from my Yoon Ha Lee random prompts generator, the "Yoonifier")




Adding to my Fine-Tuned On Artworks hypothesis, if I try to get it to give me necromancers and cavaliers mixed up with Caravaggio's The Cardsharps (which is held by a local museum so I have seen it in person multiple times and adore) by asking for Harrowhark Nonagesimus and Gideon Nav, it ignores Harrow and Gideon.

"caravaggio's the cardsharps with women gideon nav and harrowhark nonagesimus from the locked tomb trilogy. blue and black background. artstation"

It picked up on the blue I asked for, and when you put Caravaggio, blue, and women together in a painting, what you get is is reminiscent of the Virgin Mary.



But if I ask it for "caravaggio's the cardsharps science fiction. trending on artstation" it gives me someone reminiscent of Oscar Isaacs as Duke Leto in a nifty picture:




I found Midjourney via Rachel Bradley's YouTube video in which she used it to generate a bunch of variants that she turned into a painting: https://www.youtube.com/watch?v=AaL83Ab7CtQ

Post a comment in response:

This account has disabled anonymous posting.
(will be screened if not validated)
If you don't have an account you can create one now.
HTML doesn't work in the subject.
More info about formatting