GenAI hot takes and bad use cases

GenAI hot takes and bad use cases

Released Monday, 24th February 2025
Good episode? Give it some love!
GenAI hot takes and bad use cases

GenAI hot takes and bad use cases

GenAI hot takes and bad use cases

GenAI hot takes and bad use cases

Monday, 24th February 2025
Good episode? Give it some love!
Rate Episode

Episode Transcript

Transcripts are displayed as originally observed. Some content, including advertisements may have changed.

Use Ctrl + F to search

0:03

Welcome to Practical AI,

0:06

the podcast that makes artificial intelligence

0:08

practical, productive, and accessible to all.

0:10

If you like this show, you

0:12

will love The Change Log. It's

0:14

news on Mondays, deep technical interviews

0:16

on Wednesdays, and on Fridays, an

0:18

awesome talk show for your weekend

0:20

enjoyment. Find us by searching for

0:23

The Change Log wherever you get

0:25

your podcasts. Thanks to our

0:27

partners at fly .io. Launch your

0:29

AI apps in five minutes or

0:31

less. Learn how at fly .io. Welcome

0:45

to another fully connected episode

0:47

of the Practical AI

0:49

podcast. In these episodes

0:51

where it's just Chris and I,

0:53

no guest. We try to keep

0:55

you updated with some of the

0:57

things happening in the AI world.

0:59

Talk through some things that might

1:01

help you level up your machine

1:03

learning and AI game. So excited

1:05

to dig in with you today,

1:07

Chris. I'm joined as always by

1:09

my co -host Chris Benson, who is

1:11

a principal AI research engineer at

1:13

Lockheed Martin. And I'm Daniel Weitnach,

1:16

CEO of Prediction Guard. How

1:18

you doing, Chris? I'm doing good. I'm

1:21

looking forward to our conversation today.

1:23

It's a snowy day in Georgia and

1:25

we can talk a little generative

1:28

AI and talk about you wouldn't want

1:30

to use it it

1:32

was snowing in Georgia, that kind of

1:34

thing. In the theme of coldness

1:36

on today, which is also cold where

1:38

I'm at, talk about the cold side

1:40

of Gen AI or

1:42

actually what we had

1:44

talked about thinking through

1:46

where the bad use

1:48

cases for Gen AI or where

1:51

you shouldn't use Gen AI, five

1:53

or more bad use cases. Yeah.

1:55

And you know, the funny thing about it

1:57

is this is a topic that we have casually

1:59

talked about a whole bunch of times. And

2:01

we had not previously said, let's make it

2:03

an episode. But you know, one of

2:05

the, one of our, I think it may

2:07

be a little bit of a pet

2:10

peeve for not only us, but other people

2:12

I talked to in the AI space

2:14

is there are so many, you know, we're,

2:16

you know, huge hype within Gen AI

2:18

and people just want to use it for

2:20

everything that there could possibly be an

2:22

AI application for. And,

2:24

you know, there's so many places where

2:26

it doesn't necessarily produce the best

2:29

outcome for you. And we talk about

2:31

this casually all the time. So

2:33

glad that we're actually doing this in

2:35

the show today. Yeah, I

2:37

was creating some docs for

2:39

a customer of ours and

2:41

some training materials and I

2:43

have this section just labeled.

2:46

Here be dragons. So

2:49

yeah, there might be some hot takes

2:51

in here. I'm interested to hear what

2:53

your takes are. My first

2:56

one, so number one, bad

2:58

use of Gen AI or

3:00

maybe one that you want to

3:02

avoid at least for now

3:04

is maybe a hot take, but

3:06

I would say from my

3:08

perspective, completely autonomous agents of any

3:11

type are currently, you

3:13

know, well, who knows how

3:15

long this will be the case,

3:17

but currently and for some time,

3:19

generally a source of sadness for

3:22

people when they try to create

3:24

them. So what I mean by

3:26

autonomous agent would be an agent

3:28

or an automation that has no

3:30

human in the loop, just sort

3:32

of is running in the background

3:35

and you kind of hope that

3:37

it Does something for you so

3:39

it could be on the sales

3:41

side right? Oh, I'm gonna have

3:43

an agent do my whole sales

3:45

process for me and I'm just

3:48

gonna kind of sit back and

3:50

work on my product and the

3:52

agent's gonna make all of the

3:54

the sales for me or maybe

3:56

it's you know some sort of

3:58

internal admin process that you're automating

4:01

or You know even all the

4:03

way you know, into manufacturing with

4:05

automation and in planters, you know,

4:07

more industrial case, whatever you're thinking

4:09

of. My first one is completely

4:11

autonomous agents. What's your what's your

4:13

thought, Chris? Not only do I

4:16

think that's right. I'm smiling in

4:18

a big way because I'm going

4:20

to throw in something from the

4:22

side just to support that. Apparently,

4:24

there is a new show on

4:26

Netflix and I just read about

4:29

it last night. Netflix AI

4:31

is tough for me. And

4:33

the show is called Cassandra. And

4:35

it's about this. It's like a home

4:37

assistant robot, you know, with agency

4:39

in terms of doing lots of tasks,

4:41

but it goes apparently I have

4:43

not seen the show yet because I

4:46

just heard about it. But apparently

4:48

it gets very, very dark. And I'm

4:50

just like, when you're talking about

4:52

that just now, you know, in more

4:54

of a real world scenario, obviously, it

4:56

made me think of that. And

4:58

so, yeah, I agree. A completely

5:00

autonomous agent in this day and

5:02

age. with no guardrails around it,

5:04

and you're just saying, go at

5:06

it, generative AI, especially

5:09

if it's dealing with

5:11

anything that has any sort

5:13

of sensitivity or requires

5:15

a little bit of thoughtfulness

5:17

to it. Yeah, not

5:20

going there. Yeah. Well,

5:22

and I think even beyond the

5:24

kind of security privacy related things,

5:26

A lot of times I

5:28

just see people trying to do

5:30

this and it just doesn't really

5:32

work that well. Early days. Early

5:34

days. Yeah, it's early days. So

5:36

like when you have, and

5:39

for those that maybe have

5:41

or haven't listened to previous

5:43

episodes, when we're talking about

5:45

an agent, we mean you

5:47

give a task to some

5:49

sort of system. it

5:51

has the ability then to

5:53

generate queries maybe into other systems

5:55

like APIs or databases or

5:57

data stores or other things to

5:59

accomplish a certain task. And

6:02

it kind of loops over that

6:04

task until it reaches an objective, right?

6:07

And in the autonomous, fully kind of

6:09

autonomous case, you would

6:11

have, you know, just using

6:14

the sales example, because it's easy,

6:16

you know. you want an agent

6:18

to decide how to find

6:20

prospects for you on linkedin and

6:23

then you want to gather

6:25

a dossier about all of those

6:27

prospects and then you want

6:29

to initiate the contact and then

6:31

you want to pull off

6:33

some type of demo or call

6:35

and then you want to

6:37

close the deal and do the

6:39

contract arrangement right and just

6:41

sort of like determine how to

6:44

do every step of that

6:46

process basically relate. replacing a human

6:48

in their agency with the

6:50

autonomous agent. Now, I

6:52

think in that case, we

6:54

could say certain portions

6:56

of that can be very

6:59

interestingly addressed with AI

7:01

functionality. So doing the prospecting,

7:03

generating the dossiers, right? I

7:06

would consider those good use

7:08

cases if they're tied to a

7:11

you know maybe a sales professional

7:13

that's deciding how and when to

7:15

do those things in the imagination

7:17

it would be great to think

7:19

of just kind of letting that

7:21

run in the background and you

7:23

getting sales all the time but. It

7:26

just doesn't really work very well. There's

7:28

a lot of fragility in that type

7:30

of system when there's a lot of

7:32

that determination of objectives and determining how

7:34

to interact with systems and all of

7:37

these things that produces a lot of

7:39

errors, a lot of fragility. It's

7:41

much, much more productive, at

7:43

least currently for you to

7:45

have a tool that can

7:47

help your sales professionals. prospect

7:50

or a tool that can help

7:52

them create these dossiers and that

7:54

sort of thing. And

7:56

certainly tie in AI to that,

7:58

but not kind of this end -to

8:00

-end, completely autonomous

8:02

automation. I totally agree with

8:04

you. And I certainly, by the way,

8:06

just as a clarification from what I

8:08

said earlier, I was not meaning to

8:11

imply agents would typically have a robotic

8:13

body. Should I have confused anybody? There's

8:15

a lot of people exploring that. There

8:17

are. There are. just

8:19

one of the things to note in

8:22

terms of, you know, we're in this,

8:24

the rise of agents right now, it's

8:26

the hottest thing out there. But there

8:28

are, you know, it's interesting, there are

8:30

a lot of guardrail mechanisms that are

8:32

out there. I know in the industry

8:34

I work in and defense, there

8:36

are especially in things like you know, weapon

8:38

systems and stuff like that. The DOD has

8:41

guardrails around such things. So if you're listening

8:43

and aren't familiar with that, but are a

8:45

little bit worried about the world, it's,

8:47

fortunately, there are people thinking

8:49

along these lines. Yeah, and there

8:51

are, I would say, useful

8:53

agents at this. point, just not

8:56

kind of in that fully

8:58

autonomous kind of setting. So AI

9:00

systems that can connect to

9:02

multiple things and maybe are used,

9:04

triggered by a human to

9:06

do certain things, those are the

9:08

most successful that I've seen.

9:10

Absolutely. Number two from

9:12

me, Chris, so we've

9:15

got autonomous agents. Number

9:17

two for me was

9:19

time series forecasting or

9:21

really any sort of

9:23

prediction mechanism. Whether

9:25

that's predicting future

9:27

stock prices or

9:29

reasoning over series

9:31

of data, making

9:34

predictions, there's some

9:36

level of prediction that these

9:38

models can do somewhat well

9:41

in terms of maybe it's

9:43

things like general text classification.

9:47

Is this message spam or not spam

9:49

and you can give some examples

9:51

and you could get some reasonable output

9:53

from a model like that. That's

9:55

why I kind of honed in on

9:57

time series forecasting specifically because at

9:59

least far as I know, and I

10:01

know that there's research in this

10:03

area kind of using transformer models for

10:05

time series forecasting. But when

10:07

I think of Gen AI, I

10:09

think of I'm going to log

10:11

into chat GPT or I'm going

10:13

to use deep seek or one

10:15

of these models and. you know,

10:17

if you paste in a bunch

10:19

of time series data and try

10:21

to create a forecast just with

10:23

the gen AI model and nothing

10:26

else, then I think that's going

10:28

to end again in sadness for

10:30

you. It's not going to work

10:32

so well. Yeah, I think so.

10:34

I actually had that on my

10:36

list too in the form of

10:38

high stakes financial trading. High stakes

10:40

financial trading. Where do you want

10:42

to put your million dollars today

10:44

and see where it goes? Maybe

10:46

explore some of the possibilities

10:48

there, but I don't think I

10:51

would leave it to an

10:53

agent to forecast or make that

10:55

prediction on its own. Yeah,

10:57

I think people have shown basically

10:59

that these models definitely

11:01

don't have the kind

11:03

of world understanding, real world

11:05

grounding to make certain

11:08

reasoning or take certain steps

11:10

in reasoning to make

11:12

reasonable predictions, but also they're

11:14

really bad, generally really

11:17

bad with numbers. You

11:20

may be able to, even with a

11:22

vision model, paste in a graph of

11:24

a time series and say, what month

11:26

was my highest sales if it's a

11:28

graph of sales? A vision

11:31

model could reasonably return that

11:33

value to you. But then if

11:35

you say, well, now model

11:37

out my sales for the next

11:39

four quarters or something like

11:41

that, I think generally that's

11:43

not going to work so well.

11:45

I guess you could argue that. a

11:49

model could generate

11:51

code that might

11:53

use packages, forecasting

11:55

packages to actually

11:57

make a reasonable

11:59

forecast over certain

12:01

data. Then my

12:04

general question then would be, well,

12:06

that might be useful to generate your

12:08

code to do it, but really

12:10

it's not gen AI that's doing that.

12:12

It's the stats models in Python

12:14

or - That's right. profit

12:18

from from meta and that sort

12:20

of thing. Yeah, I mean in

12:22

just in case that confuses anyone,

12:24

you know, there's the generative AI

12:26

portion, you know, which can, you

12:28

know, is trained on a general

12:30

data set. And then there's these

12:32

models that it might be generating

12:34

code to access, which are designed

12:36

specifically for that function. So those

12:38

are two different things. Yeah, the

12:40

code that ends up being executed

12:42

is not having anything to do

12:44

with JANAI, basically. Yeah,

12:46

and maybe it would be worth highlighting in

12:48

each of these cases that we talk about,

12:50

Chris, some interesting tooling for

12:52

some of these things. You know,

12:54

in the autonomous agents case, certainly

12:56

workflows and automations can be created

12:59

and executed. You know, we had

13:01

Prefect on the show, which is

13:03

a workflow orchestrator that can be

13:05

monitored and handle retries and all

13:07

of that. That's a great thing

13:09

if you're looking at kind of

13:11

workflows and orchestration. Time

13:13

series forecasting. GoTo

13:16

has usually been Facebook

13:18

or Meta's profit package, which

13:21

makes certain things pretty easy,

13:23

but there's also many choices for

13:25

that as well. So take

13:27

a look through those things if

13:29

you're interested in the non -GenAI

13:31

side. Well

13:43

friends, AI is transforming how we

13:45

do business, but we need AI

13:47

solutions that are not only ambitious,

13:49

but practical and adaptable to. That's

13:51

where Domo's AI and data products

13:53

platform comes into play. It's built

13:55

for the challenges of today's AI

13:57

landscape. With Domo, you and your

13:59

team can channel AI and data

14:01

into innovative uses that deliver measurable

14:03

impact. While many companies focus on

14:06

near applications or single model solutions,

14:08

Domo's all -in -one platform is more

14:10

robust with trustworthy AI results

14:13

without having to overhaul your entire

14:15

data infrastructure, secure

14:17

AI agents that connect, prepare

14:19

and automate your workflows, helping

14:21

you and your team to gain

14:23

insights, receive alerts and act with ease

14:25

through guided apps tailored to your

14:27

role and the flexibility to choose which

14:29

AI models you want to use. So

14:32

DOMO goes beyond productivity. It's designed

14:34

to transform your processes, helping you

14:36

make smarter and faster decisions that

14:38

drive real growth. And it's all powered

14:40

by DOMO's trust, flexibility, and

14:42

years of expertise in data

14:44

and AI innovation. And

14:46

of course, the best companies rely on DOMO

14:48

to make smarter decisions. See how DOMO can

14:50

unlock your data's full potential. Learn

14:52

more at

14:55

ai .domo.com.

14:57

That's ai .domo.com.

15:04

All right, Chris, on to

15:06

number three. My third

15:08

one was do not

15:10

use Gen AI to do

15:12

complete code rewrites or

15:15

the complete development of your

15:17

applications, your software

15:19

applications. Thoughts? Oh,

15:21

I've tried that just playing

15:23

around. And I definitely

15:25

don't think that that's ready for

15:27

prime time, despite the fact that,

15:29

you know, as we sit here

15:32

and say this, there have been

15:34

quite a few CEO luminaries out

15:36

there who have been advocating that

15:38

over the last year or so. And

15:41

when I sit down

15:43

and try to do that,

15:45

I get varying results. And

15:48

it depends largely on how

15:50

mainstream a language is, for instance, on

15:53

how good it is. But

15:55

I haven't gotten anything that I

15:57

would say is a production

15:59

grade program fully functional through nothing

16:01

but generative AI, just toy

16:03

programs. Yes, without interaction. Right.

16:06

Right. Yeah. I

16:08

know this is advancing quickly,

16:10

so who knows how... this conversation

16:12

will be in a few

16:14

months, but I think we've been

16:16

talking about this for for

16:18

some time now and we've seen

16:20

things like Devin and cursor

16:22

and these sorts of things come

16:24

out which are pretty amazing

16:26

and Do a lot of really

16:28

interesting things but often don't

16:30

kind of provide that full, like

16:33

I'm going to prompt and

16:35

get a software application out of

16:37

it. There is, there's more

16:39

to it than that. So I

16:41

think sometimes people are maybe

16:43

a bit disillusioned and, you know,

16:45

a better way to think

16:48

about this or there are

16:50

amazing kind of agents and

16:52

toolings come out like the

16:54

Devin cursor, all hands, windsurf,

16:56

et cetera, that can provide

16:58

a huge acceleration. in

17:00

your code development, I

17:02

think, if you treat them

17:04

like code assistants and,

17:07

you know, maybe even junior

17:09

developers that you are

17:11

pairing with, right? So

17:13

it's not so much that I'm just

17:15

now a not complete non developer,

17:17

right? I have no technical skills and

17:19

I just say I want this

17:21

application. And it is generated for

17:24

me. That's really what I'm meaning when

17:26

I say kind of complete app development.

17:28

So, Gen AI, from my

17:30

perspective, is not capable of

17:32

that right now, or you should

17:34

not rely on it for

17:36

that right now. There may be

17:38

interesting demos and cases where

17:40

some form of that is shown,

17:42

but for the most part,

17:44

I think thinking of the technology

17:46

integrated into your code and

17:48

programming as an assistant. even

17:50

a highly functioning agent that

17:53

you compare with is a

17:55

good model. Maybe

17:58

it's a specialization of the

18:00

autonomous agent thing that I

18:02

mentioned before. I think you're

18:04

making really good points in

18:06

that. You can't just toss

18:08

it over the wall and

18:10

just say, here's an instruction,

18:13

do it all, and generate

18:15

kind of a complex set of

18:17

programs and stuff. I have

18:20

done tasking, small things very successfully,

18:22

but the scope of what

18:24

they were addressing was constrained. And

18:27

I think we are there for

18:29

things like that and doing small

18:31

bits, it's not uncommon for me

18:33

to generate. Many years

18:35

ago, I would write a VBA

18:37

code, Visual Basic for Applications for

18:39

Microsoft stuff. I don't much anymore,

18:42

and so now I can do

18:44

something like that if I happen

18:46

to be working for something in

18:48

office to do something, put something

18:50

together at work. But when

18:52

I'm actually coding up a large

18:55

project, it's very helpful to have different

18:57

tools on this, but I've not

18:59

found one yet that I was able

19:01

to discussfully do a significant coding

19:03

effort by itself, just tossing it over

19:05

the wall. So I agree with

19:07

you completely. It will be interesting to

19:09

see where we are a year

19:11

from now, two years from now. Yeah,

19:14

well, definitely, I would encourage people

19:16

to check out things like Windsurf and

19:18

Devon and all hands and cursor

19:20

and all of these things. Super cool.

19:22

Try them out. But

19:24

don't expect that if you're not

19:26

a programmer or have at

19:28

least some minimal level of skill

19:30

that you're going to create

19:32

a huge application or project with

19:34

all of its intricacies and

19:36

have that work and scale well.

19:38

Fair enough. All right, Chris, what

19:41

are we on? Number four for

19:43

me on the list of

19:45

don't do this with Gen

19:47

AI or bad Gen AI

19:49

use cases for me is

19:52

anything extremely high throughput load

19:54

latency. So of

19:56

course, small models and

19:58

very high throughput advances

20:00

have taken place with

20:02

Gen AI models, but

20:04

still, you know, if

20:06

you're doing quality assessment

20:08

of products coming

20:10

off of a actual scaled

20:12

up manufacturing line where

20:14

you have to do maybe

20:17

the assessment of each

20:19

of those products in a

20:21

fraction of a second. Really,

20:24

you don't want to

20:26

be reasoning over that data

20:28

with a Gen AI

20:30

model and take 10 seconds

20:32

to generate your quality

20:34

assessment for the product. It's

20:36

just not feasible. I

20:38

would agree with that. And I actually have a

20:40

subset that I'll throw in on that that

20:42

I think kind of fits in there, which would

20:44

be kind of like real time. applications

20:47

with critical outcomes. a

20:50

great way to phrase it. I think

20:52

that that's an area that you

20:54

may have generative AI as a

20:56

component in that mix, but you're

20:58

going to have to have some

21:00

guard grills around it, and you're

21:02

going to have to have some

21:05

specialized models to keep things on

21:07

track because in a real -time app

21:09

where things matter on the tail

21:11

end, great to

21:13

use, but you don't want to rely entirely on

21:15

that when it goes off the rails. You need some

21:17

way to catch it that doesn't take any time. I

21:20

think you make a couple great

21:22

points. Part of it is around the

21:24

latency, which I highlighted. These

21:26

models just don't operate fast enough,

21:28

and they don't operate in the

21:30

types of environments necessarily that you

21:32

need them to operate in for

21:34

these type of maybe edge use

21:36

cases as well in many cases. But

21:40

also, these models perform

21:42

or they do what they are

21:45

supposed to do most of the time,

21:47

right? But still, if

21:49

you train a computer vision

21:51

model, for example, to

21:53

do that manufacturing task, that

21:56

could run on CPU extremely

21:58

high throughput and have a

22:00

much higher accuracy than any

22:02

generalized vision model out there,

22:04

even that would need a

22:06

GPU to run, right? I

22:08

agree with that. Yeah, so

22:10

it's just not, what is

22:13

that, the separation between those

22:15

two cases is still just

22:17

really, really high in terms

22:19

of those kind of use

22:21

cases merging. Now,

22:23

I do think that in

22:25

a manufacturing scenario, right, there's

22:28

a great, or any of

22:30

these sort of other cases that you

22:32

might think of high throughput, critical

22:35

type of scenarios, JNAI is very useful.

22:37

maybe just not for that

22:39

high throughput load latency piece,

22:42

but certainly for staff at

22:44

the manufacturing facility that want

22:46

to look at and analyze

22:48

the data coming off of

22:50

the quality assessment system and

22:52

ask questions about, hey, I

22:55

see this alert, pull this

22:57

data for me to help me

22:59

understand what's going on. Or

23:01

are there any of these types of

23:03

events that have happened in the

23:05

past X time? And that query level

23:07

side via natural language can be

23:09

very powerful. for example, and there's many

23:11

other things that you could do

23:13

in those scenarios. I'll

23:16

extend this just a little bit.

23:19

As you know, my personal

23:21

passion is in autonomous platforms,

23:23

especially at massive scale, swarming,

23:25

things like that. When

23:28

you talk about that, one

23:30

of the areas where I think JNAI

23:32

does play is exactly the equivalent

23:34

of what you just said on the

23:36

manufacturing. That's having a human in

23:38

the loop or on the loop that's

23:40

able to interact and so you're

23:42

using Gen AI to actually be able

23:44

to enhance the communication between the

23:46

human who is in control or on

23:48

the loop and able to step

23:50

in and not but but not so

23:52

much in the other areas especially

23:54

considering that when you have lots of

23:56

vehicles and this could apply for

23:58

lots of different use cases both in

24:00

the commercial space and the military

24:02

space where you have a lot of

24:04

different platforms or vehicles in communication,

24:06

which requires high throughput. But yeah, I

24:08

think that the only space there

24:11

that is a big one is in

24:13

those interactions with the humans that

24:15

are involved in that for safety. Yeah,

24:17

for sure. Well, I have

24:19

one more, Chris. A last interesting

24:21

bad use case for Gen AI.

24:24

The one on my list

24:27

was anything outside of

24:29

the major languages of

24:31

the world. So anything

24:33

with any sort of linguistic

24:35

diversity or cultural diversity,

24:37

essentially the models of the

24:39

modern gen AI era

24:41

maybe work well in the

24:43

kind of top five

24:45

to 10 languages of the

24:47

world. But there's 7000

24:49

spoken languages in the world,

24:51

which means they basically

24:53

don't work for any of

24:55

the languages of the

24:57

world except for a couple.

25:00

Moreover, the

25:02

kind of cultural context

25:05

of the models is

25:07

driven by mostly what

25:09

has been gathered either

25:11

from the internet or

25:13

by Western tech companies, maybe

25:16

Chinese tech companies.

25:19

But there's certainly a

25:21

bias against certain cultural

25:24

context and languages and

25:26

you know, even if you

25:28

think about vision or

25:30

video models, I'm sure the

25:32

same is true, right?

25:34

Because just certain things aren't

25:36

represented there. So the

25:38

reality is that it would

25:40

be great if you

25:42

could, you know, land anywhere

25:44

in the world and

25:46

change your chat GPT or

25:48

whatever to help you

25:50

interact in X country in

25:52

Africa or Y country

25:54

in Asia and have that

25:56

work really well with

25:58

whatever languages you might encounter.

26:01

But I would say generally that's

26:03

not the case as of now.

26:05

I think so. I know

26:07

you haven't mentioned it yourself, but

26:09

longtime listeners who have been with

26:12

us for years will know that

26:14

you used to be in that

26:16

space in a former professional life

26:18

and know quite a bit about

26:20

this topic that you've just brought

26:22

up. I

26:24

agree. I don't

26:27

think that's changed substantially over

26:29

the last few years. Yeah,

26:31

and even simple things that don't have

26:33

a lot to do with, I mean,

26:36

it has to do with Gen AI,

26:38

but also has to do with the

26:40

tooling around it, right? In terms of

26:42

even other scripts in particular Arabic, you

26:44

know, for example, which of

26:46

course is a major language

26:48

of the world, which to

26:50

some degrees, you know, models

26:52

can do reasonably well at

26:54

at least some models. The

26:57

tooling around the Gen AI

26:59

ecosystem, right? Like, oh, I

27:01

want to download this chat.

27:03

SDK or this UI that

27:05

I can plug in a

27:07

custom model to is likely

27:09

not going to support kind

27:11

of right to left. Potentially,

27:13

there's going to be some

27:15

issues with the script and

27:18

other things. It's just another

27:20

highlight of this disparity that

27:22

exists. It exists and I

27:24

think is worth highlighting because mostly what

27:26

we're talking about here is language models. Really

27:29

language models that support a

27:31

very small amount of the languages

27:33

on on the planet. Yeah,

27:35

yeah But that's what I had

27:38

Chris any thoughts after going

27:40

through through the list of bad

27:42

I think you know there

27:44

I do have a few thoughts

27:46

there. I think one of

27:48

the things that I've noticed there

27:50

is that There are

27:52

kind of high risk and

27:54

high and like where you

27:56

have significant outcomes that can

27:58

affect people in a major

28:00

way and whether it be

28:02

financial or manufacturing or Yeah,

28:04

my industry would defense or

28:06

whatever, you know, you don't

28:08

want to put a general a

28:11

general generative AI model in charge

28:13

of doing things for which there

28:15

are no guard grills. I think

28:17

that that is a thing that

28:19

I have noticed across a lot,

28:21

and I could throw out a

28:23

couple of other areas where I

28:25

think that applies, like things like

28:27

high -stakes legal advice. Do

28:29

you have a great tooling within

28:31

things like chat, GBT, and the other

28:33

big language models for legal advice? Yeah,

28:36

but would you really want to you

28:39

know, literally put your life

28:41

savings at risk with things like

28:43

that, maybe not today at

28:45

least. You see a lot of

28:47

this, you see a lot

28:49

of AI pervading medical diagnosis. And

28:52

once again, I think there's a

28:54

very good use for those, but

28:56

probably not by itself, you know,

28:58

in isolation. So any of these

29:01

areas where you have a substantial

29:03

risk in the outcome in terms

29:05

of good and bad, You

29:07

probably want to have guardrails around it

29:09

across many, many different industries. And that's, I

29:11

think that's my takeaway. And, you

29:13

know, I think that things are continuing to

29:15

improve at a really, really rapid pace. And

29:17

we've said things and had, you know, two

29:19

months later, had the world change out from

29:21

under us. And that may happen again here

29:23

with some of these. But yeah, it's, we're

29:26

on the learning curve with these things and

29:28

they're getting better, but they're not all the

29:30

way there yet. Yeah. I think that's a

29:32

great way to summarize, Chris. Thanks

29:34

for chatting through the things with

29:36

me and we'll look forward to carrying

29:38

on the conversation very soon with

29:40

you. Sounds good. All

29:46

right, that is our

29:48

show for this week.

29:50

If you haven't checked

29:52

out our changelog newsletter,

29:55

head to changelog.com slash

29:57

news. There you'll find

29:59

29 reasons, yes, 29

30:01

reasons why you should

30:03

subscribe. I'll tell you reason

30:05

17, you might actually start

30:07

looking forward to Mondays. Sounds like

30:09

somebody's a case of the Mundus.

30:12

28 more reasons are waiting for

30:14

you at .com slash news.

30:16

Thanks again to our partners

30:18

at fly .io to breakmaster for

30:20

the beats to you for listening.

30:23

That is all for now, but we'll talk to you again

30:25

next time.

Unlock more with Podchaser Pro

  • Audience Insights
  • Contact Information
  • Demographics
  • Charts
  • Sponsor History
  • and More!
Pro Features