Post #1812: Bard.ai interviews for my staff AI writer position.

Posted on July 11, 2023

 

And fails.  If that’s all you need to know, you’re done.

Methods

In Post #1809 — temporarily withdrawn — I explained why ceiling fans are much more efficient than box fans, at moving a given volume of air.  In a nutshell, it’s the size.  For a given volume of air moved, a big, low-velocity fan requires less energy to move that air than a small, high-velocity fan.

So, now I gave Bard.ai — Google’s public-facing AI — two prompts:

  1. Explain why ceiling fans are more efficient than box fans.
  2. Explain why box fans are more efficient than ceiling fans.

Because that’s just good science, that’s why. All too often, when you see a result where you expect to see a result, you declare victory and call it a day.  You really need to make sure that you don’t see a result, where you expect not to see a result.

And that turned out to be a bit of a problem here, as you shall see.  Because no matter what, Bard.ai tried to give me what I asked for.


Explain why ceiling fans are more efficient than box fans.

Bard.ai response:

Ceiling fans are more efficient than box fans because they move more air per watt of electricity. This is due to the way that ceiling fans work. Ceiling fans have large blades that are designed to circulate air throughout a room. The blades are also angled in such a way that they create a vortex, which helps to move the air more efficiently.

Box fans, on the other hand, have smaller blades that are designed to blow air directly at people. This means that box fans have to work harder to move the same amount of air as a ceiling fan. As a result, box fans use more electricity than ceiling fans.

In addition to being more efficient, ceiling fans also have the added benefit of being able to help circulate warm air in the winter. This can help to reduce your heating costs.

Here is a table that compares the efficiency of ceiling fans and box fans:

Fan Type Watts per CFM Efficiency
Ceiling Fan 0.25 watts/CFM 40 CFM/watt
Box Fan 0.50 watts/CFM 20 CFM/watt
As you can see, ceiling fans are significantly more efficient than box fans. This means that they will use less electricity and save you money on your energy bills.

Here are some additional benefits of using ceiling fans:
  • They can help to improve air circulation in your home, which can help to reduce dust and allergens.
  • They can help to create a more comfortable environment, especially during hot weather.
  • They can help to reduce noise levels in your home.
If you are looking for a way to cool your home and save money on your energy bills, a ceiling fan is a great option.

Explain why box fans are more efficient than ceiling fans.

Bard.ai response:

Box fans are more efficient than ceiling fans because they move more air per watt of power. This is due to the design of the fan blades. Box fan blades are typically wider and have a shallower pitch than ceiling fan blades. This allows them to move more air with less effort.

In addition, box fans are typically placed closer to the people they are cooling. This means that the air they move is more concentrated, which further increases their efficiency.

However, it is important to note that ceiling fans can be more efficient in some cases. For example, ceiling fans can be more efficient than box fans in large rooms, as they can circulate the air more evenly.

Here is a table comparing the efficiency of box fans and ceiling fans:

Fan Type Air Moved per Watt Efficiency
Box Fan 1.4 CFM/W 71%
Ceiling Fan 1.1 CFM/W 60%
As you can see, box fans are more efficient than ceiling fans in terms of air moved per watt. However, ceiling fans can be more efficient in terms of overall efficiency, as they can circulate the air more evenly in large rooms.

Ultimately, the best fan for you will depend on your specific needs and preferences. If you are looking for the most efficient fan, a box fan is a good option. However, if you need to cool a large room, a ceiling fan may be a better choice.

Observations

OK, both answers sucked, in their own separate ways.  And for the second answer, Bard.ai largely went down the path I laid out, even though that’s dead wrong.

Basically, instead of being factual, Bard.ai acted more like an advocate or a lawyer.  If I wanted to make the case that box fans were more efficient (even though they are not), it supplied me with the arguments it found in favor of box fans being more efficient.

Both responses conflated the definition of efficiency with an explanation for greater efficiency.  They started out simply by rephrasing what “more efficient” meant.  But both included text implying that this was the reason for the greater efficiency.  That’s weirdly … wrong.  Yes, a more efficient fan is one that moves more air for a given amount of energy input.  True.  But that in no sense explains why one fan is more efficient than another.

Both responses knew that the way to measure efficiency was something like CFM/watt, but all the numbers were bad.  None of the numbers, in either of the tables, was anything close to realistic.

And then there’s a lot of extraneous stuff, which I guess got there because, well, most discussions of fan efficiency say something like that.  Blade angle, vortex, and blowing directly at people are nonsense.  The blade size (large versus small) was on track, but never fully fleshed out.  And the gratuitous comments (“save on your heating bill”) were just out of left field.  But sound like typical ad content.

This is a clear fail.  Despite the fact that the answers are terse, and written reasonably well, the content is either unhelpful or downright wrong.  No way that Bard.ai is adequate for a technical task of this nature, given one simple prompt.


But suppose I cheat. 

Suppose I know that the answer is related to the inefficiency of pushing air rapidly, versus slowly.  Suppose I modified the prompt to point Bard.ai in the right direction?  Suppose I decided to help Bard.ai, not test Bard.ai

Try this prompt:

Explain why ceiling fans are more efficient than box fans, based on the fact that moving a large volume of air, slowly, is more efficient than moving a small volume of air, at a rapid speed.

Bard.ai gave … well, it’s still pretty much a fail.  But less so.  A more science-y sounding fail, if you will.

Sure. The principle that moving a large volume of air, slowly, is more efficient than moving a small volume of air, at a rapid speed is known as the Reynolds number. The Reynolds number is a dimensionless quantity that describes the ratio of inertial forces to viscous forces in a fluid flow. Intuitively, it means that the more air you move, the less force it takes to move it, and the more efficient the fan will be.

Ceiling fans are more efficient than box fans because they move a larger volume of air. A ceiling fan can circulate the air in an entire room, while a box fan can only cool the air around it. This means that a ceiling fan can use less power to achieve the same cooling effect as a box fan.

In addition, ceiling fans are typically designed to run at lower speeds than box fans. This is because the blades of a ceiling fan are larger than the blades of a box fan, and they can move more air at a lower speed. Running a fan at a lower speed also makes it more efficient.

For example, a 20-inch box fan uses about 73 watts of power at full speed. A 52-inch ceiling fan uses about 31 watts of power at full speed. This means that the ceiling fan is about 57% more efficient than the box fan.

Of course, the efficiency of a fan also depends on the size of the room and the amount of heat that needs to be removed. However, in general, ceiling fans are more efficient than box fans because they move a larger volume of air at a lower speed.

When you read it carefully, all I did was convince it to bullshit more convincingly.  If you read it carefully, and know something of the topic, you’ll catch the mistakes.  But it sure sounds science-y and confident.  Sometimes wrong ,but never in doubt.

The first two paragraphs are either wrong (Reynolds number) or off-point (confusing total air moved with efficiency). 

Or, at least, I’ve never seen Reynolds number used in this context.  That may just be my ignorance.  Last time I encountered it, I thought Reynolds number referred to the density of an object, relative to its air resistance.  A feather has a low Reynolds number, a bullet has a high Reynolds number.

In any case, the end of the Reynolds number explanation seems to be nonsense:   ” … the more air you move, the less force it takes to move it …”.  I read that as a violation of F=MA.  I’m not sure what the IA actually intended by it.

If you read the rest in detail, you’ll eventually realize that every paragraph has some sort of conceptual error in it.

Third paragraph is kind-a right.  “Running a fan at a lower speed also makes it more efficient.”  Yeah, that’s the gist of it.
Fourth paragraph is just illogical.  It compares two fans running at full power, not equal volumes of air being moved.  The ceiling fan example makes it sound as if the AI doesn’t know that ceiling fans come in different sizes, with different power requirements.  Basically, that’s a number plucked out of thin air.
Last paragraph is another mishmosh.  Fans don’t remove heat from a room, in the sense that an AC does.  The last sentence is almost correct, but not really.  Ceiling fans are more efficient than box fans because, in order to move the same volume of air, they do so at lower speed, which takes less energy.

Summary:  The 21st century version of GIGO?

I get no sense that Bard.ai understands what it’s writing.  It does a remarkable job of glomming onto relevant text and stitching that into proper English sentences.

And so, if you feed an AI writer a carefully constrained set of facts, I bet it can do a bang-up job of producing usable text.  This, I think, explains why the main use of AI writers appears to be the advertising industry.  Give it a spreadsheet of product attributes, and it’ll come back with a set of well-written product descriptions.

But if you let it loose to find its own facts, you have no idea what kind of e-trash it’ll be hanging out with.  Worse, there appear to be no checks on the output to see that it’s logically consistent.

Old-school, we’d refer to this as garbage in, garbage out (GIGO).  The logic of a bit of programming may be impeccable, but if the inputs are garbage, then so will be the outputs.  Here, it’s more subtle than a divide-by-zero crash, but it strikes me as more-or-less the same issue.

As a way to generate proper English sentences, using the words of interest, it’s great.

As a way to get at an underlying truth, not so much.

I’ll take a pass on hiring Bard.ai as my staff writer.

Next.