Sunday, June 9, 2024

Some Limitations of ChatGPT

University of Texas president Jay Hartzell declared this to be "The Year of AI." So, the assignment for my "Mental Spa Day" at work was to be introduced to ChatGPT. The first task was to compare Google with ChatGPT.  "Choose a topic to search in both Google and ChatGPT: How did the results differ? What were you looking for and which one gave you the information that you needed?" 

The two tools are different, of course, though Google does now claim to be supported by an AI Assistant. 

I asked if Gerard Kuiper ever met Beatrice Tinsely, if Otto Struve ever met Gerard Kuiper, and if Otto Struve ever met Beatrice Tinsley. ChatGPT delivered approximately the same reply in all three cases. In that, it completely missed the fact that Struve and Kuiper worked together at the University of Chicago before Kuiper took over the McDonald Observatory from Struve.

I then asked ChatGPT: Tell me about the pay warrants of the Texian Navy, a subject for which I did independent research. My work was presented as an article in The Numismatist and as a lecture at an ANA Convention (virtual via Zoom) 4 August 2020. That talk is available on YouTube here https://www.youtube.com/watch?v=EWGzivjlOUI

ChatGPT's answer was at once cursory and inventive. Contrary to its claims, the warrants did not specify the period of service or the vessel on which the sailor served. The warrants were issued solely on the authority of Commodore Edwin Ward Moore. They were repudiated by Pres. Sam Houston. ChatGPT's offering is echoic of a college student writing to fill space when they cannot answer the question.

ChatGPT replied:

[quote] The pay warrants of the Texian Navy were a form of financial compensation issued to sailors and officers serving in the navy of the Republic of Texas during the 19th century. The Texian Navy, also known as the Texas Navy, played a crucial role in the fight for Texan independence from Mexico and in protecting the fledgling republic's coastline.

As with any military or naval force, it was essential to ensure that sailors and officers were compensated for their service. The pay warrants served as a form of promissory note, guaranteeing payment for their work and dedication to the cause of Texan independence.

The pay warrants were typically issued by the government of the Republic of Texas, often by the Navy Department or other relevant authorities responsible for managing naval affairs. These warrants were written documents specifying the amount of money owed to the individual sailor or officer, as well as any relevant details such as the period of service and the vessel on which they served.

In many cases, pay warrants could be redeemed for cash or used to purchase goods and services, depending on the policies and resources available to the Republic of Texas at the time. However, it's worth noting that the financial situation of the Republic of Texas was often precarious, and there were instances where pay warrants could not be immediately honored due to budgetary constraints or other factors.

Despite these challenges, the Texian Navy played a crucial role in safeguarding Texan interests and maintaining maritime security during a tumultuous period in the region's history. The issuance of pay warrants was a tangible acknowledgment of the sacrifices made by sailors and officers who served in the navy, ensuring that they received the compensation they were owed for their service to the Republic of Texas. [close]

PREVIOUSLY ON NECESSARY FACTS

Misconduct in Science and Research

Why Evidence is Not Enough

Springer Closes Wall of Shame

Slow Down and Think

No comments:

Post a Comment

Note: Only a member of this blog may post a comment.