AI Summary Omits AI Critiques

Colleen Bielitz noticed something missing from the Otter AI summary of a discussion she had with colleagues: the ​“juiciest” comment one of them had made.

Thankfully Bielitz is a human being. She was able to think for herself about what she heard — and what seemed to matter most.

She had been discussing with her colleagues plans for an upcoming panel. She made sure to include ​“juicy nuggets” left out of the Otter summary. 

That said, she still found it useful to use the summary to prepare, as long as she didn’t fully rely on it

I found Bielitz’s anecdote noteworthy when she made it Tuesday on WNHH FM’s ​“Dateline New Haven” during a conversation about artificial intelligence (AI). Otter AI did not find it noteworthy. Its instant AI-generated summary of the conversation did not include the anecdote.

Otter AI did generate a useful summary. But to write this article I, like Bielitz distilling her panel discussion, still found a need to make a human decision about what mattered, about which details to include, about which issues were most compelling or important whether or not they consumed the most time.

Bielitz considers that dynamic — the promise and limitations of the fast-moving growth and everyday adoption of artificial intelligence — in her job incorporating AI into the workings of Southern Connecticut State University (SCSU), where she serves as associate vice-president for strategic initiatives and outreach.

She spoke about that dynamic on ​“Dateline” along with Tom Goldenberg, who teaches how to work with new AI tools at SCSU as well and at an organization he founded called New Haven Code Academy.

Bielitz spoke of how AI is accelerating and expanding research the university already does. It’s incorporating AI in ​“biomimicry” deep dives into how, for instance, kelp can help cool dead zones in the ocean. It’s boosting neuroscience research that incorporates findings about bioluminescence in the ocean into models of neural pathways in the brain.

Goldenberg spoke of projects his students took on using AI. One developed an automated frequency moderator for his church in Bridgeport. Another developed a tool to scan candidate petitions to weed out dud signatures before submission; Goldenberg (who ran for New Haven mayor in 2023 on the Republican and Independent Party lines) is marketing the tool through a startup he runs; he said Ismael Malavel is using it in his campaign for the Democratic nomination for New York City comptroller.

Goldenberg was asked about whether the shortcuts and convenience offered by AI tools could be making us less human and limiting our growth. Specifically, the following argument about ​“the false god of convenience,” from writer Nathan Beacon in the Dispatch:

The AI offers us no individuality, no creativity, no genius, it merely scrapes all that has ever been published and gives us the most probable output. In doing so, it pillages all human culture and flattens it into sickly imitation.

At the same time, it threatens our freedom and creativity. We use this tool to make decisions; we use it to prepare for dates, we use it to compose letters to lovers and to grieve family members. Instead of expressing, imperfectly, with difficulty, what is in our heart, we let the machine spin out the same stale words. In vacating our own creativity, we become molded into the likeness of the algorithm, and all human expression threatens to become recursive, meaningless repetition.

Anything human worth having comes through difficulty, all growth comes through challenge, all achievement comes through friction. In attempting to make our life painless, AI tools threaten to take what is most valuable, what is most true of us: our own learning, our ability to overcome difficulty, our creativity and the originality of our encounters with the world.

“I fundamentally disagree with that,” Goldenberg responded. ​“You still have to work hard, but you should set your your sights higher. You’re just gonna put any energy elsewhere … You can aim high with these tools.”

Bielitz was asked about this review in the Economist of a new OpenAI tool called Deep Research arguing that it skews results based on findings and arguments that have been published most (or without paywalls) as opposed to those that are actually truest or most founded or innovative; and that by letting these tools do their writing for them, researchers are also letting the tools do their thinking for them, rendering them less capable of ​“noticing contradictions and gaps in the conventional wisdom.” (Discussion of those two articles did not appear in the Otter AI summary of the program. Only passing references are made to discussion of ethical implications.)

Bielitz acknowledged those perils. She also noted that Deep Research is only two weeks old; it and other tools will be improved. Still, she said the critique underscores the importance of always including human intelligence in the work of harnessing AI for positive ends.

Like in summarizing a discussion — benefiting from an instant, complete transcript and a smart summary of the most discussed themes, but also using one’s own brain to think about what matters. That’s not an unbiased process — but nor are the assumptions underlying AI models, which, Bielitz noted, are created by an industry that is 90 percent male.

Click on the video below to hear the full discussion of AI’s promise and perils on WNHH FM’s ​“Dateline New Haven” with Colleen Bielitz and Tom Goldenberg — including details about their work that you may think should have been included in the above summary. Then check out the Otter AI summary of the discussion, below the video. (Click here to subscribe or here to listen to other episodes of ​“Dateline New Haven.”)

Otter AI Summary Of The Program

Overview

The conversation on Dateline New Haven explores the impact of AI on education and workforce training at Southern Connecticut State University. Colleen Belitz discusses the establishment of the Office of Workforce and Lifelong Learning to address the rapid obsolescence of skills, with AI training courses offered to both students and adults. Tom Goldenberg, an AI professor, emphasizes the importance of responsible AI use, particularly in education to prevent cheating. They also discuss AI’s role in enhancing research and practical applications, such as in political campaigns and marine science. The discussion highlights AI’s potential to disrupt workforce dynamics and the need for ethical and innovative use of AI tools.

Action Items

• Explore using AI to map neural pathways and study brain function at Southern’s research centers.
  
• Encourage more women to get involved in AI development to bring diverse perspectives.
• Offer an AI developer boot camp course at Southern Connecticut State University in April.
• Incorporate more project-based, hands-on learning in computer science and AI courses to teach responsible usage.
  

Outline

AI’s Impact on Higher Education and Workforce Training

• Paul Bass introduces the topic of AI and its impact on New Haven, featuring Colleen Belitz and Tom Goldenberg.
• Colleen Belitz discusses the establishment of the Office of Workforce and Lifelong Learning at Southern Connecticut State University to address the rapid obsolescence of skills.
• Colleen highlights the importance of short courses in AI to help adults and students upskill without the need for long-term degrees.
• Tom Goldenberg shares his experience teaching AI to undergraduates, emphasizing the practical applications of AI in various industries.

AI in Everyday Life and Workforce Disruption

• Paul Bass and Tom Goldenberg discuss the practical applications of AI in everyday life, such as voice and text tools for coding.
• Tom explains the rapid advancements in AI and its impact on industries like software, manufacturing, and construction.
• The conversation touches on the potential for AI to disrupt 90% of current occupations and the need for responsible use of AI tools.
• Tom emphasizes the importance of project-based learning and building portfolios for students to apply AI skills in real-world scenarios.

Responsible Use of AI in Education

• Tom Goldenberg discusses the challenges of using AI in education, including concerns about cheating and the need for responsible use.
• Colleen Belitz talks about the importance of rethinking teaching methods to integrate AI as a tool rather than a replacement for human thinking.
• The conversation explores the potential for AI to enhance learning experiences through experiential and project-based approaches.
• Colleen highlights the need for teachers to adapt their teaching methods to incorporate AI while maintaining the human element in education.

AI in Research and Innovation at Southern Connecticut State University

• Colleen Belitz discusses Southern’s designation as an R2 research university and its impact on research opportunities for students.
• Colleen explains the various centers of excellence at Southern, including the Center for Nanotechnology and the Center for Coastal Marine Studies.
• The conversation explores the potential for AI to enhance research in fields like neuroscience and marine science.
• Colleen shares examples of AI-driven research projects, such as Project BLUE and the use of kelp for bio-plastics and eco-DNA.

AI’s Role in Enhancing Human Capabilities

• Colleen Belitz discusses the potential for AI to enhance human capabilities through biomimicry and the study of nature’s adaptations.
• The conversation explores the use of AI to map neural pathways in the brain and the potential for AI to advance scientific research.
• Tom Goldenberg shares his experience with New Haven Code Academy and the importance of upskilling the workforce to adapt to AI advancements.
• The discussion touches on the ethical considerations of AI and the need for responsible use to avoid negative consequences.

The Future of AI and Its Ethical Implications

• Paul Bass and the guests discuss the potential for AI to revolutionize various industries and the ethical implications of this technology.
• The conversation explores the balance between the benefits of AI and the need to maintain human creativity and individuality.
• Colleen Belitz emphasizes the importance of teaching students to use AI responsibly and for the greater good.
• The guests discuss the potential for AI to address global challenges like climate change and healthcare through innovative research and applications.

The Role of AI in Enhancing Human Potential

• Colleen Belitz discusses the importance of integrating AI into education to enhance student potential and prepare them for the future.
• The conversation explores the potential for AI to provide new opportunities for students to solve real-world problems and make a positive impact.
• Tom Goldenberg shares his vision for New Haven Code Academy and the importance of providing accessible AI training to the community.
• The guests discuss the need for continued research and development to ensure that AI tools are used ethically and effectively.

The Impact of AI on Society and Education

• Paul Bass and the guests discuss the broader implications of AI on society, including its impact on education and the workforce.
• The conversation explores the need for continued research and development to ensure that AI tools are used ethically and effectively.
• Colleen Belitz emphasizes the importance of teaching students to use AI responsibly and for the greater good.
• The guests discuss the potential for AI to address global challenges like climate change and healthcare through innovative research and applications.

The Ethical Considerations of AI

• Paul Bass and the guests discuss the ethical considerations of AI and the need for responsible use to avoid negative consequences.
• The conversation explores the potential for AI to revolutionize various industries and the ethical implications of this technology.
• Colleen Belitz emphasizes the importance of teaching students to use AI responsibly and for the greater good.
• The guests discuss the need for continued research and development to ensure that AI tools are used ethically and effectively.

The Future of AI and Its Potential Benefits

• Paul Bass and the guests discuss the potential for AI to revolutionize various industries and the ethical implications of this technology.
• The conversation explores the need for continued research and development to ensure that AI tools are used ethically and effectively.
• Colleen Belitz emphasizes the importance of teaching students to use AI responsibly and for the greater good.
• The guests discuss the potential for AI to address global challenges like climate change and healthcare through innovative research and applications.