Greetings from San Diego. I'm here to do the opening keynote at the Brand Innovators Harnessing the Power of AI & Technology conference hosted by Qualcomm. I'm looking forward to an extraordinary day.
In the news: Mistral AI, a French startup backed by Microsoft, has introduced Codestral, its first generative AI coding assistant, which supports over 80 programming languages, including mainstream languages such as Java, Python, C++, JavaScript, and more niche ones like Swift, and Fortran. Codestral is entering a competitive market dominated by platforms like GitHub Copilot and Code Llama.
That's the headline. The question you have to ask: "What will it mean to be a software engineer in 60 months?" This specific use case for LLMs is progressing at a remarkable pace. So fast, in fact, that it is sparking vigorous debate about the adage, "Teach your kids to code."
Back to Codestral: Mistral AI says Codestral (which operates on a 22B parameter model) sets new standards for performance and latency in code generation. Unlike other Mistral models, Codestral is not fully open-source. Instead, it is described as an “open-weight” model under the Mistral AI Non-Production License, restricting its use to research and testing purposes only and prohibiting commercial use. Mistral offers a hosted version of Codestral on its Le Chat conversational AI platform and a paid API. The company is planning to integrate Codestral into development environments such as LlamaIndex, LangChain, Continue.dev, and Tabnine.
AI coding assistants are very popular. It isn't hard to understand why. A study by GitHub indicated that developers using AI assistants completed tasks 55% faster. That's the good news. The bad news? Research from GitClear revealed increased code churn and concerns about reliability and accuracy in code generated by AI assistants. It gets worse, as AI-generated code often amplifies existing bugs and security vulnerabilities. The icing on the cake? A study from Purdue University found that more than half of the answers provided by OpenAI’s ChatGPT to programming questions were incorrect.
Despite these challenges, the market for AI coding assistants is growing, which will undoubtedly fuel ongoing debates about the benefits and risks of relying on AI for software development, as well as force you to consider how engineering teams will evolve over the next few years.
As always your thoughts and comments are both welcome and encouraged. Just reply to this email. -s
ABOUT SHELLY PALMER
Shelly Palmer is the Professor of Advanced Media in Residence at Syracuse University’s S.I. Newhouse School of Public Communications and CEO of The Palmer Group, a consulting practice that helps Fortune 500 companies with technology, media and marketing. Named LinkedIn’s “Top Voice in Technology,” he covers tech and business for Good Day New York, is a regular commentator on CNN and writes a popular daily business blog. He's a bestselling author, and the creator of the popular, free online course, Generative AI for Execs. Follow @shellypalmer or visit shellypalmer.com.
