
NVIDIA AI Podcast · 2026-01-14
Caterpillar & NVIDIA: AI-Driven Smarter, Safer Construction
Hosts: Noah Krebitz
Guests: Brandon Hootman
Why it matters
Caterpillar uses NVIDIA’s AI ecosystem (hardware, software, digital twins) to enhance manufacturing, supply chain, and machine operations.
Key claims
- Caterpillar uses NVIDIA’s AI ecosystem (hardware, software, digital twins) to enhance manufacturing, supply chain, and machine operations.
- AI assistants in machine cabs provide natural language interaction, real-time coaching, and operational feedback to operators, improving safety and productivity.
- Edge AI computing with NVIDIA Thor enables real-time decision-making on machines even with limited network connectivity.
- The 'Clear to Build' manufacturing process uses AI and digital twins to forecast supply chain readiness in 100 milliseconds.
Episode summary
Summary
In this episode of the NVIDIA AI Podcast, Brandon Hootman, Vice President of Data and AI at Caterpillar, discusses how Caterpillar is leveraging AI and edge computing to transform heavy machinery operations, manufacturing, and supply chain management. Caterpillar is integrating NVIDIA's AI ecosystem, including edge platforms like Thor, to enable real-time AI assistance in machine cabs, improving operator safety, efficiency, and productivity. The collaboration accelerates AI adoption across Caterpillar’s enterprise, from factory digital twins to autonomous machines on dynamic construction sites.
Brandon highlights the shift from deterministic to probabilistic AI autonomy, emphasizing rigorous simulation and testing to ensure safety. He also shares insights on how AI is revolutionizing manufacturing processes such as the “Clear to Build” supply chain forecasting, achieving millisecond-level calculations. Looking ahead, Brandon foresees AI-enabled robots physically inspecting factories and the convergence of cognitive and physical AI systems reshaping heavy industry. He stresses the importance of new skills like prompt engineering and AI-assisted workflows for the future workforce.
- Caterpillar uses NVIDIA’s AI ecosystem (hardware, software, digital twins) to enhance manufacturing, supply chain, and machine operations.
- AI assistants in machine cabs provide natural language interaction, real-time coaching, and operational feedback to operators, improving safety and productivity.
- Edge AI computing with NVIDIA Thor enables real-time decision-making on machines even with limited network connectivity.
- The 'Clear to Build' manufacturing process uses AI and digital twins to forecast supply chain readiness in 100 milliseconds.
- AI-based autonomy shifts from preprogrammed routes to task-based probabilistic decision-making, backed by extensive simulation and physical testing.
- Caterpillar leverages decades of domain-specific data to fine-tune foundation AI models for construction and mining environments.
- Future trends include AI-enabled quadruped robots inspecting factories and the merging of cognitive AI with physical systems in heavy industry.
- New workforce skills will emphasize AI interaction, prompt engineering, and AI-assisted workflows across engineering and shop floor roles.
Source material
Transcript
Welcome to the NVIDIA AI podcast.
I'm Noah Krebitz.
With me today is Brandon Hoodman.
Brandon is Vice President of Data and Artificial Intelligence at Catapiller.
And we're speaking just after CES Week 2026.
Happy New Year, everybody.
A big week for caterpillar.
So we're going to get into all the exciting stuff that's been going on this week but leading up to it certainly.
But before we do that, Brandon, welcome to the pod.
Thank you so much for taking the time to join us.
Noah, awesome to be with you.
Big week for a caterpillar.
We are excited to be on stage of CES and also excited to announce some things and in partnership with NVIDIA.
Fantastic.
We'll get into all that in a second.
But first, if you would, can you tell us a little bit about caterpillar?
I would think most people listening know the brand, have seen your machines, have seen the logo.
But if you can give us a little bit of background about the company and then also maybe a little bit about your role.
Just kind of to set up the conversation.
Happy to know.
So 2025 was a big year for caterpillar.
We celebrated our 100 year anniversary.
So we've been helping build a better world in multiple areas for the past century and really proud of that.
And I think a lot of the audience would recognize caterpillar from just the drives down the interstate.
You see our machines doing the work and that's one area of our business.
But we've also got a pretty significant footprint in other areas that individuals may not know about.
We do a lot of work in heavy mining and then we also do a significant amount of work and energy and power generation to which with AI now really taking off as you can imagine has been a huge part of our business where excited by now.
Yeah, for sure.
And so what about your role?
How long have you been a caterpillar?
If you want, you know, a little bit of backstory about you landed here.
But then see you can just kind of describe what what you do as VP of AI data.
Yeah.
Yeah.
Well, deal.
Well, so I'm a software engineer by my education and by most of most of my time in the workforce.
I've been with caterpillar for 27 years and doesn't really feel like that.
But I've been here now for 27 years.
And over the course of my 27 years, while it feels like, you know, you could look at that and say, well, you've been in one spot for quite a while, like I probably had six or seven different careers over the course of that 27 years.
So it's been been pretty cool to do.
Yeah.
I've spent time in our, you know, supporting our dealer network and the systems that they used to run their business and then our manufacturing systems and now, of course, I'm in our digital organization where we're building an ecosystem digital capabilities, the complement the machines that we sell the market.
And our goal with that is just make our customers more efficient, more effective, more productive, more safe with our equipment, than any other in the market.
So how is caterpillar thinking about AI when it comes to reshaping modern manufacturing?
We'll start there.
Yeah.
That's a great question.
So in addition to my role that I plan and cat digital, I also serve another role for for the enterprise.
It's a recently established function called AI Accelerator.
Okay.
And it truly is about accelerating the adoption and the value that we get from AI across the enterprise.
You can imagine with our business, no manufacturing supply chain is a huge component of that.
With caterpillar having been around for a hundred years, we've had probably for 60 of those hundred years, we've had systems and data produced.
And you know, the concept of transforming your enterprise in those areas used to be that you go through a big systems deployment, ERP deployment, what we found with AI is it's kind of breaking through the traditional barriers of accelerating, getting to getting to those big transformations without the heavy lift that you'd have of kind of ripping out the core of your systems, you'll be able to do that.
We're looking at AI from, and I would say, no, we're starting with the foundation.
The concept of a digital twin that can truly blueprint your manufacturing facilities, each of the work centers that you have machining centers, your supply chain, the compliments that that first basis then reinforced with real world data opens up a world of opportunities, predictive and preventative maintenance on key assets on your shop floor, being able to simulate in real time supply chain constraints and then optimize your build schedule for what you're going to be building in the next day, next week, next month, all of those scenarios that felt like they were really hard to go achieve or finding that AI is allowing us to break through those walls pretty quickly.
That's fantastic.
Yeah, we've spoken in the past months to folks using digital twins as you said, in factory manufacturing situations, automotive comes to mind, you guys are in the business of creating heavy machinery.
And as you said, you know, have you reached into other industries and kind of areas as well.
You're collaborating with Nvidia on AI transformation.
Can you dig in a little bit more and kind of talk about what that looks like day to day and whether that's for cat customers, dealers of your equipment, or maybe even, you know, your Yeah, yeah, be happy to, I guess the first thing I would highlight is the reason we're working closely with Nvidia is the, you know, the comprehensive approach to AI ecosystem, not just hardware, not just some libraries and frameworks, but it's a really well thought out ecosystem that allows you to simulate, train and deploy.
Great.
Those are the core fundamentals of getting AI, right, irrespective of where you're at internet enterprise, like caterpillar, whether we're doing AI, to make our customers more efficient in the way they work with our machines, or whether we're making our supply chains more efficient, or whether we're looking at core processes, like, you know, finance transformation, etc.
So those, those concepts, internet of themselves are almost immutable.
No, but very specifically, you know, when we look at the work that we're doing, and I'll just I'll just zoom in a little bit on specifically our customers and some of what we announced this week as CEO.
Great.
There's a lot of, especially when you get into, you know, what we would traditionally call blue collar work, they're truly is a shortage of skilled and qualified labor in the marketplace, and it really doesn't matter whether for us it might be within our factories, operators, people who actually work within our factory, you go to our dealers, it will be service technicians, and you go to our customers, it's people to operate the machines.
So we're thinking about AI as a very pragmatic way to solve those problems in a very tangible, very outcome-based way, and starting with our customers as simple as making sure that when an operator steps into the cab of our machine, they can understand the operations of the machine, they can get feedback on how they're operating the machine, they can get coaching, the advanced technology features that we have on our machines are very accessible in a natural language way.
So by bringing our Cadda AI assistant into the cab of our machine, it really allows that operator to get access to our entire digital ecosystem, the hundred years of collective knowledge that we've built, and then the, you know, the ability to get real-time interaction with that machine, and in a natural way where you're not having to open a cell phone or, you know, look at a laptop screen to go do these things, it's just there, it gets out of the way, and it kind of helps them help some do their work, and we're excited by that.
A big enabler of that, and you know, part of the reason that we're working with them videos, the edge compute platforms that Nvidia provides, the thoracosystem is, is class leading both in terms of compute power, but also the software frameworks, the libraries, and the ability to quickly deploy.
What we saw at CES, that we were able to demonstrate with AI in the cab of an excavator, know that wasn't a five-year research project that we jointly did, that culmination of that work would be measured in months, not years.
So it just shows our ability to take these technologies of scale and rapidly integrate them with the, you know, some of the best machines in the world were really excited by them.
To go back to what you were describing about, you know, to me it sounded like this copilot scenario we're metaphor that's used a lot, when we're talking about, you know, humans using AI tools in whatever line of work or whatever they're doing to kind of get that assist.
What's it like in the cab of a, of a cat machine?
What is the operator, and I'm sure they're all different, but when you're talking about, you know, the AI systems being there to help, what is the operator seeing?
Yeah, so, and we're still working on what that, what that final experience will be like, you know, we had the opportunity to demonstrate it, see us shortly after, you know, coming up here quickly will be con expo, construction expo, it's a really big industry event for the construction industry.
That'll be in Las Vegas where our customers will get an opportunity to go more hands on with that and get to see that.
So we're looking for feedback on what that final experience will be, but one of the things that we wanted to make sure that we did with that, you know, is that this was never about the AI being front in the center.
It was about helping our customers get the work done.
Yeah.
And allowing them to get to all of the advanced capabilities that we either built with on the machine or across our digital ecosystem in a way that felt natural for them.
So we want them focused on digging, moving, hauling, not playing with another screen.
And we do have a screen that, you know, in our, in our concept machine that we've showed where things come up.
So as an example, if, you know, you have questions about operating procedures, that screen will visualize those operating procedures and show them to you.
But other than that, you could have a voice interaction with the system, get everything done that you need to and never have to worry about taking your eyes off of the off of the job site.
Again, I would, my compliments to Nvidia were very quickly able to do that with Nvidia's revivoy services and parity models, etc.
Glad to hear that, but it's always about the collaboration, right?
And as you said, it's, it's for all of the advances, all of the, the speeds and feeds and benchmarks and everything we talk about when it comes to AI and data and everything that goes into it.
As you said, it's about getting the work done and really the more the system can stay out of the way, but give the operator what they need to focus.
Yeah.
That's what it's all about.
That's great to hear.
You know, and that's such a such a selling point now on and is, I would say, as we really hit stride with AI, that's what we've found.
It's ability to naturally help you just get things done in a way that isn't intrusive, that doesn't require you to have deep knowledge on systems and menus and where data is at.
It just allows you to naturally get to that outcome.
That's the game changer and it's, it's not AI instead of people, it's AI with people to help them be more efficient at the work that they're doing and be better at the work that we're doing and we're really we're really excited about that.
Absolutely.
Cats using Nvidia's AI factory and your manufacturing digital data platform to automate things like forecasting and scheduling.
Can you speak maybe to a manufacturing process that's really been overhauled that just looks completely different now because of AI?
Yeah, and I had hinted at this a little bit earlier.
No, let me double click on it.
And for your audience, I'll apologize.
I'm going to go a little bit deep into how how factories are around here.
So just bear with me for a minute.
Go deep.
That's where we're here.
Yeah.
But if you, if you think about the complexities of running a running an operation like what we do at Catapula across the really diverse product line, it's a multi-layered supply chain where you may see final assembly happening in a factory, but there are a lot of predecessors that are feeding into that.
Either parts coming from suppliers, or other facilities that we've got that are doing work on components.
So as we are getting our orders coming in from our dealers and customers, you want to be able to ensure that you have everything available to be able to produce those orders.
So that process and I think this is probably an industry term, but we use a pretty heavily a catapuler.
It's called Clear to Build.
It's very simple.
In a 30-day window, in a 14-day window, in a five-day window, in my Clear to Build, do I have all of the parts and components, the supply that I need, either in the network, or available at the factory, do I have the labor that I need to be able to do it?
Now, think about Catapula at the scale that we are in all of the data and the disparate systems and the signals from your supply chain that have to go into calculating that.
It's really hard.
Yeah.
And without, you know, everybody being on a singular system or a singular platform, you're dealing with, you know, kind of an asynchronous environment of multiple signals coming in and being able to parse and process those that scale is really, really difficult and is required a lot of really smart people to do in the past.
And even with that, it's been difficult to calculate on a long-term window.
We have found that with, you know, first with omniverse, building a good digital twin that shows an accurate representation of your factory, the capacity of the factory and the supply chain.
And then taking some of the Nvidia models and the inference services, who opt as an example, we were able to take the clear to build process and calculate that for a 30-day window in 100 milliseconds.
Wow.
That's remarkable.
Yeah.
Now, granted, these are, these are, you know, we're doing it at a facility level right now and we're working through the rest of the enterprise to be able to do that.
But that just shows you the power of, you know, kind of want to have your arms around the data.
Yeah.
Once you understand the platforms and working within the Nvidia, the Nvidia ecosystem and the AI factory, the power of what you can do.
And, you know, these, these aren't models that we had to go develop on our own, you know, compliments to Nvidia things like who, after a really good and they work really well.
So with a little bit of tuning on our side, we were able to able to make those things work at a pretty impressive scale.
I'm speaking with Brandon Hootman.
Brandon is vice president of data and artificial intelligence at caterpillar.
Cat as the logo says and people know you as you said for, you know, you're driving down the highway and you see the machines.
But so much more than that as we've been discussing.
Speaking of the machines, when operators are out, they're working on sites and they're using the machinery and the cast systems that now have are starting to have these AI guidance, you know, sort of co-pilets as you were describing.
How does AI at the edge come into play?
How do AI systems enable real-time decision-making and kind of just adapting to what must be incredibly unpredictable environments when you're out on a construction site or in a mine?
Yeah.
Yeah.
You nailed it.
No.
And he thinks about the dynamic nature of a construction site.
They today they're never the same.
Things were moving around different work is being done.
Things were being completed.
You know, materials being brought to the job site, the very nature of it is not like our factories where things are relatively predictable and you've got a line that things are moving down and it looks the same day and a day out.
So if you think about what it takes to do some level of automation and bringing AI to a job site, even as performance as networks and cloud systems are today, there is a level of processing that has to occur at the edge.
Yeah.
And that level of processing doesn't just require CPU or GPU compute.
It requires a level of storage.
It requires a level of memory to be able to process these things and it's close to real time as you can get.
You know, situations with safety can sometimes be just a matter of seconds between something being avoided or something really serious happen.
So for us, as we're thinking about what we bring to the machines and what we bring to the job site, this partnership with Nvidia and the architecture and capabilities that Thor brings is really what we see as the game changer that's going to allow us to bring the capabilities that we've had in pockets for a while to now start to bring those to customers and machines and masks.
And the way that we're doing this now is Thor allows us to bring a lot of the sophisticated AI and ML models that we had built that run across our data platform.
The power is digital today.
We can now bring those to the machine.
And in the event that we have network connectivity and the event that the scenario supports it, we might invoke a cloud agent.
But if there's too much network latency, we've now got the ability to revert back to something that can run on the machine.
It of fidelity and a level of insight that still allows the solar as a customer, the operator, it'd be effective in the tasks they're doing.
Could I ask you Brandon to dig in a little to what some of those capabilities are kind of at the machine level in whatever scenario, construction, mining, whatever it is that makes them a sense.
Yeah, you bet.
So just think about a perception based warning of needing to understand maybe an unsafe scenario on a machine or thinking about a machine operating.
Let's just say we've got a machine operating on a side of a road.
Okay.
Think about the dynamic nature of traffic going by power lines being above and let's say this machine is an excavator.
So if you need to set a wall on how far that excavator arm might swing out, you want to know that if I set that wall, I want to know that the agent that's responsible for setting that wall on how far my excavator arm can swing out, actually sets it.
Because the last thing we want to happen is an operator being the machine and all of the sudden that arm swings out and oncoming traffic for an excavator.
Yeah.
So that example, no, it would be one worth, you know, now with the power of the Thor and the ability to run these AI agents locally, we can do all of that calculation on board the machine and invoke that machine command to be able to set those set those parameters on the machine to form those functions.
Kind of a naive question on my part, but what's network connectivity generally like in, and again, I know there's a huge diversity of scenarios that the equipment is working in, but is it generally pretty unstable?
Is it like a kind of using cell phones to modern construction sites usually have network setup?
How what does that look like these days?
Yeah, I would say it's, you know, it really depends on the area where our machines are operating.
One of the, one of the decisions the catapult are made over a decade ago was that every machine that we produce will come with connectivity.
Okay, so that that is there and that connectivity can be cellular connectivity, it can be it can be satellite connectivity.
We're also looking at the next generation of connectivity of high-speed satellite connectivity, how far is he's going to play into it?
So that infrastructure is there, but then also two arm machines end up operating in areas where the cell network just just isn't great and there's not great coverage.
And what we want to do ensures when we bring these AI capabilities to the machine that when the customers need to count on them, they can count on them and by now having the storage capacity, the compute, the memory bandwidth on machine, we're now able to take a lot of what we've had to do in the back office and now bring that local to the machine which is super exciting.
Yeah, no, that's fantastic.
Yeah, well, how do you think about safety when you're building autonomous equipment, when you're building heavy construction machinery and mining machinery in the age of AI?
How do AI and safety go together?
How do you guys think about it?
Starting at the beginning of the design process and working through?
Yeah, and this is this corner worked running really quickly.
If you think about autonomy systems of the past, they were very, very interesting in the way that they worked, but they were also much more deterministic than they were probabilistic.
Right.
So what that means is that if you're going to put autonomous machines on a job site, you would almost preprogram routes into them.
You would then have a complimentary suite of sensors on them that were able to detect an object moving in front of them and then appropriately take action to avoid a safety incident.
Now with AI, you're kind of going away from preprogramming things and a deterministic autonomy, and now you're going to giving a robot a task.
Right.
And it now is using various subsystems and agents and visual processing models to then determine the action that it needs to take.
Safety for us, it's priority one.
Before we put anything into market, the amount of rigor and the pace that we put it through to ensure safety is second to none.
Doing this in a physical world is very time-consuming as you can imagine.
Yeah.
So for us, the pivot to AI-based autonomy and machines is predicated by a robust simulation environment.
The ability to take real-world data, a digital twin of a job site, a digital twin of the machine, the models that we would have driving that AI-subsystem where the machines making decisions, and ensure that we were run that through millions of hours of simulation and test scenarios.
And honestly, you know, a worst-case scenarios in our simulation environment.
And then obviously that's followed by a series of physical tests too.
But now that simulation environment, now when you're getting into omniverse and the combination of that, you know, eyesic and cosmos, and you know, we now have the capability of being able to do that at scale.
And I think that's what's going to make the, you know, make it feasible for companies like Catapur and how to make this this pivot pretty quickly from the way we've been doing autonomy for the last 20 years to what the future of it's going to look like.
Right.
You must have an incredible amount of data on just the different types of job sites and the different, you know, natural materials and building materials and all of just all of the different physical world, you know, components that go down to the work that these machines are used for.
We do.
We do.
And that, that data when you think about what it takes to make AI really work is the foundation models that are out there today, or they're good foundation models, but those foundation models haven't been built with the specificity of the way a construction site works, or the way a mining site works, or the way a query operations work.
So we have the opportunity to take those foundation models now and do some level of reinforcement learning and post-training on those models with the specificity of, you know, kind of the way our customers work and operate.
We do think that's a, that's an area of differentiation for Catapur.
Is that, you know, we want our customers to know that when they, when they get an AI assistant or an AI autonomous machine from Catapur, it's backed by the quality of Catapur, but it's also backed by the hundred years of experience in the decades of data that we've got to be able to do this the right way.
No, absolutely.
So you mentioned, obviously, Catapur turned a hundred last year congratulations to the company that I want you.
And you've been around at the company a little over a quarter of a century now.
Boy, when you say it that way, it sounds like a real long time.
I mean it in the most celebratory manner possible lately.
I'm too old to make age jokes myself.
How long, I think you said this at the beginning, so forgive me, but how long have you been working specifically on, you know, sort of data and AI related stuff?
It's been an interesting journey for me.
As I said, I started as a software engineer and I was super privileged that my first assignment was working with our dealers, Catapur's got an independent, now network of dealers of roughly 155 globally.
So I've got to work on the systems that they used to run their business and got the opportunity to just see kind of what that process looked like in terms of the edge of where they interact with the customers and that.
So super, super valuable.
And then, you know, as I kind of transition through my career, spend some time overseas and in Grenoble France at a manufacturing facility there.
And then shortly after that, in Gossily's Belgium, which is really close to Brussels and another manufacturing facility there.
And I think one of the things that that's given me the privilege of seeing is that kind of just the federated footprint of how things move and interact and what the data looks like across our value chain.
So when we started our work in cat digital of thinking about how do we utilize all of the data that we've got or machines operating in the field to build a digital ecosystem where we can, you know, do fleet management, do predictive and preventative maintenance.
I don't know whether it was by accident or good planning on somebody's part, but I kind of feel like, you know, those things prepared me pretty well to be able to to step into what we're doing in digital.
We've been, we've been, I'd say really, while we've been doing digital, I think we really stepped our game up in the last six or seven years in terms of how we thought about it.
And the platform that I cited for you know, our team started building that about six years ago to be able to build it at that scale of super proud of the work that our teams did.
Oh, for sure.
Hopefully about two years for them to build that that data infrastructure, it's cloud native, event driven.
Polyglot, as I said, 16 petabytes of data and counting that we've got in that.
And it's also pretty proud too.
If you don't mind, I'd share that MIT recently completed a pretty interesting study on catapulter that's available if you just search MIT Center for Information Systems Research Catapulter.
Your audience can go out and it's about a 25 page article that they wrote on how we approached data.
So I do also think know that that data foundation, you know, we're moving pretty quickly with AI.
I really do believe that data foundation has been a game changer for us.
It is the foundation where we know that we've got data that we can, we can trust AI working with.
Yeah, no 100%.
And as you said, that's it.
You have to trust the data you're working with to be able to have trust in the rest of the system, rest of the process, let alone.
And in your case, you know, having people out there in the physical world relying on it.
Yeah.
Through the, through the process, through, you know, building the digital ecosystem and working with AI models and, you know, working with the physical AI and getting out into the real world, there's anything that jumps to mind that, you know, either maybe surprised you along the way, a learning or something that, you know, a way things went that work that you weren't expecting.
Or maybe a challenge, you know, a challenge that you wanted your teams had to overcome that as you look back on was kind of like a, you know, a big watershed moment.
Yeah.
Yeah.
That's a great question.
I've got, I've got several, but one of the things we learned and it was almost ten by accident, a little bit, you know, the traditional way that software is built is I don't want to call it monolithic because there are agile approaches to building it.
But if you, if you think about that process of going from, I've got an idea to, I want to build, build a software product, it can be a little monolithic, and it can, it can drag out a, a little bit.
We found that when you're building AI capabilities and AI native experiences, it does really require you to think differently, that you don't need to have necessarily a completely formed thought.
What you need is a notion on what you want to go do, and then, you know, you put a small team together of a couple of data engineers, you know, a prompt engineer, a context engineer, and a data scientist, and someone that might be able to throw a quick user interface on top of it, and then you spent three weeks building a prototype, and then you validate that prototype against the hypothesis, and then you go scale rapidly.
You know, when we, the CAD AI assistant that we showed at CES, that notion of developing that, know, is something we only started about 12, 14 months ago.
Yeah, and to make the pace of developing that, you know, that's backed by a library of 20 to 30 agents with a knowledge graph, and, you know, context that passes across all of those, and, you know, we were able to bring it into the cab of the machine, and my counsel would be, is you go into AI, challenge yourself to think different than the way that you built software and be willing to, you know, step away from conventional a little bit, try some things, and then, you know, kind of see how those prototypes work, and then rapidly scale from there.
So, Brennan, that's kind of a great segue to my next question, which is kind of looking ahead a little bit.
Talking about the future of AI and heavy industry, what do you see if I could ask you to forecast a little, right?
What do you see over the next, you know, five to 10 years as being the most transformative technologies that are going to affect manufacturing and heavy equipment?
That's a really great question, no, and this has happened much quicker than I expected.
Great.
You know, the, the first iterations of, you know, if you really think about late 2021, 2022, and open AI really made a splash with, you know, with generative AI and large language models.
Up to this point, it's largely been cognitive, it's been knowledge workers, it's been, you know, getting people information or, you know, now with, you know, the concept of MCP and agents, you know, now actually performing tasks and doing work.
The intersection of the cognitive world and the physical world are converging quicker, I think, than anybody, anybody expected, and they're, they're opening doors that have been closed for a really long time.
Let me just, let me give you a real example of that in our, in our factories.
You know, we've got some factories that have been stalwarts and caterpillar for decades, and they're really important to caterpillar.
And if you think about the, you know, the capital of building a factory that builds our machines, it, you know, you don't stand one of those up, just kind of on a whim.
You're really serious about, you know, once you build that factory, you know, it's usually there, usually there for a while.
That can mean that you have critical assets in there that might be a little bit age sometime.
They may not have sensors on them.
They may you may not have the ability to get data off of them.
In the past, the answer would have been well-fined a time, shut that factory down for a couple of months, go put sensors on all of these machining centers or work centers to be able to get the data off of them, you know, to do predictive and preventative maintenance.
Yeah.
Now what we're seeing, there are quadruped robots that are AI based that have thermal sensors on them, acoustic sensors on them, the ability to visually interpret gauges on a machining center where these robots, now instead of having to, you know, put the sensors on the machine.
Now you can bring the sensors to the machine.
By the way, while they're walking your factory, they're also going to give you an updated version of, you know, data to reinforce that digital twin that you've got of the factory.
You know, these were problems that felt more like kind of IT and OT before.
And now they're going to be physically solved in a way that, you know, it was super interesting, but way different than anyone, anyone I ever thought.
And I think that's just that's the iceberg.
No, I'm more and more working to see, see, like this knowledge aspect of what AI is doing, it's going to get injected into the physical world in ways that are really going to surprise all of us.
Yeah, no, it's great to hear you talk about that, you know, because I have the context of, you know, humanoid robots and we've had conversations with folks, you know, building humanoid robots to be in people's houses and obviously delivery robots and self-driving cars and agricultural, you know, equipment, but to think about the concept of, you know, as you said, bringing the sensors to the equipment and then along the way gathering all that extra data and validating your digital trend and all of that is just the data flywheel just goes and goes.
It does and it's mind-boggling when you think about it, you know, just to go, go execute a, a scan of one of our, you know, millions of square feet on a manufacturing facility.
I mean, you're talking about months to go do that.
Now, it's, hey, I can, I can have a robot walk in a line and inspect in machines and getting an updated version of that digital twin of the factory almost in kind of real time.
Yeah.
You know, and then reinforce in your models and your simulation environments being better, so it's just, these things are, they're, they're bust and wide open and are hurting.
Yeah.
You spoke just a minute ago about kind of the shift in mindset to work with AI and kind of moving from, I mean, all the things you talked about really kind of came together, thinking about deterministic versus probabilistic and being a software engineer and, you know, working for so long and now kind of having in relatively short order, this kind of shift in the way that you, you know, everything from how big of a team you assemble for a new project to how do you, how do you start and you don't have to have it all mapped out and having a notion, can I ask you for listeners, what other skills and mindsets, do you think the next generation of workers are going to need to have to succeed in these AI accelerated industrial environments?
Yeah.
I think that's, that's a, that's an amazingly complex question to answer.
Right.
That's the trillion dollar question, right?
Yeah.
It is, it is solve the future economy for a spring.
All right.
I think it's going to, I think it's going to depend on really where you set in what function you said and, you know, for my team as an example, we're very heavy on engineering, software engineering, data engineering, AI engineering, context engineering, prompt engineering, and that work is rapidly become AI assisted.
Not AI completed, but AI assisted.
In our best engineers know how to use those tools in a very effective way.
You know, I, I think, know what we're moving to a world where I would, I would struggle to to cite a job where you wouldn't need to have some level of prompt engineering.
Right.
And if you think about what prompt engineering is, it's, how do I talk to AI to be able to get it to give me the right answer, right?
Yeah.
In so much of people's ability to be effective in the future, I think is going to depend on your ability to, to be able to leverage those tools and interact with those tools and understand to a certain extent how they think and and work and for me that starts with the very basics of just interacting with them and working with them.
And that's always the advice, you're respected with the function that I talk to.
This technology is the most approachable technology that I have seen in my couple of decades of of being there.
There are no excuses for people not finding a way to work with these these tools and interact.
There are a lot of them are free.
They're available.
They're there for you to to start working with learning, learning upon and very approachable in terms of understanding.
Um, as I said, I just don't know that there's any any one area that I could point to that I think is going to be immune from it, Noah.
Yep.
No, it sounds about right to me.
I would qualify the way you interact with it might be different though.
And let's think about this, right?
My software engineers as an example.
You know, they're probably going to have a copilot or a coding assistant that is working shoulder to shoulder with them as they're they're doing their work, right?
I mean, they might they might want to simulate a code change and it's looking upstream to say, hey, if you make this change, these are the integration impacts and offering some recommendations on some changes to your, um, to the code you're already to submit.
On the other side of it, if we look at the shop floor, we're probably not going to have a laptop setting in front of somebody that's doing torque operations on a on a shop floor, right?
But what we might have is we might have a, you know, a AI enabled torque machine that tells you if you're you're working to the right level or we might have is if you're doing complex operations, you might have a visual assistant that's helping look at the work that's being done and providing real-time work instructions to you as you're doing it or offering you advice as you're, you're doing it.
So I think that's another thing that the people are going to have to get comfortable with is your respective of your job is probably going to be somewhere next to you.
Yeah, helping you, helping you understand the tasks that you're doing and, you know, ideally taking some of that manual work or the, the mundane and the, you know, the things that you have to go look up or find, just make you better at doing the work that you're doing.
Yeah, bread and for listeners who want to learn more, there's so much great stuff that you touched upon during the conversation, all of the, all of the technical and data and AI related stuff, but then how it translates into the real world, you know, in the physical world in particular, so much to dig into there.
And you mentioned the MIT study as well, but folks, for folks who want to learn more, where's the best place for people to start online?
Well, thanks for that, Noah.
Yeah, the best place for for listeners to go is catapuler.com slash CES, we've got a great landing page that really encapsulates everything that we announced CES with, you know, also some, some more details and some direct linkage to some of the specific press releases and things that we had made of CES.
Terrific.
Well, again, thank you so much for taking the time to come on the show.
It's been a great, really fascinating conversation and so much to think about the next time I drive by a construction site, right?
You know, it's going to mean so much more to me and when I see the cat logo.
So, yeah, when you, when you drive by and see that machine, Noah just visualized the data flowing off of that, the AI running, for example, and up on the operator.
So, thanks again, Noah for the opportunity to be with you here.
It was a privilege to talk a little bit more about the work that catapulters doing and I'm really excited about what the future holds.
Absolutely.
Look forward to tracking your progress and best of luck with everything.
Thank you.