From millet plants to heart health, scientists are harnessing AI to build intelligent digital twins—virtual replicas that learn, adapt, and revolutionize how we grow crops, diagnose disease, and manufacture advanced materials.
Iowa State engineers and leaders of the university's Translational AI Center, left to right, Baskar Ganapathysubramanian, Adarsh Krishnamurthy, and Soumik Sarkar, are developing "digital twins" as powerful research tools. Photos by Christopher Gannon.
Researchers visited a campus greenhouse every week, pulled out their phones, and took videos of millet plants, a hardy cereal crop grown worldwide.
They recorded the plants' structure and growth from sprouts to grain producers. Using an artificial intelligence tool called NeRF (for neural radiance fields), they converted their 2D videos into 3D digital models of the plants.
Shambhavi Joshi, an Iowa State University doctoral student from Indore, India, called up one of the digital models during a recent visit to a laboratory operated by Iowa State's Translational AI Center.
A finger millet plant at stage 59 of development spun in its greenhouse pot, allowing you to study the full plant from any side. That's when 90% of the plant's reproductive structure emerged from its final leaf and stem.
This was far more than an illustration. It was 80 to 90 million points in space – "a point cloud" – containing data about the plant's color, shape, and 3D structure.
It's also the beginning of the creation of a "digital twin," a research tool that a committee of the National Academies of Sciences, Engineering, and Medicine wrote has "immense promise in accelerating scientific discovery and revolutionizing industries."
In its 2024 report, "Foundational Research Gaps and Future Directions for Digital Twins," the committee continued, "Digital twins have the capacity to revolutionize scientific research, enhance operational efficiency, optimize production strategies, reduce time to market, and unlock new avenues for scientific and industrial growth and innovation."
Digital twins need data updates
So, what is a digital twin?
The National Academies' report describes a digital twin as a virtual construct that "mimics the structure, context, and behavior of a natural, engineered, or social system." It says a digital twin is regularly updated with data from its physical twin and can help make predictions and inform decisions.
According to the report, aerospace engineers started using digital twins to help monitor and manage aircraft frames and engines. NASA engineers first used the term in 2010.
"A digital twin needs real-time data from its physical counterpart," said Baskar Ganapathysubramanian, the Joseph and Elizabeth Anderlik Professor in Engineering and director of the AI Institute for Resilient Agriculture based at Iowa State.
In other words, a digital twin of a corn plant needs to be regularly updated with data taken from an actual plant growing in a greenhouse or in a field. That makes a digital twin dynamic and changing, like its real-world counterparts, rather than a standard, static computer model or simulation.
"We are always aligning the digital with the real world," said Soumik Sarkar, a professor of mechanical engineering and a principal investigator of COALESCE, a project developing a cyber-agricultural system capable of using robots, drones, and other technologies to manage individual crop plants within a field.
Breakthroughs across agriculture
Building and studying digital twins is a significant feature of the AI Institute for Resilient Agriculture, a research center based at Iowa State that launched in 2021 with a five-year, $20 million grant from the U.S. National Science Foundation (NSF) and the U.S. Department of Agriculture's National Institute of Food and Agriculture.
"Using advanced sensor technology, scientists can create digital twins – virtual simulations that mimic real-world plants, crops and farms," institute researchers wrote. "For every year of biological data, digital-twin based AI systems can create hundreds of reality-based simulations."
According to the researchers, those simulations can:
- "Streamline and revolutionize" plant breeding so crops can withstand environmental, pest, and disease challenges while providing higher yields and quality
- Help farmers adopt techniques and technologies that boost profits and improve the health of land and soil resources
- Provide governments with data and insights for policies that encourage the greatest benefits at the lowest environmental costs
- Share data and knowledge with ag companies to help them develop precision agriculture tools and better plant varieties that thrive with less water, fertilizer, and pesticides
- And drive economic development in rural areas.
With the help of digital twins of crop plants – plus collaborations with plant scientists such as Arti Singh, associate professor of agronomy, and Asheesh (Danny) Singh, the G.F. Sprague Chair in Agronomy – the researchers wrote they "believe these breakthroughs – and more – can be a reality in the very near future."
Digital twins in heart health
Ming-Chen Hsu, a professor of mechanical engineering, is working to develop personalized digital twins that could help doctors monitor and detect problems with cardiovascular aging, such as heart disease.
Project researchers are working to develop personal digital twins of patients' cardiovascular systems using data collected from wearable devices, medical imaging, blood tests, and physical exams. Because they're regularly updated with patient data, the digital twins could offer early warnings of disease, even before symptoms are detected.
What makes the idea work?
"A lot of models in the past were a one-way street," said Hsu, who specializes in computational modeling, including a project that modeled heart valves in action. "They didn't interact with real-world data. The computational models didn't learn or evolve. These digital twins have to evolve."
Because it's not feasible to collect, say, heartbeat data over a human lifespan of nearly 80 years, Hsu is collaborating with Abhay Ramachandra, an assistant professor of mechanical engineering who specializes in animal models, to develop digital twins based on data from mice, which live about two years. The NSF is supporting their work with a three-year, $605,825 grant.
"With the mouse data, we can control the experimental conditions, refine our models and use model predictions to design and test different scenarios for monitoring aging," Hsu said.
Once the researchers have successfully tested their ideas with mice and their digital twins, they'll study how the approach can be applied to human health.
"I like this project so much because we're doing the fundamental development," Hsu said. "And our project is making this technology very applied to human health."
Making manufacturing processes better
Adarsh Krishnamurthy, an associate professor of mechanical engineering, is using a digital twin to optimize a new idea in 3D printing.
It's part of a federal Materials Genome Initiative focused on quickly advancing material invention and use. The NSF is looking for materials that "revolutionize and engineer our future."
Using a 3D-printing process called Digital Light Processing—a process that uses light rather than heat to quickly cure and harden liquid resin into plastic layers—the researchers expose different parts of a single resin to two different wavelengths of light. This can produce complex structures with different material properties, structures with hard and flexible parts.
Krishnamurthy said the digital twins he's using—"computational models that simulate additive manufacturing"—are being used "to optimize real-life manufacturing. "
In this case, the digital twins aren't just visual. That's because they're not something the researchers need to actually see.
"For me, it's the computations and the physics," Krishnamurthy said. "We're duplicating the physics."
That can do two things for researchers and eventually manufacturers, Krishnamurthy said:
- Working with physics in the digital realm can help researchers optimize the geometries and shapes of their products.
- It can also help modify a printing job's real-time controls and parameters to get the best result.
Krishnamurthy said he's currently using digital twins for geometry optimization but wants to use the technology for real-time controls for 3D printing.
The real value of digital twins?
"We can run thousands of experiments in tandem," Krishnamurthy said. "And we know for sure we're replicating the physics of the real world."
Helping find all the apples
Nitesh Subedi, a doctoral student from Pokhara, Nepal, is studying how mini robots could be used to treat individual crop plants with the right amount of fertilizer or even harvest a crop.
He's developed a virtual robot that uses AI to learn to use its arms to move a plant so it can see behind it, just as a worker might move a branch to reach and harvest an apple. That's a difficult task for a robot. But, with artificial intelligence tools, the virtual robot is learning that too much pushing can damage a plant, and whether it would be best to push to the right or to the left.
"You saw it was pushing the plant to the right, and that was too much," Subedi said as a video of the virtual robot played. "It's still learning, right? Now it's switching back to push to the left."
Nearby in the lab, a myBuddy 280 dual-armed robot stood before a plastic plant, ready to learn the exact same lessons in crop care and production.
The project is part of COALESCE, COntext Aware LEarning for Sustainable CybEr-Agricultural Systems. The research is supported by a five-year, $7 million Cyber-Physical Systems Frontier award jointly funded by the NSF and the USDA's National Institute of Food and Agriculture.
"This project aims to transform Cyber-Physical System capabilities in agriculture to enable farmers to respond to crop stressors with lower cost, greater agility, and significantly lower environmental impact than current practices," project researchers wrote.
COALESCE is co-led by Sarkar, who also directs Iowa State's Translational AI Center, a campus research center established in 2022. The center brings together AI researchers working in fields such as materials, manufacturing, health care, transportation, food, energy, and the ethics of using AI technologies.
The center also helps manage major research projects, including ones developing digital twins.
"The Translational AI Center is helping us to manage these large efforts with many investigators and many students," Sarkar said. "It helps with management, logistics, customers and stakeholders."
It also helps to collect and share data, attract and onboard students in computer science, agronomy, plant pathology, mechanical engineering, and more.
Ganapathysubramanian said the center is vital to these digital twin projects because they "require artificial intelligence tools, interdisciplinary teams, and deep domain science."
He said the research teams' findings could one day be vital to all of us because " this is all leading to AI for end-users."
AI Job Boom Defies Market Decline as ChatGPT Reshapes Hiring