1. Introduction
With the rapid advancement of artificial intelligence (AI) technology, its applications across various industries have become increasingly widespread, particularly in content production [
1]. By utilizing automation and intelligent processes, AI has significantly enhanced production efficiency and optimized resource allocation [
2,
3]. For example, a study by LeCun, Y et al. (2015) demonstrated notable achievements in the application of AI to image recognition and generation, which introduced new tools for animation production [
4]. As an important branch of content creation, 3D animation involves numerous complex steps, making the need for efficiency improvements especially critical [
5]. However, despite the growing attention to AI’s potential in content production, its impact on the actual efficiency of production processes has yet to be fully investigated.
While several studies have explored AI applications in specific animation tasks, a comprehensive analysis of AI’s impact across the entire production pipeline remains lacking. Additionally, existing research has primarily relied on qualitative assessments or individual case studies, leaving a gap in quantitative evaluation methods for AI integration in creative production processes.
Existing research on AI-generated content (AIGC) has primarily focused on the technology itself and the attitudes towards AI [
6], whereas studies examining the practical use of AI in the content production industry are relatively limited [
7]. Most research on the application of AI in film and animation concentrates on technological development and visual effects optimization while neglecting the overall production workflow efficiency [
8,
9]. Therefore, effectively evaluating the efficiency improvements brought by AI technology in 3D animation production has become a crucial topic.
To address these research gaps, this study introduces a systematic approach to evaluating AI’s impact on animation production efficiency. Our research contributes to the existing literature in several ways:
Development of a comprehensive four-stage evaluation framework that captures the complex interactions between AI technology and traditional animation workflows;
Implementation of a modified NDEA methodology specifically adapted for creative production processes, accounting for both quantitative and qualitative outputs;
Empirical validation of optimal AI usage ranges across different production stages, providing concrete guidelines for industry implementation.
Defining multiple stages or levels in DEA modeling can provide a deeper understanding of the production process [
10]. In this context, a multi-stage model divides a process into a series of sequential subprocesses, where the output of one stage can be considered as the input to the next [
11]. This study adopts the Network Data Envelopment Analysis approach proposed by Cook et al. (2010) to construct a multi-stage 3D animation production model [
12]. The Network DEA method breaks down a complex multi-stage process into several sub-stages and analyzes the efficiency of each stage, providing a more detailed efficiency evaluation [
13,
14]. This approach has been widely used in efficiency studies of multi-stage production processes, such as in the energy and transportation sectors [
15]. Therefore, using the Network DEA method to analyze the efficiency of each stage in the 3D animation production process enables a clear assessment of the actual impact of AI technology.
The primary objective of this study is to evaluate the actual efficiency improvement brought by AI technology in 3D animation production, providing empirical evidence for the application of AI in the animation industry. By conducting an empirical analysis of project data from multiple animation studios, companies, and educational institutions, this study aims to reveal the efficiency gains achieved through AI technology across different stages of production. The findings will serve as a reference for optimizing resource allocation and enhancing production efficiency within the animation industry.
Based on this, this study proposes the following research questions:
Does the application of AI technology improve the overall efficiency of 3D animation production?
Which production phase has shown the most significant efficiency improvement due to the introduction of AI technology?
How does the application of AI technology vary in its efficiency improvement across different types of animation projects?
Based on the proposed research questions, we formulate the following research hypotheses:
H1. The application of AI technology significantly enhances the overall production efficiency of 3D animation processes.
H2. The efficiency improvement due to AI technology is most pronounced during the pre-production phase.
H3. The impact of AI technology varies significantly across different types of animation projects, with educational projects showing relatively greater improvements due to resource constraints.
Through this study, we aim to provide new theoretical and practical insights into the application of AI technology in content production, particularly in 3D animation production, thereby fostering the development and innovation of the animation industry.
3. Method
This study employs a mixed research methodology, combining both qualitative and quantitative research strategies to comprehensively evaluate the application of artificial intelligence (AI) in 3D animation production processes. Initially, qualitative research was used to gather insights from industry experts, which subsequently informed the construction of an indicator system for analysis. Based on these indicators, Network Data Envelopment Analysis (Network DEA) was conducted to quantitatively assess the efficiency improvements across different stages of the production process.
3.1. Qualitative Research: Expert Interviews
In the initial phase of the study, we conducted expert interviews to obtain professional insights into the application and impact of AI technology in animation production. For this purpose, we invited 10 industry experts, including technical directors from animation production companies, assistant professors in animation production, and independent animation directors, all of whom have extensive experience in animation production and AI applications. Some of the experts also hold doctoral degrees in computer science or digital media, which ensures the depth and professional rigor of the interviews.
The selection of experts was based on industry recommendations and connections made through social platforms, ensuring the representativeness of participants and obtaining diverse perspectives from various fields.
Table 1 presents the key information of these experts.
3.2. Establishment of Indicator System
Through a systematic analysis of the interview content, we extracted several key indicators from the insights of the experts. Among them, three indicators were repeatedly mentioned across different expert interviews, forming a certain degree of consensus.
3.2.1. Personnel Allocation Efficiency
Personnel Allocation Efficiency: Experts generally believe that animation production is an industry that highly relies on human collaboration, and reasonable personnel allocation is a key factor influencing production efficiency. Expert C stated “Animation production is a collective effort of the team, and the progress of the project is determined by the reasonable allocation of personnel and effective collaboration”. Expert E also mentioned “In large projects, proper team member allocation not only improves efficiency but also avoids resource wastage”. Therefore, personnel allocation efficiency has been included in the indicator system.
3.2.2. Production Time
Production Time: Most experts emphasized the importance of time management in each production phase for efficiency. Expert A mentioned “In 3D animation production, time is one of the most valuable resources, especially during the asset creation phase, where the application of AI technology can significantly shorten production time”. Expert D added “Time management directly impacts the quality and budget control of the project, especially in post-production, where tight deadlines often lead to a decline in quality”. Therefore, production time has become an important evaluation metric.
3.2.3. AI Usage Hours
AI Usage Hours: Regarding the application of AI, experts tend to use AI usage hours to measure its contribution to each production stage. During the interviews, I first asked the experts what kind of criteria would best describe the extent of AI usage in their work and proposed several possible standards. Ultimately, the metric of AI usage hours was widely accepted by the experts. Expert B stated, “Compared to the specific types of tools, the actual hours of AI involvement in work better reflect its impact on production efficiency”. Expert H also pointed out, “Quantifying AI usage hours helps to better understand its role in improving efficiency, especially during the pre-production stage”. It should be noted that, in some projects, this metric is derived from recording the actual hours of AI usage, but in most projects, these data are estimated by the project managers, which introduces a certain level of subjectivity. Some experts also mentioned another potential metric, the AI Workload Ratio, but this metric largely overlaps with AI usage hours in terms of practical significance. After comprehensive consideration and given the feasibility and intuitiveness of collecting data on AI usage hours, we ultimately chose AI usage hours as a relatively reasonable indicator. Although there may be some subjectivity in AI usage hours, due to the lack of a unified industry standard, it remains an appropriate measure of AI usage in the current study.
Our data are sourced from various teams within the animation industry. Ensuring a generally consistent 3D animation workflow structure, we collected data from different types of 3D animation projects, including small studios, medium-sized teams, educational institutions, self-media, animation series, game outsourcing teams, and government and enterprise animation outsourcing projects. Most of these projects employed AI to varying extents to assist in production. Given the diversity in the AI tools used by each project, measuring the extent of AI usage based on the types and number of tools is not rigorous. Instead, the proportion of AI usage hours was confirmed as a more appropriate indicator through discussions with industry experts. All projects were in a completed state, with a time span from March 2023 to July 2024.
Based on the interviews with several experts in the animation industry and the usual 3D workflow of the animation industry, we established an indicator system, as shown in
Table 2.
Based on the expert interviews and industry practice, we established a four-stage evaluation framework. For the pre-production stage, we consider three basic inputs: staff allocation, time consumption, and AI usage hours. The outputs of this stage are measured by the number of concept designs and storyboard shots, which represent the creative planning outcomes.
The asset creation stage incorporates not only the three basic inputs but also utilizes the concept designs from the previous stage as an intermediate input, reflecting the sequential nature of animation production. This stage’s efficiency is measured by its ability to generate 3D models and character assets.
For the animation production stage, we consider both the standard inputs and two key intermediate products, characters from Stage 2 and storyboard shots directly from Stage 1, demonstrating the non-immediate successor flows in our framework. The stage’s output is quantified by the length of animated content produced.
The post-production stage maintains the three basic inputs and takes the animation length from Stage 3 as an intermediate input. Its efficiency is evaluated through two outputs: the final video length and a quality score. The quality score, based on a 100-point scale, represents the comprehensive evaluation from both audience feedback and expert assessment.
3.3. Research Model Construction
The selection of weights in our NDEA model employs a systematic approach based on resource consumption patterns. Each stage’s weight is determined by the proportion of total resources (staff, time, and AI usage hours) consumed in that stage, as calculated using Equation (6). This resource-based weighting method provides an objective measure of each stage’s relative importance in the production process while maintaining the mathematical consistency of the NDEA model. The approach is particularly suitable for animation production evaluation as it reflects the actual resource investment across different stages of the creative pipeline.
The methodology of this study is based on the general network DEA approach proposed by Cook et al. (2010) [
12], which is used to assess efficiency in multi-stage processes. Our innovative adaptation of this methodology specifically addresses the unique challenges of evaluating creative production processes, where outputs often include both quantitative metrics (such as production time) and qualitative elements (such as artistic quality). The overall efficiency of a multi-stage process is represented as a weighted average of the efficiencies of each stage, with each stage having its own inputs, outputs, and intermediate products passed on from the previous stage. Since the animation production process is generally divided into multiple stages, where the input of each stage is approximately equivalent to the output of the previous stage, a serial structure is well suited to represent the animation production workflow. However, given that certain outputs in the animation production process can bypass intermediate stages and become inputs for subsequent stages, we adopted a modified version of the serial multi-stage DMU structure, known as the non-immediate successor flows structure, as a reference model for our 3D animation production workflow. The non-immediate successor flows structure is shown in
Figure 1. In the non-immediate successor flows structure, outputs from one stage can bypass intermediate stages to become inputs for later stages. As shown in
Figure 1, while Stage 1 has sequential outputs to Stage 2, it also produces outputs that directly feed into Stage 3, bypassing Stage 2. This structure better reflects real production workflows where certain outputs may not require processing in every subsequent stage.
This study focuses on the 3D animation production process, employing a carefully considered four-stage framework based on both industry standards and practical workflow considerations. Our stage selection draws from established animation production methodologies while incorporating modern production realities. This division reflects both traditional animation pipeline structures and contemporary AI integration patterns.
The four stages—pre-production, asset creation, animation production, and post-production—were selected based on several key factors:
Industry Standard Alignment: Our framework builds upon the traditional three-stage pipeline (pre-production, production, post-production) widely accepted in the animation industry and documented in foundational texts like “3D Animation Essentials” [
54]. However, we specifically divided the production phase into ‘asset creation’ and ‘animation production’ to reflect modern production practices where these functions often operate as distinct units with different technical requirements and AI application potential.
Workflow Independence: Each selected stage represents a relatively independent workflow component with distinct inputs, outputs, and resource requirements. This independence is crucial for meaningful efficiency analysis using Network DEA methodology, as it allows for clear measurement of stage-specific improvements.
AI Integration Patterns: The selected stages align with current patterns of AI tool development and implementation in the animation industry. Different types of AI solutions have emerged for specific production tasks—from concept art generation in pre-production to automated rigging in asset creation, motion synthesis in animation production, and rendering optimization in post-production.
Resource Allocation Boundaries: These four stages typically represent natural boundaries for resource allocation and team organization in animation studios, making our analysis particularly relevant for practical implementation.
This enhanced granularity, particularly in separating asset creation from animation production, enables more precise examination of how AI technologies impact different aspects of the production pipeline, while maintaining consistency with established industry practices.
Figure 2 presents a detailed visualization of our four-stage framework, illustrating both the traditional workflow components and AI integration points within each stage. The figure highlights several key aspects of modern animation production:
Stage Components and Workflow: Each stage consists of clearly defined sequential tasks, beginning with specific inputs and culminating in stage outputs. The pre-production stage progresses from initial project requirements through story development, concept art, storyboarding to layout, resulting in comprehensive visual development and planning. The asset creation stage transforms these plans into production-ready 3D assets through modeling, UV and texturing, rigging, and asset management. The animation production stage incorporates motion capture, character animation, camera work, and scene assembly to create animation sequences. The post-production stage concludes the process with lighting, VFX, compositing, and color correction to deliver the final output.
AI Integration Points: The framework identifies specific AI applications (highlighted in blue) that complement traditional workflows at various points. In pre-production, AI assists with concept generation, script analysis, and layout automation. Asset creation benefits from automated modeling, smart rigging, texture generation, and AI-assisted asset arrangement. Animation production utilizes AI for motion capture correction, motion synthesis, crowd simulation, and scene optimization. Post-production employs AI for smart denoising, auto compositing, color correction, and quality enhancement.
Inter-stage Dependencies: The diagram illustrates workflow relationships through both solid arrows (direct sequential flow) and dotted lines (AI intervention points). Notable dependencies include the flow of visual development from pre-production to both asset creation and animation production stages, and the progression of assets through the animation and post-production pipeline. This interconnected structure reflects the complex nature of modern animation production where stages, while distinct, maintain crucial relationships with both their immediate predecessors and other stages in the pipeline.
Stage Boundaries and Outputs: Each stage has clearly defined boundaries with specific inputs and outputs, marked by black blocks in the diagram. This clear delineation of stage responsibilities and deliverables facilitates precise efficiency measurement using Network DEA methodology, allowing us to evaluate both traditional workflow efficiency and the impact of AI interventions at each stage.
This comprehensive framework provides the foundation for our efficiency analysis, enabling systematic evaluation of AI’s impact across different production stages while acknowledging the interconnected nature of animation production workflows.
While
Figure 2 illustrates the practical workflow and AI integration points in animation production,
Figure 3 presents the mathematical structure of our Network DEA model based on this four-stage framework. This model transforms the practical workflow into a quantifiable structure for efficiency analysis.
The production process is divided into four distinct stages: pre-production (Stage 1), asset creation (Stage 2), animation production (Stage 3), and post-production (Stage 4). Each stage has its own set of inputs, outputs, and intermediate products. The interactions between these stages and the flow of intermediate products are illustrated in
Figure 3.
Following the indicator system established in
Section 3.2 and the general framework of Network DEA, we construct a multi-stage efficiency evaluation model for 3D animation production. The model adopts a non-immediate successor flows structure, which effectively captures the complex relationships between different production stages, particularly the direct flow from pre-production to animation production that bypasses asset creation [
12].
For the mathematical formulation of our model, we first define the key variables. Let DMU_j represent the j-th decision-making unit. The input variables for each stage p (p = 1, 2, 3, 4) are denoted as
(number of staff),
(time consumption in hours), and
(AI usage hours). The complete variable definitions are presented in
Table 3.
The stage-specific outputs are defined as follows:
Stage 1 generates concept designs () and storyboard shots ()
Stage 2 produces models () and characters ()
Stage 3 creates animation sequences measured in seconds ()
Stage 4 delivers the final video () with an associated quality score ()
To evaluate the efficiency of each stage, we employ the ratio of weighted outputs to weighted inputs, incorporating both direct inputs and intermediate products. The efficiency measures for each stage are formulated as follows:
For Stage 1 (pre-production):
For Stage 2 (asset creation):
For Stage 3 (animation production):
For Stage 4 (post-production):
where
,
, and
represent the weights assigned to outputs, inputs, and intermediate products, respectively.
The overall efficiency θ is calculated as a weighted sum of individual stage efficiencies:
Following the resource-based weighting approach, the weight
for each stage is determined by the proportion of resources consumed in that stage:
This weighting method ensures that stages consuming more resources have a proportionally larger impact on the overall efficiency evaluation, which aligns with the practical significance of resource allocation in animation production [
14].
To solve this Network DEA model, we formulate it as a linear programming problem. For each DMU
j₀, the optimization problem is structured as follows:
This formulation allows us to determine the optimal weights that maximize the overall efficiency while maintaining the structural integrity of the production process. The solution to this linear programming problem provides both the overall efficiency score and the stage-specific efficiency scores for each DMU, enabling a comprehensive evaluation of the animation production process.
4. Results
4.1. Overall Efficiency Distribution
As illustrated in
Figure 4, the Network DEA analysis reveals significant variations in overall efficiency scores across the ten DMUs. The detailed efficiency scores are presented in
Table 4, showing values ranging from 0.19612 to 0.85175, with a mean of 0.48348 and standard deviation of 0.21937. The efficiency distribution shows a clear stratification into high (>0.60), medium (0.40–0.60), and low (<0.40) efficiency tiers.
Commercial projects demonstrate consistently higher efficiency scores, with game advertising (DMU6: 0.85175), social media content (DMU8: 0.67949), and bank promotional content (DMU7: 0.60279) occupying the high-efficiency tier. These projects maintain an average efficiency of 0.71134, significantly above the overall mean.
The medium-efficiency tier comprises projects from varied sectors, including animation short (DMU9: 0.59570), CG promotional content (DMU4: 0.51486), and 3D exhibition (DMU1: 0.57645). These projects show balanced performance across different production stages while maintaining efficiency scores above 0.50.
Lower efficiency scores characterize more complex or specialized productions, including the anime series (DMU10: 0.19612), university project (DMU2: 0.23096), medium animation (DMU5: 0.23698), and Naked Eye 3D LED Display project (DMU3: 0.34971). Educational and entertainment projects in this tier show notably lower average efficiency (0.23096 and 0.21655, respectively) compared to commercial projects.
The efficiency distribution reveals distinct patterns based on project type, scale, and complexity. Commercial projects maintain higher efficiency scores despite varying project requirements, while educational and entertainment projects face greater efficiency challenges. This pattern persists across different production scales and technical complexity levels.
4.2. Stage-Wise Efficiency Analysis
The heat map visualization (
Figure 5) shows distinct efficiency patterns across production stages:
Pre-production stage efficiencies range from 0.08795 to 1.00000, with:
Two DMUs achieving perfect efficiency (1.00000): DMU6 and DMU8
Three DMUs scoring below 0.20000: DMU3, DMU4, and DMU10
Remaining DMUs ranging between 0.20000 and 0.60000
Asset creation stage displays the widest efficiency variation:
Three DMUs reaching perfect efficiency (1.00000): DMU6, DMU8, and DMU9
Four DMUs scoring below 0.10000: DMU2, DMU5, DMU7, and DMU10
Three DMUs ranging between 0.60000 and 0.80000: DMU1, DMU3, and DMU4
Animation production stage shows consistently low efficiency:
Post-production stage demonstrates the highest consistent efficiency:
4.3. AI Usage Analysis
Our investigation encompassed both established AI solutions and enterprise-developed tools across different production stages. In pre-production, teams extensively utilized Stable Diffusion and Midjourney for concept art and storyboard generation. Several large studios developed customized node-based AI workflow tools (similar to ComfyUI v0.0.1) to streamline their production pipelines. For example, NetEase developed Sunshine Flow, a cloud-based node-based AI workflow system built on their DreamMaker platform V1.0, which enables up to five production pipelines to run simultaneously. This system significantly improved team efficiency in visual development and shot planning by allowing artists to create complex AI workflows without programming through visual node connections.
The asset creation stage showcased rapid advancement in AI-powered tools. Teams utilized Tripo AI V1.4 for efficient 3D model generation, particularly valued for its ability to produce clean topology and smooth geometry within seconds. Meshy provided comprehensive solutions for converting 2D concepts into 3D assets, while Luma AI offered sophisticated 3D asset generation capabilities. For character development, Meshcapade’s specialized platform streamlined digital human creation and animation preparation with its advanced AI-driven workflows.
During animation production, DeepMotion’s MotionGPT V1.0 emerged as a key tool, enabling direct conversion of text instructions into complex 3D animations. This was complemented by Viggle AI for nuanced character animation control and motion refinement. For complex scenes requiring multiple character animations, teams developed custom implementations of crowd simulation algorithms leveraging these AI frameworks as a foundation.
Post-production workflows integrated various AI-powered tools for rendering optimization and image enhancement. While traditional denoising solutions remained relevant, teams increasingly adopted new AI-enhanced rendering pipelines that offered superior efficiency and quality. Specialized AI tools for color correction, compositing, and quality control were strategically implemented to maintain consistency across rendered sequences.
The adoption and integration of AI technologies varied significantly based on project requirements and team expertise, as shown by the AI utilization ratios detailed in
Table 5 and illustrated in
Figure 6. Large studios often developed customized AI solutions to address their specific production needs, while smaller teams leveraged existing tools and cloud services to achieve similar efficiency gains. This pattern of AI integration, regardless of the specific tools chosen, demonstrated a clear relationship between strategic AI deployment and production efficiency improvements.
The analysis reveals distinctive patterns in AI adoption across different project types and production stages. Most notably, we observed significant variations in AI usage strategies, even among projects with similar overall efficiency scores. Social Media Content (DMU8), for instance, demonstrates consistently high AI integration across all production stages (60–85%), while Game Advertising (DMU6), despite achieving the highest overall efficiency score (0.85175), shows more targeted AI usage, concentrated primarily in pre-production (75%) and animation production (30%).
An interesting case in our dataset is the Animation Short (DMU9), which reports minimal AI usage (1%) across all stages. This represents a baseline scenario where AI integration was maintained at a minimal technical threshold to ensure computational stability in our analysis while accurately reflecting the project’s predominantly traditional animation workflow. Despite this minimal AI usage, the project achieved a relatively high efficiency score (0.59570), suggesting that efficiency gains can be achieved through various approaches beyond AI integration.
Stage-specific analysis reveals that pre-production typically sees the highest AI usage ratios, with six out of ten projects showing AI integration rates above 35% in this stage. The animation production stage shows more moderate AI adoption rates, generally ranging from 5% to 40%, with Social Media Content (DMU8) being a notable exception at 85%. Post-production exhibits the most varied AI usage patterns, ranging from minimal integration (1% in DMU9) to extensive utilization (70% in DMU8).
Interestingly, our data suggest that moderate to high AI usage in at least two production stages correlates with higher overall efficiency scores, though this relationship is not strictly linear. For example, Medium Animation (DMU5) shows relatively high AI usage in pre-production (80%) but achieves a lower overall efficiency score (0.23698), indicating that other factors beyond AI integration significantly influence production efficiency.
Stage-specific AI usage ratios (
Figure 6) show distinct patterns:
Pre-production stage:
Asset creation stage:
Animation production stage:
Post-production stage:
The relationship between AI usage ratio and overall efficiency (
Figure 4) shows:
DMUs with the highest efficiency scores (>0.60) employed AI usage ratios between 30–70%
MUs with the lowest efficiency scores (<0.40) showed AI usage ratios between 20–30%
A weak positive correlation exists between AI usage ratio and overall efficiency (correlation coefficient: 0.23)
The analysis of AI usage patterns across projects reveals an optimal integration range of 30–70%, supported by both empirical evidence and theoretical considerations. Projects operating within this range, such as Game Advertising (DMU6) and Bank Promotional (DMU7), achieved consistently higher efficiency scores. This optimal range can be explained through multiple frameworks:
First, from a resource allocation perspective, AI usage below 30% typically fails to overcome the initial implementation costs and learning curve investments. Our data show that projects with minimal AI integration (e.g., Animation Short with 1% usage) achieved moderate efficiency (0.59570) through traditional excellence but missed potential technological advantages.
Second, AI usage exceeding 70% appears to risk overemphasis on automation at the expense of creative control. While Social Media Content (DMU8) achieved high efficiency (0.67949) with 85% AI usage in animation production, it did not surpass the efficiency of projects maintaining more balanced human–AI collaboration. This aligns with recent findings on technology acceptance in creative industries [
30], suggesting that optimal outcomes require maintaining significant human creative input.
Third, this range represents an effective balance point for organizational learning and adaptation. Projects within the 30–70% range demonstrated successful integration of AI tools while maintaining established workflow strengths. This observation supports previous research on technology management system implementation [
55], which indicates that moderate technology adoption rates allow organizations to develop expertise and confidence while minimizing disruption.
The optimal range also varies by production stage, reflecting the different degrees of standardization possible in each phase. Post-production, with its more technical and standardized processes, can effectively utilize higher AI percentages, while creative stages like pre-production benefit from maintaining lower AI usage to preserve artistic innovation.
The distribution of AI usage ratios across different stages, as visualized in
Figure 6, further emphasizes these patterns while highlighting the varying approaches to AI integration taken by different projects. This variation suggests that successful AI implementation may depend not only on the extent of usage but also on how well it is integrated into existing workflows and aligned with project-specific requirements.
5. Discussion
Our empirical investigation into AI’s impact on animation production efficiency yielded several significant insights that both support and challenge our initial hypotheses. This discussion synthesizes our findings, examines their implications, and considers their broader significance for both theory and practice in the animation industry.
5.1. Evaluation of Research Hypotheses
Our analysis reveals a complex relationship between AI integration and production efficiency that partially supports our first hypothesis (H1) regarding AI’s positive impact on overall production efficiency. Projects demonstrating moderate to high AI integration (30–70% usage ratio) achieved notably superior efficiency scores, with top performers exceeding 0.60 in overall efficiency. However, the relatively weak positive correlation (0.23) between AI usage and efficiency suggests that successful AI implementation depends on more than mere technological adoption. This finding aligns with previous research suggesting that technology integration success relies heavily on implementation strategy and organizational readiness [
55].
Contrary to our second hypothesis (H2), which predicted peak efficiency gains in pre-production, the most substantial improvements emerged in post-production, where we observed remarkably consistent high efficiency scores (mean: 0.91275). This unexpected finding likely reflects the current state of AI technology development, where tools for post-production tasks have achieved greater maturity and standardization compared to those supporting more creative, early-stage processes. The pre-production stage exhibited considerable variation in efficiency (ranging from 0.08795 to 1.00000), suggesting that while AI can enhance early-stage processes, its effectiveness remains less predictable in these contexts.
Our third hypothesis (H3), which anticipated greater efficiency improvements in educational projects due to resource constraints, was not supported by the data. Instead, commercial projects, particularly in Game Advertising (DMU6: 0.85175) and Social Media Content (DMU8: 0.67949), demonstrated superior efficiency gains. This finding suggests that successful AI integration may depend more on organizational infrastructure and implementation capability than on resource limitations driving innovation.
5.2. Factors Influencing Efficiency Performance
The significant variations in efficiency scores across different animation projects reveal complex interactions between organizational capabilities, project characteristics, and AI implementation strategies. Our analysis identifies several critical factors that fundamentally influence production efficiency.
Project scope emerges as a primary determinant of efficiency, particularly in how it shapes AI integration opportunities. Commercial projects’ superior efficiency (mean: 0.71134 vs. 0.23096 for educational projects) stems not merely from resource advantages but from their well-defined deliverables and established quality metrics. This finding aligns with previous research highlighting the importance of clear project boundaries in technology adoption [
40,
41]. However, our study extends this understanding by demonstrating how project scope specifically affects AI integration effectiveness. For instance, Game Advertising’s high efficiency (0.85175) reflects not just scope clarity but how this clarity enables systematic AI tool deployment across production stages.
Organizational learning and adaptation capabilities significantly influence efficiency outcomes. The marked efficiency gap between commercial and entertainment projects (0.71134 vs. 0.21655) reflects differences in organizational ability to optimize AI integration over time. This observation supports recent findings on technology acceptance in creative industries [
32], while revealing how learning patterns specifically affect AI implementation success. Short-cycle productions, particularly in Social Media Content (DMU8: 0.67949), demonstrate superior learning and adaptation through rapid iteration cycles, allowing for the quick optimization of AI integration strategies.
The relationship between standardization and efficiency presents an interesting paradox in creative production. While standardization generally enhances efficiency, as evidenced by commercial projects’ performance, excessive standardization can impede creative aspects necessary for certain project types. This tension explains why entertainment projects like anime series (DMU10: 0.19612) face efficiency challenges despite having structured production pipelines. The finding suggests that optimal efficiency requires balancing standardization with creative flexibility, a perspective not fully explored in the existing literature on AI in creative industries [
22,
23].
Resource allocation strategies prove critical, but their impact depends heavily on organizational context. This study reveals that efficient AI integration relies more on strategic deployment than resource abundance. This finding challenges conventional assumptions about technology adoption requiring substantial resource investment [
39]. Instead, successful projects demonstrate that targeted AI implementation in high-impact areas yields better results than comprehensive but unfocused deployment. The optimal AI usage range (30–70%) identified in our analysis suggests a “sweet spot”, where AI enhancement balances effectively with human creativity.
Technical infrastructure, while important, shows less direct influence on efficiency than previously theorized [
47,
48]. Projects with sophisticated technical setups do not automatically achieve higher efficiency, as demonstrated by the varying performance of technically similar projects. This finding suggests that organizational and managerial factors may have greater influence on efficiency than pure technical capabilities, an insight that extends the current understanding of AI adoption in creative industries.
These findings highlight the need for a nuanced approach to efficiency improvement in AI-enhanced animation production. The success of high-performing projects stems from their ability to align project characteristics, organizational capabilities, and AI implementation strategies effectively. This alignment requires careful consideration of project scope, learning capabilities, standardization levels, and resource allocation strategies, factors that interact dynamically rather than operating independently.
5.3. Patterns in AI Integration Across Production Stages
The distinctive patterns of AI efficiency across different production stages offer valuable insights into the current state of AI integration in animation production. The consistently high efficiency observed in post-production warrants particular attention, as it appears to represent the most successful integration of AI technology in the animation workflow.
Our analysis reveals that the varying efficiency scores across stages are not merely numerical differences but reflect deeper structural and operational realities of animation production.
Post-production’s consistently high efficiency (mean: 0.91275) can be attributed to several key factors. First, these tasks typically involve well-defined technical processes with clear quality metrics, such as rendering optimization, color correction, and compositing. The standardized nature of these tasks makes them particularly suitable for AI automation. Second, post-production workflows often follow linear, sequential patterns, where input–output relationships are clearly defined, allowing AI systems to optimize effectively. Third, the maturity of AI tools in this domain, such as NVIDIA’s AI-accelerated rendering solutions, reflects years of focused development in solving specific technical challenges.
In contrast, the animation production stage’s consistently low efficiency scores (mean: 0.04213) highlight the unique challenges of automating creative movement design. Unlike post-production’s technical processes, character animation requires understanding of physics, emotion, and artistic timing, complex qualities that current AI systems struggle to replicate convincingly. The low efficiency scores also reflect the highly iterative nature of animation work, where changes often ripple through entire sequences, making automation more challenging. Furthermore, the subjective quality assessment of animation movement means that AI solutions must satisfy not just technical metrics but also artistic and narrative requirements.
The pre-production stage’s variable efficiency (ranging from 0.08795 to 1.00000) demonstrates how AI’s effectiveness varies with task specificity. Projects achieving perfect efficiency (1.00000) typically involved more structured pre-production tasks, such as technical visualization or standard asset planning. Lower scores often corresponded with concept development and creative planning tasks that required novel artistic solutions. This variance suggests that while AI can excel at structured pre-production tasks, it still struggles with the more abstract, creative aspects of this stage.
These stage-wise variations in efficiency align with broader patterns in AI technology development. Current AI excels at tasks with the following:
This explains why post-production, with its more technical and standardized processes, shows consistently higher efficiency than stages requiring artistic judgment and creative innovation. The pattern also suggests that future AI development in animation should focus on better supporting creative decision-making processes while maintaining the strong performance in technical tasks.
The observed efficiency patterns also reflect practical workflow realities. Post-production’s high efficiency benefits from occurring last in the production pipeline, where creative decisions are largely finalized, and tasks focus on technical execution. In contrast, earlier stages must remain flexible to accommodate creative changes, making them inherently more challenging to automate effectively.
These findings suggest that optimal AI integration strategies should vary by production stage:
Post-production: Embrace comprehensive AI integration for technical tasks;
Animation Production: Use AI selectively for technical aspects while maintaining human control over creative elements;
Pre-production: Implement AI for structured tasks while preserving human-led creative development.
5.4. Theoretical and Practical Implications
The findings from this study contribute to both the theoretical understanding and practical application of AI in creative production contexts. From a theoretical perspective, our results challenge traditional assumptions about technology adoption and efficiency improvement in creative industries. The non-linear relationship between AI usage and efficiency improvement suggests that successful AI integration depends on a complex interplay of technological, organizational, and human factors. This observation extends existing theories about technology adoption by highlighting the importance of context-specific implementation strategies.
The marked variation in AI effectiveness across different production stages also contributes to our theoretical understanding of technology integration in creative workflows. The higher success rate in post-production suggests that the standardization of processes may be a crucial precondition for effective AI implementation, a finding that has implications for how we conceptualize the role of AI in creative industries. This insight builds upon existing research on technology adoption in creative contexts while offering new perspectives on the conditions that facilitate successful AI integration.
Our research makes four major contributions to the field:
We reveal that AI integration efficiency in animation production depends primarily on organizational context rather than technological capabilities alone, challenging previous assumptions about AI adoption in creative industries.
We identify an optimal AI usage range of 30–70% across production stages, with efficiency declining outside this range, regardless of project type or scale.
We demonstrate that successful AI integration relies more on targeted deployment in standardized processes than comprehensive implementation, particularly for resource-constrained teams.
We establish that post-production standardization serves as a crucial foundation for broader AI implementation, providing a clear starting point for studios beginning AI integration.
These insights translate into practical implementation strategies for studios of varying scales. For large studios, successful AI integration begins with post-production processes, where tools show consistent efficiency gains. These organizations benefit from developing robust, standardized workflows before expanding AI implementation to more creative stages. The optimal AI usage range provides a practical guideline for resource allocation, while clear evaluation metrics help maintain quality control throughout the integration process.
Smaller, resource-constrained teams require a more focused approach to AI implementation. Rather than attempting comprehensive integration, these studios should prioritize specific high-impact areas that align with their core competencies. Quick feedback cycles and adaptable workflows prove particularly effective for smaller teams, allowing them to optimize AI tool usage while maintaining flexibility for growth. Cloud-based AI solutions and shared resources can help overcome initial infrastructure limitations.
This study also reveals distinct implementation strategies for different project types. Commercial projects benefit from early investment in workflow standardization and clear quality metrics, maintaining a careful balance between automation and creative control. Educational and creative projects, however, require a more nuanced approach, where AI tools enhance rather than constrain creativity. In these contexts, gradual implementation alongside skill development proves more effective, with a focus on reducing technical rather than creative workload.
This systematic approach to AI implementation begins with a careful assessment of current workflows and organizational readiness. Studios should first establish standardized processes and measurement metrics in areas most amenable to AI integration, typically starting with post-production tasks. As teams develop capabilities and confidence, AI implementation can expand strategically to other production stages. Continuous monitoring and adjustment ensure optimal integration, while knowledge sharing across teams helps establish best practices. Success depends not on the speed of adoption but on thoughtful alignment between AI capabilities, organizational readiness, and project requirements.
From a practical standpoint, our findings suggest several strategic implications for animation studios and production companies. First, organizations might benefit from a phased approach to AI implementation, beginning with post-production processes, where the technology has demonstrated the most consistent benefits. This approach allows organizations to build expertise and confidence with AI tools in areas where success is more readily achievable before tackling more challenging implementations in creative stages.
Second, the significant variation in efficiency across different project types suggests that organizations should carefully consider their specific production context when planning AI integration. The success of commercial projects in achieving higher efficiency gains indicates that organizational capability and infrastructure play crucial roles in determining AI implementation outcomes. Studios should, therefore, assess and potentially enhance their organizational readiness before embarking on significant AI integration initiatives.
5.5. Limitations and Future Research Directions
While this study provides valuable insights into AI’s impact on animation production efficiency, several limitations warrant consideration. The sample size of ten DMUs represents a significant limitation of this study. While these cases provide valuable initial insights across different project types, this limited sample presents several methodological challenges. First, it restricts the statistical power of our analysis and the generalizability of our findings across the broader animation industry. Second, with only ten cases, we may not have captured the full range of AI implementation scenarios, particularly in specialized animation sectors or unique production contexts. Third, the small sample size makes it difficult to control for potentially confounding variables, such as project scale, team expertise levels, and organizational maturity in AI adoption. However, as this specialized research direction gains increasing attention and deeper investigation from the academic community, we anticipate opportunities for larger-scale, more comprehensive studies that will further validate and expand upon our initial findings.
Despite these sampling limitations, our study makes significant contributions by providing a structured framework for evaluating AI’s impact on animation production efficiency. The four-stage analysis model we developed offers a practical template that future researchers can build upon and refine with larger datasets.
When applying NDEA to creative industries like animation production, several methodological limitations warrant consideration. First, NDEA’s inherent focus on quantifiable inputs and outputs may not fully capture the artistic and creative aspects of animation production. While our model incorporates quality scores, the subjective nature of creative excellence remains challenging to quantify [
56]. Despite the increasing standardization of 3D animation production workflows towards industrial-like processes, the fundamental artistic and creative nature of animation presents inherent measurement challenges. The very definition of creativity lacks consistency, complicating the selection and application of measurement methods [
57]. Nevertheless, our approach of combining quantitative efficiency metrics with quality scores provides a balanced methodology that future studies can adapt and enhance.
Furthermore, while the evaluation of highly creative capabilities remains a long-debated topic, our study contributes by demonstrating how structured efficiency analysis can coexist with creative processes. Although the perfect quantification of artistic value may be unattainable, our methodology offers a practical framework for assessing operational efficiency without compromising creative integrity.
The traditional NDEA assumptions of stage independence and linear relationships between inputs and outputs present additional challenges in creative contexts. However, our model’s ability to identify efficiency patterns across different production stages, despite these limitations, provides valuable insights for practitioners and researchers alike. The identification of post-production as a consistently high-efficiency stage, for instance, offers actionable insights for resource allocation and AI implementation strategies.
These limitations point toward promising directions for future research. While our current framework may not capture all nuances of creative production, it establishes a foundation for more sophisticated evaluation approaches. Future studies could do the following:
Develop advanced evaluation methodologies that integrate qualitative creative assessments with our quantitative framework, particularly in capturing the artistic value and creative quality of animation outputs;
Enhance the current model by incorporating dynamic analysis approaches that reflect the iterative nature of animation production, especially the feedback loops between different production stages;
Conduct longitudinal research tracking the evolution of efficiency metrics and creative outcomes over multiple projects, providing deeper insights into the long-term impact of AI adoption;
Expand upon our established framework with larger sample sizes across various animation sectors, from feature films to educational content, examining how different scales of production and resource constraints influence AI implementation strategies.
The animation industry’s continued evolution alongside AI technology suggests that these research directions will become increasingly important. While our study has limitations, it provides a crucial starting point for understanding the complex interplay between technological efficiency and creative excellence in animation production. As AI tools become more sophisticated and their integration more nuanced, the framework we established can serve as a foundation for future investigations that will further enhance our understanding of both the technical and artistic aspects of animation production efficiency.
6. Conclusions
This study provides a comprehensive analysis of AI technology’s impact on 3D animation production efficiency through the Network DEA methodology. By examining multiple stages of the production pipeline across diverse project types, we uncovered significant patterns in the relationship between AI integration and production efficiency. Our findings reveal that successful AI implementation depends fundamentally on organizational context rather than purely technological capabilities, challenging traditional assumptions about technology adoption in creative industries.
The research establishes several critical insights for AI integration in animation production. Most notably, we identify an optimal AI usage range of 30–70% across production stages, beyond which efficiency gains diminish, regardless of project scale or type. This finding provides concrete guidance for studios in resource allocation and implementation planning. This study also demonstrates that successful AI integration relies more on targeted deployment in standardized processes than comprehensive implementation, particularly benefiting resource-constrained teams. Furthermore, our analysis reveals that post-production standardization serves as a crucial foundation for broader AI integration, offering a clear starting point for studios beginning their AI adoption journey.
These findings have important implications for different scales of animation studios. Large studios benefit from a systematic approach that begins with post-production processes and gradually expands to more creative stages, maintaining careful balance between automation and artistic control. Smaller teams, rather than attempting comprehensive integration, should focus on specific high-impact areas that align with their core competencies, leveraging cloud-based solutions and shared resources to overcome infrastructure limitations.
The animation industry stands at a crucial juncture as AI technology continues to evolve rapidly. Our research demonstrates that enhancing production efficiency through AI requires thoughtful alignment between technological capabilities, organizational readiness, and project requirements. The success of commercial projects, particularly in game advertising and social media content, illustrates how clear implementation frameworks and strategic AI deployment can significantly improve production efficiency while maintaining creative quality.
Looking ahead, future research should explore how evolving AI technologies can better support creative decision-making processes in pre-production and animation stages, where current implementation shows more variable results. Additionally, longitudinal studies could provide valuable insights into how organizations optimize their AI integration strategies over time and across different project types.
This research contributes to both the theoretical understanding and practical application of AI in creative production. Through empirical analysis and strategic insights, it provides a foundation for organizations seeking to enhance their animation production efficiency through AI integration. The findings suggest that success lies not in the speed of adoption but in the thoughtful alignment of AI capabilities with organizational context and project requirements, ensuring that technological innovation serves rather than constrains creative excellence.