← Back to Hub ← 返回主页

Week 14: Implementation & Evaluation 第 14 周：系统实施与评估

Learning Objectives 学习目标

  • Evaluate system implementation and conversion strategies.
  • Define User Acceptance Testing (UAT) frameworks.
  • Identify post-implementation audit procedures.

Step-by-Step Guide 分步指南

9.1 Implementation Strategy & System Conversion

  • Direct Cutover: The old system is immediately stopped, and the new system is started. High risk if errors occur, but lowest cost and fastest implementation.
  • Parallel Running: Both old and new systems run simultaneously for a period. Lowest risk as the old system serves as a backup, but highest cost and doubles user workload.
  • Phased Conversion: Modules or features are introduced step-by-step (e.g., database tier first, then analytical modules).
  • Pilot Study: The new system is fully implemented in one department or location first to test stability before global deployment.

Real-world Case: Target Canada Failure

  • Target's Canadian expansion failed due to a direct cutover deployment of a new ERP/DSS system.
  • Undetected data entry errors caused major supply chain blockages, leaving shelves empty. Because they did not run a parallel system, they could not roll back, causing a $5.4B write-off.

Reference: Target Canada Failed Retail Expansion Inside Story

9.2 Implementation and System Evaluation

  • User Acceptance Testing (UAT): A critical verification phase where business managers test the system against actual business scenarios to sign off on usability.
  • Evaluation Criteria:
    • System Accuracy: Verify that mathematical models and databases return precise results.
    • Response Time: Measure query execution latency.
    • User Satisfaction: Usability scores gathered from survey feedback.
    • Economic Value: Calculate the actual cost-savings or profit gains.

Real-world Case: FedEx UAT Processes

  • FedEx supply chain planners undergo weeks of rigorous UAT testing during pilot stages.
  • They manually verify that route recommendations match actual logistics schedules before certifying the system for production deployment.

Reference: FedEx Operations UAT Certification

Comparison of Conversion Strategies

Conversion Strategy Implementation Action Risk Level Cost Level Best For
Direct Cutover Immediately stops old system and runs new DSS. Extremely High Low Non-critical systems, simple database changes
Parallel Running Runs old and new systems concurrently. Very Low Extremely High Critical banking or logistics systems
Phased Rollout Deploys new modules step-by-step. Low Moderate Large ERP or complex multipart DSS
Pilot Study Deploys system to one department first. Low Moderate Branch offices, localized retail networks

User Acceptance Testing (UAT)

UAT is the final gatekeeper verification before formal system acceptance. Test cases must be written by business users, verifying if the computational results and UI display meet specifications.

9.1 系统实施策略与系统切换

  • 直接切换 (Direct Cutover)： 立即停止旧系统，并启动新系统。如果发生错误风险极高，但成本最低且实施速度最快。
  • 并行运行 (Parallel Running)： 新旧系统同时运行一段时间。由于旧系统作为备份，风险最低，但成本最高且使用户的工作量翻倍。
  • 分阶段转换 (Phased Conversion)： 按步骤逐步引入系统模块或功能（例如，先部署数据库层，再部署分析模块）。
  • 试点研究 (Pilot Study)： 首先在一个部门或分支机构全面实施新系统以测试稳定性，然后再进行全局部署。

真实企业案例：塔吉特加拿大分公司 (Target Canada) 崩溃

  • Target 在加拿大扩张失败归因于对其全新的 ERP/DSS 系统进行了“直接切换”部署。
  • 未被检测出的录入数据错误导致了严重的供应链堵塞，导致货架空空如也。由于没有运行并行系统，他们无法回滚，造成了 54 亿美元的损失。

参考链接： Target 加拿大零售扩张失败的内幕故事

9.2 系统实施与用户验收评估

  • 用户验收测试 (UAT)： 关键的验证阶段，业务经理根据实际业务场景对系统进行测试，以确认其易用性并签署验收意见。
  • 评估标准体系：
    • 系统准确性： 验证数学模型和数据库返回的结果是否精确无误。
    • 响应时间： 测量查询执行的延迟时间。
    • 用户满意度： 从调查反馈中收集的易用性评分。
    • 经济价值： 计算实际节省的成本或带来的利润增长。

真实企业案例：联邦快递 (FedEx) 的 UAT 流程

  • 联邦快递的供应链计划人员在试点阶段要进行为期数周的严格 UAT 测试。
  • 他们手动核对路线推荐与实际物流班次是否一致，之后才签字批准将系统正式部署上线。

参考链接： 联邦快递运营 UAT 认证

四种系统切换策略全面对比

切换部署策略 具体执行动作 系统风险度 部署成本 最佳应用时机
直接切换 (Direct) 立即停用旧系统，同时完全启用新 DSS。 极高风险 低成本 非核心系统、简单数据库的小变动部署
并行运行 (Parallel) 新旧两套系统同时运行以比对结果。 极低风险 极高成本 核心银行业务系统、高精度物流调度系统
分阶段引入 (Phased) 按系统模块分步逐步部署激活。 较低风险 中等成本 大型企业 ERP 系统、复杂的模块化 DSS
试点研究 (Pilot) 先在单个部门或分部试点运行该系统。 较低风险 中等成本 多分店连锁零售网络、区域性企业部署

用户验收测试 (UAT)

UAT 是系统交付投产前最关键的验证关卡。测试用例必须由具体的业务人员（而非开发人员）编写，用于验证系统的计算结果和界面显示是否符合业务规划。

Concept Visualization 概念可视化

Old SystemNew SystemDirect Cutover

Educational Infographic 教学信息图

Visual concept map explaining the key module topic: 解释该模块核心主题的视觉概念图：

Direct Cutover Instant switchover High Risk Parallel Running Both run together Safe & Expensive Phased Rollout Incremental launch Manageable Steps

📊 Practical Decision Support Suite (Week 14) 📊 实用决策支持套件（第 14 周）

📗 System Conversion Strategy Decision Matrix

Evaluate cutover methods for enterprise deployment:

| Conversion Strategy | Operational Risk | Cost | Business Impact | |---|---|---|---| | Direct Cutover | High | Low | Immediate shutdown of legacy system | | Parallel Running | Low | High | Both legacy & new DSS run concurrently | | Phased Rollout | Moderate | Moderate | Module-by-module deployment | | Pilot Study | Low | Moderate | Test deployment in one branch first |

Tips 提示

UAT stands for User Acceptance Testing. Note that direct cutover is the highest risk conversion strategy, whereas parallel running is the lowest risk.
UAT 代表用户验收测试。注意，直接切换是风险最高的系统切换策略，而并行运行是风险最低的。

Knowledge Check 知识自测

1. Which conversion strategy runs both the old and new systems simultaneously? 哪种系统切换策略同时运行新旧系统？

Show Explanation 显示解析
Correct Answer: Option 2 正确选项：选项 2

2. The testing phase where business users manually certify the system is: 业务用户手动对系统进行认证的测试阶段是：

Show Explanation 显示解析
Correct Answer: Option 3 正确选项：选项 3

3. Which conversion strategy carries the highest operational risk? 哪种系统切换策略具有最高的运行风险？

Show Explanation 显示解析
Correct Answer: Option 1 正确选项：选项 1

Practical Exercise 实践练习

Task 1: SQL query to update 'Status' to 'Evaluated' in 'Systems' table. 任务 1: SQL 查询：更新 'Systems' 表中的 'Status' 值为 'Evaluated'。

Task 2: Excel formula to return today's current date. 任务 2: Excel 公式：返回今天的当前日期。

Task 3: JavaScript call statement to reload the current window page. 任务 3: JavaScript 调用语句：重新加载当前窗口页面。

Revision Guide 复习指南

Revision Checklist:

  • I can evaluate and choose the best system conversion strategy.
  • I understand how to structure User Acceptance Testing for decision support.
  • I know the metrics used to evaluate DSS business value (payback, satisfaction).

Key Concepts to Remember:

  • Implementation Strategy & System Conversion:
    • Direct Cutover: The old system is immediately stopped, and the ne...
    • Implementation and System Evaluation:
      • User Acceptance Testing (UAT): A critical verification phase wher...

Matching Game 配对游戏

Match the term on the left with its definition on the right. 将左侧的术语与右侧的定义进行配对。

Parallel Running
Immediate shutdown of old system and launch of new one立即关闭旧系统并启动新系统
Pilot Study
Running both systems concurrently for a trial period在试运行期间同时运行新旧系统
UAT
Full system launch in one branch location first首先在一个分支机构全面上线系统
Direct Cutover
End-user manual testing to verify business usability最终用户手动测试以验证业务易用性