Restructure skill to follow Progressive Disclosure Architecture: Structure Changes: - Move Python scripts to scripts/ directory - Move sample JSON files to assets/ directory - Create references/ directory with extracted content - Remove redundant HOW_TO_USE.md and README.md New Reference Files: - references/metrics.md: Detailed scoring algorithms and formulas - references/examples.md: Concrete input/output examples - references/workflows.md: Step-by-step evaluation workflows SKILL.md Improvements: - Reduced from 430 lines to ~180 lines - Added table of contents - Added trigger phrases in description - Consistent imperative voice - Points to references for details Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
8.0 KiB
Technology Evaluation Workflows
Step-by-step workflows for common evaluation scenarios.
Table of Contents
- Framework Comparison Workflow
- TCO Analysis Workflow
- Migration Assessment Workflow
- Security Evaluation Workflow
- Cloud Provider Selection Workflow
Framework Comparison Workflow
Use this workflow when comparing frontend/backend frameworks or libraries.
Step 1: Define Requirements
-
Identify the use case:
- What type of application? (SaaS, e-commerce, real-time, etc.)
- What scale? (users, requests, data volume)
- What team size and skill level?
-
Set priorities (weights must sum to 100%):
- Performance: ____%
- Scalability: ____%
- Developer Experience: ____%
- Ecosystem: ____%
- Learning Curve: ____%
- Other: ____%
-
List constraints:
- Budget limitations
- Timeline requirements
- Compliance needs
- Existing infrastructure
Step 2: Run Comparison
python scripts/stack_comparator.py \
--technologies "React,Vue,Angular" \
--use-case "enterprise-saas" \
--weights "performance:20,ecosystem:25,scalability:20,developer_experience:35"
Step 3: Analyze Results
- Review weighted total scores
- Check confidence level (High/Medium/Low)
- Examine strengths and weaknesses for each option
- Review decision factors
Step 4: Validate Recommendation
- Match recommendation to your constraints
- Consider team skills and hiring market
- Evaluate ecosystem for your specific needs
- Check corporate backing and long-term viability
Step 5: Document Decision
Record:
- Final selection with rationale
- Trade-offs accepted
- Risks identified
- Mitigation strategies
TCO Analysis Workflow
Use this workflow for comprehensive cost analysis over multiple years.
Step 1: Gather Cost Data
Initial Costs:
- Licensing fees (if any)
- Training hours per developer
- Developer hourly rate
- Migration costs
- Setup and tooling costs
Operational Costs:
- Monthly hosting costs
- Annual support contracts
- Maintenance hours per developer per month
Scaling Parameters:
- Initial user count
- Expected annual growth rate
- Infrastructure scaling approach
Step 2: Run TCO Calculator
python scripts/tco_calculator.py \
--input assets/sample_input_tco.json \
--years 5 \
--output tco_report.json
Step 3: Analyze Cost Breakdown
- Review initial vs. operational costs ratio
- Examine year-over-year cost growth
- Check cost per user trends
- Identify scaling efficiency
Step 4: Identify Optimization Opportunities
Review:
- Can hosting costs be reduced with reserved pricing?
- Can automation reduce maintenance hours?
- Are there cheaper alternatives for specific components?
Step 5: Compare Multiple Options
Run TCO analysis for each technology option:
- Current state (baseline)
- Option A
- Option B
Compare:
- 5-year total cost
- Break-even point
- Risk-adjusted costs
Migration Assessment Workflow
Use this workflow when planning technology migrations.
Step 1: Document Current State
- Count lines of code
- List all components/modules
- Identify dependencies
- Document current architecture
- Note existing pain points
Step 2: Define Target State
- Target technology/framework
- Target architecture
- Expected benefits
- Success criteria
Step 3: Assess Team Readiness
- How many developers have target technology experience?
- What training is needed?
- What is the team's capacity during migration?
Step 4: Run Migration Analysis
python scripts/migration_analyzer.py \
--from "angular-1.x" \
--to "react" \
--codebase-size 50000 \
--components 200 \
--team-size 6
Step 5: Review Risk Assessment
For each risk category:
- Identify specific risks
- Assess probability and impact
- Define mitigation strategies
- Assign risk owners
Step 6: Plan Migration Phases
-
Phase 1: Foundation
- Setup new infrastructure
- Create migration utilities
- Train team
-
Phase 2: Incremental Migration
- Migrate by feature area
- Maintain parallel systems
- Continuous testing
-
Phase 3: Completion
- Remove legacy code
- Optimize performance
- Complete documentation
-
Phase 4: Stabilization
- Monitor production
- Address issues
- Gather metrics
Step 7: Define Rollback Plan
Document:
- Trigger conditions for rollback
- Rollback procedure
- Data recovery steps
- Communication plan
Security Evaluation Workflow
Use this workflow for security and compliance assessment.
Step 1: Identify Requirements
-
List applicable compliance standards:
- GDPR
- SOC2
- HIPAA
- PCI-DSS
- Other: _____
-
Define security priorities:
- Data encryption requirements
- Access control needs
- Audit logging requirements
- Incident response expectations
Step 2: Gather Security Data
For each technology:
- CVE count (last 12 months)
- CVE count (last 3 years)
- Severity distribution
- Average patch time
- Security features list
Step 3: Run Security Assessment
python scripts/security_assessor.py \
--technology "express-js" \
--compliance "soc2,gdpr" \
--output security_report.json
Step 4: Analyze Results
Review:
- Overall security score
- Vulnerability trends
- Patch responsiveness
- Compliance readiness per standard
Step 5: Identify Gaps
For each compliance standard:
- List missing requirements
- Estimate remediation effort
- Identify workarounds if available
- Calculate compliance cost
Step 6: Make Risk-Based Decision
Consider:
- Acceptable risk level
- Cost of remediation
- Alternative technologies
- Business impact of compliance gaps
Cloud Provider Selection Workflow
Use this workflow for AWS vs Azure vs GCP decisions.
Step 1: Define Workload Requirements
-
Workload type:
- Web application
- API services
- Data analytics
- Machine learning
- IoT
- Other: _____
-
Resource requirements:
- Compute: ____ instances, ____ cores, ____ GB RAM
- Storage: ____ TB, type (block/object/file)
- Database: ____ type, ____ size
- Network: ____ GB/month transfer
-
Special requirements:
- GPU/TPU for ML
- Edge computing
- Multi-region
- Specific compliance certifications
Step 2: Evaluate Feature Availability
For each provider, verify:
- Required services exist
- Service maturity level
- Regional availability
- SLA guarantees
Step 3: Run Cost Comparison
python scripts/tco_calculator.py \
--providers "aws,azure,gcp" \
--workload-config workload.json \
--years 3
Step 4: Assess Ecosystem Fit
Consider:
- Team's existing expertise
- Development tooling preferences
- CI/CD integration
- Monitoring and observability tools
Step 5: Evaluate Vendor Lock-in
For each provider:
- List proprietary services you'll use
- Estimate migration cost if switching
- Identify portable alternatives
- Calculate lock-in risk score
Step 6: Make Final Selection
Weight factors:
- Cost: ____%
- Features: ____%
- Team expertise: ____%
- Lock-in risk: ____%
- Support quality: ____%
Select provider with highest weighted score.
Best Practices
For All Evaluations
- Document assumptions - Make all assumptions explicit
- Validate data - Verify metrics from multiple sources
- Consider context - Generic scores may not apply to your situation
- Include stakeholders - Get input from team members who will use the technology
- Plan for change - Technology landscapes evolve; plan for flexibility
Common Pitfalls to Avoid
- Over-weighting recent popularity vs. long-term stability
- Ignoring team learning curve in timeline estimates
- Underestimating migration complexity
- Assuming vendor claims are accurate
- Not accounting for hidden costs (training, hiring, technical debt)