6707dd18c2
- Comprehensive interview system design toolkit - Interview Loop Designer: generates calibrated loops for any role/level - Question Bank Generator: creates competency-based questions with rubrics - Hiring Calibrator: analyzes interview data for bias and calibration issues - Complete reference materials: competency matrices, bias mitigation, debrief guides - Sample data and expected outputs for testing - Supports all major roles: SWE, PM, Designer, Data, DevOps, Leadership - Zero external dependencies, Python standard library only - Dual output: JSON + human-readable text formats
171 lines
16 KiB
Markdown
171 lines
16 KiB
Markdown
# Competency Matrix Templates
|
|
|
|
This document provides comprehensive competency matrix templates for different engineering roles and levels. Use these matrices to design role-specific interview loops and evaluation criteria.
|
|
|
|
## Software Engineering Competency Matrix
|
|
|
|
### Technical Competencies
|
|
|
|
| Competency | Junior (L1-L2) | Mid (L3-L4) | Senior (L5-L6) | Staff+ (L7+) |
|
|
|------------|----------------|-------------|----------------|--------------|
|
|
| **Coding & Algorithms** | Basic data structures, simple algorithms, language syntax | Advanced algorithms, complexity analysis, optimization | Complex problem solving, algorithm design, performance tuning | Architecture-level algorithmic decisions, novel approach design |
|
|
| **System Design** | Component interactions, basic scalability concepts | Service design, database modeling, API design | Distributed systems, scalability patterns, trade-off analysis | Large-scale architecture, cross-system design, technology strategy |
|
|
| **Code Quality** | Readable code, basic testing, follows conventions | Maintainable code, comprehensive testing, design patterns | Code reviews, quality standards, refactoring leadership | Engineering standards, quality culture, technical debt management |
|
|
| **Debugging & Problem Solving** | Basic debugging, structured problem approach | Complex debugging, root cause analysis, performance issues | System-wide debugging, production issues, incident response | Cross-system troubleshooting, preventive measures, tooling design |
|
|
| **Domain Knowledge** | Learning role-specific technologies | Proficiency in domain tools/frameworks | Deep domain expertise, technology evaluation | Domain leadership, technology roadmap, innovation |
|
|
|
|
### Behavioral Competencies
|
|
|
|
| Competency | Junior (L1-L2) | Mid (L3-L4) | Senior (L5-L6) | Staff+ (L7+) |
|
|
|------------|----------------|-------------|----------------|--------------|
|
|
| **Communication** | Clear status updates, asks good questions | Technical explanations, stakeholder updates | Cross-functional communication, technical writing | Executive communication, external representation, thought leadership |
|
|
| **Collaboration** | Team participation, code reviews | Cross-team projects, knowledge sharing | Team leadership, conflict resolution | Cross-org collaboration, culture building, strategic partnerships |
|
|
| **Leadership & Influence** | Peer mentoring, positive attitude | Junior mentoring, project ownership | Team guidance, technical decisions, hiring | Org-wide influence, vision setting, culture change |
|
|
| **Growth & Learning** | Skill development, feedback receptivity | Proactive learning, teaching others | Continuous improvement, trend awareness | Learning culture, industry leadership, innovation adoption |
|
|
| **Ownership & Initiative** | Task completion, quality focus | Project ownership, process improvement | Feature/service ownership, strategic thinking | Product/platform ownership, business impact, market influence |
|
|
|
|
## Product Management Competency Matrix
|
|
|
|
### Product Competencies
|
|
|
|
| Competency | Associate PM (L1-L2) | PM (L3-L4) | Senior PM (L5-L6) | Principal PM (L7+) |
|
|
|------------|---------------------|------------|-------------------|-------------------|
|
|
| **Product Strategy** | Feature requirements, user stories | Product roadmaps, market analysis | Business strategy, competitive positioning | Portfolio strategy, market creation, platform vision |
|
|
| **User Research & Analytics** | Basic user interviews, metrics tracking | Research design, data interpretation | Research strategy, advanced analytics | Research culture, measurement frameworks, insight generation |
|
|
| **Technical Understanding** | Basic tech concepts, API awareness | System architecture, technical trade-offs | Technical strategy, platform decisions | Technology vision, architectural influence, innovation leadership |
|
|
| **Execution & Process** | Feature delivery, stakeholder coordination | Project management, cross-functional leadership | Process optimization, team scaling | Operational excellence, org design, strategic execution |
|
|
| **Business Acumen** | Revenue awareness, customer understanding | P&L understanding, business case development | Business strategy, market dynamics | Corporate strategy, board communication, investor relations |
|
|
|
|
### Leadership Competencies
|
|
|
|
| Competency | Associate PM (L1-L2) | PM (L3-L4) | Senior PM (L5-L6) | Principal PM (L7+) |
|
|
|------------|---------------------|------------|-------------------|-------------------|
|
|
| **Stakeholder Management** | Team collaboration, clear communication | Cross-functional alignment, expectation management | Executive communication, influence without authority | Board interaction, external partnerships, industry influence |
|
|
| **Team Development** | Peer learning, feedback sharing | Junior mentoring, knowledge transfer | Team building, hiring, performance management | Talent development, culture building, org leadership |
|
|
| **Decision Making** | Data-driven decisions, priority setting | Complex trade-offs, strategic choices | Ambiguous situations, high-stakes decisions | Strategic vision, transformational decisions, risk management |
|
|
| **Innovation & Vision** | Creative problem solving, user empathy | Market opportunity identification, feature innovation | Product vision, market strategy | Industry vision, disruptive thinking, platform creation |
|
|
|
|
## Design Competency Matrix
|
|
|
|
### Design Competencies
|
|
|
|
| Competency | Junior Designer (L1-L2) | Mid Designer (L3-L4) | Senior Designer (L5-L6) | Principal Designer (L7+) |
|
|
|------------|-------------------------|---------------------|-------------------------|-------------------------|
|
|
| **Visual Design** | UI components, typography, color theory | Design systems, visual hierarchy | Brand integration, advanced layouts | Visual strategy, brand evolution, design innovation |
|
|
| **User Experience** | User flows, wireframing, prototyping | Interaction design, usability testing | Experience strategy, journey mapping | UX vision, service design, behavioral insights |
|
|
| **Research & Validation** | User interviews, usability tests | Research planning, data synthesis | Research strategy, methodology design | Research culture, insight frameworks, market research |
|
|
| **Design Systems** | Component usage, style guides | System contribution, pattern creation | System architecture, governance | System strategy, scalable design, platform thinking |
|
|
| **Tools & Craft** | Design software proficiency, asset creation | Advanced techniques, workflow optimization | Tool evaluation, process design | Technology integration, future tooling, craft evolution |
|
|
|
|
### Collaboration Competencies
|
|
|
|
| Competency | Junior Designer (L1-L2) | Mid Designer (L3-L4) | Senior Designer (L5-L6) | Principal Designer (L7+) |
|
|
|------------|-------------------------|---------------------|-------------------------|-------------------------|
|
|
| **Cross-functional Partnership** | Engineering collaboration, handoff quality | Product partnership, stakeholder alignment | Leadership collaboration, strategic alignment | Executive partnership, business strategy integration |
|
|
| **Communication & Advocacy** | Design rationale, feedback integration | Design presentations, user advocacy | Executive communication, design thinking evangelism | Industry thought leadership, external representation |
|
|
| **Mentorship & Growth** | Peer learning, skill sharing | Junior mentoring, critique facilitation | Team development, hiring, career guidance | Design culture, talent strategy, industry leadership |
|
|
| **Business Impact** | User-centered thinking, design quality | Feature success, user satisfaction | Business metrics, strategic impact | Market influence, competitive advantage, innovation leadership |
|
|
|
|
## Data Science Competency Matrix
|
|
|
|
### Technical Competencies
|
|
|
|
| Competency | Junior DS (L1-L2) | Mid DS (L3-L4) | Senior DS (L5-L6) | Principal DS (L7+) |
|
|
|------------|-------------------|----------------|-------------------|-------------------|
|
|
| **Statistical Analysis** | Descriptive stats, hypothesis testing | Advanced statistics, experimental design | Causal inference, advanced modeling | Statistical strategy, methodology innovation |
|
|
| **Machine Learning** | Basic ML algorithms, model training | Advanced ML, feature engineering | ML systems, model deployment | ML strategy, AI platform, research direction |
|
|
| **Data Engineering** | SQL, basic ETL, data cleaning | Pipeline design, data modeling | Platform architecture, scalable systems | Data strategy, infrastructure vision, governance |
|
|
| **Programming & Tools** | Python/R proficiency, visualization | Advanced programming, tool integration | Software engineering, system design | Technology strategy, platform development, innovation |
|
|
| **Domain Expertise** | Business understanding, metric interpretation | Domain modeling, insight generation | Strategic analysis, business integration | Market expertise, competitive intelligence, thought leadership |
|
|
|
|
### Impact & Leadership Competencies
|
|
|
|
| Competency | Junior DS (L1-L2) | Mid DS (L3-L4) | Senior DS (L5-L6) | Principal DS (L7+) |
|
|
|------------|-------------------|----------------|-------------------|-------------------|
|
|
| **Business Impact** | Metric improvement, insight delivery | Project leadership, business case development | Strategic initiatives, P&L impact | Business transformation, market advantage, innovation |
|
|
| **Communication** | Technical reporting, visualization | Stakeholder presentations, executive briefings | Board communication, external representation | Industry leadership, thought leadership, market influence |
|
|
| **Team Leadership** | Peer collaboration, knowledge sharing | Junior mentoring, project management | Team building, hiring, culture development | Organizational leadership, talent strategy, vision setting |
|
|
| **Innovation & Research** | Algorithm implementation, experimentation | Research projects, publication | Research strategy, academic partnerships | Research vision, industry influence, breakthrough innovation |
|
|
|
|
## DevOps Engineering Competency Matrix
|
|
|
|
### Technical Competencies
|
|
|
|
| Competency | Junior DevOps (L1-L2) | Mid DevOps (L3-L4) | Senior DevOps (L5-L6) | Principal DevOps (L7+) |
|
|
|------------|----------------------|-------------------|----------------------|----------------------|
|
|
| **Infrastructure** | Basic cloud services, server management | Infrastructure automation, containerization | Platform architecture, multi-cloud strategy | Infrastructure vision, emerging technologies, industry standards |
|
|
| **CI/CD & Automation** | Pipeline basics, script writing | Advanced pipelines, deployment automation | Platform design, workflow optimization | Automation strategy, developer experience, productivity platforms |
|
|
| **Monitoring & Observability** | Basic monitoring, log analysis | Advanced monitoring, alerting systems | Observability strategy, SLA/SLI design | Monitoring vision, reliability engineering, performance culture |
|
|
| **Security & Compliance** | Security basics, access management | Security automation, compliance frameworks | Security architecture, risk management | Security strategy, governance, industry leadership |
|
|
| **Performance & Scalability** | Performance monitoring, basic optimization | Capacity planning, performance tuning | Scalability architecture, cost optimization | Performance strategy, efficiency platforms, innovation |
|
|
|
|
### Leadership & Impact Competencies
|
|
|
|
| Competency | Junior DevOps (L1-L2) | Mid DevOps (L3-L4) | Senior DevOps (L5-L6) | Principal DevOps (L7+) |
|
|
|------------|----------------------|-------------------|----------------------|----------------------|
|
|
| **Developer Experience** | Tool support, documentation | Platform development, self-service tools | Developer productivity, workflow design | Developer platform vision, industry best practices |
|
|
| **Incident Management** | Incident response, troubleshooting | Incident coordination, root cause analysis | Incident strategy, prevention systems | Reliability culture, organizational resilience |
|
|
| **Team Collaboration** | Cross-team support, knowledge sharing | Process improvement, training delivery | Culture building, practice evangelism | Organizational transformation, industry influence |
|
|
| **Strategic Impact** | Operational excellence, cost awareness | Efficiency improvements, platform adoption | Strategic initiatives, business enablement | Technology strategy, competitive advantage, market leadership |
|
|
|
|
## Engineering Management Competency Matrix
|
|
|
|
### People Leadership Competencies
|
|
|
|
| Competency | Manager (L1-L2) | Senior Manager (L3-L4) | Director (L5-L6) | VP+ (L7+) |
|
|
|------------|-----------------|------------------------|------------------|----------|
|
|
| **Team Building** | Hiring, onboarding, 1:1s | Team culture, performance management | Multi-team coordination, org design | Organizational culture, talent strategy |
|
|
| **Performance Management** | Individual development, feedback | Performance systems, coaching | Calibration across teams, promotion standards | Talent development, succession planning |
|
|
| **Communication** | Team updates, stakeholder management | Executive communication, cross-functional alignment | Board updates, external communication | Industry representation, thought leadership |
|
|
| **Conflict Resolution** | Team conflicts, process improvements | Cross-team issues, organizational friction | Strategic alignment, cultural challenges | Corporate-level conflicts, crisis management |
|
|
|
|
### Technical Leadership Competencies
|
|
|
|
| Competency | Manager (L1-L2) | Senior Manager (L3-L4) | Director (L5-L6) | VP+ (L7+) |
|
|
|------------|-----------------|------------------------|------------------|----------|
|
|
| **Technical Vision** | Team technical decisions, architecture input | Platform strategy, technology choices | Technical roadmap, innovation strategy | Technology vision, industry standards |
|
|
| **System Ownership** | Feature/service ownership, quality standards | Platform ownership, scalability planning | System portfolio, technical debt management | Technology strategy, competitive advantage |
|
|
| **Process & Practice** | Team processes, development practices | Engineering standards, quality systems | Process innovation, best practices | Engineering culture, industry influence |
|
|
| **Technology Strategy** | Tool evaluation, team technology choices | Platform decisions, technical investments | Technology portfolio, strategic architecture | Corporate technology strategy, market leadership |
|
|
|
|
## Usage Guidelines
|
|
|
|
### Assessment Approach
|
|
|
|
1. **Level Calibration**: Use these matrices to calibrate expectations for each level within your organization
|
|
2. **Interview Design**: Select competencies most relevant to the specific role and level being hired for
|
|
3. **Evaluation Consistency**: Ensure all interviewers understand and apply the same competency standards
|
|
4. **Growth Planning**: Use matrices for career development and promotion discussions
|
|
|
|
### Customization Tips
|
|
|
|
1. **Industry Adaptation**: Modify competencies based on your industry (fintech, healthcare, etc.)
|
|
2. **Company Stage**: Adjust expectations based on startup vs. enterprise environment
|
|
3. **Team Needs**: Emphasize competencies most critical for current team challenges
|
|
4. **Cultural Fit**: Add company-specific values and cultural competencies
|
|
|
|
### Common Pitfalls
|
|
|
|
1. **Unrealistic Expectations**: Don't expect senior-level competencies from junior candidates
|
|
2. **One-Size-Fits-All**: Customize competency emphasis based on role requirements
|
|
3. **Static Assessment**: Regularly update matrices based on changing business needs
|
|
4. **Bias Introduction**: Ensure competencies are measurable and don't introduce unconscious bias
|
|
|
|
## Matrix Validation Process
|
|
|
|
### Regular Review Cycle
|
|
- **Quarterly**: Review competency relevance and adjust weights
|
|
- **Semi-annually**: Update level expectations based on market standards
|
|
- **Annually**: Comprehensive review with stakeholder feedback
|
|
|
|
### Stakeholder Input
|
|
- **Hiring Managers**: Validate role-specific competency requirements
|
|
- **Current Team Members**: Confirm level expectations match reality
|
|
- **Recent Hires**: Gather feedback on assessment accuracy
|
|
- **HR Partners**: Ensure legal compliance and bias mitigation
|
|
|
|
### Continuous Improvement
|
|
- **Performance Correlation**: Track new hire performance against competency assessments
|
|
- **Market Benchmarking**: Compare standards with industry peers
|
|
- **Feedback Integration**: Incorporate interviewer and candidate feedback
|
|
- **Bias Monitoring**: Regular analysis of assessment patterns across demographics |