Engineering Features For Machine Learning

When to Use This Skill

This skill activates when you need to:

• Create new features from existing data to improve model accuracy.
• Select the most relevant features from a dataset to reduce model complexity and improve efficiency.
• Transform features to better suit the assumptions of a machine learning model (e.g., scaling, normalization, encoding).

Examples

Example 1: Improving Model Accuracy

User request: "Create new features from the existing 'age' and 'income' columns to improve the accuracy of a customer churn prediction model."

The skill will:

1. Generate code to create interaction terms between 'age' and 'income' (e.g., age * income, age / income).
2. Execute the code and evaluate the impact of the new features on model performance.

Example 2: Reducing Model Complexity

User request: "Select the top 10 most important features from the dataset to reduce the complexity of a fraud detection model."

The skill will:

1. Generate code to calculate feature importance using a suitable method (e.g., Random Forest, SelectKBest).
2. Execute the code and select the top 10 features based on their importance scores.

Best Practices

• Data Validation: Always validate the input data to ensure it is clean and consistent before performing feature engineering.
• Feature Scaling: Scale numerical features to prevent features with larger ranges from dominating the model.
• Encoding Categorical Features: Encode categorical features appropriately (e.g., one-hot encoding, label encoding) to make them suitable for machine learning models.

Integration

This skill integrates with the feature-engineering-toolkit plugin, providing a seamless way to create, select, and transform features for machine learning models. It can be used in conjunction with other Claude Code skills to build complete machine learning pipelines.

Prerequisites

• Appropriate file access permissions
• Required dependencies installed

Instructions

1. Invoke this skill when the trigger conditions are met
2. Provide necessary context and parameters
3. Review the generated output
4. Apply modifications as needed

Output

The skill produces structured output relevant to the task.

Error Handling

• Invalid input: Prompts for correction
• Missing dependencies: Lists required components
• Permission errors: Suggests remediation steps

Resources

• Project documentation
• Related skills and commands