Profile Dataset
data.profile_dataset
Overview
When you send JSON rows, CSV text, or a file reference, we profile each column: inferred type, null counts, distinct counts, numeric min/max/mean/median/stddev, and IQR-based outlier candidates. We never execute CSV formulas or claim confirmed schema types. Do not use this for heavy statistical modeling or legal data-classification decisions.
Before you transform or migrate data, you need a fast, honest column summary — without guessing types in an LLM.
Reliability
VERIFIABLE and deterministic for a given input and sample bound. Provide exactly one of rows, csv, or fileRef. Compare profiledRowCount to rowCount on large inputs — stats reflect the profiled sample only. Validation errors (not retryable — fix input): none or multiple of rows/csv/fileRef; row count over 100,000; malformed CSV.
Context footprint
Returns rowCount, profiledRowCount, columnCount, and per-column profiles. A successful call costs 1 execution credit.
When to use it
When you have rows, CSV, or a bounded file and need column-level understanding.
When you need rigorous statistics or confirmed schema contracts.
Scope
Non-goals
- Does not execute CSV formulas
- Does not infer sensitive attributes or PII labels
- Type inference is heuristic — not a confirmed schema
- Outliers are IQR-based candidates, not confirmed anomalies
- Stats describe the profiled sample (up to sampleLimitRows), not necessarily the full file
Properties
Capabilities
Cost & billing
Flat rate per invocation
File handling
File limits
Constraints this skill applies to your input and generated files. The “Limited by” column shows the static source of each cap; none of these can be raised by upgrading your plan.
| Limit | Value | Limited by |
|---|---|---|
| Maximum size per input file | 9.5 MiB | Skill and platform maximum |
How we handle your data
What this means
This skill may receive sensitive content and may return submitted, transformed, extracted, or reformatted content.
Squillify guarantees
- Runs inside Squillify
- This skill runs inside Squillify.
- Payloads are not sent to an external service by this skill.
- Squillify does not permanently store submitted payloads.
- Telemetry records metadata only, not submitted content.
- Submitted payloads are not used for training.
- Submitted payloads are not reviewed by humans.
- This skill does not target sensitive data.
- Output may reveal sensitive derived information
Your responsibility
Squillify does not determine whether submitted content is sensitive. Your application is responsible for deciding what data it is allowed to submit. Your application is responsible for securing the response.
Input schema
| Field | Type | Required | Description |
|---|---|---|---|
| rows | array | No | Bounded array of 0 through 100000 input row objects keyed by column name; omit it when csv or fileRef is the source. |
| csv | string | No | Bounded inline CSV source. Required unless rows or fileRef is provided. |
| fileRef | string | No | Tenant-scoped uploaded CSV reference. Omit it to use required inline rows or csv; never send more than one source. |
| hasHeader | boolean | No | Whether the CSV first line names columns; omit it for true. Ignored for inline rows. |
| sampleLimitRows | integer | No | Maximum rows to profile; omit it for 10000. |
| includeExamples | boolean | No | Whether example values are returned per column; omit it for true. |
| maxExamplesPerColumn | integer | No | Maximum example values per column; omit it for 5. |
Output schema
| Field | Type | Required | Description |
|---|---|---|---|
| rowCount | integer | Yes | Total input row count before sampling. |
| profiledRowCount | integer | Yes | How many rows were actually profiled. |
| columnCount | integer | Yes | How many columns were profiled. |
| columns | array | Yes | Bounded array of 0 through 10000 closed per-column profiles. |
API contract
POST /v1/executecurl -sS -X POST "$BASE/v1/execute" -H "Authorization: Bearer $KEY" -H 'Content-Type: application/json' -d '{"skillKey":"data.profile_dataset","input":{"rows":[{"age":30},{"age":40}]}}'import { Squillify } from "@squillify/sdk";
const sq = new Squillify({ apiKey: process.env.SQUILLIFY_API_KEY });
const { output } = await sq.execute("data.profile_dataset", {"rows":[{"age":30},{"age":40}]});Errors
| Code | HTTP | Retryable | Description |
|---|---|---|---|
| VALIDATION_ERROR | 400 | No | The request payload failed schema validation. |
| UNAUTHORIZED | 401 | No | Missing or invalid API key. |
| SKILL_NOT_ACCESSIBLE | 403 | No | The API key is not granted access to this skill. |
| SKILL_NOT_AVAILABLE_FOR_PLAN | 403 | No | This skill is not included in your current plan. |
| PLAN_ELIGIBILITY_UNAVAILABLE | 503 | Yes | Plan eligibility could not be decided. Retry after backoff. |
| SKILL_NOT_FOUND | 404 | No | The requested skill or version does not exist. |
| TENANT_RATE_LIMITED | 429 | Yes | Request rate limit exceeded. Retry after backoff. |
| QUOTA_EXCEEDED | 429 | Yes | Plan quota exhausted. Retryable once the quota period resets. |
| EXECUTION_TIMEOUT | 504 | Yes | Execution exceeded the allowed time budget. |
Other limits
| Limit | Value |
|---|---|
| Recommended inline bytes | 32 KiB |
Limitations
- Does not execute CSV formulas
- Does not infer sensitive attributes or PII labels
- Type inference is heuristic — not a confirmed schema
- Outliers are IQR-based candidates, not confirmed anomalies
- Stats describe the profiled sample (up to sampleLimitRows), not necessarily the full file
- Heavy statistical modeling
- Legal or compliance classification decisions
How to call
POST /v1/execute (requires authentication)
{
"skillKey": "data.profile_dataset",
"input": {
"rows": [
{
"age": 30
},
{
"age": 40
}
]
}
}Examples
Integer column with numeric stats and examples
{
"rows": [
{
"age": 30
},
{
"age": 40
}
]
}{
"rowCount": 2,
"columns": [
{
"name": "age",
"inferredType": "integer",
"nullCount": 0,
"nullRatio": 0,
"distinctCount": 2,
"min": 30,
"max": 40,
"mean": 35,
"median": 35,
"stddev": 5,
"outliers": [],
"examples": [
30,
40
]
}
],
"profiledRowCount": 2,
"columnCount": 1
}Stats without example values
{
"includeExamples": false,
"rows": [
{
"age": 30
},
{
"age": 40
}
]
}{
"rowCount": 2,
"columns": [
{
"name": "age",
"inferredType": "integer",
"nullCount": 0,
"nullRatio": 0,
"distinctCount": 2,
"min": 30,
"max": 40,
"mean": 35,
"median": 35,
"stddev": 5,
"outliers": []
}
],
"profiledRowCount": 2,
"columnCount": 1
}Recommended use cases
- Understand a dataset before transformation
- Data quality spot-checks
- Compare profiledRowCount to rowCount before trusting stats on large files
Avoid for
- Heavy statistical modeling
- Legal or compliance classification decisions
Related skills
Composable with
Safety & privacy
- Runs without calling any external service.
- Your payloads are never stored permanently.
- Telemetry captures metadata only — never your payload contents.
- We never train models on your payloads.
- No human reviews your payloads.