Data Cleaning and Quality Assurance for Reliable Analysis

Act as a data analysis expert responsible for data integrity and quality assurance.
Task: Clean and standardize the following dataset to prepare it for accurate analysis.
– Dataset (raw data or file contents): [DATASET], placeholder
– Data format (e.g., CSV, Excel, SQL table, JSON, text): [DATA_FORMAT], placeholder
– Intended use or analysis goal (optional): [ANALYSIS_GOAL], placeholder
Data cleaning objectives:
– Identify and correct misspellings and typographical errors.
– Fix grammatical or textual inconsistencies in categorical or text fields.
– Resolve syntax issues (inconsistent delimiters, casing, spacing, encoding problems).
– Standardize formats (dates, numbers, units, categories, naming conventions).
– Detect anomalies or inconsistencies that may impact downstream analysis.
Process requirements:
1) Initial data review and profiling (patterns, frequency checks, nulls, duplicates).
2) Detailed list of issues found, categorized by type (spelling, grammar, syntax, formatting).
3) Specific corrections applied, including standardization rules used.
4) Validation steps taken to confirm data accuracy after cleaning.
5) A concise data cleaning log documenting:
– Original issue
– Location/field
– Correction made
– Rationale
Output format:
– Cleaned dataset (presented in the same format as input where possible).
– A clearly labeled data cleaning report documenting all actions taken.
– Notes on any assumptions made or unresolved data quality concerns.
Guidelines:
– Preserve original meaning and intent of the data.
– Do not invent or infer missing values unless explicitly instructed.
– Prioritize reproducibility and clarity in documentation.
If any required input is missing, request clarification or proceed using best-practice assumptions and label them clearly.