JSON Data Transformation Project: Batch Data Processing Helper Scripts with Node.js

Brief Description

In this project, I've gathered small Node.js helper scripts for batch transformations on JSON data.

Problem

Data cleaning and field transformation tasks are repetitive and prone to errors when done manually. I've addressed the need to accelerate small but frequently performed tasks like date format conversion, field name mapping, and deletion of unnecessary keys.

Solution

I've divided the project into several independently operating scripts. One script converts Firestore-like createdAt.seconds and nanoseconds fields to JavaScript Date values, while another converts dates in YYYY-MM-DD format to a MongoDB-like $date structure. Other scripts map and rewrite field names and some text values, and I've set up a simple pipeline to collectively remove a selected id field and export the result to an output.json file.

Result

The outcome is a set of single-purpose but practical data preparation tools. I've made repetitive JSON editing tasks faster and more consistent without manual effort.

Technologies

JavaScript, Node.js, JSON, Batchfile

Setup