top of page
Data Management for Machine Learning Algorithms
I only dabble in ML, so I was helping out a student on one of the less-glorious, yet important, aspects of running ML algorithms: data management. So I asked ChatGPT two questions, one specific to my case, one more general, on what it recommends for managing data. If you remember I have talked about data in past posts and have emphasized that how you store data really depends on how you plan to use it. What are your objectives when designing your data flow? Do you want to sav

Silvia Mazzoni
7 days ago5 min read
hold on.... what's Node.JS
I thought Node.JS was just javascript..... so I asked ChatGPT: "what is the difference between javascript and node.JS" And here is the...

Silvia Mazzoni
Mar 23, 20252 min read
Node.JS and hdf5....
Now that I know I want to process my data in a Lambda function in AWS (YES I LOVE LAMBDAS ON AWS!!!), I had one more question for...

Silvia Mazzoni
Mar 23, 20253 min read
Accessing AWS Data for a Javascript app: Leveraging both server and client....
I asked ChatGPT the following question today, I'm excited about the answer it gave me and I thought it might provide useful insight for...

Silvia Mazzoni
Mar 23, 20253 min read
Multiprocessing on Windows
If I can parallellize a process, I will!!! I use the python library concurrent futures. After setting it up the first time, it's a script...

Silvia Mazzoni
Feb 26, 20252 min read
Data-Management Case: too many CSV files -- Part 2
Of course, nothing is simple. I had to make adjustments to the simple script provided by ChatGPT. That's what I like about GenerativeAI:...

Silvia Mazzoni
Feb 25, 20252 min read
Data-Management Case: too many CSV files -- Part 1
I have created the following dataset: I have 12 process methods that I have to run on 277,827 raw-data files (broken into two uneven...

Silvia Mazzoni
Feb 24, 20253 min read


You've Generated the Data—Now What? Storing It Efficiently by Design
Generating data is easy—creating vast amounts of it is even easier. The real challenge lies in deciding how to store it effectively....

Silvia Mazzoni
Feb 18, 20252 min read
bottom of page
