In the next few months, I will need to build an app/ daily job that will take data from at least 2 or 3 APIs (potentially growing to 10), clean it and post it into a relational database.
There are no standard rules about how data is coming from the APIs.
e.g for a field named
socred can be assigned different ranges like
1-10, 10-100, A-Z... etc. The tricky part of this task is to find patterns and categorise this data.
The questions are:
My tech stack: