Questions tagged [data-modeling]
Elaborating passive data structures based on the analysis of data requirements for the purpose of designing and implementing standardised data formats, databases and data processing systems.
112 questions
2
votes
1
answer
96
views
How to make the common "organization > project > content" conceptual model handle more subdivisions?
I am working on a system of websites and am back to an age-old problem of how to group the content.
In simplest terms, I am wanting to build something like a hierarchical organization of content, ...
- 2,787
-2
votes
2
answers
152
views
Preventing duplicate customers from company entry vs mobile sign-in [closed]
We have a system where customers can be created in two ways:
By a company — the customer belongs to that company and the company can edit their information.
By a mobile user — the customer has a ...
- 13
1
vote
1
answer
143
views
Fixed vs dynamic properties for a system with customization and changing requirements
Edit: writing a more specific question, as per comment, I guess my question boils down to: are dynamic properties designs appropriate for applications with rich UI and complex business logic (as ...
- 113
0
votes
1
answer
628
views
Data Flow in Data Flow Diagram
Consider the following level - 0 dataflow diagram for a patient management system :
Consider the doctor entity, the system provides an appointment report to the doctor. If the system only generates ...
- 43
-1
votes
1
answer
228
views
Modeling a CSV file: What is the standard? Python or SQL?
I have a wide CSV file of about 350mb, and want to load it into a SQL database and properly model the data to make it easier to use for analysis.
I could split the data into tables with python and ...
- 111
0
votes
1
answer
102
views
using same table for multiple features a bad coupling?
We are migrating a template that was a mere questions array questions
[
{
type:text,
name:first,
value:What is our name
},{
type:radio,
name:favourite fruits,
value:[
...
- 131
1
vote
5
answers
344
views
Data Modeling: Are technical concepts within a tool that implement a business entity entities as well?
I believe this forum is the correct one for my question, based on the community guidelines but let me know if not. It seemed like the best fit.
I am performing a data modeling exercise to formulate a ...
- 229
0
votes
2
answers
125
views
Tradeoff: Fetching less data vs having a simpler data model
We have 2 vehicle types in our system Car and Bike. Both can be associated with a Report.
There are components in our system which operate on Report but when dealing with the report they need to check ...
- 131
1
vote
2
answers
1k
views
Should I duplicate or inherit a python dataclass which changes attributes based on the version of an API endpoint?
I'm working on a python library for a REST API.I'm using python data classes to represent the structure of the returned JSON
The v2 of this API returns a slightly different object when compared to v1.
...
- 127
1
vote
0
answers
1k
views
Python - Where do I store data classes which are common across different files?
I'm working on a python wrapper for a REST API. I'm using python data classes to store the shape of the JSON response of each endpoint so developers have features like autocomplete and objects they ...
- 127
3
votes
1
answer
307
views
User (Actor) data shared across Domains / Microservices
I have read through a number of posts on Software Engineering but am unable to find a suitable solution for the problem my team and I are trying to solve.
We are building a system where we have ...
- 83
-1
votes
1
answer
444
views
How to model a ternary relationship in a graph-based paradigm?
Consider a context where we have Users saving Questions and adding personal Tags to them.
In a graph-based paradigm, a first approach could be something like:
(User)-[SAVES {tags}]->(Question)
...
- 71
1
vote
2
answers
2k
views
How to document a NoSQL document-based data model?
How do you document the logical data model of a document-oriented database like MongoDB?
For relational databases, Entity-Relationship diagrams or UML class diagrams are used.
What is the practice for ...
- 71
0
votes
1
answer
76
views
Is there a difference between these two data models?
Let us say I want to store on a database a userID, their nationality and if they are from the UK their UK passport number.
I could model this by having one table with userID as primary key, ...
- 1,159
1
vote
4
answers
627
views
Thinking about data as object vs table row [closed]
It often happens that we have a set of structured data. Let's say our data is about charitable organizations. I could turn it into a list/set of objects/structs:
struct Charity {
let name: String
...
2
votes
1
answer
1k
views
How to draw an aggregation relationship in the Crow's Foot Notation?
I was stuck on a relation description and unable to model it in the Crow's Foot Notation:
Each individual vehicle is a particular model of a particular brand offered by the company (e.g., the XF is a ...
- 185
3
votes
2
answers
445
views
What to do when putting logic into the database seems to be the only option?
I am currently working on an application that models a complex business process that consists of many steps, each having a 1:n relationship with subsequent steps. The software is written Java using ...
- 149
-1
votes
2
answers
191
views
How to change a data model
In my model a user entity has three attributes : ID, name, hasBoyfriend.
I want now to change hasBoyfriend to boyFriendsNames which is an array of names .
The user entity is used by many services.
The ...
- 1,159
0
votes
1
answer
595
views
Can we do domain modelling or create domain entities/models in NoSQL like Amazon DynamoDB? If yes then how?
Recently I was going through an article (link at the end) on AWS for DynamoDB NoSQL and got to know that they are suggesting to only have a single table with certain access patterns in your NoSQL ...
- 17
5
votes
3
answers
551
views
Rebuilding a legacy application : What about the data model?
I am currently rebuilding from scratch a product catalogue (to feed a shopping website).
The existing legacy system is heterogenous, Long story short : The some products are stored in a FileMaker ...
- 75
0
votes
1
answer
110
views
Attributes at the fact table in dimensional data model
I know that a fact table in dimensional data model consists of measures and flags for an event or transaction. I also understand that it may contain date of the event. I have to design on fact table ...
4
votes
5
answers
3k
views
What is the normal form of JSON? What is theory that you can't automate normalizing?
What is the normal form of a typical JSON object?
We often need to convert JSON objects to some set of tables. Once they are tables, the tables have measurable normal forms based on all the usual ...
- 213
1
vote
0
answers
162
views
IoT Data Model Standards
I am currently trying to model IoT devices within buildings. I could start from scratch and develop the data model myself, but this seems like a common problem which will have been solved multiple ...
- 119
0
votes
4
answers
3k
views
Introducing "status" column to an SQL table changes its definition
I saw this pattern in multiple projects I wrote: I create an SQL model for a certain type of entities and at some point, we realize that there's a need to store multiples types of the same entities. ...
- 143
0
votes
1
answer
531
views
What kind of Relations should I have in my E/R Diagram
I am trying to create an Entity/Relationship Chen Diagram for a new APP. Scope is simple enough.
I will have multiples types of users login through the same Login Form.
What I decided to do... Is ...
- 117
4
votes
2
answers
862
views
Applying Domain Driven Design to an analysis driven domain
I am currently working on a domain that is fundamentally driven by analytics. I'll use a fictitious example to illustrate my question.
Suppose the application is a service based on House Prices. The ...
- 87
1
vote
1
answer
4k
views
SQL Database schema for Catering/Menu management
Background
I'm building a Private Chef booking service where you can book a Chef to cook you a custom Menu. I'm having trouble creating a SQL db schema that accurately represents the domain while ...
- 111
2
votes
3
answers
1k
views
Database Model Classes in TypeScript
I'm using Knex.js with TypeScript for database access.
Table
uid (UUID, auto-generated by Postgres)
name (varchar)
Model
interface User {
uid: string | null;
name: string;
}
...
1
vote
1
answer
12k
views
Data Flow Diagram for patient information system for a hospital
I have an example for a DFD for a patient information system implemented in a certain hospital. The below figure, represents the overview diagram (level 0-diagram, if we consider that the first level ...
- 145
2
votes
2
answers
934
views
How to represent a data model?
Often enough, the terms data model and data format are used interchangeably, but here I disagree. Let's start with the simpler one, the data format. I don't know exact definitions, but the data format ...
- 237
1
vote
1
answer
230
views
How to avoid code duplication from handling "structually similar types" in Scala?
Often, when programming, you'll have different degrees of information to you in different contexts.
For example, a web server may have two routes, which recieve information about a Person, one of ...
- 174
3
votes
2
answers
949
views
Is Excel data model as good as or better than Microsoft Access?
I'm working with several Excel worksheets and workbooks that need to consolidated or linked to each other. These workbooks will track client interactions for different team members.
I did the initial ...
- 51
0
votes
1
answer
393
views
API Request/Response Model for showing differences in JSON objects
I am writing an API to merge two different JSON Objects.
Both of these objects can have same as well different number of properties.
Object 1 :
{
"name": "Sam",
"lastName": "Hanks",
"...
- 101
2
votes
1
answer
3k
views
Optional relationship on ERD diagram
Upon generating an entity-relationship diagram of my database I observed several occurrence like this:
This diagram (in IDEF1X notation) shows the following:
Our team's DB convention is that each ...
- 1,426
-1
votes
2
answers
372
views
Correct place to store semi dynamic data
What I mean by semi dynamic data are data that are expected to be changed only with product versions.
Now imagine this scenario, In version 1 of the product, I have item status : SUCCESS , FAIL
In ...
- 241
-1
votes
2
answers
2k
views
When self-referencing in a table, do you prefer `parent_id = null` or `parent_id = id` for a row referencing to itself?
For the discussion, I will provide my example. But I am interested in the broad guidelines.
I save in my postgres DB legislation (law texts) composed of a single header (H), paragraphs (P), sub-...
- 155
2
votes
3
answers
191
views
Many-to-many assignments in user system
I have a few software architecture/design questions related to a technically quite simple problem. We already have all the functionality implemented properly, however from a design perspective it is ...
- 129
1
vote
2
answers
53
views
Best way to model assay steps with low variability?
I have to process biological data input in the format of 96-well plates.
explainer for the non-biologists:
These plates are basically a 2D matrix of 8 rows x 12 columns of small cups called wells. ...
- 19
-1
votes
2
answers
154
views
Help designing a product model with vast amount of properties
I've been asked how to re-design a legacy system by a relative for a company that builds custom chairs. On their website you can customize your chair in about 30 permutations : chair type, material, ...
- 9
0
votes
2
answers
323
views
Creating a "pass-through" dynamic model
We have a layer that exists in our architecture that, for lack of a better term, bears the responsibility of defining the common models. In other words, when systems need to communicate, rather than ...
- 117
0
votes
0
answers
226
views
What kind of diagram best represents the field-level mapping from one system component to another?
In my environment, we have multiple systems developed independently by different teams. Those teams frequently recreate the wheel because they're building applications, not building blocks.
As a ...
- 1
4
votes
3
answers
284
views
ER diagram - feasibility of a requirement
I need to model the following requirement in an Entity-Relationship diagram.
"Customers place orders, which contain a list of products with their quantity and prices. A shipment is made when ...
- 49
0
votes
1
answer
377
views
How to create a flexible datamodel?
I'm trying to create a flexible datamodel and i'm not sure what's the right approach.
My application is used by several clients (big and small). Big clients need all the seperate layers, but small ...
- 49
0
votes
1
answer
114
views
Lightweight data mining + organization & visualization
I'm looking to do some simple data mining that consists of going once per day to a single page and collect the following information:
List of movie theaters
Movies today on each theater
Session times ...
- 11
2
votes
2
answers
1k
views
Index / Unique on `deleted_at` column?
We have an Accounts table in a Postgres DB that has a unique index on user_id and product. Users can have many accounts, there's no product table. Occasionally users will create an account ...
- 129
2
votes
2
answers
154
views
how to model 2 objects that refer to each other in the DB
Now I have 2 objects which are "PROBLEM" and "SOLUTION", obviously "SOLUTION" is a proposed solution to a given "PROBLEM", my problem is that in my business I have the following relations:
a "PROBLEM"...
- 241
29
votes
4
answers
9k
views
Is there an industry standard for gender model other than male and female?
I am modeling a database that should be used as generic non-functional requisite for all services of the startup company, like persons, users, services and commercial data like coupons, signature ...
- 549
2
votes
1
answer
165
views
How to model rdbms relationships as graph relationships?
I am modeling our existing database in transition to a graph database.
Currently here is how I can interpret the database a graph relationships
group -have-> groups
group -have-> participants
...
- 123
2
votes
3
answers
2k
views
How to store sequential timespans in a database?
How can consecutive periods of time (defined by a start and end date) be stored in a database?
For example:
from 2018-01-01 00:00:00+01:00 until 2018-06-01 00:00:00+02:00
from 2018-06-01 00:00:00+02:...
- 131
4
votes
1
answer
6k
views
What is an example giving the difference between Domain Model and Data Model?
I've seen many articles describing differences between Domain Model and Data Model. However none of the articles have picture representations showing difference.
https://stackoverflow.com/questions/...
- 381