Flatten JSON structure with jq without duplicates

Question

I’m starting from this structure:

[{
    "experiment": "ex1",
    "models": [{
        "name": "model1",
        "reference": 0.1,
        "code": [{
            "name": "foo",
            "version": "a",
            "value": 0.2
        },{
            "name": "foo",
            "version": "b",
            "value": 0.2
        },{
            "name": "bar",
            "version": "a",
            "value": 0.15
        }]
    },{
        "name": "model2",
        "reference": 0.12,
        "code": [{
            "name": "foo",
            "version": "a",
            "value": 0.09
        },{
            "name": "baz",
            "version": "a",
            "value": 0.15
        }]
    }]
}]

and I want this as the result:

{
  "model": "model1",
  "code": "foo",
  "version": "a"
}
{
  "model": "model1",
  "code": "foo",
  "version": "b"
}
{
  "model": "model1",
  "code": "bar",
  "version": "a"
}
{
  "model": "model2",
  "code": "foo",
  "version": "a"
}
{
  "model": "model2",
  "code": "baz",
  "version": "a"
}

So I wrote the following query.

.[] | { "model": .name, "code": .code[].name, "version": .code[].version }

The problem is that for each use of .code[] in the output structure the results are multiplied, resulting in many duplicates. How can I avoid that, and get only the desired result?

oguz ismail · Accepted Answer · 2020-11-26 12:34:10Z

2

Many similar questions have been asked before^{[1][2][3][4]...}. You need to avoid expanding the same array more than once as shown below to prevent a combinatorial explosion.

.[].models[] | {model: .name} + (.code[] | {name, version})

^{Online demo}

edited Nov 26, 2020 at 12:34

answered Nov 25, 2020 at 11:26

oguz ismail

51.8k16 gold badges64 silver badges83 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Flatten JSON structure with jq without duplicates

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related