How to remove duplicate values from Json in PHP

Question

How can I use PHP to remove a duplicate from JSON?

<?php
if(!function_exists("curl_init")) die("cURL extension is not installed");
$json = 'https://sug.daraz.pk/sug?area=lazada_pk_web&code=utf-8&q=book';

$ch=curl_init($json);
curl_setopt($ch, CURLOPT_RETURNTRANSFER, true);
$r=curl_exec($ch);
curl_close($ch);

$arr = json_decode($r,true);

foreach($arr['result'] as $item) {

    foreach ($item["model"] as $key => $value) {
        $pattern = '/\s+/';
        $string = $value.' ';

        $split = preg_split( $pattern, $string);
        $go = implode(', ', $split);

        echo $go;
        }
}
?>

I get result :

books, book, shelf, book, rack, bookmarks, books, for, kids, book, holder, book, shelve, book, stand, book, end, book, reader,

I want the result to be in text like this:

books, book, shelf, rack, bookmarks, for, kids, holder, shelve, stand, end, reader,

Ronak Dhoot · Accepted Answer · 2020-03-07 16:08:57Z

2

I am using array_unique and array_merge

if(!function_exists("curl_init")) die("cURL extension is not installed");
$json = 'https://sug.daraz.pk/sug?area=lazada_pk_web&code=utf-8&q=book';

$ch=curl_init($json);
curl_setopt($ch, CURLOPT_RETURNTRANSFER, true);
$r=curl_exec($ch);
curl_close($ch);

$arr = json_decode($r,true);
$result = array();

foreach($arr['result'] as $item) {

    foreach ($item["model"] as $key => $value) {
        $pattern = '/\s+/';
        $string = $value.' ';

        $split = preg_split( $pattern, $string);
        $result = array_merge($result, $split);
    }
}
$result = array_values(array_filter(array_unique($result), function($value) { return !is_null($value) && $value !== ''; }));
print implode(', ', $result);

output as expected:

books, book, shelf, rack, bookmarks, for, kids, holder, shelve, stand, end, reader

edited Mar 7, 2020 at 16:08

answered Mar 7, 2020 at 15:30

Ronak Dhoot

2,3311 gold badge14 silver badges19 bronze badges

Sign up to request clarification or add additional context in comments.

6 Comments

lyndria Over a year ago

Omg.. Nice ideas,... Thanks... :D

Jared Farrish Over a year ago

I count four array methods used, one in a nested foreach(), of which there are two. This code is wandering around trying to accomplish a reductive outcome. Why not just use array_reduce()?

Jared Farrish Over a year ago

You might have missed my point. Take a look at the answer I provided; the procedure in this answer is quite a bit more inefficient than just reducing the source array into a collection based on a check for presence.

Ronak Dhoot Over a year ago

@JaredFarrish got it @lyndra you can array_reduce as well see JaredFarrish's anwser

lyndria Over a year ago

@JaredFarrish I dont understand :( can you give example?

|

TamirNahum · Accepted Answer · 2020-03-07 15:17:28Z

The best practice for your needs is to create a new Array and push your keys into it using a condition to check if they aren't already into the array using the in_array function.

For example:

<?php
if(!function_exists("curl_init")) die("cURL extension is not installed");
$json = 'https://sug.daraz.pk/sug?area=lazada_pk_web&code=utf-8&q=book';

$ch=curl_init($json);
curl_setopt($ch, CURLOPT_RETURNTRANSFER, true);
$r=curl_exec($ch);
curl_close($ch);

$arr = json_decode($r, true);
$data = array();

foreach($arr['result'] as $item) {
    foreach ($item["model"] as $key => $value) {
        $pattern = '/\s+/';
        $string = $value.' ';

        $split = preg_split( $pattern, $string);
        $go = implode(', ', $split);

        if (!in_array($go, $data)) {
            array_push($data, $go);
        }
    }
}

echo implode(',', $data);

Jared Farrish · Accepted Answer · 2020-03-07 18:25:30Z

1

This is a fairly standard reduce function. Note the array passed in the very end, and that I explode the search terms.

$data = json_decode('{"result":[{"type":"nt-common","model":{"query":"books"}},{"type":"nt-common","model":{"query":"book shelf"}},{"type":"nt-common","model":{"query":"book rack"}},{"type":"nt-common","model":{"query":"bookmarks"}},{"type":"nt-common","model":{"query":"books for kids"}},{"type":"nt-common","model":{"query":"book holder"}},{"type":"nt-common","model":{"query":"book shelve"}},{"type":"nt-common","model":{"query":"book stand"}},{"type":"nt-common","model":{"query":"book end"}},{"type":"nt-common","model":{"query":"book reader"}}]}');

$queries = array_reduce($data->result, static function($found, $result) {
    $items = explode(' ', $result->model->query);

    foreach($items as $item) {
        if (!in_array($item, $found)) {
            $found[] = $item;
        }
    }

    return $found;
}, []);

sort($queries);

Gives:

book bookmarks books end for holder kids rack reader shelf shelve stand

https://3v4l.org/Xeaek

Putting it together:

$fetch = static function(string $uri) {
    function_exists('curl_init') || die('cURL extension is not installed.');

    $handle = curl_init($uri);
    curl_setopt($handle, CURLOPT_RETURNTRANSFER, true);
    $data = json_decode(curl_exec($handle));
    curl_close($handle);

    return $data;
};

$modelQueries = static function($found, $result) {
    $items = explode(' ', $result->model->query);

    foreach($items as $item) {
        if (!in_array($item, $found)) {
            $found[] = $item;
        }
    }

    return $found;
};

$bookModels = 'https://sug.daraz.pk/sug?area=lazada_pk_web&code=utf-8&q=book';

$books = $fetch($bookModels);

$bookQueries = array_reduce($books->result, $modelQueries, []);

sort($bookQueries);

edited Mar 7, 2020 at 18:25

answered Mar 7, 2020 at 15:33

Jared Farrish

49.4k17 gold badges100 silver badges108 bronze badges

2 Comments

lyndria Over a year ago

I change $data to url.. Get null... :?

Jared Farrish Over a year ago

@lyndria I reincorporated an example into the answer.

Collectives™ on Stack Overflow

How to remove duplicate values from Json in PHP

3 Answers 3

6 Comments

Comments

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

6 Comments

Comments

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related