Forking And Redis Store

[malohtie]

Hi guys im trying to cache some data in redis using this package but sometimes the result in not serialized and throw errors
unserialize(): Error at offset 0 of 2 bytes

 Isp::has('lists')
            ->active()
            ->cursor()
            ->each(function (Isp $isp) use (&$processes) {
                $processes[] = function () use ($isp) {
                   return $this->cache($isp);
                };
            });
        $result = Fork::new()->concurrent(5)
            ->before(fn() => DB::reconnect())
            ->run(...$processes);

private function cache(Isp $isp): array
    {
        $this->comment(sprintf("Caching Mix Isp : %s - %s", $isp->id, $isp->name));
        Cache::forget('mix:lists_isp:' . $isp->id);
        try {
            $lists = ListsAction::cache_isp_lists($isp->id);
            if ($lists->isNotEmpty()) {
                Cache::tags(['mix_cache_'.$isp->id])->put('mix:lists_isp:' . $isp->id, $lists, now()->addHour());
                return ['isp' => $isp->id, 'name' => $isp->name, 'result' => true];
            }
            return ['isp' => $isp->id, 'name' => $isp->name, 'result' => false, 'error' => 'EMPTY LIST'];
        } catch (Exception $ex) {
            report($ex);
            $this->error(sprintf("Error %s in Mix Isp : %s - %s", $ex->getMessage(), $isp->id, $isp->name));
            return ['isp' => $isp->id, 'name' => $isp->name, 'result' => false, 'error' => $ex->getMessage()];
        }
    }

found a similar issue but purging doesn't help

any thoughts ? im running out of ideas
thanks guys

[brendt]

@malohtie do you have any more debugging data? I'm not sure I can be of any help with just these code examples…

[malohtie]

Hi @brendt sure, is this example it fail by ~ 10% i know it related to laravel caching, forking working great .
Do you think it need something like Cache::reconnect() ? but apparently this method doesn't exist

public function handle()
{
    $processes = [];
    foreach (range(1, 100) as $i) {
        $processes[] = function () {
            $this->cache();
        };
    }
    Fork::new()->concurrent(5)
        ->before(fn() => DB::reconnect())
        ->run(...$processes);
    return 0;
}

public function cache()
{
    $value = uniqid();
    $this->comment(sprintf("Caching %s", $value);
    try {
        Cache::tags(['cache_values'])->put($value, [$value], now()->addMinute());
    } catch (Exception $ex) {
        report($ex);
        $this->error(sprintf("Error %s _____ %s", $ex->getMessage(), $value));
    }
}

[2022-01-31 09:49:55] local.ERROR: unserialize(): Error at offset 0 of 2 bytes {"exception":"[object] (ErrorException(code: 0): unserialize(): Error at offset 0 of 2 bytes at /home/med/Desktop/work/vendor/laravel/framework/src/Illuminate/Cache/RedisStore.php:345)
[stacktrace]
#0 [internal function]: Illuminate\\Foundation\\Bootstrap\\HandleExceptions->handleError()
#1 /home/med/Desktop/work/vendor/laravel/framework/src/Illuminate/Cache/RedisStore.php(345): unserialize()
#2 /home/med/Desktop/work/vendor/laravel/framework/src/Illuminate/Cache/RedisStore.php(64): Illuminate\\Cache\\RedisStore->unserialize()
#3 /home/med/Desktop/work/vendor/laravel/framework/src/Illuminate/Cache/TagSet.php(107): Illuminate\\Cache\\RedisStore->get()
#4 [internal function]: Illuminate\\Cache\\TagSet->tagId()
#5 /home/med/Desktop/work/vendor/laravel/framework/src/Illuminate/Cache/TagSet.php(96): array_map()
#6 /home/med/Desktop/work/vendor/laravel/framework/src/Illuminate/Cache/TagSet.php(86): Illuminate\\Cache\\TagSet->tagIds()
#7 /home/med/Desktop/work/vendor/laravel/framework/src/Illuminate/Cache/TaggedCache.php(102): Illuminate\\Cache\\TagSet->getNamespace()
#8 /home/med/Desktop/work/vendor/laravel/framework/src/Illuminate/Cache/TaggedCache.php(91): Illuminate\\Cache\\TaggedCache->taggedItemKey()
#9 /home/med/Desktop/work/vendor/laravel/framework/src/Illuminate/Cache/Repository.php(213): Illuminate\\Cache\\TaggedCache->itemKey()
#10 /home/med/Desktop/work/vendor/laravel/framework/src/Illuminate/Cache/RedisTaggedCache.php(37): Illuminate\\Cache\\Repository->put()
#11 /home/med/Desktop/work/app/Console/Commands/test.php(40): Illuminate\\Cache\\RedisTaggedCache->put()
#12 /home/med/Desktop/work/app/Console/Commands/test.php(26): App\\Console\\Commands\\test->cache()
#13 /home/med/Desktop/work/vendor/spatie/fork/src/Task.php(92): App\\Console\\Commands\\test->App\\Console\\Commands\\{closure}()
#14 /home/med/Desktop/work/vendor/spatie/fork/src/Fork.php(154): Spatie\\Fork\\Task->execute()
#15 /home/med/Desktop/work/vendor/spatie/fork/src/Fork.php(128): Spatie\\Fork\\Fork->executeInChildTask()
#16 /home/med/Desktop/work/vendor/spatie/fork/src/Fork.php(103): Spatie\\Fork\\Fork->forkForTask()
#17 /home/med/Desktop/work/vendor/spatie/fork/src/Fork.php(182): Spatie\\Fork\\Fork->runTask()
#18 /home/med/Desktop/work/vendor/spatie/fork/src/Fork.php(76): Spatie\\Fork\\Fork->startRunning()
#19 /home/med/Desktop/work/vendor/spatie/fork/src/Fork.php(69): Spatie\\Fork\\Fork->waitFor()
#20 /home/med/Desktop/work/app/Console/Commands/test.php(31): Spatie\\Fork\\Fork->run()
#21 /home/med/Desktop/work/vendor/laravel/framework/src/Illuminate/Container/BoundMethod.php(36): App\\Console\\Commands\\test->handle()
#22 /home/med/Desktop/work/vendor/laravel/framework/src/Illuminate/Container/Util.php(40): Illuminate\\Container\\BoundMethod::Illuminate\\Container\\{closure}()
#23 /home/med/Desktop/work/vendor/laravel/framework/src/Illuminate/Container/BoundMethod.php(93): Illuminate\\Container\\Util::unwrapIfClosure()
#24 /home/med/Desktop/work/vendor/laravel/framework/src/Illuminate/Container/BoundMethod.php(37): Illuminate\\Container\\BoundMethod::callBoundMethod()
#25 /home/med/Desktop/work/vendor/laravel/framework/src/Illuminate/Container/Container.php(653): Illuminate\\Container\\BoundMethod::call()
#26 /home/med/Desktop/work/vendor/laravel/framework/src/Illuminate/Console/Command.php(136): Illuminate\\Container\\Container->call()
#27 /home/med/Desktop/work/vendor/symfony/console/Command/Command.php(298): Illuminate\\Console\\Command->execute()
#28 /home/med/Desktop/work/vendor/laravel/framework/src/Illuminate/Console/Command.php(121): Symfony\\Component\\Console\\Command\\Command->run()
#29 /home/med/Desktop/work/vendor/symfony/console/Application.php(1005): Illuminate\\Console\\Command->run()
#30 /home/med/Desktop/work/vendor/symfony/console/Application.php(299): Symfony\\Component\\Console\\Application->doRunCommand()
#31 /home/med/Desktop/work/vendor/symfony/console/Application.php(171): Symfony\\Component\\Console\\Application->doRun()
#32 /home/med/Desktop/work/vendor/laravel/framework/src/Illuminate/Console/Application.php(94): Symfony\\Component\\Console\\Application->run()
#33 /home/med/Desktop/work/vendor/laravel/framework/src/Illuminate/Foundation/Console/Kernel.php(129): Illuminate\\Console\\Application->run()
#34 /home/med/Desktop/work/artisan(37): Illuminate\\Foundation\\Console\\Kernel->handle()
#35 {main}
"} 

PHP 8.0.14 (cli) 
Redis server v=6.0.6

[brendt]

Yes, it'll probably be something connection related: your connection should always be re-established in every child fork. I can't speak about this specific case though, I'm not familiar enough with these components.

[pavloniym]

This works for me...

 // Fork multiple processes to handle the packages concurrently
Fork::new()
    ->before(function () {
        // Reconnect to Redis before each process
       Redis::disconnect();
       Redis::connect();
    })
    ->run(...)