456 questions
3
votes
2
answers
119
views
Adding a file to an existing in memory zip file with Zip4j
with Zip4j, I'm trying to add a file to an existing zip file loaded in memory. I have no access to the file system. My zip file is basically a byte[] and I would like to not unzip it to add my new ...
- 73
0
votes
0
answers
26
views
Error while testing PUT (with EntityState.Modified) request to a database using InMemory, xUnit in .NET unit tests
I do not have much experience with testing in .NET. I ran into an issue that I do not understand how to solve. Please advise where I can read about it.
I have a backend code that works with a simple ...
- 1
0
votes
0
answers
49
views
How to cython with source programs in memory?
dear all:
I am generating customized pyd with cython in a server.
I want to protect my source code of the pyd.
Thus I would prefer to encrypt the source code and then when I need generate the ...
- 241
0
votes
0
answers
83
views
How to Compile Java Classes at Runtime Without Saving to the Filesystem?
I'm developing a Java application where I need to compile Java code provided as a String at runtime. I know that using the JavaCompiler API from javax.tools allows for dynamic compilation, but most ...
- 3,626
0
votes
1
answer
325
views
Does pyarrow pq.read_table(my_parquet).to_pandas() place data in memory twice?
So my question is whether using PyArrow's pq.read_table('dataset.parq').to_pandas() will hold in-memory twice the data being read.
One for holding the py arrow table due to pq.read_table('dataset.parq'...
- 43
0
votes
2
answers
382
views
XSLT 3.0 - how do I correctly use apply-templates and copy-of?
I am fairly new to xslt 3.0 and have a problem that requires it's use. I am very close but my output is printing the text-only copy of the data that I do not want.
I have to basically merge the T3 ...
- 21
2
votes
2
answers
133
views
Using in-memory dBase III (DBF) databases in Python
I am aware of several Python packages available to read dBase III files (dbf: https://github.com/ethanfurman/dbf/tree/master , dbfpy: https://sourceforge.net/projects/dbfpy/files/ , dbfread: https://...
- 31
0
votes
1
answer
47
views
How to achieve in-memory caching technique with two azure instances
We have an asp.net mvc application hosted on azure with 2 instances. Recently we are trying to implement in-memory caching technique. But it is storing cache in 2 servers differently(not consistent). ...
1
vote
0
answers
73
views
How to implement memory sharing between .NET services?
I am developing a .NET application that consists of multiple services needing to share data efficiently. I am exploring various methods to achieve this, and I am seeking advice on the best approach to ...
0
votes
1
answer
258
views
pagination on snapshot of data in postgres
Is there any pre-existing mechanism in postgresql to save a query result in some cache and do pagination on it (in case the data being queried keeps changing and it is not required to show updated ...
0
votes
2
answers
702
views
HangFire Schedule method not firing when used with Enqueue inside BackgroundJib Server
[Latest version of HangFire Nuget Package used]
I have created a service in .NET 6 for taking care of one corn job. I need to execute a method right away and schedule it to execute again after some ...
- 189
1
vote
1
answer
905
views
How to use in memory and redis cache in the same project?
Have two classes, both annotating with @Cacheable (org.springframework.cache.annotation.Cacheable), either methods or class. I think it doesn't matter for this question.
Example:
@Cacheable(value = ...
- 36.3k
0
votes
0
answers
203
views
Multitenancy with Database connection using credentials to achieve pure isolation and increases security
Using "single database multi-schema" strategy of multitenancy I want to make purely isolated connections to database for each tenant.
I thought to reach it in small phases :
Phase 1 : ...
- 904
0
votes
1
answer
264
views
ChronicleMap Custom Key & Value serialisers
Hello ChronicleMap Users,
I am trying to use ChronicleMap with custom Key and Value. The Key is composed of various inputs and Value is the result of a database lookup. I would like to store this in ...
- 105
0
votes
1
answer
760
views
Is there a standard way of a simple in-memory caching code in .NET Core?
I have an IHostedService that saves a reference table from the database to cache in .NET Core 6. Meaning, the information saved will not be changed; it's just a reference table. Though there were ...
- 2,449
1
vote
0
answers
294
views
how to implement hazelcast in-memory distributed cache using dotnet core 6
I am using Hazelcast c# client for creating an in-memory distributed cache. I am not sure if my implementation is correct or missing something. I am testing it against an MSSQL server that is faster ...
0
votes
0
answers
186
views
Parsing large XML file and inserting the data to MongoDB in the fastest way
I have 5.5 GB XML file needs to be parsed and insert into MongoDB. My XML will have different classes / group. sample group:
<parent class="class1">
<p key="value"/>...
- 1
2
votes
2
answers
6k
views
What Exactly Stale data mean ? How can we Handle this in Cache?
What Exactly Stale data mean ? How can we Handle this in Cache ?
I'm going through Cache and found about stale data. How we can handle it?? How release the stale data if it is not being used?
Can ...
- 47
0
votes
2
answers
187
views
How to persist an object in Haskell to a memory location via unsafePerformIO or similar
In a Haskell system I don't have much control over, I provide a syntactically pure function with the following signature:
doTheWork :: Int -> TheInput -> MyResult
doTheWork counter data = ...
...
- 10.8k
3
votes
1
answer
918
views
read a .7z file in memory with Python, and process each line as a stream
I'm working with a huge .7z file that I need to process line by line.
First I tried py7zr, but it only works by first decompressing the whole file into an object. This runs out of memory.
Then ...
- 59.8k
0
votes
0
answers
650
views
Find a way to resolve System.OutOfMemoryException for In-memory cache c# web application
We have our c# web application which use in-memory to store data using multi threading, our application work till 14-15 days after that it start to throw OutOfMemoryException for thread and for ...
- 69
0
votes
1
answer
258
views
Is it possible to stream large data (object) in spring
We construct a large object currently in java and send it as text/xml. It seems the client times out. Is it possible to convert this object in byte array or String and stream the data.
Will it help? ...
1
vote
2
answers
4k
views
Apache Ignite support for java 17
Does apache ignite 2.14.0 work with java 17?
Tried running a java 17 application which uses apache ignite 2.14.0 and this error occured:
Error while running java 17 application using which uses apache ...
- 21
0
votes
1
answer
121
views
How to provide non-determinist value (id, dates, random...) to Domain Entity or Aggregate Root given that its been injected as dependencies
I am working on a frontend repository that implements an hexagonal architecture with domain driven design, using Redux Toolkit.
It is being developed in a TDD fashion. For that purpose, I am using &...
- 2,057
1
vote
1
answer
3k
views
Effective Way To Build (Use) In-Memory Cache
People tend to use in-memory caches for faster response times and avoiding the re-computation of what could be prevented for the time being.
A simple in memory cache looks like:
const cache = {};
...
- 23.4k
1
vote
1
answer
2k
views
How can I populate correctly H2 database with custom script automatically?
Let's say I have:
spring.datasource.url=jdbc:h2:mem:testdb;DB_CLOSE_DELAY=-1
spring.datasource.driverClassName=org.h2.Driver
spring.datasource.username=root
spring.datasource.password=root
spring.jpa....
- 6,638
1
vote
0
answers
259
views
how can i cache mongodb queries in c#
Where(Expression<Func<TDocument, bool>> filterExpression, int page = 1, int pageSize = 100);
Find(FilterDefinition<TDocument> filterExpression);
I want to do prepopulation caching ...
- 300
1
vote
0
answers
663
views
How to convert Excel (XLSXWriter) file to PDF in Python
I have created an xlsx file in memory (BytesIO) with the help of the XLSXWriter Library. I now want to read that in-memory file and convert it into pdf format, and the result should also be a bytes ...
- 41
-1
votes
1
answer
63
views
In-memory Angular Post to Backend
So i have 2 components 1 is form and the other is dialog with form, so when i click the dialog with form and input a data i want to save it first in in-memory then when i save it i want all my input ...
- 133
0
votes
1
answer
455
views
Masstransit v8 test consumer with TestServer
I try to test MassTransit v8 consumer with TestServer by creating whole application with all DI services. I have created TestServer instance with replaced some dependencies but I am most concerned ...
- 41
0
votes
2
answers
4k
views
Python in-memory files for caching large files
I am doing very large data processing (16GB) and I would like to try and speed up the operations through storing the entire file in RAM in order to deal with disk latency.
I looked into the existing ...
0
votes
1
answer
434
views
Concurrently modified some keys
I am using Ignite 2.13.x for one of my requirement, I need to maintain cache in Ignite cluster and some of the keys value will be updates concurrently and selection also happens parallel. So here i am ...
- 39
3
votes
1
answer
302
views
!EXE Tkinter PROBLEM: datas are LOST when I quit the program
I made a GUI in python, with Tkinter.
Now I just want to create an executable (.exe), so anyone can use my program.
This program must record datas (The aim is to follow management indicators), so the ...
0
votes
0
answers
114
views
How to avoid in-responsiveness of in-memory caching process triggered due to OutOFMemory Error
Assume, there is a java process which acts as a in-memory cache server and stores data into it.
There are multiple clients which continuously can push data of any size. In case client tries to push ...
- 362
0
votes
1
answer
587
views
Read PDF tables from memory with Python
I'm trying to read a PDF file extracted from a zip file in memory to get the tables inside the file. Camelot seems a good way to do it, but I'm getting the following error:
AttributeError: '_io....
- 51
1
vote
1
answer
879
views
Spring Boot @Cacheable does not serve requests from in-memory cache
Given the following method with the Cacheable annotation:
@Cacheable(value = "cachekey", key = "#taskId")
public Task getTask(Long taskId) {
log.info("called&...
- 2,135
2
votes
1
answer
4k
views
How to build a thread safe in-memory cache per request scope with Spring Boot
I'd like to implement a thread-safe in-memory cache inside a Spring Boot Application. Basically, each time a request comes in, I need to request info from a remote client while saving the response in ...
- 3,901
0
votes
0
answers
63
views
what are different types of cache from an interview point of view? Is cache always in-memory
I know there are different types of cache like:
in-memory
disk cache
distributed
application server cache
Global cache
CDN
However, I am not sure whether any of the above types is actually a subtype ...
- 121
1
vote
0
answers
186
views
How to run unit test with in memory Kombu with an infinite loop running drain events?
Hi I am new to Python & I got issue with unit test involving Kombu & inifinite while loop.
I use Python 3.9 with the latest Kombu library & PyTest.
I got a microservice class which has ...
- 1,288
0
votes
1
answer
739
views
How do you securely move sensitive data from memory to a local disk?
Purpose of this question
This question was created to share information, because the documentation for various modules is limited on this topic. This question might become a community wiki.
Use Case
...
- 15.8k
0
votes
1
answer
1k
views
Mongodb in memory
The goal is to optimize the read of near-static data.
My protocol database has a few collections each of which with couple of thousands of records.
The data in the protocol database rarely changes (...
- 45
0
votes
1
answer
452
views
How to view in-memory graph in Neo4j?
Is it possible to call an in-memory graph (projected graph) in a way that returns a graph (not only Table, Text & Code) in a Neo4j database?
- 484
1
vote
2
answers
149
views
Hekaton and Durability
Tech paper by Microsoft (Hekaton: SQL Server’s Memory-Optimized OLTP Engine) says
Generating a log record only at transaction commit time is possible
because Hekaton does not use write-ahead logging (...
- 2,038
1
vote
2
answers
190
views
Which class can I use to pass a "RecordSet" between an WinForm VB.Net EXE program and a classes DLL?
I have developped a VB.Net DLL that can read Postgres, Oracle and OleDb.
To allow this DLL to execute some SQL commands, I pass it a Connection object and I use it to execute some SQL SELECT command.
...
- 3,839
0
votes
0
answers
771
views
Use in-memory buffer as a file
During my program's execution I get a buffer that I need to additionally feed into an external program and read it's output. Unfortunately, this program only accepts filenames as input and output, so ...
- 1,159
2
votes
0
answers
329
views
Is there an in-memory SNS?
im currently looking for a framework that provides a Rest-Api of a SNS and runs in-memory. That means no docker containers which sadly dont let me use localstack. I already searched everything and ...
- 27
0
votes
1
answer
1k
views
How to access EF Core in-memory db from another application?
I have two applications, one is a Web API, and the other is a scheduled job.
Web API
First I run this service
There is an entity called 'User'
I'm adding some fake users using a DB Context called '...
- 1,508
6
votes
1
answer
2k
views
Use node to create a tarball from memory buffers (non disk) and store result in memory
Say i have the two buffers:
const bufferFile1 = Buffer.from('Hello World!', 'utf-8')
const bufferFile2 = Buffer.from('Hello Again World!', 'utf-8')
How can i create tarball file buffer/stream/blob (...
- 614
1
vote
0
answers
136
views
Do I need to scan malicious files if they are in memory only?
I'm writing a Python tool that manages users' files across multiple providers like Google Drive, Dropbox, etc. It will allow uploading the files directly from the application memory to these providers ...
- 3,227
0
votes
1
answer
1k
views
append data to an existing Json file in nodejs
i'm trying to add new data in an existing json file named db.json which i use to store data locally aka inMemory.So i tried many ways to achieve that but still not working as expected Since the add ...
- 39