Skip to main content
Software Engineering

Questions tagged [file-handling]

Ask Question

File handling refers to the set of tools, functions, and libraries to work with files and file handles. Creating, writing, appending, moving, and deleting files fall in this domain.

172 questions
Newest Active Bountied Unanswered
Filter by
Sorted by
Tagged with
0 votes
2 answers
176 views

My company receives files via SFTP. We currently have a service running on a timer that: polls the inbound directory moves files to an 'In Progress' directory processes files (queueing messages for ...
Ace's user avatar
  • 3
0 votes
4 answers
493 views

I have a c++ code that needs to store some data whenever an event is triggered. The data contains about 3000 floating point values. So each of these values needs to be written in a file when the event ...
user146290's user avatar
  • 133
4 votes
5 answers
3k views

I have the following method, which needs to return a List, but exceptions might occur along the way, and I don't want to handle them in my application, mainly because I don't even know how to handle ...
MasterTJ123's user avatar
  • 75
-1 votes
2 answers
108 views

I've been working on a software project recently that's meant to include an audio player, and my plans for it definitely are to simply use an off-the-shelf player library, and go with that. However, ...
Daneolog's user avatar
  • 107
2 votes
2 answers
123 views

I want to create a secure script that grants access to files based on specific conditions. The access should be controlled by both time-based and API-based conditions. The script should only allow ...
edge selcuk's user avatar
  • 33
11 votes
8 answers
7k views

I understand that log file rotation is changing the log file you used when (1) one gets big enough or (2) at EOD, but I'm not sure I understand the reason for (1). I have never had any issues with ...
user129393192's user avatar
  • 255
0 votes
2 answers
177 views

I am trying to devise a simple system that, with the use of tokens, allows a specific file to be rendered in the client's browser, yet prevents the user agent from being able to download the file. ...
oldboy's user avatar
  • 103
0 votes
5 answers
296 views

We have a huge amount of queries hitting our API that request a minor or major extract of some huge files lying around on our mounted hard drives. The data needs to be extracted from the files and ...
glades's user avatar
  • 493
2 votes
1 answer
109 views

I would like to write a program that essentially handles text data and metadata of files locally on a machine's filesystem. There is no need for any network activity. I am working with large ...
the_endian's user avatar
  • 1,152
0 votes
3 answers
1k views

I'm working on a system and we need to do some refactoring on the upload service, that handles all files and images uploads to the system. Nothing fancy, but I it got me thinking about the folder ...
celsomtrindade's user avatar
  • 291
6 votes
3 answers
3k views

There are few reliable absolutes in this world. One I have relied on is the idea that checking if a file exists before doing something with it just creates an unwanted race condition. Meaning between ...
candied_orange's user avatar
  • 120k
0 votes
1 answer
223 views

I have an embedded system running on a little-endian Cortex-M3. This system is able to accept packets from the network and reply to them. Now, I would like the system to start generating files. These ...
9a3eedi's user avatar
  • 2,099
0 votes
1 answer
98 views

I am working on a C++ application which lets users work on projects. Each project consists of several files that should not be known / edited manually by the user. For that we currently use a folder ...
f222's user avatar
  • 1,040
1 vote
1 answer
109 views

I know almost nothing about threads, synchronization, ... That being said, I am working on a record handler, that hits Excel sheet to pull/push data. There exist, in my code base, a BaseRecordHandler, ...
Mike Warren's user avatar
  • 332
-1 votes
2 answers
1k views

I'm developing an application (Java & JavaFX) that writes/reads data (a file). The problem is I don't want to restrict user to run only one instance (of my app) at a time, as I really can't think ...
Wiktor's user avatar
  • 33
0 votes
2 answers
121 views

I have a web app that will be used locally on 2 different site. The program is a Vue web app made with node.js and express, using MySQL database. Due to limitation (no internet in site 1), there is no ...
Aditya D.'s user avatar
  • 19
2 votes
1 answer
2k views

I have seen download managers manage to resume HTTP downloads from where they stopped. How are they able to resume downloads? Is it related to the Accept-Range Header? Or are there other mechanisms ...
Vipin Menon's user avatar
  • 129
0 votes
1 answer
484 views

I'm looking for a more efficient algorithm for the following problem: The input of the algorithm is a text file and two non-negative integer numbers - the number of headers and the number of tails. ...
kanbagoly's user avatar
  • 111
0 votes
1 answer
1k views

I need to write continuously into a JSON file in C++. The format and structure are defined as requirement. The data is produced in the process itself and needs to be stored multiple times per second. ...
da-chiller's user avatar
  • 27
0 votes
0 answers
55 views

i have as a mechanical engineering student in my practice semester to create a database that includes about 100k+ paths to images in our network. Every, lets say week, i have to synchronize all ...
Prodigy's user avatar
  • 1
1 vote
0 answers
109 views

tl;dr - I want to stream text data from one writer process to multiple reader processes. I'm thinking of using a file to achieve this. Is it a good idea? Using a file would avoid having to maintain ...
Catherine's user avatar
  • 19
-3 votes
1 answer
289 views

I have an SQL database in Azure that is ~4.5 TB / 150 million rows worth of data. Users will need to query this database for large sets of data. Right now, I am having users submit their requests ...
Alex Gao's user avatar
  • 1
1 vote
0 answers
485 views

Note: All of this would be in AWS Hi everyone, What would you guys suggest for building something that: Takes in several different input file types (ex: csv, json, jsonl, xml, .gz, ...) That can be ...
user avatar
4 votes
1 answer
3k views

What's a good way of storing and referencing files of different types (csv, pdf, jpg, html), each of which needs my own custom metadata? The metadata stores details of the content and how it was ...
MrTelly's user avatar
  • 647
1 vote
0 answers
104 views

I'm trying to implement a system that allows a user to upload files over HTTP, saves the file to object storage as well as any metadata surrounding the file that already exists to a NoSQL database (i....
foxtrotuniform6969's user avatar
  • 859
7 votes
4 answers
885 views

I'm reaching out with the following situation: I'm the author of an application that saves a file format to disk. There are real users using the application in their workflows. Frequently, I want to ...
Nate Rush's user avatar
  • 181
0 votes
1 answer
282 views

Using Vue/Electron to post to rails/Postgres backend. Is there a common design pattern/approach to posting multiple audio file objects BUT in a single post request? My current process (which works, ...
bcarp121177's user avatar
  • 3
0 votes
1 answer
5k views

I have a class that is responsible for writing formatted binary objects to a file on a network drive with a 100Mbps bandwidth. Each time an object is created (via lets call it w.addObj()) it formats ...
pstatix's user avatar
  • 1,047
0 votes
1 answer
577 views

as the title suggest, I need to handle the tenant files in a multi-tenant saas app. fairly common scenario I believe and should have been solved by the gurus already. right now the app is in infancy ...
Waku-2's user avatar
  • 143
-4 votes
1 answer
1k views

I have a huge csv file and I have to process that file and do some data manipulation. Right now I'm reading/loading the file in buffer and then doing the data processing work. I find this approach ...
ilaunchpad's user avatar
  • 101
3 votes
5 answers
804 views

I've often found myself with the need to develop tools that process large files over a network and perform an operation to every element in that file. An element may be an individual line or an object ...
pstatix's user avatar
  • 1,047
0 votes
1 answer
91 views

I've been designing and developing a very scalable logging library for a while. The main goal of this library is pretty simple. Like many others projects, a simple goal does not mean a simple way the ...
VRoxa's user avatar
  • 111
-2 votes
1 answer
3k views

I need to generate a large Excel file (something around 50 megs) and send response to another API which will provide it to the front end for a download option. My question is if it will be better to ...
JackTheKnife's user avatar
  • 389
1 vote
1 answer
367 views

Note this is a general, conceptual question about performance optimization. motivated by the following real-world case. I have a file on a Windows network drive that has a 100Mbps limt; it is a ...
pstatix's user avatar
  • 1,047
0 votes
1 answer
119 views

I try to build a very small object database, not for production only to learn a bit in my spare time. I've got a data structure that saves my data in blocks of a specific size und combine them when ...
Sebastian's user avatar
  • 129
2 votes
0 answers
184 views

I am planning to write a program that will produce digest logs for file changes in a particular directory. The idea is that whenever a file is deleted in a particular directory, it will show up in the ...
Michael John's user avatar
  • 21
0 votes
1 answer
39 views

I am working on an internal application that is maintained by the same people that operate the servers the application runs on. We have noticed, while transitioning from Windows to Linux, that some ...
kqr's user avatar
  • 379
3 votes
1 answer
2k views

I'm in the process of designing a new desktop application which is very different from other stuff I did before, and so I'll be happy if I could be pointed towards the right direction regarding the ...
HagaiH's user avatar
  • 141
0 votes
1 answer
2k views

I'm writing a program, part of which consists of determining if a given file is a PNG. Knowing that a file doesn't have to be named with its respective filename extension to be of a certain type, I ...
Areg Sarvazyan's user avatar
  • 111
1 vote
1 answer
903 views

I am working on a web application which allows users to review pdf documents. These documents are submitted from another public facing website. A typical workflow involves: A document is uploaded on ...
software_writer's user avatar
  • 127
0 votes
1 answer
1k views

I want to understand different ways to object design classes. I have three different classes. Generally I am creating a file parser. The classes: CustomerData - which shows text Data Model. A File ...
CarSpeed87's user avatar
  • 381
2 votes
0 answers
99 views

I am coding a disk (HDD/SSD) benchmarking software. I have a few questions on how a disk should be benchmarked (regardless of programming language used). This is my pseudo code for testing sequential ...
Canol Gökel's user avatar
  • 175
0 votes
3 answers
175 views

I'm currently working on a script (in PHP, but I'm not sure if that's relevant here) which allows users to set up a simple file-sharing system on their server. I'm stuck when trying to figure out how ...
undo's user avatar
  • 220
0 votes
1 answer
259 views

I'd like to deploy my code to a web server as a package. There Python is subprocessed and scripts are executed. These scripts use data files. But in case a file is needed and it doesn't exist, it ...
Felix's user avatar
  • 387
0 votes
2 answers
125 views

Based on the demo or license version of my application, I am supposed to either save the data to a file (xml) at a specific location or a relational database. What should be my approach for this case ...
Rajasri.J's user avatar
  • 21
6 votes
2 answers
3k views

A bit of context. The company where I work is starting to transition to a modular architecture (something similar to microservices) for our main product, currently monolithic. The first step is to ...
GalacticDessert's user avatar
  • 93
1 vote
1 answer
317 views

I'm looking for a method to solve the following problem: Assume there is a spool directory with a lot of files that need to be processed. There is a process A that is constantly writing new files to ...
Steve's user avatar
  • 127
7 votes
2 answers
1k views

Looking at a range of cross-platform languages, libraries and GUI toolkits, I often notice a conspicuous absence of support for asynchronous file I/O. This seems like too much of a common factor to be ...
detly's user avatar
  • 1,615
0 votes
1 answer
1k views

Given a recursive subroutine in single threaded environment which starts numerous asynchronous I/O operations and registers callback functions for each of them. This callbacks will be called on the ...
atevm's user avatar
  • 111
-4 votes
2 answers
516 views

One of the most annoying boneheaded bugs I run into is trying to create a new file in a directory that does not exist. (At least on Windows/NTFS, not sure about other OS/FS combinations.) Here's how ...
relatively_random's user avatar
  • 93

1
2 3 4