如何解决Google App Engine GAE - Java - 根据请求运行长进程？

我正在使用 GAE 创建一个 HTTPservlet，这是我编辑的代码：

@WebServlet(name = "DoGetMillionsRow",value = "/do-get-million-row")
public class DoGetMillionsRow extends HttpServlet{
    private static final Logger LOGGER = LoggerFactory.getLogger(DoGetMillionsRow.class);
    private final BigQuery bigquery = BigQueryOptions.getDefaultInstance().getService();

    String projectId = "myprojectid";
    
    public DoGetMillionsRow() throws IOException {
    }

    @Override
    protected void doPost(HttpServletRequest req,HttpServletResponse resp) throws servletexception,IOException {
        try {
            Base64.Decoder decoder = Base64.getDecoder();
            String body = req.getReader().lines().collect(Collectors.joining(System.lineseparator()));
            ObjectMapper mapper = new ObjectMapper();
            MyCustomSpec spec = mapper.readValue(body,MyCustomSpec.class);
            CompletableFuture.runAsync(() ->
                    {
                        try {
                            doSomeProcess(spec);
                            LOGGER.info("CompletableFuture success");
                        } catch (Exception e) {
                            LOGGER.error("CompletableFuture error",e);
                        }
                    }
            );
                resp.setHeader("Access-Control-Allow-Origin","*");
                resp.setContentType("application/json");
                resp.setStatus(200);

                AmsApiResponse finalResponse = new AmsApiResponse(true,"success");
                resp.getWriter().write(new Gson().toJson(finalResponse));

        } catch (Exception e) {
            LOGGER.error("API Exception",e);
            resp.setStatus(400);
            resp.sendError(HttpServletResponse.SC_INTERNAL_SERVER_ERROR);
        }
    }


    private boolean doSomeProcess(MyCustomSpec spec) throws APIException,ExecutionException,InterruptedException {
        List<Customresponse> result = getMyData(spec);
        sendDataToStackoverflow()
        return true;
    }
    
    private void sendDataToStackoverflow(List<Customresponse> spec){
        //SEND DATA TO STACKOVERFLOW
    }

    private List<Customresponse> getMyData(MyCustomSpec spec){
        List<String> result = new ArrayList<>();
        String query = "SELECT field1,field2 FROM `myProjectId.myDataSet.myTable` WHERE field3=@field3"
        QueryJobConfiguration queryConfig =
                QueryJobConfiguration.newBuilder(query)
                        .addNamedParameter("field3",QueryParameterValue.string(spec.getFilter))
                        .setUseLegacysql(false)
                        .setJobTimeoutMs(600000L)
                        .build();
        List<String> result = new ArrayList<>();
        LOGGER.info("progress 1 ");
        TableResult tableResult = getTableResult(bigquery,queryConfig);
        for (FieldValueList row : tableResult.iterateall()) {
            result.add(new Customresponse(
                    row.get("field1").getValue(),row.get("field").getValue()
            ));
        }
        LOGGER.info("progress 9 ");
        return result;
    }

private TableResult getTableResult(BigQuery bigquery,QueryJobConfiguration queryConfig) throws InterruptedException {
        LOGGER.info("progress 3");
        JobId jobId = JobId.of(UUID.randomUUID().toString());
        Job queryJob = bigquery.create(JobInfo.newBuilder(queryConfig).setJobId(jobId).build());
        queryJob = queryJob.waitFor();
        LOGGER.info("progress 4");

        if (queryJob == null) {
            LOGGER.info("progress 5");
            throw new RuntimeException("Job no longer exists");
        } else if (queryJob.getStatus().getError() != null) {
            LOGGER.info("progress 6");
            // You can also look at queryJob.getStatus().getExecutionErrors() for all
            // errors,not just the latest one.
            throw new RuntimeException(queryJob.getStatus().getError().toString());
        }
        LOGGER.info("progress 7");
        TableResult result = queryJob.getQueryResults();
        LOGGER.info("progress 8");
        return result;
    }


    @Override
    protected void doOptions(HttpServletRequest req,IOException {
        resp.setHeader("Access-Control-Allow-Origin","*");
        resp.setHeader("Access-Control-Allow-Methods","*");
        resp.setHeader("Access-Control-Allow-Headers","Authorization,Content-Type");
    }

}

在第一次尝试时，我没有使用 CompletableFuture runAsync，并且出现此错误

started at 2021/04/27 08:06:28.845 UTC 
and was still executing at 2021/04/27 08:07:33.165 UTC.
    at java.util.Collections$UnmodifiableCollection.size(Collections.java:1030)
    at com.google.api.client.util.DataMap$EntryIterator.hasNext(DataMap.java:151)
    at com.google.api.client.util.GenericData$EntryIterator.hasNext(GenericData.java:269)
    at java.util.AbstractMap.containsKey(AbstractMap.java:153)

已经在网上做了一些研究，据说最大超时时间为 60 秒且不可更改

在第二次尝试中，我尝试了 runAsync 没有错误日志，进程正在运行，我得到了一些日志 但是最后一个日志是在“progress 3”上，之后的进程没有运行

仅供参考：

1. 在 bigquery 控制台上查询需要 12 秒
2. 查询过程大约2.4GB数据（未来应该是240GB或更多）
3. 查询结果大约有 140k 行，当我将其下载为 json 文件时，数据大小为 (16mb)

有什么办法或解决方法吗？

解决方法

暂无找到可以解决该程序问题的有效方法，小编努力寻找整理中！

如果你已经找到好的解决方法，欢迎将解决方案带上本链接一起发送给小编。

小编邮箱:dio#foxmail.com (将#修改为@）