Bigquery crashlytics 数据集计划间隔

Posted 2023-03-25

【中文标题】Bigquery crashlytics 数据集计划间隔

【英文标题】：Bigquery crashlytics dataset schedule interval

【发布时间】：2020-02-24 09:07:31

【问题描述】：

我们目前正在调查 FirebaseBigQuery（非沙盒）以进行监控。我们已经使用 Firebase 集成连接了我们的一个项目，并收集了几天的数据。

只有数据总是休息一天，这是有道理的，因为传输仅每 24 小时运行一次。但试图通过 bq cli 改变它：

bq update --transfer_config \
  --target_dataset='crashlytics' \
  --schedule='every 2 hours' \
  projects/p/locations/l/transferConfigs/c

导致 400 错误：

Bigquery service returned an invalid reply in update operation: Error reported by server with missing error fields. Server returned: u'error': u'status': u'INVALID_ARGUMENT',
u'message': u'Request contains an invalid argument.', u'code': 400.

Please make sure you are using the latest version of the bq tool and try again. If this problem persists, you may have encountered a bug in the bigquery client. Please file a bug
report in our public issue tracker:
https://issuetracker.google.com/issues/new?component=187149&template=0
Please include a brief description of the steps that led to this issue, as well as any rows that can be made public from the following information:

========================================
== Platform ==
  CPython:2.7.16:Darwin-19.2.0-x86_64-i386-64bit
== bq version ==
  2.0.53

== Command line ==
  ['/path/bq/bq.py', '--application_default_credential_file', '/path/[e-mail]/adc.json', '--credential_file', '/path/[e-mail]/singlestore_bq.json', '--project_id=tde-psv-app', 'update', '--transfer_config', '--target_dataset=crashlytics', '--schedule=every 2 hours', 'projects/p/locations/l/transferConfigs/c']
== UTC timestamp ==
  2020-02-24 08:47:23
== Error trace ==
Traceback (most recent call last):
  File "/path/bq/bq.py", line 1116, in RunSafely
    return_value = self.RunWithArgs(*args, **kwds)
  File "/path/bq/bq.py", line 4615, in RunWithArgs
    schedule_args=schedule_args)
  File "/path/bq/bigquery_client.py", line 3984, in UpdateTransferConfig
    x__xgafv='2').execute()
  File "/path/bq/bigquery_client.py", line 810, in execute
    BigqueryHttp.RaiseErrorFromHttpError(e)
  File "/path/bq/bigquery_client.py", line 788, in RaiseErrorFromHttpError
    BigqueryClient.RaiseError(content)
  File "/path/bq/bigquery_client.py", line 2385, in RaiseError
    raise BigqueryError.Create(error, result, [])
BigqueryInterfaceError: Error reported by server with missing error fields. Server returned: u'error': u'status': u'INVALID_ARGUMENT', u'message': u'Request contains an invalid argument.', u'code': 400
========================================

Unexpected exception in update operation: Bigquery service returned an invalid reply in update operation: Error reported by server with missing error fields. Server returned:
u'error': u'status': u'INVALID_ARGUMENT',
u'message': u'Request contains an invalid argument.', u'code': 400.

Please make sure you are using the latest version of the bq tool and try again. If this problem persists, you may have encountered a bug in the bigquery client. Please file a bug
report in our public issue tracker:
https://issuetracker.google.com/issues/new?component=187149&template=0
Please include a brief description of the steps that led to this issue, as well as any rows that can be made public from the following information:

我们可能会觉得这种数据集/Firebase 项目不可能做到这一点，但我们无法找到任何明确的答案。

【问题讨论】：

您能否确认您可以在 BigQuery 网页界面中执行相同的操作？

我在相同的用户场景中做了一些测试，更新了 Bigquery 传输配置，到目前为止你的bq update 命令看起来不错，但是我使用的是 Python 3.7.5 而不是 Python 2.7。 16 和相同的bg 工具版本 2.0.53。

【参考方案1】：

目前，数据导出仅每 24 小时可用一次。我们正在研究改变这种行为。请随时关注 Firebase 博客的最新消息。